2023-08-25T04:24:39.016 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-25T04:24:39.017 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379076 --verbose --owner scheduled_rishabh@teuthology --name rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379076/orig.config.yaml 2023-08-25T04:24:39.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T04:24:39.139 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379076 branch: wip-rishabh-2023aug3-b5 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7379076' kernel: flavor: default kdb: true sha1: a6a69670761025e039dc5ae86619b0cf04c46dc2 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-rishabh-2023aug3-b5 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023aug3-b5 sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023aug3-b5 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNdk02F5Zp7DF6Kxc3VDjP2yFCkYkt6JpJvUOkgTLg+edCzIz+Uos56ai55M/5zQbSDoA/cV4PMDDFWeDwaN+wQ= smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9JwuFW1WSAHQPuJIZ0mOzklryPugj6o4k1m5IWQ6tr2MZkU59M8E68oFm4XlAo9wmAeSuDe80Tg7GbOmBqT82OnBR7XA7eU590Zir7fT0OVe2UZIIni9nKexgwZrPAtqLRDLJM5FdpnE1cEEr65r6kQO//NXsKMEKcDfvzNSc4/2w7QrnoWQDxQRBzzGsGBLsd5AHO3EncR9EbWgBXpDqNsVusf9wAj4XGYKaiOYlcBI8IrrShLDSJ0QZHBOiQYSJId83GGhFI8C8RnL0de9xABu7LpRsralbSRmnq+DBuIpCVkPqZVL3R2njazZ6kza5si8OmKbVZOx21s9SvQeW6iyS6HJcl4W43x7QPnFgF9diBFgStcxX5oHQQ3bOfbS6e5kpNX6DQcEe0XJ/JpTWuy10tQKj2u39Z6k93wO/WButGq1k0uYD2KylNS6aTXKIxXOgES+1FZ0CmP5S1PgUTMpEVLY2GiQJfIAxka2T8gCJ/n8BJDeWrwAA0N+5RiM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-25_01:50:32 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-25T04:24:39.140 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa; will attempt to use it 2023-08-25T04:24:39.141 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa/tasks 2023-08-25T04:24:39.141 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-25T04:24:39.143 INFO:teuthology.task.internal:Checking packages... 2023-08-25T04:24:39.171 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ba6b39e4f4f77fb95c747099b53db0467d435f56' 2023-08-25T04:24:39.172 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-25T04:24:39.172 INFO:teuthology.packaging:ref: None 2023-08-25T04:24:39.172 INFO:teuthology.packaging:tag: None 2023-08-25T04:24:39.173 INFO:teuthology.packaging:branch: wip-rishabh-2023aug3-b5 2023-08-25T04:24:39.173 INFO:teuthology.packaging:sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:24:39.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023aug3-b5 2023-08-25T04:24:39.332 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5703.gba6b39e4 2023-08-25T04:24:39.333 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-25T04:24:39.340 INFO:teuthology.task.internal:no buildpackages task found 2023-08-25T04:24:39.341 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-25T04:24:39.349 INFO:teuthology.task.internal:Saving configuration 2023-08-25T04:24:39.365 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-25T04:24:39.370 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T04:24:39.397 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 04:19:07.346360', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNdk02F5Zp7DF6Kxc3VDjP2yFCkYkt6JpJvUOkgTLg+edCzIz+Uos56ai55M/5zQbSDoA/cV4PMDDFWeDwaN+wQ='} 2023-08-25T04:24:39.422 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 04:19:07.348169', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIsTt0Z2Fc1aO34y6Er6Q1UsGRuH9RGhHQmkh++53TLqk4Y5c6WBP3bXeqsYX3oMjJLNrT2bmDcQxeTXOQn4Iv4='} 2023-08-25T04:24:39.423 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-25T04:24:39.429 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-25T04:24:39.429 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-25T04:24:39.429 INFO:teuthology.run_tasks:Running task console_log... 2023-08-25T04:24:39.518 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb22c2d0f70>, signals=[15]) 2023-08-25T04:24:39.519 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-25T04:24:39.525 INFO:teuthology.task.internal:Opening connections... 2023-08-25T04:24:39.526 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-08-25T04:24:39.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:24:39.596 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2023-08-25T04:24:39.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:24:39.668 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-25T04:24:39.676 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-08-25T04:24:39.699 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-08-25T04:24:39.699 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-08-25T04:24:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-08-25T04:24:39.760 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2023-08-25T04:24:39.761 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-08-25T04:24:39.761 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-08-25T04:24:39.762 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2023-08-25T04:24:39.762 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-08-25T04:24:39.762 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-25T04:24:39.762 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-08-25T04:24:39.762 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-25T04:24:39.762 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-08-25T04:24:39.763 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T04:24:39.763 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T04:24:39.763 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-25T04:24:39.764 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-08-25T04:24:39.789 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2023-08-25T04:24:39.812 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2023-08-25T04:24:39.812 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-08-25T04:24:39.873 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2023-08-25T04:24:39.874 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8" 2023-08-25T04:24:39.874 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2023-08-25T04:24:39.874 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2023-08-25T04:24:39.874 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8" 2023-08-25T04:24:39.874 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2023-08-25T04:24:39.874 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-25T04:24:39.875 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2023-08-25T04:24:39.876 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-25T04:24:39.876 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2023-08-25T04:24:39.876 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-25T04:24:39.877 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-25T04:24:39.877 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-25T04:24:39.877 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-08-25T04:24:39.898 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-25T04:24:39.911 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-25T04:24:39.918 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-25T04:24:39.919 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-08-25T04:24:39.921 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2023-08-25T04:24:39.941 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-25T04:24:39.951 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-25T04:24:39.951 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-08-25T04:24:39.984 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2023-08-25T04:24:40.009 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-25T04:24:40.064 INFO:teuthology.run_tasks:Running task kernel... 2023-08-25T04:24:40.089 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'} 2023-08-25T04:24:40.091 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}}, timeout 300 2023-08-25T04:24:40.092 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-25T04:24:40.093 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-25T04:24:40.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:24:40.114 DEBUG:teuthology.task.kernel:sha1 for mon.a is a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T04:24:40.115 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "a6a69670761025e039dc5ae86619b0cf04c46dc2"... 2023-08-25T04:24:40.115 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-08-25T04:24:40.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:24:40.116 DEBUG:teuthology.task.kernel:sha1 for mon.b is a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T04:24:40.116 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "a6a69670761025e039dc5ae86619b0cf04c46dc2"... 2023-08-25T04:24:40.117 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2023-08-25T04:24:40.174 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-489.el8.x86_64 2023-08-25T04:24:40.175 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T04:24:40.175 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-25T04:24:40.176 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T04:24:40.179 INFO:teuthology.orchestra.run.smithi137.stdout:4.18.0-489.el8.x86_64 2023-08-25T04:24:40.179 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T04:24:40.180 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-25T04:24:40.180 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T04:24:40.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum upgrade -y linux-firmware 2023-08-25T04:24:40.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum upgrade -y linux-firmware 2023-08-25T04:24:45.991 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - AppStream 10 MB/s | 33 MB 00:03 2023-08-25T04:24:48.156 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 11 MB/s | 33 MB 00:03 2023-08-25T04:24:53.924 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 41 MB 00:01 2023-08-25T04:24:56.345 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 41 MB 00:02 2023-08-25T04:25:00.424 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - Extras 34 kB/s | 18 kB 00:00 2023-08-25T04:25:00.767 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - Extras common packages 39 kB/s | 6.8 kB 00:00 2023-08-25T04:25:01.060 INFO:teuthology.orchestra.run.smithi137.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-08-25T04:25:03.331 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 16 MB 00:02 2023-08-25T04:25:04.826 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 7.4 kB/s | 18 kB 00:02 2023-08-25T04:25:05.819 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 8.3 kB/s | 6.8 kB 00:00 2023-08-25T04:25:06.129 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-08-25T04:25:07.204 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 604 kB/s | 24 kB 00:00 2023-08-25T04:25:07.586 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-08-25T04:25:10.751 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2023-08-25T04:25:10.752 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2023-08-25T04:25:10.752 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2023-08-25T04:25:10.753 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2023-08-25T04:25:10.753 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2023-08-25T04:25:10.753 INFO:teuthology.orchestra.run.smithi137.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-08-25T04:25:10.753 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:25:10.754 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2023-08-25T04:25:10.754 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2023-08-25T04:25:10.754 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 1 Package 2023-08-25T04:25:10.754 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:25:10.755 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 266 M 2023-08-25T04:25:10.755 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2023-08-25T04:25:11.326 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 435 kB/s | 24 kB 00:00 2023-08-25T04:25:14.981 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-08-25T04:25:14.982 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-08-25T04:25:14.983 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repo Size 2023-08-25T04:25:14.983 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-08-25T04:25:14.983 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-08-25T04:25:14.983 INFO:teuthology.orchestra.run.smithi072.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-08-25T04:25:14.983 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:25:14.983 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-08-25T04:25:14.983 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-08-25T04:25:14.984 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 1 Package 2023-08-25T04:25:14.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:25:14.984 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 266 M 2023-08-25T04:25:14.984 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-08-25T04:25:21.421 INFO:teuthology.orchestra.run.smithi137.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 25 MB/s | 266 MB 00:10 2023-08-25T04:25:21.422 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2023-08-25T04:25:21.422 INFO:teuthology.orchestra.run.smithi137.stdout:Total 25 MB/s | 266 MB 00:10 2023-08-25T04:25:23.007 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2023-08-25T04:25:23.072 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2023-08-25T04:25:23.072 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2023-08-25T04:25:24.731 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2023-08-25T04:25:24.767 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2023-08-25T04:25:27.813 INFO:teuthology.orchestra.run.smithi072.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 21 MB/s | 266 MB 00:12 2023-08-25T04:25:27.813 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-08-25T04:25:27.814 INFO:teuthology.orchestra.run.smithi072.stdout:Total 21 MB/s | 266 MB 00:12 2023-08-25T04:25:29.432 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-08-25T04:25:29.533 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-08-25T04:25:29.534 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-08-25T04:25:31.195 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-08-25T04:25:31.216 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-08-25T04:25:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2023-08-25T04:25:42.930 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-08-25T04:25:43.192 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-25T04:25:43.419 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-25T04:25:43.419 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-08-25T04:25:44.142 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-25T04:25:44.142 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:25:44.142 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2023-08-25T04:25:44.142 INFO:teuthology.orchestra.run.smithi137.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-08-25T04:25:44.142 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:25:44.143 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2023-08-25T04:25:44.358 INFO:teuthology.task.kernel:Downloading kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on mon.b... 2023-08-25T04:25:44.358 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T04:25:44.577 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/ 2023-08-25T04:25:44.578 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_ga6a696707610-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-25T04:25:44.581 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi137.front.sepia.ceph.com to complete... 2023-08-25T04:25:50.736 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-08-25T04:25:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-08-25T04:25:51.406 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-25T04:25:51.634 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-25T04:25:51.635 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-08-25T04:25:52.344 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-25T04:25:52.345 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:25:52.345 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-08-25T04:25:52.345 INFO:teuthology.orchestra.run.smithi072.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-08-25T04:25:52.345 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:25:52.346 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-08-25T04:25:52.521 INFO:teuthology.task.kernel:Downloading kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on mon.a... 2023-08-25T04:25:52.521 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T04:25:52.760 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/ 2023-08-25T04:25:52.760 DEBUG:teuthology.orchestra.run.smithi072:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_ga6a696707610-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-25T04:25:52.763 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi072.front.sepia.ceph.com to complete... 2023-08-25T04:25:57.909 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25 04:25:57 URL:https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_ga6a696707610-1.x86_64.rpm [380759896/380759896] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-25T04:25:57.910 INFO:teuthology.orchestra.run.smithi137.stderr:FINISHED --2023-08-25 04:25:57-- 2023-08-25T04:25:57.910 INFO:teuthology.orchestra.run.smithi137.stderr:Total wall clock time: 13s 2023-08-25T04:25:57.910 INFO:teuthology.orchestra.run.smithi137.stderr:Downloaded: 1 files, 363M in 13s (28.1 MB/s) 2023-08-25T04:25:57.911 INFO:teuthology.task.kernel:Installing kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on mon.b... 2023-08-25T04:25:57.911 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-25T04:25:59.570 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying... ######################################## 2023-08-25T04:25:59.614 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing... ######################################## 2023-08-25T04:25:59.724 INFO:teuthology.orchestra.run.smithi137.stdout:Updating / installing... 2023-08-25T04:26:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25 04:26:18 URL:https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_ga6a696707610-1.x86_64.rpm [380759896/380759896] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-25T04:26:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:FINISHED --2023-08-25 04:26:18-- 2023-08-25T04:26:18.004 INFO:teuthology.orchestra.run.smithi072.stderr:Total wall clock time: 25s 2023-08-25T04:26:18.005 INFO:teuthology.orchestra.run.smithi072.stderr:Downloaded: 1 files, 363M in 25s (14.8 MB/s) 2023-08-25T04:26:18.006 INFO:teuthology.task.kernel:Installing kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on mon.a... 2023-08-25T04:26:18.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-25T04:26:19.675 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying... ######################################## 2023-08-25T04:26:19.718 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing... ######################################## 2023-08-25T04:26:19.827 INFO:teuthology.orchestra.run.smithi072.stdout:Updating / installing... 2023-08-25T04:26:37.741 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-6.5.0_rc7_ga6a696707610-1 ######################################## 2023-08-25T04:26:58.190 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-6.5.0_rc7_ga6a696707610-1 ######################################## 2023-08-25T04:27:00.078 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-25T04:27:00.078 DEBUG:teuthology.orchestra.run.smithi137:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-25T04:27:00.105 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-25T04:27:00.106 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/config-6.5.0-rc7-ga6a696707610 2023-08-25T04:27:00.106 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-25T04:27:00.106 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610 2023-08-25T04:27:00.106 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel 2023-08-25T04:27:00.106 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch 2023-08-25T04:27:00.107 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86 2023-08-25T04:27:00.107 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto 2023-08-25T04:27:00.107 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-25T04:27:00.107 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-25T04:27:00.107 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-25T04:27:00.107 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-25T04:27:00.107 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-25T04:27:00.108 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-25T04:27:00.108 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-25T04:27:00.108 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-25T04:27:00.108 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-25T04:27:00.108 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-25T04:27:00.108 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-25T04:27:00.108 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-25T04:27:00.109 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-25T04:27:00.109 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-25T04:27:00.109 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-25T04:27:00.109 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-25T04:27:00.109 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-25T04:27:00.109 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-25T04:27:00.109 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-25T04:27:00.109 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-25T04:27:00.110 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel 2023-08-25T04:27:00.110 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu 2023-08-25T04:27:00.126 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce 2023-08-25T04:27:00.127 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-25T04:27:00.127 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm 2023-08-25T04:27:00.127 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-25T04:27:00.127 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-25T04:27:00.127 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm.ko 2023-08-25T04:27:00.128 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto 2023-08-25T04:27:00.128 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ansi_cprng.ko 2023-08-25T04:27:00.128 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/anubis.ko 2023-08-25T04:27:00.128 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/arc4.ko 2023-08-25T04:27:00.128 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx 2023-08-25T04:27:00.128 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_memcpy.ko 2023-08-25T04:27:00.128 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_pq.ko 2023-08-25T04:27:00.129 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-25T04:27:00.129 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_tx.ko 2023-08-25T04:27:00.129 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_xor.ko 2023-08-25T04:27:00.129 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/raid6test.ko 2023-08-25T04:27:00.129 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authenc.ko 2023-08-25T04:27:00.129 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authencesn.ko 2023-08-25T04:27:00.130 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blake2b_generic.ko 2023-08-25T04:27:00.130 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_common.ko 2023-08-25T04:27:00.130 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_generic.ko 2023-08-25T04:27:00.130 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/camellia_generic.ko 2023-08-25T04:27:00.130 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast5_generic.ko 2023-08-25T04:27:00.130 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast6_generic.ko 2023-08-25T04:27:00.130 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast_common.ko 2023-08-25T04:27:00.131 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ccm.ko 2023-08-25T04:27:00.131 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cmac.ko 2023-08-25T04:27:00.131 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crc32_generic.ko 2023-08-25T04:27:00.131 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_engine.ko 2023-08-25T04:27:00.131 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_user.ko 2023-08-25T04:27:00.131 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cts.ko 2023-08-25T04:27:00.131 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/des_generic.ko 2023-08-25T04:27:00.131 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/dh_generic.ko 2023-08-25T04:27:00.132 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/echainiv.ko 2023-08-25T04:27:00.132 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/essiv.ko 2023-08-25T04:27:00.132 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/fcrypt.ko 2023-08-25T04:27:00.132 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/khazad.ko 2023-08-25T04:27:00.132 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4.ko 2023-08-25T04:27:00.132 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4hc.ko 2023-08-25T04:27:00.132 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/md4.ko 2023-08-25T04:27:00.132 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/michael_mic.ko 2023-08-25T04:27:00.133 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcbc.ko 2023-08-25T04:27:00.133 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcrypt.ko 2023-08-25T04:27:00.133 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/rmd160.ko 2023-08-25T04:27:00.133 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/seed.ko 2023-08-25T04:27:00.134 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/serpent_generic.ko 2023-08-25T04:27:00.134 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tcrypt.ko 2023-08-25T04:27:00.134 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tea.ko 2023-08-25T04:27:00.134 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_common.ko 2023-08-25T04:27:00.134 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_generic.ko 2023-08-25T04:27:00.134 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/vmac.ko 2023-08-25T04:27:00.134 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/wp512.ko 2023-08-25T04:27:00.135 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xcbc.ko 2023-08-25T04:27:00.135 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xor.ko 2023-08-25T04:27:00.135 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xxhash_generic.ko 2023-08-25T04:27:00.135 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers 2023-08-25T04:27:00.135 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi 2023-08-25T04:27:00.135 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-25T04:27:00.135 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_pad.ko 2023-08-25T04:27:00.136 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/custom_method.ko 2023-08-25T04:27:00.136 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/ec_sys.ko 2023-08-25T04:27:00.136 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/platform_profile.ko 2023-08-25T04:27:00.136 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbs.ko 2023-08-25T04:27:00.136 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbshc.ko 2023-08-25T04:27:00.136 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/video.ko 2023-08-25T04:27:00.136 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata 2023-08-25T04:27:00.136 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/acard-ahci.ko 2023-08-25T04:27:00.137 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ahci_platform.ko 2023-08-25T04:27:00.137 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ata_generic.ko 2023-08-25T04:27:00.137 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/libahci_platform.ko 2023-08-25T04:27:00.137 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_acpi.ko 2023-08-25T04:27:00.137 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ali.ko 2023-08-25T04:27:00.137 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_amd.ko 2023-08-25T04:27:00.137 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_artop.ko 2023-08-25T04:27:00.137 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atiixp.ko 2023-08-25T04:27:00.138 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atp867x.ko 2023-08-25T04:27:00.138 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd640.ko 2023-08-25T04:27:00.138 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd64x.ko 2023-08-25T04:27:00.138 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cypress.ko 2023-08-25T04:27:00.138 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_efar.ko 2023-08-25T04:27:00.138 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt366.ko 2023-08-25T04:27:00.138 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt37x.ko 2023-08-25T04:27:00.139 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-25T04:27:00.139 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-25T04:27:00.139 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it8213.ko 2023-08-25T04:27:00.140 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it821x.ko 2023-08-25T04:27:00.140 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_jmicron.ko 2023-08-25T04:27:00.141 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_marvell.ko 2023-08-25T04:27:00.141 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_mpiix.ko 2023-08-25T04:27:00.141 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_netcell.ko 2023-08-25T04:27:00.141 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ninja32.ko 2023-08-25T04:27:00.141 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87410.ko 2023-08-25T04:27:00.141 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87415.ko 2023-08-25T04:27:00.141 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_oldpiix.ko 2023-08-25T04:27:00.142 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_opti.ko 2023-08-25T04:27:00.142 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_optidma.ko 2023-08-25T04:27:00.142 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pcmcia.ko 2023-08-25T04:27:00.142 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-25T04:27:00.142 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-25T04:27:00.142 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_piccolo.ko 2023-08-25T04:27:00.142 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_rdc.ko 2023-08-25T04:27:00.143 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sch.ko 2023-08-25T04:27:00.143 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_serverworks.ko 2023-08-25T04:27:00.143 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sil680.ko 2023-08-25T04:27:00.143 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sis.ko 2023-08-25T04:27:00.143 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sl82c105.ko 2023-08-25T04:27:00.143 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_triflex.ko 2023-08-25T04:27:00.143 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_via.ko 2023-08-25T04:27:00.144 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pdc_adma.ko 2023-08-25T04:27:00.144 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_inic162x.ko 2023-08-25T04:27:00.144 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_mv.ko 2023-08-25T04:27:00.144 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_nv.ko 2023-08-25T04:27:00.145 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_promise.ko 2023-08-25T04:27:00.145 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_qstor.ko 2023-08-25T04:27:00.145 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil.ko 2023-08-25T04:27:00.146 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil24.ko 2023-08-25T04:27:00.146 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sis.ko 2023-08-25T04:27:00.146 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_svw.ko 2023-08-25T04:27:00.146 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sx4.ko 2023-08-25T04:27:00.146 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_uli.ko 2023-08-25T04:27:00.146 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_via.ko 2023-08-25T04:27:00.147 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_vsc.ko 2023-08-25T04:27:00.147 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay 2023-08-25T04:27:00.147 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay/ks0108.ko 2023-08-25T04:27:00.147 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base 2023-08-25T04:27:00.147 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap 2023-08-25T04:27:00.147 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-25T04:27:00.147 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-25T04:27:00.148 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma 2023-08-25T04:27:00.148 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma/bcma.ko 2023-08-25T04:27:00.148 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block 2023-08-25T04:27:00.148 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe 2023-08-25T04:27:00.148 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe/aoe.ko 2023-08-25T04:27:00.148 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/brd.ko 2023-08-25T04:27:00.149 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd 2023-08-25T04:27:00.149 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd/drbd.ko 2023-08-25T04:27:00.149 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/floppy.ko 2023-08-25T04:27:00.149 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/loop.ko 2023-08-25T04:27:00.149 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx 2023-08-25T04:27:00.149 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-25T04:27:00.149 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/nbd.ko 2023-08-25T04:27:00.150 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk 2023-08-25T04:27:00.150 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk/null_blk.ko 2023-08-25T04:27:00.150 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/pktcdvd.ko 2023-08-25T04:27:00.150 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/rbd.ko 2023-08-25T04:27:00.150 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/virtio_blk.ko 2023-08-25T04:27:00.150 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback 2023-08-25T04:27:00.151 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-25T04:27:00.151 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkfront.ko 2023-08-25T04:27:00.151 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram 2023-08-25T04:27:00.151 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram/zram.ko 2023-08-25T04:27:00.151 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char 2023-08-25T04:27:00.151 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hangcheck-timer.ko 2023-08-25T04:27:00.151 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random 2023-08-25T04:27:00.151 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-25T04:27:00.152 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-25T04:27:00.152 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-25T04:27:00.152 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/via-rng.ko 2023-08-25T04:27:00.152 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-25T04:27:00.152 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi 2023-08-25T04:27:00.152 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-25T04:27:00.152 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-25T04:27:00.153 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-25T04:27:00.153 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-25T04:27:00.153 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-25T04:27:00.153 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-25T04:27:00.153 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/lp.ko 2023-08-25T04:27:00.153 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave 2023-08-25T04:27:00.153 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave/mwave.ko 2023-08-25T04:27:00.154 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ppdev.ko 2023-08-25T04:27:00.154 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tlclk.ko 2023-08-25T04:27:00.154 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm 2023-08-25T04:27:00.154 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm.ko 2023-08-25T04:27:00.154 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-25T04:27:00.154 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-25T04:27:00.155 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-25T04:27:00.155 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-25T04:27:00.155 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-25T04:27:00.155 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/uv_mmtimer.ko 2023-08-25T04:27:00.155 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/virtio_console.ko 2023-08-25T04:27:00.155 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq 2023-08-25T04:27:00.155 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-25T04:27:00.155 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-25T04:27:00.156 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-25T04:27:00.156 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-25T04:27:00.156 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-25T04:27:00.156 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-25T04:27:00.156 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto 2023-08-25T04:27:00.156 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp 2023-08-25T04:27:00.156 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-25T04:27:00.157 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp.ko 2023-08-25T04:27:00.157 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel 2023-08-25T04:27:00.157 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat 2023-08-25T04:27:00.157 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common 2023-08-25T04:27:00.157 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-25T04:27:00.157 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-25T04:27:00.157 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-25T04:27:00.158 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-aes.ko 2023-08-25T04:27:00.158 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-sha.ko 2023-08-25T04:27:00.158 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio 2023-08-25T04:27:00.158 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-25T04:27:00.158 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca 2023-08-25T04:27:00.158 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca/dca.ko 2023-08-25T04:27:00.158 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/devfreq 2023-08-25T04:27:00.159 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-25T04:27:00.159 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma 2023-08-25T04:27:00.159 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw 2023-08-25T04:27:00.159 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-25T04:27:00.159 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat 2023-08-25T04:27:00.159 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-25T04:27:00.159 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac 2023-08-25T04:27:00.160 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/amd64_edac.ko 2023-08-25T04:27:00.160 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/e752x_edac.ko 2023-08-25T04:27:00.160 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/edac_mce_amd.ko 2023-08-25T04:27:00.160 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3000_edac.ko 2023-08-25T04:27:00.160 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3200_edac.ko 2023-08-25T04:27:00.161 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5100_edac.ko 2023-08-25T04:27:00.161 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5400_edac.ko 2023-08-25T04:27:00.161 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7300_edac.ko 2023-08-25T04:27:00.161 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7core_edac.ko 2023-08-25T04:27:00.161 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i82975x_edac.ko 2023-08-25T04:27:00.162 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/ie31200_edac.ko 2023-08-25T04:27:00.162 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/sb_edac.ko 2023-08-25T04:27:00.162 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/x38_edac.ko 2023-08-25T04:27:00.162 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware 2023-08-25T04:27:00.162 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/edd.ko 2023-08-25T04:27:00.162 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-25T04:27:00.162 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio 2023-08-25T04:27:00.163 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-ich.ko 2023-08-25T04:27:00.163 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-25T04:27:00.163 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid 2023-08-25T04:27:00.163 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-appleir.ko 2023-08-25T04:27:00.163 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-aureal.ko 2023-08-25T04:27:00.163 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-axff.ko 2023-08-25T04:27:00.164 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-dr.ko 2023-08-25T04:27:00.164 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elecom.ko 2023-08-25T04:27:00.164 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elo.ko 2023-08-25T04:27:00.164 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-emsff.ko 2023-08-25T04:27:00.164 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gaff.ko 2023-08-25T04:27:00.165 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gt683r.ko 2023-08-25T04:27:00.165 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gyration.ko 2023-08-25T04:27:00.165 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-25T04:27:00.165 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-25T04:27:00.165 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtekff.ko 2023-08-25T04:27:00.165 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-hyperv.ko 2023-08-25T04:27:00.165 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-icade.ko 2023-08-25T04:27:00.166 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-keytouch.ko 2023-08-25T04:27:00.166 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-kye.ko 2023-08-25T04:27:00.166 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lcpower.ko 2023-08-25T04:27:00.166 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-led.ko 2023-08-25T04:27:00.166 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lenovo.ko 2023-08-25T04:27:00.166 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-25T04:27:00.166 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-25T04:27:00.167 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-multitouch.ko 2023-08-25T04:27:00.167 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ortek.ko 2023-08-25T04:27:00.167 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-penmount.ko 2023-08-25T04:27:00.167 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-petalynx.ko 2023-08-25T04:27:00.167 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-picolcd.ko 2023-08-25T04:27:00.167 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-pl.ko 2023-08-25T04:27:00.168 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-plantronics.ko 2023-08-25T04:27:00.168 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-primax.ko 2023-08-25T04:27:00.168 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-rmi.ko 2023-08-25T04:27:00.168 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-25T04:27:00.168 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-common.ko 2023-08-25T04:27:00.169 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-25T04:27:00.169 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-25T04:27:00.169 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-25T04:27:00.169 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-25T04:27:00.169 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-25T04:27:00.170 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-25T04:27:00.170 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-25T04:27:00.170 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-25T04:27:00.170 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-25T04:27:00.170 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat.ko 2023-08-25T04:27:00.170 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-saitek.ko 2023-08-25T04:27:00.171 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-samsung.ko 2023-08-25T04:27:00.171 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-25T04:27:00.171 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sjoy.ko 2023-08-25T04:27:00.171 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sony.ko 2023-08-25T04:27:00.172 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-speedlink.ko 2023-08-25T04:27:00.172 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-steelseries.ko 2023-08-25T04:27:00.172 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sunplus.ko 2023-08-25T04:27:00.172 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-25T04:27:00.172 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tivo.ko 2023-08-25T04:27:00.172 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tmff.ko 2023-08-25T04:27:00.173 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-topseed.ko 2023-08-25T04:27:00.173 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-twinhan.ko 2023-08-25T04:27:00.173 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-uclogic.ko 2023-08-25T04:27:00.173 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-waltop.ko 2023-08-25T04:27:00.173 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-wiimote.ko 2023-08-25T04:27:00.173 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-xinmo.ko 2023-08-25T04:27:00.173 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zpff.ko 2023-08-25T04:27:00.174 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zydacron.ko 2023-08-25T04:27:00.174 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/uhid.ko 2023-08-25T04:27:00.174 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/wacom.ko 2023-08-25T04:27:00.174 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv 2023-08-25T04:27:00.174 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_balloon.ko 2023-08-25T04:27:00.174 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_utils.ko 2023-08-25T04:27:00.175 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_vmbus.ko 2023-08-25T04:27:00.175 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon 2023-08-25T04:27:00.175 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru.ko 2023-08-25T04:27:00.175 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru3.ko 2023-08-25T04:27:00.175 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-25T04:27:00.175 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7414.ko 2023-08-25T04:27:00.176 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7418.ko 2023-08-25T04:27:00.176 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adc128d818.ko 2023-08-25T04:27:00.176 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1025.ko 2023-08-25T04:27:00.176 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1026.ko 2023-08-25T04:27:00.176 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1029.ko 2023-08-25T04:27:00.176 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1031.ko 2023-08-25T04:27:00.177 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm9240.ko 2023-08-25T04:27:00.177 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ads7828.ko 2023-08-25T04:27:00.177 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7410.ko 2023-08-25T04:27:00.177 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7411.ko 2023-08-25T04:27:00.177 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7462.ko 2023-08-25T04:27:00.177 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7470.ko 2023-08-25T04:27:00.177 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7475.ko 2023-08-25T04:27:00.178 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7x10.ko 2023-08-25T04:27:00.178 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/amc6821.ko 2023-08-25T04:27:00.178 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/applesmc.ko 2023-08-25T04:27:00.178 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asb100.ko 2023-08-25T04:27:00.178 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asc7621.ko 2023-08-25T04:27:00.178 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-25T04:27:00.179 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/atxp1.ko 2023-08-25T04:27:00.179 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/coretemp.ko 2023-08-25T04:27:00.179 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-25T04:27:00.179 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dme1737.ko 2023-08-25T04:27:00.179 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds1621.ko 2023-08-25T04:27:00.179 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds620.ko 2023-08-25T04:27:00.179 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc1403.ko 2023-08-25T04:27:00.180 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc6w201.ko 2023-08-25T04:27:00.180 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71805f.ko 2023-08-25T04:27:00.180 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71882fg.ko 2023-08-25T04:27:00.180 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f75375s.ko 2023-08-25T04:27:00.180 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fam15h_power.ko 2023-08-25T04:27:00.180 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fschmd.ko 2023-08-25T04:27:00.181 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g760a.ko 2023-08-25T04:27:00.181 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g762.ko 2023-08-25T04:27:00.181 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl518sm.ko 2023-08-25T04:27:00.181 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl520sm.ko 2023-08-25T04:27:00.181 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-25T04:27:00.181 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5500_temp.ko 2023-08-25T04:27:00.182 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5k_amb.ko 2023-08-25T04:27:00.182 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmaem.ko 2023-08-25T04:27:00.182 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmpex.ko 2023-08-25T04:27:00.182 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina209.ko 2023-08-25T04:27:00.182 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina2xx.ko 2023-08-25T04:27:00.182 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/it87.ko 2023-08-25T04:27:00.183 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k10temp.ko 2023-08-25T04:27:00.183 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k8temp.ko 2023-08-25T04:27:00.183 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lineage-pem.ko 2023-08-25T04:27:00.183 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm63.ko 2023-08-25T04:27:00.183 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm73.ko 2023-08-25T04:27:00.183 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm75.ko 2023-08-25T04:27:00.184 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm77.ko 2023-08-25T04:27:00.184 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm78.ko 2023-08-25T04:27:00.184 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm80.ko 2023-08-25T04:27:00.184 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm83.ko 2023-08-25T04:27:00.184 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm85.ko 2023-08-25T04:27:00.184 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm87.ko 2023-08-25T04:27:00.185 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm90.ko 2023-08-25T04:27:00.185 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm92.ko 2023-08-25T04:27:00.185 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm93.ko 2023-08-25T04:27:00.185 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95234.ko 2023-08-25T04:27:00.185 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95241.ko 2023-08-25T04:27:00.185 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95245.ko 2023-08-25T04:27:00.185 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc2945.ko 2023-08-25T04:27:00.186 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4151.ko 2023-08-25T04:27:00.186 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4215.ko 2023-08-25T04:27:00.186 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4222.ko 2023-08-25T04:27:00.186 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4245.ko 2023-08-25T04:27:00.187 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4260.ko 2023-08-25T04:27:00.187 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4261.ko 2023-08-25T04:27:00.187 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max16065.ko 2023-08-25T04:27:00.187 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1619.ko 2023-08-25T04:27:00.188 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1668.ko 2023-08-25T04:27:00.188 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max197.ko 2023-08-25T04:27:00.188 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6639.ko 2023-08-25T04:27:00.188 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6650.ko 2023-08-25T04:27:00.188 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6697.ko 2023-08-25T04:27:00.189 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/mcp3021.ko 2023-08-25T04:27:00.189 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6683.ko 2023-08-25T04:27:00.189 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775-core.ko 2023-08-25T04:27:00.189 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775.ko 2023-08-25T04:27:00.190 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct7802.ko 2023-08-25T04:27:00.190 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87360.ko 2023-08-25T04:27:00.190 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87427.ko 2023-08-25T04:27:00.190 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pcf8591.ko 2023-08-25T04:27:00.190 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus 2023-08-25T04:27:00.191 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-25T04:27:00.191 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-25T04:27:00.191 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-25T04:27:00.191 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-25T04:27:00.192 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-25T04:27:00.192 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-25T04:27:00.192 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-25T04:27:00.192 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-25T04:27:00.192 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-25T04:27:00.193 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-25T04:27:00.193 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-25T04:27:00.193 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-25T04:27:00.193 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/powr1220.ko 2023-08-25T04:27:00.194 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5627.ko 2023-08-25T04:27:00.194 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5636.ko 2023-08-25T04:27:00.194 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-25T04:27:00.194 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht15.ko 2023-08-25T04:27:00.194 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht21.ko 2023-08-25T04:27:00.195 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/shtc1.ko 2023-08-25T04:27:00.195 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sis5595.ko 2023-08-25T04:27:00.195 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47b397.ko 2023-08-25T04:27:00.195 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m1.ko 2023-08-25T04:27:00.195 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m192.ko 2023-08-25T04:27:00.196 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/thmc50.ko 2023-08-25T04:27:00.196 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp102.ko 2023-08-25T04:27:00.196 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp103.ko 2023-08-25T04:27:00.196 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp401.ko 2023-08-25T04:27:00.196 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp421.ko 2023-08-25T04:27:00.197 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via-cputemp.ko 2023-08-25T04:27:00.197 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via686a.ko 2023-08-25T04:27:00.197 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt1211.ko 2023-08-25T04:27:00.197 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt8231.ko 2023-08-25T04:27:00.197 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627ehf.ko 2023-08-25T04:27:00.198 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627hf.ko 2023-08-25T04:27:00.198 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83781d.ko 2023-08-25T04:27:00.198 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83791d.ko 2023-08-25T04:27:00.198 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83792d.ko 2023-08-25T04:27:00.198 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83793.ko 2023-08-25T04:27:00.199 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83795.ko 2023-08-25T04:27:00.199 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l785ts.ko 2023-08-25T04:27:00.199 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l786ng.ko 2023-08-25T04:27:00.200 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c 2023-08-25T04:27:00.200 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos 2023-08-25T04:27:00.200 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-25T04:27:00.200 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-25T04:27:00.200 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses 2023-08-25T04:27:00.201 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-25T04:27:00.201 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-25T04:27:00.201 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-25T04:27:00.201 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-25T04:27:00.201 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-25T04:27:00.201 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-25T04:27:00.202 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-25T04:27:00.202 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-25T04:27:00.202 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-25T04:27:00.202 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-25T04:27:00.202 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-25T04:27:00.202 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-25T04:27:00.203 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-25T04:27:00.203 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-25T04:27:00.203 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-25T04:27:00.203 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-25T04:27:00.204 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-25T04:27:00.204 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-25T04:27:00.204 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-25T04:27:00.205 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-25T04:27:00.205 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-25T04:27:00.205 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-25T04:27:00.205 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-25T04:27:00.205 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-dev.ko 2023-08-25T04:27:00.206 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-mux.ko 2023-08-25T04:27:00.206 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-25T04:27:00.206 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-smbus.ko 2023-08-25T04:27:00.206 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-stub.ko 2023-08-25T04:27:00.206 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband 2023-08-25T04:27:00.207 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core 2023-08-25T04:27:00.207 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-25T04:27:00.207 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_core.ko 2023-08-25T04:27:00.207 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-25T04:27:00.207 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-25T04:27:00.207 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-25T04:27:00.208 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-25T04:27:00.208 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-25T04:27:00.208 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw 2023-08-25T04:27:00.209 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4 2023-08-25T04:27:00.209 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-25T04:27:00.209 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4 2023-08-25T04:27:00.209 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-25T04:27:00.209 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5 2023-08-25T04:27:00.209 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-25T04:27:00.210 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca 2023-08-25T04:27:00.210 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-25T04:27:00.210 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp 2023-08-25T04:27:00.210 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib 2023-08-25T04:27:00.210 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-25T04:27:00.211 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser 2023-08-25T04:27:00.211 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-25T04:27:00.211 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert 2023-08-25T04:27:00.211 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-25T04:27:00.211 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp 2023-08-25T04:27:00.211 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-25T04:27:00.212 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt 2023-08-25T04:27:00.212 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-25T04:27:00.212 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input 2023-08-25T04:27:00.212 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport 2023-08-25T04:27:00.212 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-25T04:27:00.212 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-25T04:27:00.212 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/gameport.ko 2023-08-25T04:27:00.213 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/lightning.ko 2023-08-25T04:27:00.213 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/ns558.ko 2023-08-25T04:27:00.213 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/joydev.ko 2023-08-25T04:27:00.213 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard 2023-08-25T04:27:00.213 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-25T04:27:00.213 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse 2023-08-25T04:27:00.214 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/appletouch.ko 2023-08-25T04:27:00.214 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/bcm5974.ko 2023-08-25T04:27:00.214 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/cyapatp.ko 2023-08-25T04:27:00.214 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-25T04:27:00.214 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/sermouse.ko 2023-08-25T04:27:00.214 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-25T04:27:00.214 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-25T04:27:00.215 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-25T04:27:00.215 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4 2023-08-25T04:27:00.215 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-25T04:27:00.215 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio 2023-08-25T04:27:00.215 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/altera_ps2.ko 2023-08-25T04:27:00.215 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/arc_ps2.ko 2023-08-25T04:27:00.216 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-25T04:27:00.216 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/serio_raw.ko 2023-08-25T04:27:00.216 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/sparse-keymap.ko 2023-08-25T04:27:00.216 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu 2023-08-25T04:27:00.216 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd 2023-08-25T04:27:00.216 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-25T04:27:00.216 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds 2023-08-25T04:27:00.217 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-blinkm.ko 2023-08-25T04:27:00.217 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3530.ko 2023-08-25T04:27:00.217 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lp3944.ko 2023-08-25T04:27:00.217 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-ss4200.ko 2023-08-25T04:27:00.217 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger 2023-08-25T04:27:00.217 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-25T04:27:00.217 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-25T04:27:00.218 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-25T04:27:00.218 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-25T04:27:00.219 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-25T04:27:00.219 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-25T04:27:00.219 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-25T04:27:00.220 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-25T04:27:00.220 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md 2023-08-25T04:27:00.220 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache 2023-08-25T04:27:00.220 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache/bcache.ko 2023-08-25T04:27:00.220 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-bio-prison.ko 2023-08-25T04:27:00.220 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache-smq.ko 2023-08-25T04:27:00.221 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache.ko 2023-08-25T04:27:00.221 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-crypt.ko 2023-08-25T04:27:00.221 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-delay.ko 2023-08-25T04:27:00.221 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-flakey.ko 2023-08-25T04:27:00.221 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-log-userspace.ko 2023-08-25T04:27:00.221 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-multipath.ko 2023-08-25T04:27:00.221 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-queue-length.ko 2023-08-25T04:27:00.222 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-raid.ko 2023-08-25T04:27:00.222 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-round-robin.ko 2023-08-25T04:27:00.222 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-service-time.ko 2023-08-25T04:27:00.222 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-switch.ko 2023-08-25T04:27:00.222 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-thin-pool.ko 2023-08-25T04:27:00.222 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-verity.ko 2023-08-25T04:27:00.222 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/faulty.ko 2023-08-25T04:27:00.223 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/linear.ko 2023-08-25T04:27:00.223 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/multipath.ko 2023-08-25T04:27:00.223 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data 2023-08-25T04:27:00.223 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-25T04:27:00.223 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid0.ko 2023-08-25T04:27:00.223 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid1.ko 2023-08-25T04:27:00.223 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid10.ko 2023-08-25T04:27:00.224 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid456.ko 2023-08-25T04:27:00.224 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message 2023-08-25T04:27:00.224 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion 2023-08-25T04:27:00.224 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptbase.ko 2023-08-25T04:27:00.224 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptctl.ko 2023-08-25T04:27:00.224 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptfc.ko 2023-08-25T04:27:00.224 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptlan.ko 2023-08-25T04:27:00.225 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptsas.ko 2023-08-25T04:27:00.225 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptscsih.ko 2023-08-25T04:27:00.225 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptspi.ko 2023-08-25T04:27:00.225 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd 2023-08-25T04:27:00.225 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_ich.ko 2023-08-25T04:27:00.225 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_sch.ko 2023-08-25T04:27:00.225 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/mfd-core.ko 2023-08-25T04:27:00.226 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/sm501.ko 2023-08-25T04:27:00.226 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/viperboard.ko 2023-08-25T04:27:00.226 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/vx855.ko 2023-08-25T04:27:00.226 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/wl1273-core.ko 2023-08-25T04:27:00.226 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc 2023-08-25T04:27:00.226 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl 2023-08-25T04:27:00.226 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-25T04:27:00.227 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds9802als.ko 2023-08-25T04:27:00.227 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds990x.ko 2023-08-25T04:27:00.227 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/bh1770glc.ko 2023-08-25T04:27:00.227 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710 2023-08-25T04:27:00.227 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710/cb710.ko 2023-08-25T04:27:00.227 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom 2023-08-25T04:27:00.228 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/at24.ko 2023-08-25T04:27:00.228 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-25T04:27:00.228 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-25T04:27:00.228 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/max6875.ko 2023-08-25T04:27:00.228 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/enclosure.ko 2023-08-25T04:27:00.228 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/hpilo.ko 2023-08-25T04:27:00.228 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29003.ko 2023-08-25T04:27:00.229 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29020.ko 2023-08-25T04:27:00.229 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d 2023-08-25T04:27:00.229 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-25T04:27:00.229 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-25T04:27:00.229 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei 2023-08-25T04:27:00.229 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-me.ko 2023-08-25T04:27:00.229 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-txe.ko 2023-08-25T04:27:00.230 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei.ko 2023-08-25T04:27:00.230 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-gru 2023-08-25T04:27:00.230 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-25T04:27:00.230 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp 2023-08-25T04:27:00.230 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-25T04:27:00.230 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-25T04:27:00.230 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-25T04:27:00.231 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_7xx1.ko 2023-08-25T04:27:00.231 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_core.ko 2023-08-25T04:27:00.231 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tsl2550.ko 2023-08-25T04:27:00.232 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_balloon.ko 2023-08-25T04:27:00.232 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci 2023-08-25T04:27:00.232 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-25T04:27:00.232 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net 2023-08-25T04:27:00.232 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding 2023-08-25T04:27:00.232 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding/bonding.ko 2023-08-25T04:27:00.233 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa 2023-08-25T04:27:00.233 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53 2023-08-25T04:27:00.233 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-25T04:27:00.233 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-25T04:27:00.233 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-25T04:27:00.233 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx 2023-08-25T04:27:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-25T04:27:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dummy.ko 2023-08-25T04:27:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/eql.ko 2023-08-25T04:27:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet 2023-08-25T04:27:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com 2023-08-25T04:27:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-25T04:27:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-25T04:27:00.235 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-25T04:27:00.235 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-25T04:27:00.235 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390 2023-08-25T04:27:00.235 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-25T04:27:00.235 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-25T04:27:00.235 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-25T04:27:00.235 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-25T04:27:00.236 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec 2023-08-25T04:27:00.236 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-25T04:27:00.236 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere 2023-08-25T04:27:00.236 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-25T04:27:00.236 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon 2023-08-25T04:27:00.236 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-25T04:27:00.236 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera 2023-08-25T04:27:00.237 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-25T04:27:00.237 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd 2023-08-25T04:27:00.237 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-25T04:27:00.237 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-25T04:27:00.237 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-25T04:27:00.237 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros 2023-08-25T04:27:00.237 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx 2023-08-25T04:27:00.238 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-25T04:27:00.238 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-25T04:27:00.238 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-25T04:27:00.238 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-25T04:27:00.238 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-25T04:27:00.238 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx 2023-08-25T04:27:00.239 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-25T04:27:00.239 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-25T04:27:00.239 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom 2023-08-25T04:27:00.239 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-25T04:27:00.239 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-25T04:27:00.239 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-25T04:27:00.240 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-25T04:27:00.240 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-25T04:27:00.240 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet 2023-08-25T04:27:00.240 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-25T04:27:00.240 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-25T04:27:00.240 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade 2023-08-25T04:27:00.240 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna 2023-08-25T04:27:00.241 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-25T04:27:00.241 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio 2023-08-25T04:27:00.241 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-25T04:27:00.241 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-25T04:27:00.241 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-25T04:27:00.241 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-25T04:27:00.242 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-25T04:27:00.242 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-25T04:27:00.242 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-25T04:27:00.242 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-25T04:27:00.242 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-25T04:27:00.242 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-25T04:27:00.242 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco 2023-08-25T04:27:00.242 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic 2023-08-25T04:27:00.243 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-25T04:27:00.243 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec 2023-08-25T04:27:00.243 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip 2023-08-25T04:27:00.243 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-25T04:27:00.243 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-25T04:27:00.243 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-25T04:27:00.243 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-25T04:27:00.244 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-25T04:27:00.244 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-25T04:27:00.244 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink 2023-08-25T04:27:00.245 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-25T04:27:00.245 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-25T04:27:00.245 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dnet.ko 2023-08-25T04:27:00.245 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex 2023-08-25T04:27:00.246 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet 2023-08-25T04:27:00.246 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-25T04:27:00.246 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ethoc.ko 2023-08-25T04:27:00.246 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fealnx.ko 2023-08-25T04:27:00.246 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel 2023-08-25T04:27:00.246 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-25T04:27:00.246 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000 2023-08-25T04:27:00.247 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-25T04:27:00.247 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e 2023-08-25T04:27:00.247 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-25T04:27:00.247 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k 2023-08-25T04:27:00.247 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-25T04:27:00.247 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e 2023-08-25T04:27:00.248 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-25T04:27:00.248 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf 2023-08-25T04:27:00.248 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-25T04:27:00.248 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb 2023-08-25T04:27:00.248 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-25T04:27:00.248 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf 2023-08-25T04:27:00.249 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-25T04:27:00.249 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-25T04:27:00.249 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-25T04:27:00.249 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-25T04:27:00.249 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-25T04:27:00.249 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/jme.ko 2023-08-25T04:27:00.250 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell 2023-08-25T04:27:00.250 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-25T04:27:00.250 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-25T04:27:00.250 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-25T04:27:00.250 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox 2023-08-25T04:27:00.250 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-25T04:27:00.251 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-25T04:27:00.251 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-25T04:27:00.251 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-25T04:27:00.251 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-25T04:27:00.251 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-25T04:27:00.251 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel 2023-08-25T04:27:00.252 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-25T04:27:00.252 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom 2023-08-25T04:27:00.252 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-25T04:27:00.252 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-25T04:27:00.252 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi 2023-08-25T04:27:00.252 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-25T04:27:00.252 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-25T04:27:00.252 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion 2023-08-25T04:27:00.253 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-25T04:27:00.253 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia 2023-08-25T04:27:00.253 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-25T04:27:00.253 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines 2023-08-25T04:27:00.253 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-25T04:27:00.253 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-25T04:27:00.253 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic 2023-08-25T04:27:00.254 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-25T04:27:00.254 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-25T04:27:00.254 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-25T04:27:00.254 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-25T04:27:00.254 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-25T04:27:00.254 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc 2023-08-25T04:27:00.254 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-25T04:27:00.255 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek 2023-08-25T04:27:00.255 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-25T04:27:00.255 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-25T04:27:00.255 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-25T04:27:00.255 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-25T04:27:00.255 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rocker 2023-08-25T04:27:00.256 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-25T04:27:00.256 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc 2023-08-25T04:27:00.256 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-25T04:27:00.256 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan 2023-08-25T04:27:00.256 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-25T04:27:00.256 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis 2023-08-25T04:27:00.256 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-25T04:27:00.257 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-25T04:27:00.257 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc 2023-08-25T04:27:00.257 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-25T04:27:00.257 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-25T04:27:00.257 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-25T04:27:00.257 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-25T04:27:00.257 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro 2023-08-25T04:27:00.258 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-25T04:27:00.258 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-25T04:27:00.258 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-25T04:27:00.258 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun 2023-08-25T04:27:00.258 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-25T04:27:00.258 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-25T04:27:00.259 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-25T04:27:00.259 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-25T04:27:00.259 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti 2023-08-25T04:27:00.259 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-25T04:27:00.259 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti 2023-08-25T04:27:00.259 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-25T04:27:00.260 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via 2023-08-25T04:27:00.260 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-25T04:27:00.260 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-25T04:27:00.260 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet 2023-08-25T04:27:00.260 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-25T04:27:00.260 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-25T04:27:00.260 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom 2023-08-25T04:27:00.261 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-25T04:27:00.261 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/geneve.ko 2023-08-25T04:27:00.261 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv 2023-08-25T04:27:00.261 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-25T04:27:00.261 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154 2023-08-25T04:27:00.261 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-25T04:27:00.261 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ifb.ko 2023-08-25T04:27:00.261 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan 2023-08-25T04:27:00.262 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-25T04:27:00.262 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvlan.ko 2023-08-25T04:27:00.262 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvtap.ko 2023-08-25T04:27:00.262 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio 2023-08-25T04:27:00.262 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio.ko 2023-08-25T04:27:00.262 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-25T04:27:00.262 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-25T04:27:00.263 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-25T04:27:00.263 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mii.ko 2023-08-25T04:27:00.263 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/net_failover.ko 2023-08-25T04:27:00.263 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/netconsole.ko 2023-08-25T04:27:00.263 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/nlmon.ko 2023-08-25T04:27:00.263 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs 2023-08-25T04:27:00.263 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-25T04:27:00.264 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-25T04:27:00.264 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy 2023-08-25T04:27:00.264 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/amd.ko 2023-08-25T04:27:00.264 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-25T04:27:00.264 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-25T04:27:00.264 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-25T04:27:00.264 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm87xx.ko 2023-08-25T04:27:00.264 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/broadcom.ko 2023-08-25T04:27:00.265 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/cicada.ko 2023-08-25T04:27:00.265 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/davicom.ko 2023-08-25T04:27:00.265 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/dp83640.ko 2023-08-25T04:27:00.265 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/et1011c.ko 2023-08-25T04:27:00.265 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/icplus.ko 2023-08-25T04:27:00.266 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/lxt.ko 2023-08-25T04:27:00.266 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/marvell.ko 2023-08-25T04:27:00.266 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/micrel.ko 2023-08-25T04:27:00.266 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/national.ko 2023-08-25T04:27:00.266 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/phylink.ko 2023-08-25T04:27:00.266 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/qsemi.ko 2023-08-25T04:27:00.267 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/realtek.ko 2023-08-25T04:27:00.267 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/smsc.ko 2023-08-25T04:27:00.267 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/ste10Xp.ko 2023-08-25T04:27:00.267 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/vitesse.ko 2023-08-25T04:27:00.267 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp 2023-08-25T04:27:00.267 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-25T04:27:00.267 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_async.ko 2023-08-25T04:27:00.268 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-25T04:27:00.268 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-25T04:27:00.268 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-25T04:27:00.268 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-25T04:27:00.268 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppoe.ko 2023-08-25T04:27:00.268 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppox.ko 2023-08-25T04:27:00.268 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pptp.ko 2023-08-25T04:27:00.269 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip 2023-08-25T04:27:00.269 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slhc.ko 2023-08-25T04:27:00.269 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slip.ko 2023-08-25T04:27:00.269 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/sungem_phy.ko 2023-08-25T04:27:00.269 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tap.ko 2023-08-25T04:27:00.269 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team 2023-08-25T04:27:00.269 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team.ko 2023-08-25T04:27:00.269 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-25T04:27:00.270 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-25T04:27:00.270 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-25T04:27:00.270 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_random.ko 2023-08-25T04:27:00.270 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-25T04:27:00.270 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tun.ko 2023-08-25T04:27:00.270 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/veth.ko 2023-08-25T04:27:00.270 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/virtio_net.ko 2023-08-25T04:27:00.271 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3 2023-08-25T04:27:00.271 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-25T04:27:00.271 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan 2023-08-25T04:27:00.271 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan/vxlan.ko 2023-08-25T04:27:00.271 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback 2023-08-25T04:27:00.271 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-25T04:27:00.271 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netfront.ko 2023-08-25T04:27:00.272 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb 2023-08-25T04:27:00.272 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb/ntb.ko 2023-08-25T04:27:00.272 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme 2023-08-25T04:27:00.272 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host 2023-08-25T04:27:00.272 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme-core.ko 2023-08-25T04:27:00.272 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme.ko 2023-08-25T04:27:00.273 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport 2023-08-25T04:27:00.273 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport.ko 2023-08-25T04:27:00.273 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_cs.ko 2023-08-25T04:27:00.273 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_pc.ko 2023-08-25T04:27:00.273 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_serial.ko 2023-08-25T04:27:00.273 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci 2023-08-25T04:27:00.273 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug 2023-08-25T04:27:00.274 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-25T04:27:00.274 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pcie 2023-08-25T04:27:00.274 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-25T04:27:00.274 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/xen-pcifront.ko 2023-08-25T04:27:00.274 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia 2023-08-25T04:27:00.274 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/i82092.ko 2023-08-25T04:27:00.274 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pd6729.ko 2023-08-25T04:27:00.275 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-25T04:27:00.275 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl 2023-08-25T04:27:00.275 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel 2023-08-25T04:27:00.275 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-25T04:27:00.275 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform 2023-08-25T04:27:00.275 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86 2023-08-25T04:27:00.275 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-25T04:27:00.276 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acerhdf.ko 2023-08-25T04:27:00.276 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-25T04:27:00.276 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-25T04:27:00.276 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-25T04:27:00.276 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-25T04:27:00.276 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-25T04:27:00.276 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-25T04:27:00.277 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-25T04:27:00.277 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-25T04:27:00.277 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-25T04:27:00.277 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/hdaps.ko 2023-08-25T04:27:00.277 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel 2023-08-25T04:27:00.277 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-25T04:27:00.277 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel_ips.ko 2023-08-25T04:27:00.277 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-25T04:27:00.278 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-25T04:27:00.278 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-25T04:27:00.278 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-25T04:27:00.278 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-25T04:27:00.278 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-25T04:27:00.278 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-25T04:27:00.278 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-25T04:27:00.279 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-25T04:27:00.279 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi.ko 2023-08-25T04:27:00.279 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap 2023-08-25T04:27:00.279 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-25T04:27:00.279 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-25T04:27:00.279 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps 2023-08-25T04:27:00.279 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients 2023-08-25T04:27:00.280 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-25T04:27:00.280 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-25T04:27:00.280 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps_parport.ko 2023-08-25T04:27:00.280 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/pps_core.ko 2023-08-25T04:27:00.280 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp 2023-08-25T04:27:00.280 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp.ko 2023-08-25T04:27:00.280 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp_kvm.ko 2023-08-25T04:27:00.281 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc 2023-08-25T04:27:00.281 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-25T04:27:00.281 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-25T04:27:00.281 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-25T04:27:00.281 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-25T04:27:00.281 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-25T04:27:00.281 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-25T04:27:00.281 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-25T04:27:00.282 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-25T04:27:00.282 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-25T04:27:00.282 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-25T04:27:00.282 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-25T04:27:00.282 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-em3027.ko 2023-08-25T04:27:00.282 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-25T04:27:00.282 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-25T04:27:00.283 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-25T04:27:00.283 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-25T04:27:00.283 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-25T04:27:00.283 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-25T04:27:00.283 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max6900.ko 2023-08-25T04:27:00.283 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-25T04:27:00.283 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-25T04:27:00.284 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-25T04:27:00.284 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-25T04:27:00.284 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-25T04:27:00.284 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-25T04:27:00.284 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-25T04:27:00.284 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-25T04:27:00.284 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-25T04:27:00.284 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-25T04:27:00.285 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-25T04:27:00.285 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-25T04:27:00.285 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-x1205.ko 2023-08-25T04:27:00.285 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi 2023-08-25T04:27:00.285 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-9xxx.ko 2023-08-25T04:27:00.285 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-sas.ko 2023-08-25T04:27:00.285 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-xxxx.ko 2023-08-25T04:27:00.285 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/BusLogic.ko 2023-08-25T04:27:00.286 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/a100u2w.ko 2023-08-25T04:27:00.286 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid 2023-08-25T04:27:00.286 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-25T04:27:00.286 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/advansys.ko 2023-08-25T04:27:00.286 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx 2023-08-25T04:27:00.286 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-25T04:27:00.286 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-25T04:27:00.287 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/am53c974.ko 2023-08-25T04:27:00.287 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr 2023-08-25T04:27:00.287 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-25T04:27:00.287 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/atp870u.ko 2023-08-25T04:27:00.287 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi 2023-08-25T04:27:00.287 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-25T04:27:00.287 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa 2023-08-25T04:27:00.288 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa/bfa.ko 2023-08-25T04:27:00.288 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc 2023-08-25T04:27:00.288 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-25T04:27:00.288 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i 2023-08-25T04:27:00.288 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-25T04:27:00.288 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ch.ko 2023-08-25T04:27:00.288 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor 2023-08-25T04:27:00.288 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-25T04:27:00.289 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi 2023-08-25T04:27:00.289 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-25T04:27:00.289 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-25T04:27:00.289 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-25T04:27:00.290 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-25T04:27:00.290 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-25T04:27:00.290 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dc395x.ko 2023-08-25T04:27:00.290 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler 2023-08-25T04:27:00.291 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-25T04:27:00.291 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-25T04:27:00.291 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-25T04:27:00.291 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-25T04:27:00.291 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dmx3191d.ko 2023-08-25T04:27:00.291 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r 2023-08-25T04:27:00.291 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-25T04:27:00.292 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esp_scsi.ko 2023-08-25T04:27:00.292 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe 2023-08-25T04:27:00.292 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-25T04:27:00.292 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-25T04:27:00.292 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic 2023-08-25T04:27:00.292 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic/fnic.ko 2023-08-25T04:27:00.293 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hpsa.ko 2023-08-25T04:27:00.293 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hptiop.ko 2023-08-25T04:27:00.293 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hv_storvsc.ko 2023-08-25T04:27:00.293 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/initio.ko 2023-08-25T04:27:00.293 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ipr.ko 2023-08-25T04:27:00.293 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ips.ko 2023-08-25T04:27:00.293 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci 2023-08-25T04:27:00.294 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci/isci.ko 2023-08-25T04:27:00.294 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-25T04:27:00.295 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-25T04:27:00.295 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc 2023-08-25T04:27:00.295 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc/libfc.ko 2023-08-25T04:27:00.296 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi.ko 2023-08-25T04:27:00.296 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-25T04:27:00.296 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas 2023-08-25T04:27:00.296 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas/libsas.ko 2023-08-25T04:27:00.296 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc 2023-08-25T04:27:00.296 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-25T04:27:00.297 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid 2023-08-25T04:27:00.297 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid.ko 2023-08-25T04:27:00.297 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-25T04:27:00.297 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-25T04:27:00.297 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-25T04:27:00.297 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas 2023-08-25T04:27:00.297 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-25T04:27:00.298 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas 2023-08-25T04:27:00.298 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-25T04:27:00.298 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvumi.ko 2023-08-25T04:27:00.298 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001 2023-08-25T04:27:00.298 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-25T04:27:00.298 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pmcraid.ko 2023-08-25T04:27:00.298 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla1280.ko 2023-08-25T04:27:00.299 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx 2023-08-25T04:27:00.299 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-25T04:27:00.299 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-25T04:27:00.299 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx 2023-08-25T04:27:00.299 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-25T04:27:00.299 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/raid_class.ko 2023-08-25T04:27:00.299 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_debug.ko 2023-08-25T04:27:00.300 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-25T04:27:00.300 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-25T04:27:00.300 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-25T04:27:00.300 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-25T04:27:00.300 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-25T04:27:00.300 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ses.ko 2023-08-25T04:27:00.300 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/st.ko 2023-08-25T04:27:00.301 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/stex.ko 2023-08-25T04:27:00.301 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2 2023-08-25T04:27:00.301 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-25T04:27:00.301 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/virtio_scsi.ko 2023-08-25T04:27:00.301 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-25T04:27:00.301 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/wd719x.ko 2023-08-25T04:27:00.301 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb 2023-08-25T04:27:00.302 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb/ssb.ko 2023-08-25T04:27:00.302 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target 2023-08-25T04:27:00.302 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi 2023-08-25T04:27:00.302 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-25T04:27:00.302 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback 2023-08-25T04:27:00.302 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-25T04:27:00.302 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_file.ko 2023-08-25T04:27:00.302 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_iblock.ko 2023-08-25T04:27:00.303 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_mod.ko 2023-08-25T04:27:00.303 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_pscsi.ko 2023-08-25T04:27:00.303 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_user.ko 2023-08-25T04:27:00.304 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc 2023-08-25T04:27:00.304 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-25T04:27:00.304 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal 2023-08-25T04:27:00.304 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel 2023-08-25T04:27:00.304 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal 2023-08-25T04:27:00.304 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-25T04:27:00.304 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-25T04:27:00.304 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-25T04:27:00.305 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-25T04:27:00.305 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-25T04:27:00.305 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-25T04:27:00.305 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-25T04:27:00.305 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-25T04:27:00.305 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-25T04:27:00.305 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-25T04:27:00.306 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-25T04:27:00.306 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-25T04:27:00.306 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-25T04:27:00.306 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-25T04:27:00.306 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-25T04:27:00.306 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty 2023-08-25T04:27:00.306 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless 2023-08-25T04:27:00.306 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-25T04:27:00.307 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_gsm.ko 2023-08-25T04:27:00.307 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_hdlc.ko 2023-08-25T04:27:00.307 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/nozomi.ko 2023-08-25T04:27:00.307 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial 2023-08-25T04:27:00.307 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250 2023-08-25T04:27:00.307 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-25T04:27:00.307 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/arc_uart.ko 2023-08-25T04:27:00.308 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm 2023-08-25T04:27:00.308 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-25T04:27:00.308 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/synclink_gt.ko 2023-08-25T04:27:00.308 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs 2023-08-25T04:27:00.308 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core 2023-08-25T04:27:00.308 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-25T04:27:00.308 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host 2023-08-25T04:27:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-25T04:27:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio 2023-08-25T04:27:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio.ko 2023-08-25T04:27:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_aec.ko 2023-08-25T04:27:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_cif.ko 2023-08-25T04:27:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_pci_generic.ko 2023-08-25T04:27:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_sercos3.ko 2023-08-25T04:27:00.309 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb 2023-08-25T04:27:00.310 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class 2023-08-25T04:27:00.310 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-acm.ko 2023-08-25T04:27:00.310 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-25T04:27:00.310 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usblp.ko 2023-08-25T04:27:00.310 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usbtmc.ko 2023-08-25T04:27:00.310 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host 2023-08-25T04:27:00.310 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-25T04:27:00.311 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image 2023-08-25T04:27:00.311 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/mdc800.ko 2023-08-25T04:27:00.311 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/microtek.ko 2023-08-25T04:27:00.311 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc 2023-08-25T04:27:00.311 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/adutux.ko 2023-08-25T04:27:00.311 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/appledisplay.ko 2023-08-25T04:27:00.311 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi26.ko 2023-08-25T04:27:00.311 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi62.ko 2023-08-25T04:27:00.312 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ezusb.ko 2023-08-25T04:27:00.312 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/idmouse.ko 2023-08-25T04:27:00.312 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/iowarrior.ko 2023-08-25T04:27:00.312 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-25T04:27:00.312 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ldusb.ko 2023-08-25T04:27:00.312 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/legousbtower.ko 2023-08-25T04:27:00.312 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga 2023-08-25T04:27:00.313 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-25T04:27:00.313 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-25T04:27:00.313 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usb3503.ko 2023-08-25T04:27:00.313 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usblcd.ko 2023-08-25T04:27:00.313 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-25T04:27:00.313 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/uss720.ko 2023-08-25T04:27:00.313 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/yurex.ko 2023-08-25T04:27:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy 2023-08-25T04:27:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-generic.ko 2023-08-25T04:27:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial 2023-08-25T04:27:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/aircable.ko 2023-08-25T04:27:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ark3116.ko 2023-08-25T04:27:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-25T04:27:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ch341.ko 2023-08-25T04:27:00.314 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cp210x.ko 2023-08-25T04:27:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cyberjack.ko 2023-08-25T04:27:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-25T04:27:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-25T04:27:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/empeg.ko 2023-08-25T04:27:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-25T04:27:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-25T04:27:00.315 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-25T04:27:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_ti.ko 2023-08-25T04:27:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipaq.ko 2023-08-25T04:27:00.316 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipw.ko 2023-08-25T04:27:00.317 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ir-usb.ko 2023-08-25T04:27:00.317 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-25T04:27:00.317 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan.ko 2023-08-25T04:27:00.317 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-25T04:27:00.317 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-25T04:27:00.317 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-25T04:27:00.317 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mct_u232.ko 2023-08-25T04:27:00.318 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7720.ko 2023-08-25T04:27:00.318 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7840.ko 2023-08-25T04:27:00.318 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/navman.ko 2023-08-25T04:27:00.318 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/omninet.ko 2023-08-25T04:27:00.318 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/opticon.ko 2023-08-25T04:27:00.318 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/option.ko 2023-08-25T04:27:00.318 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/oti6858.ko 2023-08-25T04:27:00.319 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/pl2303.ko 2023-08-25T04:27:00.319 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcaux.ko 2023-08-25T04:27:00.319 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcserial.ko 2023-08-25T04:27:00.319 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/quatech2.ko 2023-08-25T04:27:00.319 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/safe_serial.ko 2023-08-25T04:27:00.319 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/sierra.ko 2023-08-25T04:27:00.319 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-25T04:27:00.320 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ssu100.ko 2023-08-25T04:27:00.320 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/symbolserial.ko 2023-08-25T04:27:00.320 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-25T04:27:00.320 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-25T04:27:00.320 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_debug.ko 2023-08-25T04:27:00.320 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-25T04:27:00.320 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/visor.ko 2023-08-25T04:27:00.321 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/whiteheat.ko 2023-08-25T04:27:00.321 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-25T04:27:00.321 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage 2023-08-25T04:27:00.321 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/uas.ko 2023-08-25T04:27:00.321 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-25T04:27:00.321 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-25T04:27:00.321 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-25T04:27:00.322 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-25T04:27:00.322 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-25T04:27:00.322 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-25T04:27:00.322 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-25T04:27:00.322 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-karma.ko 2023-08-25T04:27:00.322 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-25T04:27:00.322 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-25T04:27:00.322 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-25T04:27:00.323 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-25T04:27:00.323 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-25T04:27:00.323 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/usb-storage.ko 2023-08-25T04:27:00.323 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip 2023-08-25T04:27:00.324 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-25T04:27:00.324 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-25T04:27:00.324 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-25T04:27:00.324 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio 2023-08-25T04:27:00.324 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci 2023-08-25T04:27:00.325 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-25T04:27:00.325 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-25T04:27:00.325 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio.ko 2023-08-25T04:27:00.325 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-25T04:27:00.325 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost 2023-08-25T04:27:00.325 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost.ko 2023-08-25T04:27:00.325 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-25T04:27:00.326 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_net.ko 2023-08-25T04:27:00.326 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_scsi.ko 2023-08-25T04:27:00.326 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video 2023-08-25T04:27:00.326 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight 2023-08-25T04:27:00.326 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/apple_bl.ko 2023-08-25T04:27:00.326 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lcd.ko 2023-08-25T04:27:00.326 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-25T04:27:00.327 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio 2023-08-25T04:27:00.327 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio.ko 2023-08-25T04:27:00.327 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_balloon.ko 2023-08-25T04:27:00.327 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_mmio.ko 2023-08-25T04:27:00.327 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci.ko 2023-08-25T04:27:00.327 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-25T04:27:00.328 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-25T04:27:00.329 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_ring.ko 2023-08-25T04:27:00.329 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1 2023-08-25T04:27:00.329 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters 2023-08-25T04:27:00.329 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2482.ko 2023-08-25T04:27:00.329 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2490.ko 2023-08-25T04:27:00.329 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves 2023-08-25T04:27:00.330 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-25T04:27:00.330 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-25T04:27:00.330 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-25T04:27:00.330 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-25T04:27:00.330 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-25T04:27:00.330 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-25T04:27:00.330 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-25T04:27:00.330 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-25T04:27:00.331 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-25T04:27:00.331 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-25T04:27:00.331 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-25T04:27:00.331 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/wire.ko 2023-08-25T04:27:00.331 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog 2023-08-25T04:27:00.331 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-25T04:27:00.331 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-25T04:27:00.331 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-25T04:27:00.332 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/hpwdt.ko 2023-08-25T04:27:00.332 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/i6300esb.ko 2023-08-25T04:27:00.332 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-25T04:27:00.332 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-25T04:27:00.332 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ib700wdt.ko 2023-08-25T04:27:00.333 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ibmasr.ko 2023-08-25T04:27:00.333 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-25T04:27:00.334 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-25T04:27:00.334 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it87_wdt.ko 2023-08-25T04:27:00.334 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/machzwd.ko 2023-08-25T04:27:00.334 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/nv_tco.ko 2023-08-25T04:27:00.334 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-25T04:27:00.334 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-25T04:27:00.334 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-25T04:27:00.335 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-25T04:27:00.335 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/softdog.ko 2023-08-25T04:27:00.335 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-25T04:27:00.335 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/via_wdt.ko 2023-08-25T04:27:00.335 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-25T04:27:00.335 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-25T04:27:00.335 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-25T04:27:00.336 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wdt_pci.ko 2023-08-25T04:27:00.336 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/xen_wdt.ko 2023-08-25T04:27:00.336 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen 2023-08-25T04:27:00.336 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-25T04:27:00.336 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-evtchn.ko 2023-08-25T04:27:00.336 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntalloc.ko 2023-08-25T04:27:00.337 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntdev.ko 2023-08-25T04:27:00.338 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback 2023-08-25T04:27:00.338 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-25T04:27:00.338 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-privcmd.ko 2023-08-25T04:27:00.338 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs 2023-08-25T04:27:00.338 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-25T04:27:00.338 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs 2023-08-25T04:27:00.338 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p 2023-08-25T04:27:00.339 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p/9p.ko 2023-08-25T04:27:00.339 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs 2023-08-25T04:27:00.339 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs/affs.ko 2023-08-25T04:27:00.339 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs 2023-08-25T04:27:00.339 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs/befs.ko 2023-08-25T04:27:00.339 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/binfmt_misc.ko 2023-08-25T04:27:00.339 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs 2023-08-25T04:27:00.339 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs/btrfs.ko 2023-08-25T04:27:00.340 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles 2023-08-25T04:27:00.340 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles/cachefiles.ko 2023-08-25T04:27:00.340 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph 2023-08-25T04:27:00.340 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph/ceph.ko 2023-08-25T04:27:00.340 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda 2023-08-25T04:27:00.340 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda/coda.ko 2023-08-25T04:27:00.340 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs 2023-08-25T04:27:00.341 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs/cramfs.ko 2023-08-25T04:27:00.341 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm 2023-08-25T04:27:00.341 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm/dlm.ko 2023-08-25T04:27:00.341 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ecryptfs 2023-08-25T04:27:00.341 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-25T04:27:00.341 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs 2023-08-25T04:27:00.341 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs/f2fs.ko 2023-08-25T04:27:00.341 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat 2023-08-25T04:27:00.342 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/fat.ko 2023-08-25T04:27:00.342 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/msdos.ko 2023-08-25T04:27:00.342 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/vfat.ko 2023-08-25T04:27:00.342 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache 2023-08-25T04:27:00.342 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache/fscache.ko 2023-08-25T04:27:00.342 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse 2023-08-25T04:27:00.342 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/cuse.ko 2023-08-25T04:27:00.343 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/fuse.ko 2023-08-25T04:27:00.343 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2 2023-08-25T04:27:00.343 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2/gfs2.ko 2023-08-25T04:27:00.343 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs 2023-08-25T04:27:00.343 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs/hfs.ko 2023-08-25T04:27:00.343 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus 2023-08-25T04:27:00.343 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus/hfsplus.ko 2023-08-25T04:27:00.343 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs 2023-08-25T04:27:00.344 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs/isofs.ko 2023-08-25T04:27:00.344 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs 2023-08-25T04:27:00.345 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs/jfs.ko 2023-08-25T04:27:00.345 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd 2023-08-25T04:27:00.345 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd/lockd.ko 2023-08-25T04:27:00.345 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix 2023-08-25T04:27:00.345 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix/minix.ko 2023-08-25T04:27:00.345 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs 2023-08-25T04:27:00.345 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs/netfs.ko 2023-08-25T04:27:00.346 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs 2023-08-25T04:27:00.346 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout 2023-08-25T04:27:00.346 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-25T04:27:00.346 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout 2023-08-25T04:27:00.346 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-25T04:27:00.346 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout 2023-08-25T04:27:00.346 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-25T04:27:00.347 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfs.ko 2023-08-25T04:27:00.347 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv3.ko 2023-08-25T04:27:00.347 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv4.ko 2023-08-25T04:27:00.347 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common 2023-08-25T04:27:00.347 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/grace.ko 2023-08-25T04:27:00.347 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/nfs_acl.ko 2023-08-25T04:27:00.347 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd 2023-08-25T04:27:00.348 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd/nfsd.ko 2023-08-25T04:27:00.348 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2 2023-08-25T04:27:00.348 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2/nilfs2.ko 2023-08-25T04:27:00.348 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls 2023-08-25T04:27:00.349 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-celtic.ko 2023-08-25T04:27:00.349 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-centeuro.ko 2023-08-25T04:27:00.349 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-croatian.ko 2023-08-25T04:27:00.349 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-cyrillic.ko 2023-08-25T04:27:00.350 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-gaelic.ko 2023-08-25T04:27:00.350 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-greek.ko 2023-08-25T04:27:00.350 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-iceland.ko 2023-08-25T04:27:00.351 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-inuit.ko 2023-08-25T04:27:00.351 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-roman.ko 2023-08-25T04:27:00.351 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-romanian.ko 2023-08-25T04:27:00.352 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-turkish.ko 2023-08-25T04:27:00.352 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1250.ko 2023-08-25T04:27:00.352 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1251.ko 2023-08-25T04:27:00.353 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1255.ko 2023-08-25T04:27:00.353 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp737.ko 2023-08-25T04:27:00.353 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp775.ko 2023-08-25T04:27:00.353 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp850.ko 2023-08-25T04:27:00.354 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp852.ko 2023-08-25T04:27:00.354 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp855.ko 2023-08-25T04:27:00.354 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp857.ko 2023-08-25T04:27:00.354 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp860.ko 2023-08-25T04:27:00.354 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp861.ko 2023-08-25T04:27:00.354 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp862.ko 2023-08-25T04:27:00.354 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp863.ko 2023-08-25T04:27:00.355 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp864.ko 2023-08-25T04:27:00.355 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp865.ko 2023-08-25T04:27:00.355 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp866.ko 2023-08-25T04:27:00.355 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp869.ko 2023-08-25T04:27:00.355 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp874.ko 2023-08-25T04:27:00.356 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp932.ko 2023-08-25T04:27:00.356 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp936.ko 2023-08-25T04:27:00.356 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp949.ko 2023-08-25T04:27:00.356 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp950.ko 2023-08-25T04:27:00.356 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_euc-jp.ko 2023-08-25T04:27:00.357 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-1.ko 2023-08-25T04:27:00.357 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-13.ko 2023-08-25T04:27:00.357 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-14.ko 2023-08-25T04:27:00.358 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-15.ko 2023-08-25T04:27:00.358 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-2.ko 2023-08-25T04:27:00.358 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-3.ko 2023-08-25T04:27:00.359 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-4.ko 2023-08-25T04:27:00.359 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-5.ko 2023-08-25T04:27:00.359 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-6.ko 2023-08-25T04:27:00.360 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-7.ko 2023-08-25T04:27:00.368 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-9.ko 2023-08-25T04:27:00.369 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-r.ko 2023-08-25T04:27:00.376 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-ru.ko 2023-08-25T04:27:00.377 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-u.ko 2023-08-25T04:27:00.377 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_utf8.ko 2023-08-25T04:27:00.377 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2 2023-08-25T04:27:00.378 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster 2023-08-25T04:27:00.378 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-25T04:27:00.378 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm 2023-08-25T04:27:00.378 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-25T04:27:00.379 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs 2023-08-25T04:27:00.381 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-25T04:27:00.382 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2.ko 2023-08-25T04:27:00.382 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-25T04:27:00.382 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-25T04:27:00.384 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-25T04:27:00.384 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs 2023-08-25T04:27:00.384 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs/overlay.ko 2023-08-25T04:27:00.384 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore 2023-08-25T04:27:00.385 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore/ramoops.ko 2023-08-25T04:27:00.385 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs 2023-08-25T04:27:00.385 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs/reiserfs.ko 2023-08-25T04:27:00.386 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs 2023-08-25T04:27:00.386 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs/romfs.ko 2023-08-25T04:27:00.386 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb 2023-08-25T04:27:00.386 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client 2023-08-25T04:27:00.387 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client/cifs.ko 2023-08-25T04:27:00.387 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common 2023-08-25T04:27:00.387 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_arc4.ko 2023-08-25T04:27:00.387 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_md4.ko 2023-08-25T04:27:00.387 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs 2023-08-25T04:27:00.388 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs/squashfs.ko 2023-08-25T04:27:00.388 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv 2023-08-25T04:27:00.388 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv/sysv.ko 2023-08-25T04:27:00.388 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf 2023-08-25T04:27:00.388 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf/udf.ko 2023-08-25T04:27:00.388 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs 2023-08-25T04:27:00.388 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs/ufs.ko 2023-08-25T04:27:00.389 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs 2023-08-25T04:27:00.389 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs/xfs.ko 2023-08-25T04:27:00.389 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel 2023-08-25T04:27:00.389 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/rcu 2023-08-25T04:27:00.389 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/rcu/rcutorture.ko 2023-08-25T04:27:00.390 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/torture.ko 2023-08-25T04:27:00.390 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/trace 2023-08-25T04:27:00.390 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-25T04:27:00.390 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib 2023-08-25T04:27:00.390 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/asn1_encoder.ko 2023-08-25T04:27:00.390 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc-itu-t.ko 2023-08-25T04:27:00.390 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc8.ko 2023-08-25T04:27:00.390 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto 2023-08-25T04:27:00.391 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libarc4.ko 2023-08-25T04:27:00.391 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libdes.ko 2023-08-25T04:27:00.391 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/libcrc32c.ko 2023-08-25T04:27:00.391 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lru_cache.ko 2023-08-25T04:27:00.391 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4 2023-08-25T04:27:00.391 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4_compress.ko 2023-08-25T04:27:00.391 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4hc_compress.ko 2023-08-25T04:27:00.391 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math 2023-08-25T04:27:00.392 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math/cordic.ko 2023-08-25T04:27:00.392 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6 2023-08-25T04:27:00.392 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6/raid6_pq.ko 2023-08-25T04:27:00.392 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon 2023-08-25T04:27:00.392 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-25T04:27:00.392 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_bm.ko 2023-08-25T04:27:00.392 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_fsm.ko 2023-08-25T04:27:00.393 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_kmp.ko 2023-08-25T04:27:00.393 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/zstd 2023-08-25T04:27:00.393 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/zstd/zstd_compress.ko 2023-08-25T04:27:00.393 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm 2023-08-25T04:27:00.393 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm/hwpoison-inject.ko 2023-08-25T04:27:00.394 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net 2023-08-25T04:27:00.394 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan 2023-08-25T04:27:00.394 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/6lowpan.ko 2023-08-25T04:27:00.394 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_dest.ko 2023-08-25T04:27:00.394 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_fragment.ko 2023-08-25T04:27:00.395 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_hop.ko 2023-08-25T04:27:00.395 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-25T04:27:00.395 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_mobility.ko 2023-08-25T04:27:00.395 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_routing.ko 2023-08-25T04:27:00.395 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_udp.ko 2023-08-25T04:27:00.395 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802 2023-08-25T04:27:00.395 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/garp.ko 2023-08-25T04:27:00.395 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/mrp.ko 2023-08-25T04:27:00.396 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/p8022.ko 2023-08-25T04:27:00.396 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/psnap.ko 2023-08-25T04:27:00.396 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/stp.ko 2023-08-25T04:27:00.396 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q 2023-08-25T04:27:00.396 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q/8021q.ko 2023-08-25T04:27:00.396 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p 2023-08-25T04:27:00.396 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet.ko 2023-08-25T04:27:00.397 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_fd.ko 2023-08-25T04:27:00.397 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_rdma.ko 2023-08-25T04:27:00.397 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_virtio.ko 2023-08-25T04:27:00.397 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv 2023-08-25T04:27:00.397 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv/batman-adv.ko 2023-08-25T04:27:00.397 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge 2023-08-25T04:27:00.397 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/br_netfilter.ko 2023-08-25T04:27:00.397 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/bridge.ko 2023-08-25T04:27:00.398 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter 2023-08-25T04:27:00.398 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-25T04:27:00.398 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-25T04:27:00.398 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-25T04:27:00.398 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-25T04:27:00.398 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-25T04:27:00.398 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-25T04:27:00.399 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-25T04:27:00.399 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-25T04:27:00.399 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-25T04:27:00.399 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-25T04:27:00.399 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-25T04:27:00.399 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-25T04:27:00.399 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-25T04:27:00.399 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-25T04:27:00.400 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-25T04:27:00.400 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-25T04:27:00.400 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-25T04:27:00.400 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-25T04:27:00.402 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-25T04:27:00.402 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-25T04:27:00.403 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtables.ko 2023-08-25T04:27:00.403 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-25T04:27:00.403 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-25T04:27:00.403 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-25T04:27:00.404 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph 2023-08-25T04:27:00.405 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph/libceph.ko 2023-08-25T04:27:00.406 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core 2023-08-25T04:27:00.408 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/failover.ko 2023-08-25T04:27:00.409 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/pktgen.ko 2023-08-25T04:27:00.412 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp 2023-08-25T04:27:00.413 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp.ko 2023-08-25T04:27:00.414 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_diag.ko 2023-08-25T04:27:00.415 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv4.ko 2023-08-25T04:27:00.415 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv6.ko 2023-08-25T04:27:00.416 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dns_resolver 2023-08-25T04:27:00.420 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dns_resolver/dns_resolver.ko 2023-08-25T04:27:00.420 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa 2023-08-25T04:27:00.420 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/dsa_core.ko 2023-08-25T04:27:00.421 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_brcm.ko 2023-08-25T04:27:00.421 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_dsa.ko 2023-08-25T04:27:00.421 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_none.ko 2023-08-25T04:27:00.421 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_trailer.ko 2023-08-25T04:27:00.421 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154 2023-08-25T04:27:00.421 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan 2023-08-25T04:27:00.421 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-25T04:27:00.422 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154.ko 2023-08-25T04:27:00.422 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-25T04:27:00.422 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4 2023-08-25T04:27:00.422 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ah4.ko 2023-08-25T04:27:00.422 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/esp4.ko 2023-08-25T04:27:00.422 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/fou.ko 2023-08-25T04:27:00.423 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/gre.ko 2023-08-25T04:27:00.423 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/inet_diag.ko 2023-08-25T04:27:00.424 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_gre.ko 2023-08-25T04:27:00.424 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_tunnel.ko 2023-08-25T04:27:00.424 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_vti.ko 2023-08-25T04:27:00.425 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipcomp.ko 2023-08-25T04:27:00.425 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipip.ko 2023-08-25T04:27:00.425 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter 2023-08-25T04:27:00.425 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-25T04:27:00.425 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-25T04:27:00.425 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-25T04:27:00.425 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-25T04:27:00.426 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-25T04:27:00.426 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-25T04:27:00.426 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-25T04:27:00.426 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-25T04:27:00.426 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-25T04:27:00.426 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-25T04:27:00.427 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-25T04:27:00.427 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-25T04:27:00.428 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-25T04:27:00.428 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-25T04:27:00.428 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-25T04:27:00.428 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-25T04:27:00.428 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-25T04:27:00.429 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-25T04:27:00.429 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-25T04:27:00.429 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-25T04:27:00.429 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-25T04:27:00.429 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_bic.ko 2023-08-25T04:27:00.429 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_dctcp.ko 2023-08-25T04:27:00.429 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_diag.ko 2023-08-25T04:27:00.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_highspeed.ko 2023-08-25T04:27:00.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_htcp.ko 2023-08-25T04:27:00.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_hybla.ko 2023-08-25T04:27:00.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_illinois.ko 2023-08-25T04:27:00.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_lp.ko 2023-08-25T04:27:00.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_scalable.ko 2023-08-25T04:27:00.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_vegas.ko 2023-08-25T04:27:00.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_veno.ko 2023-08-25T04:27:00.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_westwood.ko 2023-08-25T04:27:00.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_yeah.ko 2023-08-25T04:27:00.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tunnel4.ko 2023-08-25T04:27:00.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_diag.ko 2023-08-25T04:27:00.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_tunnel.ko 2023-08-25T04:27:00.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-25T04:27:00.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6 2023-08-25T04:27:00.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ah6.ko 2023-08-25T04:27:00.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/esp6.ko 2023-08-25T04:27:00.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/fou6.ko 2023-08-25T04:27:00.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_tunnel.ko 2023-08-25T04:27:00.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-25T04:27:00.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_vti.ko 2023-08-25T04:27:00.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ipcomp6.ko 2023-08-25T04:27:00.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter 2023-08-25T04:27:00.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-25T04:27:00.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-25T04:27:00.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-25T04:27:00.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-25T04:27:00.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-25T04:27:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-25T04:27:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-25T04:27:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-25T04:27:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-25T04:27:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-25T04:27:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-25T04:27:00.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-25T04:27:00.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-25T04:27:00.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-25T04:27:00.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-25T04:27:00.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-25T04:27:00.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-25T04:27:00.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-25T04:27:00.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-25T04:27:00.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-25T04:27:00.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-25T04:27:00.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-25T04:27:00.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-25T04:27:00.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-25T04:27:00.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/sit.ko 2023-08-25T04:27:00.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/tunnel6.ko 2023-08-25T04:27:00.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-25T04:27:00.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key 2023-08-25T04:27:00.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key/af_key.ko 2023-08-25T04:27:00.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp 2023-08-25T04:27:00.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_core.ko 2023-08-25T04:27:00.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-25T04:27:00.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_eth.ko 2023-08-25T04:27:00.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip.ko 2023-08-25T04:27:00.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip6.ko 2023-08-25T04:27:00.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_netlink.ko 2023-08-25T04:27:00.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ppp.ko 2023-08-25T04:27:00.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc 2023-08-25T04:27:00.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/llc.ko 2023-08-25T04:27:00.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154 2023-08-25T04:27:00.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154/mac802154.ko 2023-08-25T04:27:00.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls 2023-08-25T04:27:00.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls/mpls_gso.ko 2023-08-25T04:27:00.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter 2023-08-25T04:27:00.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset 2023-08-25T04:27:00.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set.ko 2023-08-25T04:27:00.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-25T04:27:00.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-25T04:27:00.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-25T04:27:00.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-25T04:27:00.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-25T04:27:00.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-25T04:27:00.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-25T04:27:00.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-25T04:27:00.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-25T04:27:00.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-25T04:27:00.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-25T04:27:00.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-25T04:27:00.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-25T04:27:00.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-25T04:27:00.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-25T04:27:00.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs 2023-08-25T04:27:00.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-25T04:27:00.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-25T04:27:00.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-25T04:27:00.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-25T04:27:00.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-25T04:27:00.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-25T04:27:00.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-25T04:27:00.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-25T04:27:00.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-25T04:27:00.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-25T04:27:00.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-25T04:27:00.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-25T04:27:00.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-25T04:27:00.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-25T04:27:00.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conncount.ko 2023-08-25T04:27:00.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack.ko 2023-08-25T04:27:00.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-25T04:27:00.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-25T04:27:00.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-25T04:27:00.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-25T04:27:00.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-25T04:27:00.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-25T04:27:00.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-25T04:27:00.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-25T04:27:00.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-25T04:27:00.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-25T04:27:00.448 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-25T04:27:00.448 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-25T04:27:00.448 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-25T04:27:00.448 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table.ko 2023-08-25T04:27:00.448 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-25T04:27:00.448 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_log_syslog.ko 2023-08-25T04:27:00.448 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat.ko 2023-08-25T04:27:00.449 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-25T04:27:00.449 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-25T04:27:00.449 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_irc.ko 2023-08-25T04:27:00.449 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_sip.ko 2023-08-25T04:27:00.449 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-25T04:27:00.449 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-25T04:27:00.449 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_tables.ko 2023-08-25T04:27:00.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink.ko 2023-08-25T04:27:00.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-25T04:27:00.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_log.ko 2023-08-25T04:27:00.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-25T04:27:00.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-25T04:27:00.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_chain_nat.ko 2023-08-25T04:27:00.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_compat.ko 2023-08-25T04:27:00.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_ct.ko 2023-08-25T04:27:00.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-25T04:27:00.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fib.ko 2023-08-25T04:27:00.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-25T04:27:00.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_hash.ko 2023-08-25T04:27:00.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_limit.ko 2023-08-25T04:27:00.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_log.ko 2023-08-25T04:27:00.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_masq.ko 2023-08-25T04:27:00.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_nat.ko 2023-08-25T04:27:00.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_numgen.ko 2023-08-25T04:27:00.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_queue.ko 2023-08-25T04:27:00.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_quota.ko 2023-08-25T04:27:00.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_redir.ko 2023-08-25T04:27:00.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject.ko 2023-08-25T04:27:00.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject_inet.ko 2023-08-25T04:27:00.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_socket.ko 2023-08-25T04:27:00.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_tunnel.ko 2023-08-25T04:27:00.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_AUDIT.ko 2023-08-25T04:27:00.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-25T04:27:00.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-25T04:27:00.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-25T04:27:00.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CT.ko 2023-08-25T04:27:00.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_DSCP.ko 2023-08-25T04:27:00.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HL.ko 2023-08-25T04:27:00.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HMARK.ko 2023-08-25T04:27:00.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-25T04:27:00.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LED.ko 2023-08-25T04:27:00.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LOG.ko 2023-08-25T04:27:00.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-25T04:27:00.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NETMAP.ko 2023-08-25T04:27:00.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFLOG.ko 2023-08-25T04:27:00.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-25T04:27:00.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_RATEEST.ko 2023-08-25T04:27:00.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-25T04:27:00.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_SECMARK.ko 2023-08-25T04:27:00.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-25T04:27:00.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-25T04:27:00.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TEE.ko 2023-08-25T04:27:00.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TPROXY.ko 2023-08-25T04:27:00.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TRACE.ko 2023-08-25T04:27:00.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_addrtype.ko 2023-08-25T04:27:00.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_bpf.ko 2023-08-25T04:27:00.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cgroup.ko 2023-08-25T04:27:00.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cluster.ko 2023-08-25T04:27:00.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_comment.ko 2023-08-25T04:27:00.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connbytes.ko 2023-08-25T04:27:00.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlabel.ko 2023-08-25T04:27:00.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlimit.ko 2023-08-25T04:27:00.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connmark.ko 2023-08-25T04:27:00.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_conntrack.ko 2023-08-25T04:27:00.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cpu.ko 2023-08-25T04:27:00.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dccp.ko 2023-08-25T04:27:00.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_devgroup.ko 2023-08-25T04:27:00.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dscp.ko 2023-08-25T04:27:00.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ecn.ko 2023-08-25T04:27:00.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_esp.ko 2023-08-25T04:27:00.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hashlimit.ko 2023-08-25T04:27:00.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_helper.ko 2023-08-25T04:27:00.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hl.ko 2023-08-25T04:27:00.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipcomp.ko 2023-08-25T04:27:00.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_iprange.ko 2023-08-25T04:27:00.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipvs.ko 2023-08-25T04:27:00.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_l2tp.ko 2023-08-25T04:27:00.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_length.ko 2023-08-25T04:27:00.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_limit.ko 2023-08-25T04:27:00.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mac.ko 2023-08-25T04:27:00.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mark.ko 2023-08-25T04:27:00.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_multiport.ko 2023-08-25T04:27:00.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nat.ko 2023-08-25T04:27:00.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nfacct.ko 2023-08-25T04:27:00.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_osf.ko 2023-08-25T04:27:00.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_owner.ko 2023-08-25T04:27:00.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_physdev.ko 2023-08-25T04:27:00.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_pkttype.ko 2023-08-25T04:27:00.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_policy.ko 2023-08-25T04:27:00.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_quota.ko 2023-08-25T04:27:00.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_rateest.ko 2023-08-25T04:27:00.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_realm.ko 2023-08-25T04:27:00.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_recent.ko 2023-08-25T04:27:00.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_sctp.ko 2023-08-25T04:27:00.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_set.ko 2023-08-25T04:27:00.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_socket.ko 2023-08-25T04:27:00.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_state.ko 2023-08-25T04:27:00.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_statistic.ko 2023-08-25T04:27:00.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_string.ko 2023-08-25T04:27:00.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_tcpmss.ko 2023-08-25T04:27:00.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_time.ko 2023-08-25T04:27:00.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_u32.ko 2023-08-25T04:27:00.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink 2023-08-25T04:27:00.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink/netlink_diag.ko 2023-08-25T04:27:00.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh 2023-08-25T04:27:00.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh/nsh.ko 2023-08-25T04:27:00.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch 2023-08-25T04:27:00.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/openvswitch.ko 2023-08-25T04:27:00.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-geneve.ko 2023-08-25T04:27:00.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-gre.ko 2023-08-25T04:27:00.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-vxlan.ko 2023-08-25T04:27:00.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet 2023-08-25T04:27:00.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet/af_packet_diag.ko 2023-08-25T04:27:00.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds 2023-08-25T04:27:00.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds.ko 2023-08-25T04:27:00.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_rdma.ko 2023-08-25T04:27:00.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_tcp.ko 2023-08-25T04:27:00.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched 2023-08-25T04:27:00.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_csum.ko 2023-08-25T04:27:00.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_gact.ko 2023-08-25T04:27:00.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_ipt.ko 2023-08-25T04:27:00.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_mirred.ko 2023-08-25T04:27:00.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_nat.ko 2023-08-25T04:27:00.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_pedit.ko 2023-08-25T04:27:00.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_police.ko 2023-08-25T04:27:00.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_simple.ko 2023-08-25T04:27:00.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_skbedit.ko 2023-08-25T04:27:00.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_vlan.ko 2023-08-25T04:27:00.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_basic.ko 2023-08-25T04:27:00.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_bpf.ko 2023-08-25T04:27:00.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_flow.ko 2023-08-25T04:27:00.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_fw.ko 2023-08-25T04:27:00.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_route.ko 2023-08-25T04:27:00.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_u32.ko 2023-08-25T04:27:00.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_cmp.ko 2023-08-25T04:27:00.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_ipset.ko 2023-08-25T04:27:00.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_meta.ko 2023-08-25T04:27:00.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_nbyte.ko 2023-08-25T04:27:00.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_text.ko 2023-08-25T04:27:00.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_u32.ko 2023-08-25T04:27:00.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_choke.ko 2023-08-25T04:27:00.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_codel.ko 2023-08-25T04:27:00.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_drr.ko 2023-08-25T04:27:00.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_fq.ko 2023-08-25T04:27:00.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_gred.ko 2023-08-25T04:27:00.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hfsc.ko 2023-08-25T04:27:00.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hhf.ko 2023-08-25T04:27:00.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_htb.ko 2023-08-25T04:27:00.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_ingress.ko 2023-08-25T04:27:00.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio.ko 2023-08-25T04:27:00.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio_lib.ko 2023-08-25T04:27:00.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_multiq.ko 2023-08-25T04:27:00.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_netem.ko 2023-08-25T04:27:00.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_pie.ko 2023-08-25T04:27:00.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_plug.ko 2023-08-25T04:27:00.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_prio.ko 2023-08-25T04:27:00.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_qfq.ko 2023-08-25T04:27:00.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_red.ko 2023-08-25T04:27:00.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfb.ko 2023-08-25T04:27:00.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfq.ko 2023-08-25T04:27:00.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_tbf.ko 2023-08-25T04:27:00.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_teql.ko 2023-08-25T04:27:00.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp 2023-08-25T04:27:00.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp.ko 2023-08-25T04:27:00.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp_diag.ko 2023-08-25T04:27:00.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc 2023-08-25T04:27:00.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss 2023-08-25T04:27:00.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-25T04:27:00.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-25T04:27:00.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/sunrpc.ko 2023-08-25T04:27:00.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma 2023-08-25T04:27:00.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-25T04:27:00.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc 2023-08-25T04:27:00.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/diag.ko 2023-08-25T04:27:00.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/tipc.ko 2023-08-25T04:27:00.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix 2023-08-25T04:27:00.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix/unix_diag.ko 2023-08-25T04:27:00.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock 2023-08-25T04:27:00.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-25T04:27:00.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-25T04:27:00.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock.ko 2023-08-25T04:27:00.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-25T04:27:00.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-25T04:27:00.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm 2023-08-25T04:27:00.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-25T04:27:00.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security 2023-08-25T04:27:00.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys 2023-08-25T04:27:00.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/encrypted-keys 2023-08-25T04:27:00.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-25T04:27:00.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/trusted-keys 2023-08-25T04:27:00.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/trusted-keys/trusted.ko 2023-08-25T04:27:00.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt 2023-08-25T04:27:00.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib 2023-08-25T04:27:00.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib/irqbypass.ko 2023-08-25T04:27:00.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.alias 2023-08-25T04:27:00.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.alias.bin 2023-08-25T04:27:00.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin 2023-08-25T04:27:00.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.bin 2023-08-25T04:27:00.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.modinfo 2023-08-25T04:27:00.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.dep 2023-08-25T04:27:00.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.dep.bin 2023-08-25T04:27:00.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.devname 2023-08-25T04:27:00.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.order 2023-08-25T04:27:00.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.softdep 2023-08-25T04:27:00.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols 2023-08-25T04:27:00.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols.bin 2023-08-25T04:27:00.482 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-ga6a696707610 2023-08-25T04:27:00.483 DEBUG:teuthology.orchestra.run.smithi137:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-25T04:27:00.515 INFO:teuthology.orchestra.run.smithi137.stdout:postinstall scriptlet (using /bin/sh): 2023-08-25T04:27:00.516 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-ga6a696707610 -a -r /boot/System.map-6.5.0-rc7-ga6a696707610 ]; then 2023-08-25T04:27:00.516 INFO:teuthology.orchestra.run.smithi137.stdout:cp /boot/vmlinuz-6.5.0-rc7-ga6a696707610 /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T04:27:00.516 INFO:teuthology.orchestra.run.smithi137.stdout:cp /boot/System.map-6.5.0-rc7-ga6a696707610 /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T04:27:00.516 INFO:teuthology.orchestra.run.smithi137.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-ga6a696707610 /boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-25T04:27:00.517 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/installkernel 6.5.0-rc7-ga6a696707610 /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T04:27:00.517 INFO:teuthology.orchestra.run.smithi137.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T04:27:00.517 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2023-08-25T04:27:00.517 INFO:teuthology.orchestra.run.smithi137.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-25T04:27:00.517 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-25T04:27:00.517 INFO:teuthology.orchestra.run.smithi137.stdout:new-kernel-pkg --remove 6.5.0-rc7-ga6a696707610 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-ga6a696707610.img 2023-08-25T04:27:00.517 INFO:teuthology.orchestra.run.smithi137.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-25T04:27:00.518 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-install remove 6.5.0-rc7-ga6a696707610 2023-08-25T04:27:00.518 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2023-08-25T04:27:00.518 INFO:teuthology.orchestra.run.smithi137.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-25T04:27:00.518 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-25T04:27:00.518 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-ga6a696707610 2023-08-25T04:27:00.519 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2023-08-25T04:27:00.519 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2023-08-25T04:27:00.595 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2023-08-25T04:27:00.595 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2023-08-25T04:27:00.595 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.02 2023-08-25T04:27:00.596 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 129.el8 2023-08-25T04:27:00.596 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2023-08-25T04:27:00.596 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-25T04:27:00.596 INFO:teuthology.orchestra.run.smithi137.stdout:Group : System Environment/Base 2023-08-25T04:27:00.596 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 9265586 2023-08-25T04:27:00.596 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2023-08-25T04:27:00.597 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-25T04:27:00.598 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-25T04:27:00.598 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-25T04:27:00.598 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-25T04:27:00.598 INFO:teuthology.orchestra.run.smithi137.stdout:Relocations : (not relocatable) 2023-08-25T04:27:00.598 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : CentOS BuildSystem 2023-08-25T04:27:00.598 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2023-08-25T04:27:00.598 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-25T04:27:00.599 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2023-08-25T04:27:00.599 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2023-08-25T04:27:00.599 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:27:00.599 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-25T04:27:00.599 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-25T04:27:00.599 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-25T04:27:00.599 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2023-08-25T04:27:00.599 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:27:00.600 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2023-08-25T04:27:00.601 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-25T04:27:00.601 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 6.5.0-rc7-ga6a696707610 2023-08-25T04:27:00.601 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-25T04:27:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2023-08-25T04:27:06.877 INFO:teuthology.orchestra.run.smithi137.stderr:done 2023-08-25T04:27:06.879 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2023-08-25T04:27:06.904 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.C7ojKlAjNy 2023-08-25T04:27:06.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.C7ojKlAjNy 2023-08-25T04:27:06.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.C7ojKlAjNy 2023-08-25T04:27:07.096 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.C7ojKlAjNy is 6KB 2023-08-25T04:27:07.146 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.C7ojKlAjNy 2023-08-25T04:27:07.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2023-08-25T04:27:07.238 INFO:teuthology.orchestra.run.smithi137.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-25T04:27:07.238 INFO:teuthology.orchestra.run.smithi137.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-25T04:27:07.238 INFO:teuthology.orchestra.run.smithi137.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-25T04:27:07.238 INFO:teuthology.orchestra.run.smithi137.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-ga6a696707610.conf 2023-08-25T04:27:07.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-ga6a696707610 2023-08-25T04:27:07.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2023-08-25T04:27:35.605 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-25T04:27:35.606 DEBUG:teuthology.orchestra.run.smithi072:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-25T04:27:35.694 INFO:teuthology.orchestra.run.smithi072.stdout:/boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-25T04:27:35.695 INFO:teuthology.orchestra.run.smithi072.stdout:/boot/config-6.5.0-rc7-ga6a696707610 2023-08-25T04:27:35.695 INFO:teuthology.orchestra.run.smithi072.stdout:/boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-25T04:27:35.695 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610 2023-08-25T04:27:35.695 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel 2023-08-25T04:27:35.695 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch 2023-08-25T04:27:35.696 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86 2023-08-25T04:27:35.696 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto 2023-08-25T04:27:35.696 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-25T04:27:35.696 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-25T04:27:35.696 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-25T04:27:35.696 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-25T04:27:35.696 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-25T04:27:35.697 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-25T04:27:35.697 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-25T04:27:35.697 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-25T04:27:35.697 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-25T04:27:35.697 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-25T04:27:35.697 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-25T04:27:35.697 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-25T04:27:35.698 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-25T04:27:35.698 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-25T04:27:35.698 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-25T04:27:35.698 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-25T04:27:35.698 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-25T04:27:35.698 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-25T04:27:35.698 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-25T04:27:35.699 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-25T04:27:35.699 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel 2023-08-25T04:27:35.699 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu 2023-08-25T04:27:35.699 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce 2023-08-25T04:27:35.699 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-25T04:27:35.699 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm 2023-08-25T04:27:35.699 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-25T04:27:35.699 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-25T04:27:35.700 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm.ko 2023-08-25T04:27:35.700 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto 2023-08-25T04:27:35.700 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ansi_cprng.ko 2023-08-25T04:27:35.700 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/anubis.ko 2023-08-25T04:27:35.700 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/arc4.ko 2023-08-25T04:27:35.700 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx 2023-08-25T04:27:35.700 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_memcpy.ko 2023-08-25T04:27:35.701 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_pq.ko 2023-08-25T04:27:35.701 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-25T04:27:35.701 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_tx.ko 2023-08-25T04:27:35.701 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_xor.ko 2023-08-25T04:27:35.701 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/raid6test.ko 2023-08-25T04:27:35.701 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authenc.ko 2023-08-25T04:27:35.701 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authencesn.ko 2023-08-25T04:27:35.702 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blake2b_generic.ko 2023-08-25T04:27:35.702 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_common.ko 2023-08-25T04:27:35.702 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_generic.ko 2023-08-25T04:27:35.702 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/camellia_generic.ko 2023-08-25T04:27:35.702 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast5_generic.ko 2023-08-25T04:27:35.702 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast6_generic.ko 2023-08-25T04:27:35.702 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast_common.ko 2023-08-25T04:27:35.703 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ccm.ko 2023-08-25T04:27:35.703 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cmac.ko 2023-08-25T04:27:35.703 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crc32_generic.ko 2023-08-25T04:27:35.703 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_engine.ko 2023-08-25T04:27:35.703 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_user.ko 2023-08-25T04:27:35.703 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cts.ko 2023-08-25T04:27:35.703 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/des_generic.ko 2023-08-25T04:27:35.704 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/dh_generic.ko 2023-08-25T04:27:35.704 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/echainiv.ko 2023-08-25T04:27:35.704 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/essiv.ko 2023-08-25T04:27:35.704 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/fcrypt.ko 2023-08-25T04:27:35.704 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/khazad.ko 2023-08-25T04:27:35.704 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4.ko 2023-08-25T04:27:35.704 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4hc.ko 2023-08-25T04:27:35.704 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/md4.ko 2023-08-25T04:27:35.705 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/michael_mic.ko 2023-08-25T04:27:35.705 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcbc.ko 2023-08-25T04:27:35.705 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcrypt.ko 2023-08-25T04:27:35.705 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/rmd160.ko 2023-08-25T04:27:35.705 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/seed.ko 2023-08-25T04:27:35.705 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/serpent_generic.ko 2023-08-25T04:27:35.705 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tcrypt.ko 2023-08-25T04:27:35.706 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tea.ko 2023-08-25T04:27:35.706 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_common.ko 2023-08-25T04:27:35.706 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_generic.ko 2023-08-25T04:27:35.706 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/vmac.ko 2023-08-25T04:27:35.706 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/wp512.ko 2023-08-25T04:27:35.706 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xcbc.ko 2023-08-25T04:27:35.706 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xor.ko 2023-08-25T04:27:35.706 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xxhash_generic.ko 2023-08-25T04:27:35.707 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers 2023-08-25T04:27:35.707 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi 2023-08-25T04:27:35.707 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-25T04:27:35.707 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_pad.ko 2023-08-25T04:27:35.707 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/custom_method.ko 2023-08-25T04:27:35.707 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/ec_sys.ko 2023-08-25T04:27:35.707 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/platform_profile.ko 2023-08-25T04:27:35.708 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbs.ko 2023-08-25T04:27:35.708 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbshc.ko 2023-08-25T04:27:35.708 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/video.ko 2023-08-25T04:27:35.708 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata 2023-08-25T04:27:35.708 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/acard-ahci.ko 2023-08-25T04:27:35.708 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ahci_platform.ko 2023-08-25T04:27:35.708 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ata_generic.ko 2023-08-25T04:27:35.708 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/libahci_platform.ko 2023-08-25T04:27:35.709 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_acpi.ko 2023-08-25T04:27:35.709 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ali.ko 2023-08-25T04:27:35.709 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_amd.ko 2023-08-25T04:27:35.709 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_artop.ko 2023-08-25T04:27:35.709 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atiixp.ko 2023-08-25T04:27:35.709 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atp867x.ko 2023-08-25T04:27:35.709 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd640.ko 2023-08-25T04:27:35.710 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd64x.ko 2023-08-25T04:27:35.710 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cypress.ko 2023-08-25T04:27:35.710 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_efar.ko 2023-08-25T04:27:35.710 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt366.ko 2023-08-25T04:27:35.710 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt37x.ko 2023-08-25T04:27:35.710 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-25T04:27:35.710 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-25T04:27:35.711 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it8213.ko 2023-08-25T04:27:35.711 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it821x.ko 2023-08-25T04:27:35.711 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_jmicron.ko 2023-08-25T04:27:35.711 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_marvell.ko 2023-08-25T04:27:35.711 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_mpiix.ko 2023-08-25T04:27:35.711 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_netcell.ko 2023-08-25T04:27:35.711 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ninja32.ko 2023-08-25T04:27:35.711 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87410.ko 2023-08-25T04:27:35.712 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87415.ko 2023-08-25T04:27:35.712 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_oldpiix.ko 2023-08-25T04:27:35.712 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_opti.ko 2023-08-25T04:27:35.712 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_optidma.ko 2023-08-25T04:27:35.712 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pcmcia.ko 2023-08-25T04:27:35.712 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-25T04:27:35.712 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-25T04:27:35.713 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_piccolo.ko 2023-08-25T04:27:35.713 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_rdc.ko 2023-08-25T04:27:35.713 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sch.ko 2023-08-25T04:27:35.713 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_serverworks.ko 2023-08-25T04:27:35.713 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sil680.ko 2023-08-25T04:27:35.713 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sis.ko 2023-08-25T04:27:35.713 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sl82c105.ko 2023-08-25T04:27:35.715 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_triflex.ko 2023-08-25T04:27:35.715 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_via.ko 2023-08-25T04:27:35.716 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pdc_adma.ko 2023-08-25T04:27:35.716 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_inic162x.ko 2023-08-25T04:27:35.716 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_mv.ko 2023-08-25T04:27:35.717 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_nv.ko 2023-08-25T04:27:35.717 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_promise.ko 2023-08-25T04:27:35.717 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_qstor.ko 2023-08-25T04:27:35.717 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil.ko 2023-08-25T04:27:35.717 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil24.ko 2023-08-25T04:27:35.717 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sis.ko 2023-08-25T04:27:35.718 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_svw.ko 2023-08-25T04:27:35.718 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sx4.ko 2023-08-25T04:27:35.719 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_uli.ko 2023-08-25T04:27:35.719 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_via.ko 2023-08-25T04:27:35.721 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_vsc.ko 2023-08-25T04:27:35.722 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay 2023-08-25T04:27:35.722 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay/ks0108.ko 2023-08-25T04:27:35.722 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base 2023-08-25T04:27:35.722 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap 2023-08-25T04:27:35.722 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-25T04:27:35.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-25T04:27:35.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma 2023-08-25T04:27:35.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma/bcma.ko 2023-08-25T04:27:35.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block 2023-08-25T04:27:35.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe 2023-08-25T04:27:35.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe/aoe.ko 2023-08-25T04:27:35.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/brd.ko 2023-08-25T04:27:35.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd 2023-08-25T04:27:35.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd/drbd.ko 2023-08-25T04:27:35.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/floppy.ko 2023-08-25T04:27:35.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/loop.ko 2023-08-25T04:27:35.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx 2023-08-25T04:27:35.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-25T04:27:35.727 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/nbd.ko 2023-08-25T04:27:35.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk 2023-08-25T04:27:35.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk/null_blk.ko 2023-08-25T04:27:35.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/pktcdvd.ko 2023-08-25T04:27:35.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/rbd.ko 2023-08-25T04:27:35.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/virtio_blk.ko 2023-08-25T04:27:35.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback 2023-08-25T04:27:35.729 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-25T04:27:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkfront.ko 2023-08-25T04:27:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram 2023-08-25T04:27:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram/zram.ko 2023-08-25T04:27:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char 2023-08-25T04:27:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hangcheck-timer.ko 2023-08-25T04:27:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random 2023-08-25T04:27:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-25T04:27:35.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-25T04:27:35.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-25T04:27:35.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/via-rng.ko 2023-08-25T04:27:35.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-25T04:27:35.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi 2023-08-25T04:27:35.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-25T04:27:35.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-25T04:27:35.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-25T04:27:35.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-25T04:27:35.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-25T04:27:35.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-25T04:27:35.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/lp.ko 2023-08-25T04:27:35.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave 2023-08-25T04:27:35.733 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave/mwave.ko 2023-08-25T04:27:35.733 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ppdev.ko 2023-08-25T04:27:35.733 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tlclk.ko 2023-08-25T04:27:35.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm 2023-08-25T04:27:35.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm.ko 2023-08-25T04:27:35.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-25T04:27:35.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-25T04:27:35.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-25T04:27:35.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-25T04:27:35.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-25T04:27:35.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/uv_mmtimer.ko 2023-08-25T04:27:35.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/virtio_console.ko 2023-08-25T04:27:35.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq 2023-08-25T04:27:35.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-25T04:27:35.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-25T04:27:35.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-25T04:27:35.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-25T04:27:35.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-25T04:27:35.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-25T04:27:35.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto 2023-08-25T04:27:35.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp 2023-08-25T04:27:35.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-25T04:27:35.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp.ko 2023-08-25T04:27:35.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel 2023-08-25T04:27:35.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat 2023-08-25T04:27:35.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common 2023-08-25T04:27:35.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-25T04:27:35.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-25T04:27:35.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-25T04:27:35.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-aes.ko 2023-08-25T04:27:35.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-sha.ko 2023-08-25T04:27:35.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio 2023-08-25T04:27:35.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-25T04:27:35.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca 2023-08-25T04:27:35.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca/dca.ko 2023-08-25T04:27:35.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/devfreq 2023-08-25T04:27:35.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-25T04:27:35.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma 2023-08-25T04:27:35.739 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw 2023-08-25T04:27:35.739 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-25T04:27:35.739 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat 2023-08-25T04:27:35.739 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-25T04:27:35.739 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac 2023-08-25T04:27:35.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/amd64_edac.ko 2023-08-25T04:27:35.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/e752x_edac.ko 2023-08-25T04:27:35.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/edac_mce_amd.ko 2023-08-25T04:27:35.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3000_edac.ko 2023-08-25T04:27:35.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3200_edac.ko 2023-08-25T04:27:35.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5100_edac.ko 2023-08-25T04:27:35.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5400_edac.ko 2023-08-25T04:27:35.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7300_edac.ko 2023-08-25T04:27:35.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7core_edac.ko 2023-08-25T04:27:35.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i82975x_edac.ko 2023-08-25T04:27:35.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/ie31200_edac.ko 2023-08-25T04:27:35.742 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/sb_edac.ko 2023-08-25T04:27:35.742 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/x38_edac.ko 2023-08-25T04:27:35.742 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware 2023-08-25T04:27:35.742 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/edd.ko 2023-08-25T04:27:35.742 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-25T04:27:35.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio 2023-08-25T04:27:35.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-ich.ko 2023-08-25T04:27:35.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-25T04:27:35.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid 2023-08-25T04:27:35.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-appleir.ko 2023-08-25T04:27:35.744 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-aureal.ko 2023-08-25T04:27:35.744 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-axff.ko 2023-08-25T04:27:35.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-dr.ko 2023-08-25T04:27:35.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elecom.ko 2023-08-25T04:27:35.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elo.ko 2023-08-25T04:27:35.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-emsff.ko 2023-08-25T04:27:35.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gaff.ko 2023-08-25T04:27:35.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gt683r.ko 2023-08-25T04:27:35.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gyration.ko 2023-08-25T04:27:35.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-25T04:27:35.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-25T04:27:35.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtekff.ko 2023-08-25T04:27:35.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-hyperv.ko 2023-08-25T04:27:35.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-icade.ko 2023-08-25T04:27:35.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-keytouch.ko 2023-08-25T04:27:35.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-kye.ko 2023-08-25T04:27:35.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lcpower.ko 2023-08-25T04:27:35.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-led.ko 2023-08-25T04:27:35.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lenovo.ko 2023-08-25T04:27:35.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-25T04:27:35.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-25T04:27:35.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-multitouch.ko 2023-08-25T04:27:35.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ortek.ko 2023-08-25T04:27:35.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-penmount.ko 2023-08-25T04:27:35.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-petalynx.ko 2023-08-25T04:27:35.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-picolcd.ko 2023-08-25T04:27:35.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-pl.ko 2023-08-25T04:27:35.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-plantronics.ko 2023-08-25T04:27:35.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-primax.ko 2023-08-25T04:27:35.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-rmi.ko 2023-08-25T04:27:35.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-25T04:27:35.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-common.ko 2023-08-25T04:27:35.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-25T04:27:35.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-25T04:27:35.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-25T04:27:35.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-25T04:27:35.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-25T04:27:35.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-25T04:27:35.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-25T04:27:35.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-25T04:27:35.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-25T04:27:35.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat.ko 2023-08-25T04:27:35.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-saitek.ko 2023-08-25T04:27:35.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-samsung.ko 2023-08-25T04:27:35.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-25T04:27:35.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sjoy.ko 2023-08-25T04:27:35.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sony.ko 2023-08-25T04:27:35.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-speedlink.ko 2023-08-25T04:27:35.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-steelseries.ko 2023-08-25T04:27:35.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sunplus.ko 2023-08-25T04:27:35.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-25T04:27:35.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tivo.ko 2023-08-25T04:27:35.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tmff.ko 2023-08-25T04:27:35.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-topseed.ko 2023-08-25T04:27:35.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-twinhan.ko 2023-08-25T04:27:35.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-uclogic.ko 2023-08-25T04:27:35.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-waltop.ko 2023-08-25T04:27:35.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-wiimote.ko 2023-08-25T04:27:35.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-xinmo.ko 2023-08-25T04:27:35.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zpff.ko 2023-08-25T04:27:35.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zydacron.ko 2023-08-25T04:27:35.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/uhid.ko 2023-08-25T04:27:35.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/wacom.ko 2023-08-25T04:27:35.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv 2023-08-25T04:27:35.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_balloon.ko 2023-08-25T04:27:35.754 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_utils.ko 2023-08-25T04:27:35.754 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_vmbus.ko 2023-08-25T04:27:35.754 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon 2023-08-25T04:27:35.755 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru.ko 2023-08-25T04:27:35.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru3.ko 2023-08-25T04:27:35.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-25T04:27:35.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7414.ko 2023-08-25T04:27:35.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7418.ko 2023-08-25T04:27:35.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adc128d818.ko 2023-08-25T04:27:35.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1025.ko 2023-08-25T04:27:35.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1026.ko 2023-08-25T04:27:35.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1029.ko 2023-08-25T04:27:35.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1031.ko 2023-08-25T04:27:35.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm9240.ko 2023-08-25T04:27:35.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ads7828.ko 2023-08-25T04:27:35.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7410.ko 2023-08-25T04:27:35.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7411.ko 2023-08-25T04:27:35.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7462.ko 2023-08-25T04:27:35.758 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7470.ko 2023-08-25T04:27:35.758 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7475.ko 2023-08-25T04:27:35.758 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7x10.ko 2023-08-25T04:27:35.758 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/amc6821.ko 2023-08-25T04:27:35.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/applesmc.ko 2023-08-25T04:27:35.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asb100.ko 2023-08-25T04:27:35.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asc7621.ko 2023-08-25T04:27:35.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-25T04:27:35.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/atxp1.ko 2023-08-25T04:27:35.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/coretemp.ko 2023-08-25T04:27:35.760 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-25T04:27:35.760 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dme1737.ko 2023-08-25T04:27:35.764 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds1621.ko 2023-08-25T04:27:35.764 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds620.ko 2023-08-25T04:27:35.764 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc1403.ko 2023-08-25T04:27:35.765 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc6w201.ko 2023-08-25T04:27:35.765 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71805f.ko 2023-08-25T04:27:35.765 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71882fg.ko 2023-08-25T04:27:35.765 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f75375s.ko 2023-08-25T04:27:35.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fam15h_power.ko 2023-08-25T04:27:35.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fschmd.ko 2023-08-25T04:27:35.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g760a.ko 2023-08-25T04:27:35.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g762.ko 2023-08-25T04:27:35.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl518sm.ko 2023-08-25T04:27:35.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl520sm.ko 2023-08-25T04:27:35.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-25T04:27:35.767 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5500_temp.ko 2023-08-25T04:27:35.770 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5k_amb.ko 2023-08-25T04:27:35.770 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmaem.ko 2023-08-25T04:27:35.770 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmpex.ko 2023-08-25T04:27:35.772 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina209.ko 2023-08-25T04:27:35.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina2xx.ko 2023-08-25T04:27:35.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/it87.ko 2023-08-25T04:27:35.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k10temp.ko 2023-08-25T04:27:35.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k8temp.ko 2023-08-25T04:27:35.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lineage-pem.ko 2023-08-25T04:27:35.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm63.ko 2023-08-25T04:27:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm73.ko 2023-08-25T04:27:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm75.ko 2023-08-25T04:27:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm77.ko 2023-08-25T04:27:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm78.ko 2023-08-25T04:27:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm80.ko 2023-08-25T04:27:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm83.ko 2023-08-25T04:27:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm85.ko 2023-08-25T04:27:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm87.ko 2023-08-25T04:27:35.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm90.ko 2023-08-25T04:27:35.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm92.ko 2023-08-25T04:27:35.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm93.ko 2023-08-25T04:27:35.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95234.ko 2023-08-25T04:27:35.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95241.ko 2023-08-25T04:27:35.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95245.ko 2023-08-25T04:27:35.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc2945.ko 2023-08-25T04:27:35.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4151.ko 2023-08-25T04:27:35.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4215.ko 2023-08-25T04:27:35.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4222.ko 2023-08-25T04:27:35.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4245.ko 2023-08-25T04:27:35.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4260.ko 2023-08-25T04:27:35.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4261.ko 2023-08-25T04:27:35.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max16065.ko 2023-08-25T04:27:35.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1619.ko 2023-08-25T04:27:35.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1668.ko 2023-08-25T04:27:35.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max197.ko 2023-08-25T04:27:35.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6639.ko 2023-08-25T04:27:35.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6650.ko 2023-08-25T04:27:35.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6697.ko 2023-08-25T04:27:35.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/mcp3021.ko 2023-08-25T04:27:35.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6683.ko 2023-08-25T04:27:35.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775-core.ko 2023-08-25T04:27:35.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775.ko 2023-08-25T04:27:35.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct7802.ko 2023-08-25T04:27:35.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87360.ko 2023-08-25T04:27:35.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87427.ko 2023-08-25T04:27:35.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pcf8591.ko 2023-08-25T04:27:35.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus 2023-08-25T04:27:35.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-25T04:27:35.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-25T04:27:35.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-25T04:27:35.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-25T04:27:35.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-25T04:27:35.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-25T04:27:35.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-25T04:27:35.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-25T04:27:35.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-25T04:27:35.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-25T04:27:35.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-25T04:27:35.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-25T04:27:35.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/powr1220.ko 2023-08-25T04:27:35.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5627.ko 2023-08-25T04:27:35.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5636.ko 2023-08-25T04:27:35.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-25T04:27:35.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht15.ko 2023-08-25T04:27:35.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht21.ko 2023-08-25T04:27:35.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/shtc1.ko 2023-08-25T04:27:35.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sis5595.ko 2023-08-25T04:27:35.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47b397.ko 2023-08-25T04:27:35.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m1.ko 2023-08-25T04:27:35.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m192.ko 2023-08-25T04:27:35.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/thmc50.ko 2023-08-25T04:27:35.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp102.ko 2023-08-25T04:27:35.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp103.ko 2023-08-25T04:27:35.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp401.ko 2023-08-25T04:27:35.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp421.ko 2023-08-25T04:27:35.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via-cputemp.ko 2023-08-25T04:27:35.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via686a.ko 2023-08-25T04:27:35.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt1211.ko 2023-08-25T04:27:35.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt8231.ko 2023-08-25T04:27:35.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627ehf.ko 2023-08-25T04:27:35.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627hf.ko 2023-08-25T04:27:35.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83781d.ko 2023-08-25T04:27:35.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83791d.ko 2023-08-25T04:27:35.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83792d.ko 2023-08-25T04:27:35.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83793.ko 2023-08-25T04:27:35.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83795.ko 2023-08-25T04:27:35.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l785ts.ko 2023-08-25T04:27:35.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l786ng.ko 2023-08-25T04:27:35.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c 2023-08-25T04:27:35.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos 2023-08-25T04:27:35.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-25T04:27:35.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-25T04:27:35.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses 2023-08-25T04:27:35.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-25T04:27:35.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-25T04:27:35.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-25T04:27:35.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-25T04:27:35.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-25T04:27:35.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-25T04:27:35.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-25T04:27:35.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-25T04:27:35.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-25T04:27:35.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-25T04:27:35.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-25T04:27:35.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-25T04:27:35.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-25T04:27:35.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-25T04:27:35.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-25T04:27:35.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-25T04:27:35.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-25T04:27:35.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-25T04:27:35.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-25T04:27:35.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-25T04:27:35.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-25T04:27:35.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-25T04:27:35.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-25T04:27:35.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-dev.ko 2023-08-25T04:27:35.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-mux.ko 2023-08-25T04:27:35.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-25T04:27:35.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-smbus.ko 2023-08-25T04:27:35.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-stub.ko 2023-08-25T04:27:35.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband 2023-08-25T04:27:35.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core 2023-08-25T04:27:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-25T04:27:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_core.ko 2023-08-25T04:27:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-25T04:27:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-25T04:27:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-25T04:27:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-25T04:27:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-25T04:27:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw 2023-08-25T04:27:35.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4 2023-08-25T04:27:35.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-25T04:27:35.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4 2023-08-25T04:27:35.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-25T04:27:35.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5 2023-08-25T04:27:35.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-25T04:27:35.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca 2023-08-25T04:27:35.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-25T04:27:35.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp 2023-08-25T04:27:35.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib 2023-08-25T04:27:35.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-25T04:27:35.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser 2023-08-25T04:27:35.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-25T04:27:35.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert 2023-08-25T04:27:35.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-25T04:27:35.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp 2023-08-25T04:27:35.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-25T04:27:35.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt 2023-08-25T04:27:35.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-25T04:27:35.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input 2023-08-25T04:27:35.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport 2023-08-25T04:27:35.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-25T04:27:35.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-25T04:27:35.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/gameport.ko 2023-08-25T04:27:35.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/lightning.ko 2023-08-25T04:27:35.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/ns558.ko 2023-08-25T04:27:35.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/joydev.ko 2023-08-25T04:27:35.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard 2023-08-25T04:27:35.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-25T04:27:35.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse 2023-08-25T04:27:35.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/appletouch.ko 2023-08-25T04:27:35.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/bcm5974.ko 2023-08-25T04:27:35.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/cyapatp.ko 2023-08-25T04:27:35.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-25T04:27:35.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/sermouse.ko 2023-08-25T04:27:35.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-25T04:27:35.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-25T04:27:35.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-25T04:27:35.795 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4 2023-08-25T04:27:35.795 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-25T04:27:35.795 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio 2023-08-25T04:27:35.795 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/altera_ps2.ko 2023-08-25T04:27:35.796 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/arc_ps2.ko 2023-08-25T04:27:35.796 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-25T04:27:35.796 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/serio_raw.ko 2023-08-25T04:27:35.796 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/sparse-keymap.ko 2023-08-25T04:27:35.796 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu 2023-08-25T04:27:35.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd 2023-08-25T04:27:35.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-25T04:27:35.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds 2023-08-25T04:27:35.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-blinkm.ko 2023-08-25T04:27:35.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3530.ko 2023-08-25T04:27:35.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lp3944.ko 2023-08-25T04:27:35.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-ss4200.ko 2023-08-25T04:27:35.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger 2023-08-25T04:27:35.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-25T04:27:35.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-25T04:27:35.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-25T04:27:35.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-25T04:27:35.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-25T04:27:35.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-25T04:27:35.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-25T04:27:35.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-25T04:27:35.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md 2023-08-25T04:27:35.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache 2023-08-25T04:27:35.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache/bcache.ko 2023-08-25T04:27:35.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-bio-prison.ko 2023-08-25T04:27:35.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache-smq.ko 2023-08-25T04:27:35.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache.ko 2023-08-25T04:27:35.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-crypt.ko 2023-08-25T04:27:35.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-delay.ko 2023-08-25T04:27:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-flakey.ko 2023-08-25T04:27:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-log-userspace.ko 2023-08-25T04:27:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-multipath.ko 2023-08-25T04:27:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-queue-length.ko 2023-08-25T04:27:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-raid.ko 2023-08-25T04:27:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-round-robin.ko 2023-08-25T04:27:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-service-time.ko 2023-08-25T04:27:35.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-switch.ko 2023-08-25T04:27:35.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-thin-pool.ko 2023-08-25T04:27:35.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-verity.ko 2023-08-25T04:27:35.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/faulty.ko 2023-08-25T04:27:35.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/linear.ko 2023-08-25T04:27:35.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/multipath.ko 2023-08-25T04:27:35.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data 2023-08-25T04:27:35.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-25T04:27:35.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid0.ko 2023-08-25T04:27:35.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid1.ko 2023-08-25T04:27:35.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid10.ko 2023-08-25T04:27:35.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid456.ko 2023-08-25T04:27:35.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message 2023-08-25T04:27:35.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion 2023-08-25T04:27:35.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptbase.ko 2023-08-25T04:27:35.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptctl.ko 2023-08-25T04:27:35.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptfc.ko 2023-08-25T04:27:35.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptlan.ko 2023-08-25T04:27:35.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptsas.ko 2023-08-25T04:27:35.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptscsih.ko 2023-08-25T04:27:35.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptspi.ko 2023-08-25T04:27:35.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd 2023-08-25T04:27:35.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_ich.ko 2023-08-25T04:27:35.804 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_sch.ko 2023-08-25T04:27:35.804 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/mfd-core.ko 2023-08-25T04:27:35.804 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/sm501.ko 2023-08-25T04:27:35.804 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/viperboard.ko 2023-08-25T04:27:35.804 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/vx855.ko 2023-08-25T04:27:35.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/wl1273-core.ko 2023-08-25T04:27:35.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc 2023-08-25T04:27:35.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl 2023-08-25T04:27:35.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-25T04:27:35.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds9802als.ko 2023-08-25T04:27:35.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds990x.ko 2023-08-25T04:27:35.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/bh1770glc.ko 2023-08-25T04:27:35.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710 2023-08-25T04:27:35.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710/cb710.ko 2023-08-25T04:27:35.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom 2023-08-25T04:27:35.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/at24.ko 2023-08-25T04:27:35.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-25T04:27:35.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-25T04:27:35.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/max6875.ko 2023-08-25T04:27:35.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/enclosure.ko 2023-08-25T04:27:35.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/hpilo.ko 2023-08-25T04:27:35.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29003.ko 2023-08-25T04:27:35.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29020.ko 2023-08-25T04:27:35.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d 2023-08-25T04:27:35.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-25T04:27:35.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-25T04:27:35.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei 2023-08-25T04:27:35.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-me.ko 2023-08-25T04:27:35.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-txe.ko 2023-08-25T04:27:35.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei.ko 2023-08-25T04:27:35.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-gru 2023-08-25T04:27:35.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-25T04:27:35.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp 2023-08-25T04:27:35.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-25T04:27:35.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-25T04:27:35.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-25T04:27:35.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_7xx1.ko 2023-08-25T04:27:35.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_core.ko 2023-08-25T04:27:35.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tsl2550.ko 2023-08-25T04:27:35.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_balloon.ko 2023-08-25T04:27:35.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci 2023-08-25T04:27:35.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-25T04:27:35.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net 2023-08-25T04:27:35.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding 2023-08-25T04:27:35.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding/bonding.ko 2023-08-25T04:27:35.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa 2023-08-25T04:27:35.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53 2023-08-25T04:27:35.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-25T04:27:35.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-25T04:27:35.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-25T04:27:35.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx 2023-08-25T04:27:35.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-25T04:27:35.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dummy.ko 2023-08-25T04:27:35.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/eql.ko 2023-08-25T04:27:35.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet 2023-08-25T04:27:35.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com 2023-08-25T04:27:35.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-25T04:27:35.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-25T04:27:35.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-25T04:27:35.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-25T04:27:35.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390 2023-08-25T04:27:35.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-25T04:27:35.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-25T04:27:35.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-25T04:27:35.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-25T04:27:35.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec 2023-08-25T04:27:35.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-25T04:27:35.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere 2023-08-25T04:27:35.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-25T04:27:35.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon 2023-08-25T04:27:35.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-25T04:27:35.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera 2023-08-25T04:27:35.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-25T04:27:35.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd 2023-08-25T04:27:35.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-25T04:27:35.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-25T04:27:35.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-25T04:27:35.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros 2023-08-25T04:27:35.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx 2023-08-25T04:27:35.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-25T04:27:35.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-25T04:27:35.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-25T04:27:35.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-25T04:27:35.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-25T04:27:35.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx 2023-08-25T04:27:35.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-25T04:27:35.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-25T04:27:35.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom 2023-08-25T04:27:35.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-25T04:27:35.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-25T04:27:35.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-25T04:27:35.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-25T04:27:35.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-25T04:27:35.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet 2023-08-25T04:27:35.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-25T04:27:35.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-25T04:27:35.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade 2023-08-25T04:27:35.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna 2023-08-25T04:27:35.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-25T04:27:35.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio 2023-08-25T04:27:35.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-25T04:27:35.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-25T04:27:35.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-25T04:27:35.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-25T04:27:35.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-25T04:27:35.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-25T04:27:35.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-25T04:27:35.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-25T04:27:35.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-25T04:27:35.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-25T04:27:35.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco 2023-08-25T04:27:35.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic 2023-08-25T04:27:35.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-25T04:27:35.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec 2023-08-25T04:27:35.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip 2023-08-25T04:27:35.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-25T04:27:35.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-25T04:27:35.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-25T04:27:35.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-25T04:27:35.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-25T04:27:35.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-25T04:27:35.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink 2023-08-25T04:27:35.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-25T04:27:35.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-25T04:27:35.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dnet.ko 2023-08-25T04:27:35.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex 2023-08-25T04:27:35.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet 2023-08-25T04:27:35.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-25T04:27:35.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ethoc.ko 2023-08-25T04:27:35.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fealnx.ko 2023-08-25T04:27:35.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel 2023-08-25T04:27:35.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-25T04:27:35.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000 2023-08-25T04:27:35.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-25T04:27:35.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e 2023-08-25T04:27:35.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-25T04:27:35.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k 2023-08-25T04:27:35.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-25T04:27:35.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e 2023-08-25T04:27:35.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-25T04:27:35.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf 2023-08-25T04:27:35.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-25T04:27:35.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb 2023-08-25T04:27:35.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-25T04:27:35.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf 2023-08-25T04:27:35.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-25T04:27:35.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-25T04:27:35.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-25T04:27:35.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-25T04:27:35.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-25T04:27:35.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/jme.ko 2023-08-25T04:27:35.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell 2023-08-25T04:27:35.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-25T04:27:35.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-25T04:27:35.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-25T04:27:35.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox 2023-08-25T04:27:35.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-25T04:27:35.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-25T04:27:35.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-25T04:27:35.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-25T04:27:35.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-25T04:27:35.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-25T04:27:35.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel 2023-08-25T04:27:35.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-25T04:27:35.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom 2023-08-25T04:27:35.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-25T04:27:35.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-25T04:27:35.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi 2023-08-25T04:27:35.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-25T04:27:35.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-25T04:27:35.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion 2023-08-25T04:27:35.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-25T04:27:35.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia 2023-08-25T04:27:35.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-25T04:27:35.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines 2023-08-25T04:27:35.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-25T04:27:35.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-25T04:27:35.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic 2023-08-25T04:27:35.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-25T04:27:35.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-25T04:27:35.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-25T04:27:35.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-25T04:27:35.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-25T04:27:35.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc 2023-08-25T04:27:35.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-25T04:27:35.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek 2023-08-25T04:27:35.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-25T04:27:35.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-25T04:27:35.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-25T04:27:35.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-25T04:27:35.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rocker 2023-08-25T04:27:35.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-25T04:27:35.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc 2023-08-25T04:27:35.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-25T04:27:35.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan 2023-08-25T04:27:35.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-25T04:27:35.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis 2023-08-25T04:27:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-25T04:27:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-25T04:27:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc 2023-08-25T04:27:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-25T04:27:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-25T04:27:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-25T04:27:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-25T04:27:35.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro 2023-08-25T04:27:35.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-25T04:27:35.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-25T04:27:35.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-25T04:27:35.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun 2023-08-25T04:27:35.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-25T04:27:35.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-25T04:27:35.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-25T04:27:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-25T04:27:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti 2023-08-25T04:27:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-25T04:27:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti 2023-08-25T04:27:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-25T04:27:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via 2023-08-25T04:27:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-25T04:27:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-25T04:27:35.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet 2023-08-25T04:27:35.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-25T04:27:35.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-25T04:27:35.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom 2023-08-25T04:27:35.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-25T04:27:35.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/geneve.ko 2023-08-25T04:27:35.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv 2023-08-25T04:27:35.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-25T04:27:35.834 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154 2023-08-25T04:27:35.834 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-25T04:27:35.834 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ifb.ko 2023-08-25T04:27:35.834 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan 2023-08-25T04:27:35.834 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-25T04:27:35.834 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvlan.ko 2023-08-25T04:27:35.835 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvtap.ko 2023-08-25T04:27:35.835 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio 2023-08-25T04:27:35.835 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio.ko 2023-08-25T04:27:35.835 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-25T04:27:35.835 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-25T04:27:35.835 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-25T04:27:35.835 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mii.ko 2023-08-25T04:27:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/net_failover.ko 2023-08-25T04:27:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/netconsole.ko 2023-08-25T04:27:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/nlmon.ko 2023-08-25T04:27:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs 2023-08-25T04:27:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-25T04:27:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-25T04:27:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy 2023-08-25T04:27:35.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/amd.ko 2023-08-25T04:27:35.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-25T04:27:35.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-25T04:27:35.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-25T04:27:35.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm87xx.ko 2023-08-25T04:27:35.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/broadcom.ko 2023-08-25T04:27:35.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/cicada.ko 2023-08-25T04:27:35.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/davicom.ko 2023-08-25T04:27:35.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/dp83640.ko 2023-08-25T04:27:35.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/et1011c.ko 2023-08-25T04:27:35.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/icplus.ko 2023-08-25T04:27:35.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/lxt.ko 2023-08-25T04:27:35.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/marvell.ko 2023-08-25T04:27:35.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/micrel.ko 2023-08-25T04:27:35.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/national.ko 2023-08-25T04:27:35.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/phylink.ko 2023-08-25T04:27:35.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/qsemi.ko 2023-08-25T04:27:35.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/realtek.ko 2023-08-25T04:27:35.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/smsc.ko 2023-08-25T04:27:35.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/ste10Xp.ko 2023-08-25T04:27:35.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/vitesse.ko 2023-08-25T04:27:35.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp 2023-08-25T04:27:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-25T04:27:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_async.ko 2023-08-25T04:27:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-25T04:27:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-25T04:27:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-25T04:27:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-25T04:27:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppoe.ko 2023-08-25T04:27:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppox.ko 2023-08-25T04:27:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pptp.ko 2023-08-25T04:27:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip 2023-08-25T04:27:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slhc.ko 2023-08-25T04:27:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slip.ko 2023-08-25T04:27:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/sungem_phy.ko 2023-08-25T04:27:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tap.ko 2023-08-25T04:27:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team 2023-08-25T04:27:35.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team.ko 2023-08-25T04:27:35.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-25T04:27:35.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-25T04:27:35.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-25T04:27:35.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_random.ko 2023-08-25T04:27:35.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-25T04:27:35.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tun.ko 2023-08-25T04:27:35.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/veth.ko 2023-08-25T04:27:35.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/virtio_net.ko 2023-08-25T04:27:35.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3 2023-08-25T04:27:35.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-25T04:27:35.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan 2023-08-25T04:27:35.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan/vxlan.ko 2023-08-25T04:27:35.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback 2023-08-25T04:27:35.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-25T04:27:35.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netfront.ko 2023-08-25T04:27:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb 2023-08-25T04:27:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb/ntb.ko 2023-08-25T04:27:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme 2023-08-25T04:27:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host 2023-08-25T04:27:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme-core.ko 2023-08-25T04:27:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme.ko 2023-08-25T04:27:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport 2023-08-25T04:27:35.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport.ko 2023-08-25T04:27:35.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_cs.ko 2023-08-25T04:27:35.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_pc.ko 2023-08-25T04:27:35.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_serial.ko 2023-08-25T04:27:35.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci 2023-08-25T04:27:35.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug 2023-08-25T04:27:35.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-25T04:27:35.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pcie 2023-08-25T04:27:35.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-25T04:27:35.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/xen-pcifront.ko 2023-08-25T04:27:35.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia 2023-08-25T04:27:35.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/i82092.ko 2023-08-25T04:27:35.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pd6729.ko 2023-08-25T04:27:35.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-25T04:27:35.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl 2023-08-25T04:27:35.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel 2023-08-25T04:27:35.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-25T04:27:35.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform 2023-08-25T04:27:35.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86 2023-08-25T04:27:35.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-25T04:27:35.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acerhdf.ko 2023-08-25T04:27:35.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-25T04:27:35.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-25T04:27:35.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-25T04:27:35.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-25T04:27:35.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-25T04:27:35.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-25T04:27:35.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-25T04:27:35.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-25T04:27:35.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-25T04:27:35.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/hdaps.ko 2023-08-25T04:27:35.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel 2023-08-25T04:27:35.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-25T04:27:35.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel_ips.ko 2023-08-25T04:27:35.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-25T04:27:35.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-25T04:27:35.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-25T04:27:35.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-25T04:27:35.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-25T04:27:35.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-25T04:27:35.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-25T04:27:35.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-25T04:27:35.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-25T04:27:35.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi.ko 2023-08-25T04:27:35.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap 2023-08-25T04:27:35.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-25T04:27:35.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-25T04:27:35.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps 2023-08-25T04:27:35.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients 2023-08-25T04:27:35.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-25T04:27:35.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-25T04:27:35.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps_parport.ko 2023-08-25T04:27:35.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/pps_core.ko 2023-08-25T04:27:35.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp 2023-08-25T04:27:35.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp.ko 2023-08-25T04:27:35.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp_kvm.ko 2023-08-25T04:27:35.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc 2023-08-25T04:27:35.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-25T04:27:35.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-25T04:27:35.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-25T04:27:35.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-25T04:27:35.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-25T04:27:35.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-25T04:27:35.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-25T04:27:35.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-25T04:27:35.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-25T04:27:35.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-25T04:27:35.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-25T04:27:35.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-em3027.ko 2023-08-25T04:27:35.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-25T04:27:35.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-25T04:27:35.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-25T04:27:35.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-25T04:27:35.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-25T04:27:35.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-25T04:27:35.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max6900.ko 2023-08-25T04:27:35.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-25T04:27:35.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-25T04:27:35.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-25T04:27:35.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-25T04:27:35.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-25T04:27:35.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-25T04:27:35.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-25T04:27:35.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-25T04:27:35.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-25T04:27:35.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-25T04:27:35.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-25T04:27:35.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-25T04:27:35.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-x1205.ko 2023-08-25T04:27:35.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi 2023-08-25T04:27:35.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-9xxx.ko 2023-08-25T04:27:35.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-sas.ko 2023-08-25T04:27:35.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-xxxx.ko 2023-08-25T04:27:35.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/BusLogic.ko 2023-08-25T04:27:35.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/a100u2w.ko 2023-08-25T04:27:35.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid 2023-08-25T04:27:35.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-25T04:27:35.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/advansys.ko 2023-08-25T04:27:35.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx 2023-08-25T04:27:35.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-25T04:27:35.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-25T04:27:35.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/am53c974.ko 2023-08-25T04:27:35.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr 2023-08-25T04:27:35.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-25T04:27:35.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/atp870u.ko 2023-08-25T04:27:35.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi 2023-08-25T04:27:35.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-25T04:27:35.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa 2023-08-25T04:27:35.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa/bfa.ko 2023-08-25T04:27:35.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc 2023-08-25T04:27:35.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-25T04:27:35.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i 2023-08-25T04:27:35.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-25T04:27:35.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ch.ko 2023-08-25T04:27:35.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor 2023-08-25T04:27:35.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-25T04:27:35.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi 2023-08-25T04:27:35.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-25T04:27:35.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-25T04:27:35.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-25T04:27:35.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-25T04:27:35.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-25T04:27:35.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dc395x.ko 2023-08-25T04:27:35.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler 2023-08-25T04:27:35.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-25T04:27:35.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-25T04:27:35.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-25T04:27:35.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-25T04:27:35.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dmx3191d.ko 2023-08-25T04:27:35.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r 2023-08-25T04:27:35.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-25T04:27:35.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esp_scsi.ko 2023-08-25T04:27:35.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe 2023-08-25T04:27:35.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-25T04:27:35.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-25T04:27:35.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic 2023-08-25T04:27:35.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic/fnic.ko 2023-08-25T04:27:35.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hpsa.ko 2023-08-25T04:27:35.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hptiop.ko 2023-08-25T04:27:35.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hv_storvsc.ko 2023-08-25T04:27:35.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/initio.ko 2023-08-25T04:27:35.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ipr.ko 2023-08-25T04:27:35.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ips.ko 2023-08-25T04:27:35.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci 2023-08-25T04:27:35.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci/isci.ko 2023-08-25T04:27:35.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-25T04:27:35.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-25T04:27:35.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc 2023-08-25T04:27:35.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc/libfc.ko 2023-08-25T04:27:35.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi.ko 2023-08-25T04:27:35.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-25T04:27:35.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas 2023-08-25T04:27:35.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas/libsas.ko 2023-08-25T04:27:35.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc 2023-08-25T04:27:35.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-25T04:27:35.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid 2023-08-25T04:27:35.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid.ko 2023-08-25T04:27:35.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-25T04:27:35.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-25T04:27:35.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-25T04:27:35.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas 2023-08-25T04:27:35.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-25T04:27:35.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas 2023-08-25T04:27:35.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-25T04:27:35.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvumi.ko 2023-08-25T04:27:35.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001 2023-08-25T04:27:35.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-25T04:27:35.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pmcraid.ko 2023-08-25T04:27:35.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla1280.ko 2023-08-25T04:27:35.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx 2023-08-25T04:27:35.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-25T04:27:35.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-25T04:27:35.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx 2023-08-25T04:27:35.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-25T04:27:35.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/raid_class.ko 2023-08-25T04:27:35.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_debug.ko 2023-08-25T04:27:35.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-25T04:27:35.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-25T04:27:35.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-25T04:27:35.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-25T04:27:35.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-25T04:27:35.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ses.ko 2023-08-25T04:27:35.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/st.ko 2023-08-25T04:27:35.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/stex.ko 2023-08-25T04:27:35.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2 2023-08-25T04:27:35.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-25T04:27:35.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/virtio_scsi.ko 2023-08-25T04:27:35.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-25T04:27:35.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/wd719x.ko 2023-08-25T04:27:35.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb 2023-08-25T04:27:35.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb/ssb.ko 2023-08-25T04:27:35.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target 2023-08-25T04:27:35.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi 2023-08-25T04:27:35.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-25T04:27:35.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback 2023-08-25T04:27:35.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-25T04:27:35.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_file.ko 2023-08-25T04:27:35.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_iblock.ko 2023-08-25T04:27:35.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_mod.ko 2023-08-25T04:27:35.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_pscsi.ko 2023-08-25T04:27:35.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_user.ko 2023-08-25T04:27:35.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc 2023-08-25T04:27:35.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-25T04:27:35.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal 2023-08-25T04:27:35.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel 2023-08-25T04:27:35.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal 2023-08-25T04:27:35.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-25T04:27:35.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-25T04:27:35.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-25T04:27:35.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-25T04:27:35.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-25T04:27:35.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-25T04:27:35.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-25T04:27:35.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-25T04:27:35.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-25T04:27:35.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-25T04:27:35.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-25T04:27:35.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-25T04:27:35.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-25T04:27:35.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-25T04:27:35.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-25T04:27:35.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty 2023-08-25T04:27:35.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless 2023-08-25T04:27:35.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-25T04:27:35.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_gsm.ko 2023-08-25T04:27:35.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_hdlc.ko 2023-08-25T04:27:35.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/nozomi.ko 2023-08-25T04:27:35.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial 2023-08-25T04:27:35.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250 2023-08-25T04:27:35.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-25T04:27:35.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/arc_uart.ko 2023-08-25T04:27:35.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm 2023-08-25T04:27:35.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-25T04:27:35.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/synclink_gt.ko 2023-08-25T04:27:35.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs 2023-08-25T04:27:35.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core 2023-08-25T04:27:35.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-25T04:27:35.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host 2023-08-25T04:27:35.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-25T04:27:35.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio 2023-08-25T04:27:35.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio.ko 2023-08-25T04:27:35.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_aec.ko 2023-08-25T04:27:35.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_cif.ko 2023-08-25T04:27:35.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_pci_generic.ko 2023-08-25T04:27:35.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_sercos3.ko 2023-08-25T04:27:35.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb 2023-08-25T04:27:35.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class 2023-08-25T04:27:35.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-acm.ko 2023-08-25T04:27:35.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-25T04:27:35.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usblp.ko 2023-08-25T04:27:35.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usbtmc.ko 2023-08-25T04:27:35.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host 2023-08-25T04:27:35.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-25T04:27:35.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image 2023-08-25T04:27:35.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/mdc800.ko 2023-08-25T04:27:35.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/microtek.ko 2023-08-25T04:27:35.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc 2023-08-25T04:27:35.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/adutux.ko 2023-08-25T04:27:35.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/appledisplay.ko 2023-08-25T04:27:35.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi26.ko 2023-08-25T04:27:35.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi62.ko 2023-08-25T04:27:35.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ezusb.ko 2023-08-25T04:27:35.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/idmouse.ko 2023-08-25T04:27:35.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/iowarrior.ko 2023-08-25T04:27:35.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-25T04:27:35.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ldusb.ko 2023-08-25T04:27:35.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/legousbtower.ko 2023-08-25T04:27:35.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga 2023-08-25T04:27:35.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-25T04:27:35.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-25T04:27:35.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usb3503.ko 2023-08-25T04:27:35.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usblcd.ko 2023-08-25T04:27:35.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-25T04:27:35.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/uss720.ko 2023-08-25T04:27:35.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/yurex.ko 2023-08-25T04:27:35.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy 2023-08-25T04:27:35.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-generic.ko 2023-08-25T04:27:35.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial 2023-08-25T04:27:35.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/aircable.ko 2023-08-25T04:27:35.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ark3116.ko 2023-08-25T04:27:35.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-25T04:27:35.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ch341.ko 2023-08-25T04:27:35.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cp210x.ko 2023-08-25T04:27:35.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cyberjack.ko 2023-08-25T04:27:35.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-25T04:27:35.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-25T04:27:35.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/empeg.ko 2023-08-25T04:27:35.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-25T04:27:35.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-25T04:27:35.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-25T04:27:35.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_ti.ko 2023-08-25T04:27:35.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipaq.ko 2023-08-25T04:27:35.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipw.ko 2023-08-25T04:27:35.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ir-usb.ko 2023-08-25T04:27:35.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-25T04:27:35.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan.ko 2023-08-25T04:27:35.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-25T04:27:35.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-25T04:27:35.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-25T04:27:35.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mct_u232.ko 2023-08-25T04:27:35.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7720.ko 2023-08-25T04:27:35.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7840.ko 2023-08-25T04:27:35.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/navman.ko 2023-08-25T04:27:35.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/omninet.ko 2023-08-25T04:27:35.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/opticon.ko 2023-08-25T04:27:35.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/option.ko 2023-08-25T04:27:35.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/oti6858.ko 2023-08-25T04:27:35.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/pl2303.ko 2023-08-25T04:27:35.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcaux.ko 2023-08-25T04:27:35.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcserial.ko 2023-08-25T04:27:35.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/quatech2.ko 2023-08-25T04:27:35.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/safe_serial.ko 2023-08-25T04:27:35.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/sierra.ko 2023-08-25T04:27:35.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-25T04:27:35.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ssu100.ko 2023-08-25T04:27:35.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/symbolserial.ko 2023-08-25T04:27:35.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-25T04:27:35.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-25T04:27:35.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_debug.ko 2023-08-25T04:27:35.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-25T04:27:35.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/visor.ko 2023-08-25T04:27:35.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/whiteheat.ko 2023-08-25T04:27:35.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-25T04:27:35.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage 2023-08-25T04:27:35.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/uas.ko 2023-08-25T04:27:35.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-25T04:27:35.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-25T04:27:35.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-25T04:27:35.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-25T04:27:35.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-25T04:27:35.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-25T04:27:35.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-25T04:27:35.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-karma.ko 2023-08-25T04:27:35.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-25T04:27:35.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-25T04:27:35.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-25T04:27:35.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-25T04:27:35.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-25T04:27:35.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/usb-storage.ko 2023-08-25T04:27:35.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip 2023-08-25T04:27:35.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-25T04:27:35.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-25T04:27:35.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-25T04:27:35.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio 2023-08-25T04:27:35.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci 2023-08-25T04:27:35.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-25T04:27:35.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-25T04:27:35.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio.ko 2023-08-25T04:27:35.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-25T04:27:35.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost 2023-08-25T04:27:35.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost.ko 2023-08-25T04:27:35.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-25T04:27:35.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_net.ko 2023-08-25T04:27:35.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_scsi.ko 2023-08-25T04:27:35.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video 2023-08-25T04:27:35.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight 2023-08-25T04:27:35.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/apple_bl.ko 2023-08-25T04:27:35.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lcd.ko 2023-08-25T04:27:35.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-25T04:27:35.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio 2023-08-25T04:27:35.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio.ko 2023-08-25T04:27:35.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_balloon.ko 2023-08-25T04:27:35.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_mmio.ko 2023-08-25T04:27:35.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci.ko 2023-08-25T04:27:35.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-25T04:27:35.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-25T04:27:35.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_ring.ko 2023-08-25T04:27:35.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1 2023-08-25T04:27:35.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters 2023-08-25T04:27:35.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2482.ko 2023-08-25T04:27:35.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2490.ko 2023-08-25T04:27:35.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves 2023-08-25T04:27:35.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-25T04:27:35.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-25T04:27:35.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-25T04:27:35.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-25T04:27:35.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-25T04:27:35.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-25T04:27:35.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-25T04:27:35.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-25T04:27:35.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-25T04:27:35.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-25T04:27:35.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-25T04:27:35.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/wire.ko 2023-08-25T04:27:35.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog 2023-08-25T04:27:35.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-25T04:27:35.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-25T04:27:35.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-25T04:27:35.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/hpwdt.ko 2023-08-25T04:27:35.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/i6300esb.ko 2023-08-25T04:27:35.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-25T04:27:35.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-25T04:27:35.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ib700wdt.ko 2023-08-25T04:27:35.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ibmasr.ko 2023-08-25T04:27:35.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-25T04:27:35.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-25T04:27:35.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it87_wdt.ko 2023-08-25T04:27:35.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/machzwd.ko 2023-08-25T04:27:35.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/nv_tco.ko 2023-08-25T04:27:35.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-25T04:27:35.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-25T04:27:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-25T04:27:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-25T04:27:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/softdog.ko 2023-08-25T04:27:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-25T04:27:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/via_wdt.ko 2023-08-25T04:27:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-25T04:27:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-25T04:27:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-25T04:27:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wdt_pci.ko 2023-08-25T04:27:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/xen_wdt.ko 2023-08-25T04:27:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen 2023-08-25T04:27:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-25T04:27:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-evtchn.ko 2023-08-25T04:27:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntalloc.ko 2023-08-25T04:27:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntdev.ko 2023-08-25T04:27:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback 2023-08-25T04:27:35.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-25T04:27:35.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-privcmd.ko 2023-08-25T04:27:35.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs 2023-08-25T04:27:35.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-25T04:27:35.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs 2023-08-25T04:27:35.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p 2023-08-25T04:27:35.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p/9p.ko 2023-08-25T04:27:35.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs 2023-08-25T04:27:35.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs/affs.ko 2023-08-25T04:27:35.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs 2023-08-25T04:27:35.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs/befs.ko 2023-08-25T04:27:35.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/binfmt_misc.ko 2023-08-25T04:27:35.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs 2023-08-25T04:27:35.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs/btrfs.ko 2023-08-25T04:27:35.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles 2023-08-25T04:27:35.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles/cachefiles.ko 2023-08-25T04:27:35.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph 2023-08-25T04:27:35.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph/ceph.ko 2023-08-25T04:27:35.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda 2023-08-25T04:27:35.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda/coda.ko 2023-08-25T04:27:35.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs 2023-08-25T04:27:35.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs/cramfs.ko 2023-08-25T04:27:35.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm 2023-08-25T04:27:35.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm/dlm.ko 2023-08-25T04:27:35.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ecryptfs 2023-08-25T04:27:35.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-25T04:27:35.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs 2023-08-25T04:27:35.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs/f2fs.ko 2023-08-25T04:27:35.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat 2023-08-25T04:27:35.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/fat.ko 2023-08-25T04:27:35.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/msdos.ko 2023-08-25T04:27:35.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/vfat.ko 2023-08-25T04:27:35.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache 2023-08-25T04:27:35.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache/fscache.ko 2023-08-25T04:27:35.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse 2023-08-25T04:27:35.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/cuse.ko 2023-08-25T04:27:35.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/fuse.ko 2023-08-25T04:27:35.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2 2023-08-25T04:27:35.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2/gfs2.ko 2023-08-25T04:27:35.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs 2023-08-25T04:27:35.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs/hfs.ko 2023-08-25T04:27:35.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus 2023-08-25T04:27:35.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus/hfsplus.ko 2023-08-25T04:27:35.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs 2023-08-25T04:27:35.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs/isofs.ko 2023-08-25T04:27:35.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs 2023-08-25T04:27:35.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs/jfs.ko 2023-08-25T04:27:35.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd 2023-08-25T04:27:35.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd/lockd.ko 2023-08-25T04:27:35.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix 2023-08-25T04:27:35.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix/minix.ko 2023-08-25T04:27:35.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs 2023-08-25T04:27:35.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs/netfs.ko 2023-08-25T04:27:35.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs 2023-08-25T04:27:35.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout 2023-08-25T04:27:35.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-25T04:27:35.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout 2023-08-25T04:27:35.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-25T04:27:35.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout 2023-08-25T04:27:35.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-25T04:27:35.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfs.ko 2023-08-25T04:27:35.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv3.ko 2023-08-25T04:27:35.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv4.ko 2023-08-25T04:27:35.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common 2023-08-25T04:27:35.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/grace.ko 2023-08-25T04:27:35.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/nfs_acl.ko 2023-08-25T04:27:35.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd 2023-08-25T04:27:35.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd/nfsd.ko 2023-08-25T04:27:35.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2 2023-08-25T04:27:35.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2/nilfs2.ko 2023-08-25T04:27:35.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls 2023-08-25T04:27:35.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-celtic.ko 2023-08-25T04:27:35.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-centeuro.ko 2023-08-25T04:27:35.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-croatian.ko 2023-08-25T04:27:35.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-cyrillic.ko 2023-08-25T04:27:35.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-gaelic.ko 2023-08-25T04:27:35.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-greek.ko 2023-08-25T04:27:35.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-iceland.ko 2023-08-25T04:27:35.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-inuit.ko 2023-08-25T04:27:35.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-roman.ko 2023-08-25T04:27:35.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-romanian.ko 2023-08-25T04:27:35.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-turkish.ko 2023-08-25T04:27:35.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1250.ko 2023-08-25T04:27:35.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1251.ko 2023-08-25T04:27:35.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1255.ko 2023-08-25T04:27:35.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp737.ko 2023-08-25T04:27:35.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp775.ko 2023-08-25T04:27:35.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp850.ko 2023-08-25T04:27:35.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp852.ko 2023-08-25T04:27:35.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp855.ko 2023-08-25T04:27:35.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp857.ko 2023-08-25T04:27:35.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp860.ko 2023-08-25T04:27:35.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp861.ko 2023-08-25T04:27:35.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp862.ko 2023-08-25T04:27:35.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp863.ko 2023-08-25T04:27:35.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp864.ko 2023-08-25T04:27:35.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp865.ko 2023-08-25T04:27:35.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp866.ko 2023-08-25T04:27:35.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp869.ko 2023-08-25T04:27:35.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp874.ko 2023-08-25T04:27:35.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp932.ko 2023-08-25T04:27:35.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp936.ko 2023-08-25T04:27:35.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp949.ko 2023-08-25T04:27:35.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp950.ko 2023-08-25T04:27:35.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_euc-jp.ko 2023-08-25T04:27:35.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-1.ko 2023-08-25T04:27:35.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-13.ko 2023-08-25T04:27:35.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-14.ko 2023-08-25T04:27:35.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-15.ko 2023-08-25T04:27:35.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-2.ko 2023-08-25T04:27:35.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-3.ko 2023-08-25T04:27:35.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-4.ko 2023-08-25T04:27:35.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-5.ko 2023-08-25T04:27:35.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-6.ko 2023-08-25T04:27:35.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-7.ko 2023-08-25T04:27:35.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-9.ko 2023-08-25T04:27:35.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-r.ko 2023-08-25T04:27:35.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-ru.ko 2023-08-25T04:27:35.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-u.ko 2023-08-25T04:27:35.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_utf8.ko 2023-08-25T04:27:35.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2 2023-08-25T04:27:35.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster 2023-08-25T04:27:35.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-25T04:27:35.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm 2023-08-25T04:27:35.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-25T04:27:35.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs 2023-08-25T04:27:35.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-25T04:27:35.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2.ko 2023-08-25T04:27:35.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-25T04:27:35.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-25T04:27:35.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-25T04:27:35.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs 2023-08-25T04:27:35.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs/overlay.ko 2023-08-25T04:27:35.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore 2023-08-25T04:27:35.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore/ramoops.ko 2023-08-25T04:27:35.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs 2023-08-25T04:27:35.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs/reiserfs.ko 2023-08-25T04:27:35.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs 2023-08-25T04:27:35.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs/romfs.ko 2023-08-25T04:27:35.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb 2023-08-25T04:27:35.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client 2023-08-25T04:27:35.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client/cifs.ko 2023-08-25T04:27:35.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common 2023-08-25T04:27:35.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_arc4.ko 2023-08-25T04:27:35.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_md4.ko 2023-08-25T04:27:35.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs 2023-08-25T04:27:35.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs/squashfs.ko 2023-08-25T04:27:35.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv 2023-08-25T04:27:35.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv/sysv.ko 2023-08-25T04:27:35.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf 2023-08-25T04:27:35.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf/udf.ko 2023-08-25T04:27:35.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs 2023-08-25T04:27:35.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs/ufs.ko 2023-08-25T04:27:35.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs 2023-08-25T04:27:35.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs/xfs.ko 2023-08-25T04:27:35.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel 2023-08-25T04:27:35.919 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/rcu 2023-08-25T04:27:35.919 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/rcu/rcutorture.ko 2023-08-25T04:27:35.919 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/torture.ko 2023-08-25T04:27:35.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/trace 2023-08-25T04:27:35.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-25T04:27:35.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib 2023-08-25T04:27:35.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/asn1_encoder.ko 2023-08-25T04:27:35.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc-itu-t.ko 2023-08-25T04:27:35.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc8.ko 2023-08-25T04:27:35.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto 2023-08-25T04:27:35.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libarc4.ko 2023-08-25T04:27:35.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libdes.ko 2023-08-25T04:27:35.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/libcrc32c.ko 2023-08-25T04:27:35.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lru_cache.ko 2023-08-25T04:27:35.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4 2023-08-25T04:27:35.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4_compress.ko 2023-08-25T04:27:35.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4hc_compress.ko 2023-08-25T04:27:35.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math 2023-08-25T04:27:35.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math/cordic.ko 2023-08-25T04:27:35.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6 2023-08-25T04:27:35.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6/raid6_pq.ko 2023-08-25T04:27:35.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon 2023-08-25T04:27:35.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-25T04:27:35.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_bm.ko 2023-08-25T04:27:35.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_fsm.ko 2023-08-25T04:27:35.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_kmp.ko 2023-08-25T04:27:35.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/zstd 2023-08-25T04:27:35.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/zstd/zstd_compress.ko 2023-08-25T04:27:35.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm 2023-08-25T04:27:35.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm/hwpoison-inject.ko 2023-08-25T04:27:35.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net 2023-08-25T04:27:35.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan 2023-08-25T04:27:35.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/6lowpan.ko 2023-08-25T04:27:35.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_dest.ko 2023-08-25T04:27:35.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_fragment.ko 2023-08-25T04:27:35.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_hop.ko 2023-08-25T04:27:35.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-25T04:27:35.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_mobility.ko 2023-08-25T04:27:35.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_routing.ko 2023-08-25T04:27:35.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_udp.ko 2023-08-25T04:27:35.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802 2023-08-25T04:27:35.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/garp.ko 2023-08-25T04:27:35.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/mrp.ko 2023-08-25T04:27:35.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/p8022.ko 2023-08-25T04:27:35.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/psnap.ko 2023-08-25T04:27:35.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/stp.ko 2023-08-25T04:27:35.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q 2023-08-25T04:27:35.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q/8021q.ko 2023-08-25T04:27:35.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p 2023-08-25T04:27:35.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet.ko 2023-08-25T04:27:35.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_fd.ko 2023-08-25T04:27:35.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_rdma.ko 2023-08-25T04:27:35.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_virtio.ko 2023-08-25T04:27:35.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv 2023-08-25T04:27:35.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv/batman-adv.ko 2023-08-25T04:27:35.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge 2023-08-25T04:27:35.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/br_netfilter.ko 2023-08-25T04:27:35.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/bridge.ko 2023-08-25T04:27:35.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter 2023-08-25T04:27:35.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-25T04:27:35.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-25T04:27:35.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-25T04:27:35.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-25T04:27:35.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-25T04:27:35.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-25T04:27:35.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-25T04:27:35.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-25T04:27:35.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-25T04:27:35.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-25T04:27:35.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-25T04:27:35.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-25T04:27:35.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-25T04:27:35.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-25T04:27:35.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-25T04:27:35.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-25T04:27:35.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-25T04:27:35.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-25T04:27:35.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-25T04:27:35.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-25T04:27:35.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtables.ko 2023-08-25T04:27:35.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-25T04:27:35.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-25T04:27:35.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-25T04:27:35.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph 2023-08-25T04:27:35.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph/libceph.ko 2023-08-25T04:27:35.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core 2023-08-25T04:27:35.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/failover.ko 2023-08-25T04:27:35.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/pktgen.ko 2023-08-25T04:27:35.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp 2023-08-25T04:27:35.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp.ko 2023-08-25T04:27:35.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_diag.ko 2023-08-25T04:27:35.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv4.ko 2023-08-25T04:27:35.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv6.ko 2023-08-25T04:27:35.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dns_resolver 2023-08-25T04:27:35.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dns_resolver/dns_resolver.ko 2023-08-25T04:27:35.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa 2023-08-25T04:27:35.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/dsa_core.ko 2023-08-25T04:27:35.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_brcm.ko 2023-08-25T04:27:35.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_dsa.ko 2023-08-25T04:27:35.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_none.ko 2023-08-25T04:27:35.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_trailer.ko 2023-08-25T04:27:35.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154 2023-08-25T04:27:35.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan 2023-08-25T04:27:35.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-25T04:27:35.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154.ko 2023-08-25T04:27:35.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-25T04:27:35.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4 2023-08-25T04:27:35.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ah4.ko 2023-08-25T04:27:35.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/esp4.ko 2023-08-25T04:27:35.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/fou.ko 2023-08-25T04:27:35.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/gre.ko 2023-08-25T04:27:35.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/inet_diag.ko 2023-08-25T04:27:35.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_gre.ko 2023-08-25T04:27:35.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_tunnel.ko 2023-08-25T04:27:35.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_vti.ko 2023-08-25T04:27:35.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipcomp.ko 2023-08-25T04:27:35.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipip.ko 2023-08-25T04:27:35.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter 2023-08-25T04:27:35.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-25T04:27:35.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-25T04:27:35.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-25T04:27:35.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-25T04:27:35.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-25T04:27:35.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-25T04:27:35.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-25T04:27:35.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-25T04:27:35.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-25T04:27:35.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-25T04:27:35.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-25T04:27:35.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-25T04:27:35.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-25T04:27:35.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-25T04:27:35.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-25T04:27:35.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-25T04:27:35.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-25T04:27:35.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-25T04:27:35.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-25T04:27:35.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-25T04:27:35.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-25T04:27:35.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_bic.ko 2023-08-25T04:27:35.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_dctcp.ko 2023-08-25T04:27:35.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_diag.ko 2023-08-25T04:27:35.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_highspeed.ko 2023-08-25T04:27:35.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_htcp.ko 2023-08-25T04:27:35.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_hybla.ko 2023-08-25T04:27:35.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_illinois.ko 2023-08-25T04:27:35.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_lp.ko 2023-08-25T04:27:35.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_scalable.ko 2023-08-25T04:27:35.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_vegas.ko 2023-08-25T04:27:35.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_veno.ko 2023-08-25T04:27:35.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_westwood.ko 2023-08-25T04:27:35.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_yeah.ko 2023-08-25T04:27:35.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tunnel4.ko 2023-08-25T04:27:35.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_diag.ko 2023-08-25T04:27:35.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_tunnel.ko 2023-08-25T04:27:35.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-25T04:27:35.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6 2023-08-25T04:27:35.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ah6.ko 2023-08-25T04:27:35.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/esp6.ko 2023-08-25T04:27:35.940 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/fou6.ko 2023-08-25T04:27:35.940 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_tunnel.ko 2023-08-25T04:27:35.940 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-25T04:27:35.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_vti.ko 2023-08-25T04:27:35.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ipcomp6.ko 2023-08-25T04:27:35.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter 2023-08-25T04:27:35.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-25T04:27:35.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-25T04:27:35.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-25T04:27:35.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-25T04:27:35.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-25T04:27:35.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-25T04:27:35.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-25T04:27:35.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-25T04:27:35.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-25T04:27:35.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-25T04:27:35.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-25T04:27:35.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-25T04:27:35.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-25T04:27:35.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-25T04:27:35.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-25T04:27:35.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-25T04:27:35.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-25T04:27:35.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-25T04:27:35.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-25T04:27:35.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-25T04:27:35.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-25T04:27:35.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-25T04:27:35.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-25T04:27:35.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-25T04:27:35.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/sit.ko 2023-08-25T04:27:35.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/tunnel6.ko 2023-08-25T04:27:35.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-25T04:27:35.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key 2023-08-25T04:27:35.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key/af_key.ko 2023-08-25T04:27:35.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp 2023-08-25T04:27:35.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_core.ko 2023-08-25T04:27:35.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-25T04:27:35.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_eth.ko 2023-08-25T04:27:35.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip.ko 2023-08-25T04:27:35.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip6.ko 2023-08-25T04:27:35.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_netlink.ko 2023-08-25T04:27:35.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ppp.ko 2023-08-25T04:27:35.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc 2023-08-25T04:27:35.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/llc.ko 2023-08-25T04:27:35.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154 2023-08-25T04:27:35.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154/mac802154.ko 2023-08-25T04:27:35.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls 2023-08-25T04:27:35.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls/mpls_gso.ko 2023-08-25T04:27:35.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter 2023-08-25T04:27:35.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset 2023-08-25T04:27:35.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set.ko 2023-08-25T04:27:35.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-25T04:27:35.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-25T04:27:35.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-25T04:27:35.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-25T04:27:35.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-25T04:27:35.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-25T04:27:35.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-25T04:27:35.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-25T04:27:35.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-25T04:27:35.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-25T04:27:35.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-25T04:27:35.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-25T04:27:35.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-25T04:27:35.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-25T04:27:35.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-25T04:27:35.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs 2023-08-25T04:27:35.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-25T04:27:35.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-25T04:27:35.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-25T04:27:35.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-25T04:27:35.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-25T04:27:35.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-25T04:27:35.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-25T04:27:35.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-25T04:27:35.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-25T04:27:35.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-25T04:27:35.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-25T04:27:35.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-25T04:27:35.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-25T04:27:35.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-25T04:27:35.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conncount.ko 2023-08-25T04:27:35.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack.ko 2023-08-25T04:27:35.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-25T04:27:35.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-25T04:27:35.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-25T04:27:35.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-25T04:27:35.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-25T04:27:35.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-25T04:27:35.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-25T04:27:35.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-25T04:27:35.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-25T04:27:35.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-25T04:27:35.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-25T04:27:35.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-25T04:27:35.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-25T04:27:35.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table.ko 2023-08-25T04:27:35.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-25T04:27:35.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_log_syslog.ko 2023-08-25T04:27:35.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat.ko 2023-08-25T04:27:35.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-25T04:27:35.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-25T04:27:35.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_irc.ko 2023-08-25T04:27:35.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_sip.ko 2023-08-25T04:27:35.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-25T04:27:35.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-25T04:27:35.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_tables.ko 2023-08-25T04:27:35.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink.ko 2023-08-25T04:27:35.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-25T04:27:35.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_log.ko 2023-08-25T04:27:35.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-25T04:27:35.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-25T04:27:35.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_chain_nat.ko 2023-08-25T04:27:35.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_compat.ko 2023-08-25T04:27:35.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_ct.ko 2023-08-25T04:27:35.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-25T04:27:35.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fib.ko 2023-08-25T04:27:35.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-25T04:27:35.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_hash.ko 2023-08-25T04:27:35.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_limit.ko 2023-08-25T04:27:35.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_log.ko 2023-08-25T04:27:35.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_masq.ko 2023-08-25T04:27:35.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_nat.ko 2023-08-25T04:27:35.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_numgen.ko 2023-08-25T04:27:35.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_queue.ko 2023-08-25T04:27:35.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_quota.ko 2023-08-25T04:27:35.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_redir.ko 2023-08-25T04:27:35.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject.ko 2023-08-25T04:27:35.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject_inet.ko 2023-08-25T04:27:35.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_socket.ko 2023-08-25T04:27:35.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_tunnel.ko 2023-08-25T04:27:35.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_AUDIT.ko 2023-08-25T04:27:35.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-25T04:27:35.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-25T04:27:35.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-25T04:27:35.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CT.ko 2023-08-25T04:27:35.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_DSCP.ko 2023-08-25T04:27:35.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HL.ko 2023-08-25T04:27:35.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HMARK.ko 2023-08-25T04:27:35.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-25T04:27:35.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LED.ko 2023-08-25T04:27:35.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LOG.ko 2023-08-25T04:27:35.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-25T04:27:35.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NETMAP.ko 2023-08-25T04:27:35.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFLOG.ko 2023-08-25T04:27:35.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-25T04:27:35.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_RATEEST.ko 2023-08-25T04:27:35.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-25T04:27:35.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_SECMARK.ko 2023-08-25T04:27:35.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-25T04:27:35.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-25T04:27:35.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TEE.ko 2023-08-25T04:27:35.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TPROXY.ko 2023-08-25T04:27:35.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TRACE.ko 2023-08-25T04:27:35.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_addrtype.ko 2023-08-25T04:27:35.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_bpf.ko 2023-08-25T04:27:35.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cgroup.ko 2023-08-25T04:27:35.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cluster.ko 2023-08-25T04:27:35.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_comment.ko 2023-08-25T04:27:35.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connbytes.ko 2023-08-25T04:27:35.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlabel.ko 2023-08-25T04:27:35.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlimit.ko 2023-08-25T04:27:35.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connmark.ko 2023-08-25T04:27:35.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_conntrack.ko 2023-08-25T04:27:35.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cpu.ko 2023-08-25T04:27:35.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dccp.ko 2023-08-25T04:27:35.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_devgroup.ko 2023-08-25T04:27:35.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dscp.ko 2023-08-25T04:27:35.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ecn.ko 2023-08-25T04:27:35.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_esp.ko 2023-08-25T04:27:35.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hashlimit.ko 2023-08-25T04:27:35.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_helper.ko 2023-08-25T04:27:35.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hl.ko 2023-08-25T04:27:35.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipcomp.ko 2023-08-25T04:27:35.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_iprange.ko 2023-08-25T04:27:35.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipvs.ko 2023-08-25T04:27:35.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_l2tp.ko 2023-08-25T04:27:35.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_length.ko 2023-08-25T04:27:35.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_limit.ko 2023-08-25T04:27:35.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mac.ko 2023-08-25T04:27:35.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mark.ko 2023-08-25T04:27:35.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_multiport.ko 2023-08-25T04:27:35.964 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nat.ko 2023-08-25T04:27:35.964 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nfacct.ko 2023-08-25T04:27:35.964 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_osf.ko 2023-08-25T04:27:35.964 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_owner.ko 2023-08-25T04:27:35.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_physdev.ko 2023-08-25T04:27:35.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_pkttype.ko 2023-08-25T04:27:35.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_policy.ko 2023-08-25T04:27:35.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_quota.ko 2023-08-25T04:27:35.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_rateest.ko 2023-08-25T04:27:35.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_realm.ko 2023-08-25T04:27:35.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_recent.ko 2023-08-25T04:27:35.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_sctp.ko 2023-08-25T04:27:35.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_set.ko 2023-08-25T04:27:35.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_socket.ko 2023-08-25T04:27:35.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_state.ko 2023-08-25T04:27:35.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_statistic.ko 2023-08-25T04:27:35.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_string.ko 2023-08-25T04:27:35.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_tcpmss.ko 2023-08-25T04:27:35.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_time.ko 2023-08-25T04:27:35.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_u32.ko 2023-08-25T04:27:35.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink 2023-08-25T04:27:35.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink/netlink_diag.ko 2023-08-25T04:27:35.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh 2023-08-25T04:27:35.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh/nsh.ko 2023-08-25T04:27:35.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch 2023-08-25T04:27:35.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/openvswitch.ko 2023-08-25T04:27:35.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-geneve.ko 2023-08-25T04:27:35.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-gre.ko 2023-08-25T04:27:35.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-vxlan.ko 2023-08-25T04:27:35.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet 2023-08-25T04:27:35.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet/af_packet_diag.ko 2023-08-25T04:27:35.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds 2023-08-25T04:27:35.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds.ko 2023-08-25T04:27:35.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_rdma.ko 2023-08-25T04:27:35.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_tcp.ko 2023-08-25T04:27:35.969 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched 2023-08-25T04:27:35.969 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_csum.ko 2023-08-25T04:27:35.969 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_gact.ko 2023-08-25T04:27:35.969 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_ipt.ko 2023-08-25T04:27:35.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_mirred.ko 2023-08-25T04:27:35.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_nat.ko 2023-08-25T04:27:35.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_pedit.ko 2023-08-25T04:27:35.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_police.ko 2023-08-25T04:27:35.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_simple.ko 2023-08-25T04:27:35.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_skbedit.ko 2023-08-25T04:27:35.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_vlan.ko 2023-08-25T04:27:35.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_basic.ko 2023-08-25T04:27:35.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_bpf.ko 2023-08-25T04:27:35.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_flow.ko 2023-08-25T04:27:35.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_fw.ko 2023-08-25T04:27:35.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_route.ko 2023-08-25T04:27:35.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_u32.ko 2023-08-25T04:27:35.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_cmp.ko 2023-08-25T04:27:35.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_ipset.ko 2023-08-25T04:27:35.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_meta.ko 2023-08-25T04:27:35.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_nbyte.ko 2023-08-25T04:27:35.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_text.ko 2023-08-25T04:27:35.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_u32.ko 2023-08-25T04:27:35.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_choke.ko 2023-08-25T04:27:35.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_codel.ko 2023-08-25T04:27:35.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_drr.ko 2023-08-25T04:27:35.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_fq.ko 2023-08-25T04:27:35.973 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_gred.ko 2023-08-25T04:27:35.973 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hfsc.ko 2023-08-25T04:27:35.976 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hhf.ko 2023-08-25T04:27:35.976 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_htb.ko 2023-08-25T04:27:35.976 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_ingress.ko 2023-08-25T04:27:35.976 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio.ko 2023-08-25T04:27:35.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio_lib.ko 2023-08-25T04:27:35.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_multiq.ko 2023-08-25T04:27:35.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_netem.ko 2023-08-25T04:27:35.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_pie.ko 2023-08-25T04:27:35.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_plug.ko 2023-08-25T04:27:35.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_prio.ko 2023-08-25T04:27:35.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_qfq.ko 2023-08-25T04:27:35.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_red.ko 2023-08-25T04:27:35.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfb.ko 2023-08-25T04:27:35.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfq.ko 2023-08-25T04:27:35.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_tbf.ko 2023-08-25T04:27:35.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_teql.ko 2023-08-25T04:27:35.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp 2023-08-25T04:27:35.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp.ko 2023-08-25T04:27:35.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp_diag.ko 2023-08-25T04:27:35.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc 2023-08-25T04:27:35.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss 2023-08-25T04:27:35.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-25T04:27:35.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-25T04:27:35.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/sunrpc.ko 2023-08-25T04:27:35.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma 2023-08-25T04:27:35.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-25T04:27:35.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc 2023-08-25T04:27:35.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/diag.ko 2023-08-25T04:27:35.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/tipc.ko 2023-08-25T04:27:35.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix 2023-08-25T04:27:35.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix/unix_diag.ko 2023-08-25T04:27:35.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock 2023-08-25T04:27:35.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-25T04:27:35.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-25T04:27:35.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock.ko 2023-08-25T04:27:35.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-25T04:27:35.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-25T04:27:35.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm 2023-08-25T04:27:35.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-25T04:27:35.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security 2023-08-25T04:27:35.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys 2023-08-25T04:27:35.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/encrypted-keys 2023-08-25T04:27:35.983 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-25T04:27:35.983 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/trusted-keys 2023-08-25T04:27:35.983 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/trusted-keys/trusted.ko 2023-08-25T04:27:35.984 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt 2023-08-25T04:27:35.984 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib 2023-08-25T04:27:35.984 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib/irqbypass.ko 2023-08-25T04:27:35.984 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.alias 2023-08-25T04:27:35.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.alias.bin 2023-08-25T04:27:35.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin 2023-08-25T04:27:35.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.bin 2023-08-25T04:27:35.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.modinfo 2023-08-25T04:27:35.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.dep 2023-08-25T04:27:35.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.dep.bin 2023-08-25T04:27:35.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.devname 2023-08-25T04:27:35.986 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.order 2023-08-25T04:27:35.986 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.softdep 2023-08-25T04:27:35.986 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols 2023-08-25T04:27:35.986 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols.bin 2023-08-25T04:27:35.987 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-ga6a696707610 2023-08-25T04:27:35.987 DEBUG:teuthology.orchestra.run.smithi072:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-25T04:27:36.017 INFO:teuthology.orchestra.run.smithi072.stdout:postinstall scriptlet (using /bin/sh): 2023-08-25T04:27:36.018 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-ga6a696707610 -a -r /boot/System.map-6.5.0-rc7-ga6a696707610 ]; then 2023-08-25T04:27:36.018 INFO:teuthology.orchestra.run.smithi072.stdout:cp /boot/vmlinuz-6.5.0-rc7-ga6a696707610 /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T04:27:36.018 INFO:teuthology.orchestra.run.smithi072.stdout:cp /boot/System.map-6.5.0-rc7-ga6a696707610 /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T04:27:36.018 INFO:teuthology.orchestra.run.smithi072.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-ga6a696707610 /boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-25T04:27:36.018 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/installkernel 6.5.0-rc7-ga6a696707610 /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T04:27:36.018 INFO:teuthology.orchestra.run.smithi072.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-25T04:27:36.019 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2023-08-25T04:27:36.019 INFO:teuthology.orchestra.run.smithi072.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-25T04:27:36.019 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-25T04:27:36.019 INFO:teuthology.orchestra.run.smithi072.stdout:new-kernel-pkg --remove 6.5.0-rc7-ga6a696707610 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-ga6a696707610.img 2023-08-25T04:27:36.019 INFO:teuthology.orchestra.run.smithi072.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-25T04:27:36.019 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-install remove 6.5.0-rc7-ga6a696707610 2023-08-25T04:27:36.019 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2023-08-25T04:27:36.020 INFO:teuthology.orchestra.run.smithi072.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-25T04:27:36.020 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-25T04:27:36.020 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-ga6a696707610 2023-08-25T04:27:36.027 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2023-08-25T04:27:36.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2023-08-25T04:27:36.102 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2023-08-25T04:27:36.104 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2023-08-25T04:27:36.105 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.02 2023-08-25T04:27:36.105 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 129.el8 2023-08-25T04:27:36.105 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2023-08-25T04:27:36.106 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-25T04:27:36.106 INFO:teuthology.orchestra.run.smithi072.stdout:Group : System Environment/Base 2023-08-25T04:27:36.106 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 9265586 2023-08-25T04:27:36.106 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2023-08-25T04:27:36.107 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-25T04:27:36.107 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-25T04:27:36.111 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-25T04:27:36.111 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-25T04:27:36.111 INFO:teuthology.orchestra.run.smithi072.stdout:Relocations : (not relocatable) 2023-08-25T04:27:36.111 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : CentOS BuildSystem 2023-08-25T04:27:36.111 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2023-08-25T04:27:36.111 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-25T04:27:36.112 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2023-08-25T04:27:36.112 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2023-08-25T04:27:36.112 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:27:36.112 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-25T04:27:36.112 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-25T04:27:36.112 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-25T04:27:36.112 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2023-08-25T04:27:36.113 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:27:36.113 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2023-08-25T04:27:36.113 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-25T04:27:36.113 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 6.5.0-rc7-ga6a696707610 2023-08-25T04:27:36.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-25T04:27:37.009 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2023-08-25T04:27:37.377 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-08-25T04:27:37.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-08-25T04:27:37.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:27:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:done 2023-08-25T04:27:39.531 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-08-25T04:27:39.568 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.LIfIKe6hJn 2023-08-25T04:27:39.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LIfIKe6hJn 2023-08-25T04:27:39.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.LIfIKe6hJn 2023-08-25T04:27:39.828 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.LIfIKe6hJn is 6KB 2023-08-25T04:27:39.855 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.LIfIKe6hJn 2023-08-25T04:27:39.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2023-08-25T04:27:39.945 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-25T04:27:39.945 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-25T04:27:39.946 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-25T04:27:39.946 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-ga6a696707610.conf 2023-08-25T04:27:39.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-ga6a696707610 2023-08-25T04:27:40.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2023-08-25T04:28:10.196 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-08-25T04:28:10.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-25T04:28:10.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:28:37.404 DEBUG:teuthology.orchestra.remote:timed out 2023-08-25T04:28:46.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-08-25T04:28:46.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:28:46.784 DEBUG:teuthology.orchestra.run.smithi137:> true 2023-08-25T04:28:47.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-08-25T04:28:47.291 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc7-ga6a696707610"... 2023-08-25T04:28:47.292 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2023-08-25T04:28:47.338 INFO:teuthology.orchestra.run.smithi137.stdout:6.5.0-rc7-ga6a696707610 2023-08-25T04:28:47.338 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-ga6a696707610 vs 6.5.0-rc7-ga6a696707610 2023-08-25T04:28:47.339 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-25T04:28:47.339 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-25T04:28:48.341 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-08-25T04:28:48.342 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-25T04:28:48.458 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2023-08-25T04:28:48.483 DEBUG:teuthology.parallel:result is None 2023-08-25T04:29:10.200 DEBUG:teuthology.orchestra.remote:timed out 2023-08-25T04:29:19.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-25T04:29:19.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:29:34.811 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-08-25T04:29:35.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-25T04:29:35.266 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc7-ga6a696707610"... 2023-08-25T04:29:35.267 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-08-25T04:29:35.311 INFO:teuthology.orchestra.run.smithi072.stdout:6.5.0-rc7-ga6a696707610 2023-08-25T04:29:35.312 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-ga6a696707610 vs 6.5.0-rc7-ga6a696707610 2023-08-25T04:29:35.312 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-25T04:29:35.312 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-25T04:29:36.313 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-08-25T04:29:36.314 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-25T04:29:36.449 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2023-08-25T04:29:36.474 DEBUG:teuthology.parallel:result is None 2023-08-25T04:29:36.475 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-25T04:29:36.487 INFO:teuthology.task.internal:Creating test directory... 2023-08-25T04:29:36.488 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-25T04:29:36.492 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-25T04:29:36.543 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-25T04:29:36.585 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-25T04:29:36.593 INFO:teuthology.task.internal:Creating archive directory... 2023-08-25T04:29:36.594 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-25T04:29:36.598 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-25T04:29:37.117 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-25T04:29:37.128 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-25T04:29:37.129 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-25T04:29:37.134 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-25T04:29:37.211 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T04:29:37.237 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T04:29:37.237 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T04:29:37.264 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T04:29:37.267 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-25T04:29:37.276 INFO:teuthology.task.internal:Configuring sudo... 2023-08-25T04:29:37.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-25T04:29:37.281 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-25T04:29:37.353 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-25T04:29:37.363 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-25T04:29:37.363 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-25T04:29:37.368 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-25T04:29:37.413 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T04:29:37.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T04:29:37.591 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T04:29:37.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T04:29:37.734 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:29:37.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-25T04:29:37.805 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T04:29:37.880 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T04:29:37.960 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T04:29:38.031 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T04:29:38.100 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:29:38.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-25T04:29:38.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-08-25T04:29:38.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2023-08-25T04:29:38.281 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-25T04:29:38.356 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-25T04:29:38.665 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-25T04:29:38.679 INFO:teuthology.task.internal:Starting timer... 2023-08-25T04:29:38.680 INFO:teuthology.run_tasks:Running task pcp... 2023-08-25T04:29:38.695 INFO:teuthology.run_tasks:Running task selinux... 2023-08-25T04:29:38.705 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-25T04:29:38.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2023-08-25T04:29:38.848 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2023-08-25T04:29:38.851 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2023-08-25T04:29:38.979 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2023-08-25T04:29:38.983 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-25T04:29:38.983 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2023-08-25T04:29:39.038 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2023-08-25T04:29:39.039 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2023-08-25T04:29:39.087 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2023-08-25T04:29:39.088 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi137.front.sepia.ceph.com': 'permissive'} 2023-08-25T04:29:39.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-25T04:29:39.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:29:39.158 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-25T04:29:39.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:29:39.229 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-25T04:29:39.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2023-08-25T04:29:39.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2023-08-25T04:29:39.370 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-25T04:29:39.383 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-08-25T04:29:39.390 INFO:teuthology.repo_utils:Fetching main from origin 2023-08-25T04:29:39.534 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-25T04:29:39.556 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-25T04:29:46.745 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-25T04:41:31.107 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2023-08-25T04:41:31.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-25T04:41:31.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:41:31.382 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-08-25T04:41:31.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-25T04:41:31.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-08-25T04:41:31.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T04:41:31.593 DEBUG:teuthology.orchestra.run.smithi137:> true 2023-08-25T04:41:31.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-08-25T04:41:31.668 INFO:teuthology.run_tasks:Running task clock... 2023-08-25T04:41:31.687 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-25T04:41:31.688 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-25T04:41:31.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T04:41:31.694 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-25T04:41:31.694 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T04:41:31.768 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-25T04:41:31.771 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-25T04:41:31.800 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-25T04:41:31.804 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-25T04:41:31.895 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2023-08-25T04:41:31.896 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2023-08-25T04:41:31.924 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2023-08-25T04:41:31.925 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2023-08-25T04:41:31.954 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-25T04:41:31.955 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-25T04:41:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-25T04:41:31.987 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-25T04:41:32.075 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-08-25T04:41:32.079 INFO:teuthology.orchestra.run.smithi137.stderr:bash: ntpq: command not found 2023-08-25T04:41:32.082 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-25T04:41:32.082 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-08-25T04:41:32.082 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:41:32.082 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:41:32.083 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:41:32.083 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:41:32.086 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-25T04:41:32.087 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2023-08-25T04:41:32.087 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:41:32.087 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:41:32.087 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:41:32.087 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-25T04:41:32.088 INFO:teuthology.run_tasks:Running task install... 2023-08-25T04:41:32.096 DEBUG:teuthology.task.install:project ceph 2023-08-25T04:41:32.097 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}} 2023-08-25T04:41:32.097 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'} 2023-08-25T04:41:32.097 INFO:teuthology.task.install:Using flavor: default 2023-08-25T04:41:32.103 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-25T04:41:32.103 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-25T04:41:32.104 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'tag': None, 'wait_for_package': False} 2023-08-25T04:41:32.105 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:41:32.108 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'tag': None, 'wait_for_package': False} 2023-08-25T04:41:32.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:41:32.251 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/ 2023-08-25T04:41:32.252 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5703.gba6b39e4 2023-08-25T04:41:32.264 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/ 2023-08-25T04:41:32.265 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5703.gba6b39e4 2023-08-25T04:41:32.364 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-25T04:41:32.365 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:41:32.366 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-25T04:41:32.374 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-25T04:41:32.375 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:41:32.375 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-25T04:41:32.435 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-25T04:41:32.436 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ba6b39e4f4f77fb95c747099b53db0467d435f56/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-25T04:41:32.445 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-25T04:41:32.446 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ba6b39e4f4f77fb95c747099b53db0467d435f56/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-25T04:41:32.547 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-25T04:41:32.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-25T04:41:32.642 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-25T04:41:32.652 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-25T04:41:32.711 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2023-08-25T04:41:32.714 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2023-08-25T04:41:32.720 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-08-25T04:41:32.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-08-25T04:41:33.063 INFO:teuthology.orchestra.run.smithi137.stdout:76 files removed 2023-08-25T04:41:33.069 INFO:teuthology.orchestra.run.smithi072.stdout:76 files removed 2023-08-25T04:41:33.098 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-25T04:41:33.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-25T04:41:33.996 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 232 kB/s | 81 kB 00:00 2023-08-25T04:41:34.143 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 161 kB/s | 81 kB 00:00 2023-08-25T04:41:34.372 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-08-25T04:41:34.452 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-08-25T04:41:34.724 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-08-25T04:41:34.827 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 4.3 kB/s | 1.5 kB 00:00 2023-08-25T04:41:38.544 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - AppStream 8.9 MB/s | 33 MB 00:03 2023-08-25T04:41:39.366 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 7.1 MB/s | 33 MB 00:04 2023-08-25T04:41:47.145 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 41 MB 00:02 2023-08-25T04:41:48.313 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 41 MB 00:02 2023-08-25T04:41:53.770 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2023-08-25T04:41:54.454 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.8 kB 00:00 2023-08-25T04:41:55.189 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 30 kB/s | 18 kB 00:00 2023-08-25T04:41:55.580 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - PowerTools 6.4 MB/s | 6.3 MB 00:00 2023-08-25T04:41:55.865 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.8 kB 00:00 2023-08-25T04:41:57.015 INFO:teuthology.orchestra.run.smithi137.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-08-25T04:41:57.243 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - PowerTools 5.1 MB/s | 6.3 MB 00:01 2023-08-25T04:41:58.074 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-08-25T04:41:58.721 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-08-25T04:42:00.065 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-08-25T04:42:02.624 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 106 kB/s | 24 kB 00:00 2023-08-25T04:42:04.475 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 382 kB/s | 24 kB 00:00 2023-08-25T04:42:06.807 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-25T04:42:07.038 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-25T04:42:07.038 INFO:teuthology.orchestra.run.smithi137.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-08-25T04:42:07.038 INFO:teuthology.orchestra.run.smithi137.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-08-25T04:42:07.038 INFO:teuthology.orchestra.run.smithi137.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-08-25T04:42:07.039 INFO:teuthology.orchestra.run.smithi137.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-08-25T04:42:07.039 INFO:teuthology.orchestra.run.smithi137.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-25T04:42:07.039 INFO:teuthology.orchestra.run.smithi137.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-25T04:42:07.040 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-25T04:42:07.040 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-25T04:42:07.040 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2023-08-25T04:42:07.040 INFO:teuthology.orchestra.run.smithi137.stdout:==================================================================================================== 2023-08-25T04:42:07.040 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2023-08-25T04:42:07.040 INFO:teuthology.orchestra.run.smithi137.stdout:==================================================================================================== 2023-08-25T04:42:07.040 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2023-08-25T04:42:07.041 INFO:teuthology.orchestra.run.smithi137.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-25T04:42:07.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 6.4 k 2023-08-25T04:42:07.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 5.4 M 2023-08-25T04:42:07.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 862 k 2023-08-25T04:42:07.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 167 k 2023-08-25T04:42:07.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 1.6 M 2023-08-25T04:42:07.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 132 k 2023-08-25T04:42:07.042 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 1.7 M 2023-08-25T04:42:07.042 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 7.4 M 2023-08-25T04:42:07.042 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 47 k 2023-08-25T04:42:07.042 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 14 M 2023-08-25T04:42:07.042 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 48 M 2023-08-25T04:42:07.042 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 261 k 2023-08-25T04:42:07.042 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 171 k 2023-08-25T04:42:07.042 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 260 k 2023-08-25T04:42:07.043 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 18 k 2023-08-25T04:42:07.043 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-08-25T04:42:07.043 INFO:teuthology.orchestra.run.smithi137.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-25T04:42:07.043 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-25T04:42:07.043 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 31 k 2023-08-25T04:42:07.043 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 784 k 2023-08-25T04:42:07.043 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 139 k 2023-08-25T04:42:07.044 INFO:teuthology.orchestra.run.smithi137.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-25T04:42:07.044 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-08-25T04:42:07.044 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-25T04:42:07.044 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql x86_64 10.23-2.module_el8+572+929c87ac appstream 1.6 M 2023-08-25T04:42:07.044 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib x86_64 10.23-2.module_el8+572+929c87ac appstream 901 k 2023-08-25T04:42:07.044 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server x86_64 10.23-2.module_el8+572+929c87ac appstream 5.1 M 2023-08-25T04:42:07.045 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 197 k 2023-08-25T04:42:07.045 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 371 k 2023-08-25T04:42:07.045 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 364 k 2023-08-25T04:42:07.045 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 107 k 2023-08-25T04:42:07.045 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 94 k 2023-08-25T04:42:07.045 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.5 M 2023-08-25T04:42:07.046 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 179 k 2023-08-25T04:42:07.046 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-25T04:42:07.046 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2023-08-25T04:42:07.046 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-08-25T04:42:07.046 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-08-25T04:42:07.046 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-08-25T04:42:07.046 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-08-25T04:42:07.046 INFO:teuthology.orchestra.run.smithi137.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-08-25T04:42:07.047 INFO:teuthology.orchestra.run.smithi137.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-08-25T04:42:07.047 INFO:teuthology.orchestra.run.smithi137.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-08-25T04:42:07.047 INFO:teuthology.orchestra.run.smithi137.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-08-25T04:42:07.047 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.7 M 2023-08-25T04:42:07.047 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.6 M 2023-08-25T04:42:07.047 INFO:teuthology.orchestra.run.smithi137.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-08-25T04:42:07.047 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-08-25T04:42:07.047 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-08-25T04:42:07.048 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-08-25T04:42:07.048 INFO:teuthology.orchestra.run.smithi137.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-08-25T04:42:07.048 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-25T04:42:07.048 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2023-08-25T04:42:07.048 INFO:teuthology.orchestra.run.smithi137.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-08-25T04:42:07.048 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 22 M 2023-08-25T04:42:07.048 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 23 k 2023-08-25T04:42:07.049 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 2.3 M 2023-08-25T04:42:07.049 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 242 k 2023-08-25T04:42:07.049 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 4.6 M 2023-08-25T04:42:07.049 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 18 M 2023-08-25T04:42:07.049 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 15 k 2023-08-25T04:42:07.049 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 24 k 2023-08-25T04:42:07.049 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-25T04:42:07.050 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-25T04:42:07.050 INFO:teuthology.orchestra.run.smithi137.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-25T04:42:07.050 INFO:teuthology.orchestra.run.smithi137.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-25T04:42:07.050 INFO:teuthology.orchestra.run.smithi137.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-25T04:42:07.050 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 139 k 2023-08-25T04:42:07.050 INFO:teuthology.orchestra.run.smithi137.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-25T04:42:07.051 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-25T04:42:07.051 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-25T04:42:07.051 INFO:teuthology.orchestra.run.smithi137.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-08-25T04:42:07.051 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-25T04:42:07.051 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-25T04:42:07.051 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 473 k 2023-08-25T04:42:07.051 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-25T04:42:07.051 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 6.8 M 2023-08-25T04:42:07.052 INFO:teuthology.orchestra.run.smithi137.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-25T04:42:07.052 INFO:teuthology.orchestra.run.smithi137.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-25T04:42:07.052 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-25T04:42:07.052 INFO:teuthology.orchestra.run.smithi137.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-25T04:42:07.052 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-25T04:42:07.052 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-25T04:42:07.052 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-25T04:42:07.053 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-25T04:42:07.053 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-25T04:42:07.053 INFO:teuthology.orchestra.run.smithi137.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-25T04:42:07.053 INFO:teuthology.orchestra.run.smithi137.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-25T04:42:07.053 INFO:teuthology.orchestra.run.smithi137.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-25T04:42:07.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-25T04:42:07.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-25T04:42:07.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-25T04:42:07.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-25T04:42:07.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-25T04:42:07.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 45 k 2023-08-25T04:42:07.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 126 k 2023-08-25T04:42:07.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-25T04:42:07.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-25T04:42:07.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-25T04:42:07.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-25T04:42:07.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-25T04:42:07.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-25T04:42:07.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-25T04:42:07.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-25T04:42:07.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-25T04:42:07.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-25T04:42:07.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-25T04:42:07.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-25T04:42:07.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-25T04:42:07.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-25T04:42:07.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-25T04:42:07.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-25T04:42:07.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-25T04:42:07.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-25T04:42:07.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-25T04:42:07.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-25T04:42:07.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-25T04:42:07.057 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-25T04:42:07.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-25T04:42:07.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-25T04:42:07.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-25T04:42:07.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-25T04:42:07.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-25T04:42:07.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-25T04:42:07.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-08-25T04:42:07.058 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-25T04:42:07.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-25T04:42:07.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-25T04:42:07.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-25T04:42:07.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-25T04:42:07.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-25T04:42:07.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-25T04:42:07.059 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-25T04:42:07.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-25T04:42:07.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-25T04:42:07.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-25T04:42:07.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-25T04:42:07.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-25T04:42:07.060 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-25T04:42:07.061 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-25T04:42:07.061 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-25T04:42:07.061 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-25T04:42:07.061 INFO:teuthology.orchestra.run.smithi137.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-08-25T04:42:07.061 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-25T04:42:07.061 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-25T04:42:07.061 INFO:teuthology.orchestra.run.smithi137.stdout:Enabling module streams: 2023-08-25T04:42:07.061 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql 10 2023-08-25T04:42:07.062 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:42:07.062 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2023-08-25T04:42:07.062 INFO:teuthology.orchestra.run.smithi137.stdout:==================================================================================================== 2023-08-25T04:42:07.062 INFO:teuthology.orchestra.run.smithi137.stdout:Install 128 Packages 2023-08-25T04:42:07.062 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 16 Packages 2023-08-25T04:42:07.062 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:42:07.063 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 213 M 2023-08-25T04:42:07.063 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2023-08-25T04:42:08.418 INFO:teuthology.orchestra.run.smithi137.stdout:(1/144): ceph-18.0.0-5703.gba6b39e4.el8.x86_64. 13 kB/s | 6.4 kB 00:00 2023-08-25T04:42:08.643 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-25T04:42:08.645 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-25T04:42:08.658 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-08-25T04:42:08.658 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-08-25T04:42:08.660 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-08-25T04:42:08.661 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-08-25T04:42:08.661 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-25T04:42:08.663 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-25T04:42:08.666 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-25T04:42:08.667 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-25T04:42:08.834 INFO:teuthology.orchestra.run.smithi137.stdout:(2/144): ceph-fuse-18.0.0-5703.gba6b39e4.el8.x8 2.0 MB/s | 862 kB 00:00 2023-08-25T04:42:08.863 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-08-25T04:42:08.877 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-08-25T04:42:08.877 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-08-25T04:42:08.877 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-08-25T04:42:08.878 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-08-25T04:42:08.878 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-25T04:42:08.878 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 6.4 k 2023-08-25T04:42:08.878 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 5.4 M 2023-08-25T04:42:08.878 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 862 k 2023-08-25T04:42:08.878 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 167 k 2023-08-25T04:42:08.878 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 1.6 M 2023-08-25T04:42:08.879 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 132 k 2023-08-25T04:42:08.879 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 1.7 M 2023-08-25T04:42:08.879 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 7.4 M 2023-08-25T04:42:08.879 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 47 k 2023-08-25T04:42:08.879 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 14 M 2023-08-25T04:42:08.879 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 48 M 2023-08-25T04:42:08.880 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 261 k 2023-08-25T04:42:08.880 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 171 k 2023-08-25T04:42:08.880 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 260 k 2023-08-25T04:42:08.880 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 18 k 2023-08-25T04:42:08.880 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-08-25T04:42:08.881 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-25T04:42:08.881 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-25T04:42:08.881 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 31 k 2023-08-25T04:42:08.881 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 784 k 2023-08-25T04:42:08.881 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 139 k 2023-08-25T04:42:08.881 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-25T04:42:08.881 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-08-25T04:42:08.882 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-25T04:42:08.883 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql x86_64 10.23-2.module_el8+572+929c87ac appstream 1.6 M 2023-08-25T04:42:08.883 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib x86_64 10.23-2.module_el8+572+929c87ac appstream 901 k 2023-08-25T04:42:08.883 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server x86_64 10.23-2.module_el8+572+929c87ac appstream 5.1 M 2023-08-25T04:42:08.883 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 197 k 2023-08-25T04:42:08.883 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 371 k 2023-08-25T04:42:08.883 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 364 k 2023-08-25T04:42:08.883 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 107 k 2023-08-25T04:42:08.884 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 94 k 2023-08-25T04:42:08.884 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.5 M 2023-08-25T04:42:08.884 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 179 k 2023-08-25T04:42:08.884 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-25T04:42:08.884 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-08-25T04:42:08.884 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-08-25T04:42:08.884 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-08-25T04:42:08.885 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-08-25T04:42:08.885 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-08-25T04:42:08.885 INFO:teuthology.orchestra.run.smithi072.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-08-25T04:42:08.885 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-08-25T04:42:08.885 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-08-25T04:42:08.885 INFO:teuthology.orchestra.run.smithi072.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-08-25T04:42:08.885 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.7 M 2023-08-25T04:42:08.885 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 3.6 M 2023-08-25T04:42:08.886 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-08-25T04:42:08.886 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-08-25T04:42:08.886 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-08-25T04:42:08.886 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-08-25T04:42:08.886 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-08-25T04:42:08.886 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-25T04:42:08.887 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-08-25T04:42:08.887 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-08-25T04:42:08.887 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 22 M 2023-08-25T04:42:08.887 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 23 k 2023-08-25T04:42:08.887 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 2.3 M 2023-08-25T04:42:08.887 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 242 k 2023-08-25T04:42:08.887 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 4.6 M 2023-08-25T04:42:08.888 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 18 M 2023-08-25T04:42:08.888 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5703.gba6b39e4.el8 ceph-noarch 15 k 2023-08-25T04:42:08.888 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 24 k 2023-08-25T04:42:08.888 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-25T04:42:08.888 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-25T04:42:08.888 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-25T04:42:08.889 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-25T04:42:08.889 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-25T04:42:08.889 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 139 k 2023-08-25T04:42:08.889 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-25T04:42:08.889 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-25T04:42:08.889 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-25T04:42:08.889 INFO:teuthology.orchestra.run.smithi072.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-08-25T04:42:08.889 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-25T04:42:08.890 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-25T04:42:08.890 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 473 k 2023-08-25T04:42:08.893 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-25T04:42:08.894 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 6.8 M 2023-08-25T04:42:08.894 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-25T04:42:08.894 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-25T04:42:08.894 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-25T04:42:08.894 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-25T04:42:08.894 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-25T04:42:08.895 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-25T04:42:08.895 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-25T04:42:08.895 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-25T04:42:08.895 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-25T04:42:08.895 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-25T04:42:08.895 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-25T04:42:08.895 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-25T04:42:08.895 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-25T04:42:08.896 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-25T04:42:08.896 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-25T04:42:08.896 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-25T04:42:08.896 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-25T04:42:08.896 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 45 k 2023-08-25T04:42:08.897 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:18.0.0-5703.gba6b39e4.el8 ceph 126 k 2023-08-25T04:42:08.897 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-25T04:42:08.897 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-25T04:42:08.897 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-25T04:42:08.897 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-25T04:42:08.897 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-25T04:42:08.897 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-25T04:42:08.898 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-25T04:42:08.898 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-25T04:42:08.898 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-25T04:42:08.898 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-25T04:42:08.899 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-25T04:42:08.899 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-25T04:42:08.899 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-25T04:42:08.899 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-25T04:42:08.899 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-25T04:42:08.899 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-25T04:42:08.899 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-25T04:42:08.900 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-25T04:42:08.900 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-25T04:42:08.900 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-25T04:42:08.900 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-25T04:42:08.900 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-25T04:42:08.900 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-25T04:42:08.900 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-25T04:42:08.901 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-25T04:42:08.901 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-25T04:42:08.901 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-25T04:42:08.901 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-25T04:42:08.901 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-08-25T04:42:08.901 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-25T04:42:08.901 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-25T04:42:08.901 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-25T04:42:08.902 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-25T04:42:08.902 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-25T04:42:08.902 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-25T04:42:08.902 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-25T04:42:08.902 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-25T04:42:08.902 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-25T04:42:08.902 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-25T04:42:08.902 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-25T04:42:08.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-25T04:42:08.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-25T04:42:08.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-25T04:42:08.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-25T04:42:08.903 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-25T04:42:08.904 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-25T04:42:08.904 INFO:teuthology.orchestra.run.smithi072.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-08-25T04:42:08.904 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-25T04:42:08.904 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-25T04:42:08.904 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling module streams: 2023-08-25T04:42:08.904 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql 10 2023-08-25T04:42:08.905 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:42:08.905 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-08-25T04:42:08.905 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-08-25T04:42:08.905 INFO:teuthology.orchestra.run.smithi072.stdout:Install 128 Packages 2023-08-25T04:42:08.905 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 16 Packages 2023-08-25T04:42:08.905 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:42:08.906 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 213 M 2023-08-25T04:42:08.906 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-08-25T04:42:08.934 INFO:teuthology.orchestra.run.smithi137.stdout:(3/144): ceph-immutable-object-cache-18.0.0-570 1.6 MB/s | 167 kB 00:00 2023-08-25T04:42:09.559 INFO:teuthology.orchestra.run.smithi137.stdout:(4/144): ceph-mds-18.0.0-5703.gba6b39e4.el8.x86 3.7 MB/s | 2.3 MB 00:00 2023-08-25T04:42:09.676 INFO:teuthology.orchestra.run.smithi137.stdout:(5/144): ceph-base-18.0.0-5703.gba6b39e4.el8.x8 3.1 MB/s | 5.4 MB 00:01 2023-08-25T04:42:10.102 INFO:teuthology.orchestra.run.smithi137.stdout:(6/144): ceph-common-18.0.0-5703.gba6b39e4.el8. 10 MB/s | 22 MB 00:02 2023-08-25T04:42:10.144 INFO:teuthology.orchestra.run.smithi137.stdout:(7/144): ceph-mgr-18.0.0-5703.gba6b39e4.el8.x86 2.7 MB/s | 1.6 MB 00:00 2023-08-25T04:42:10.402 INFO:teuthology.orchestra.run.smithi137.stdout:(8/144): ceph-mon-18.0.0-5703.gba6b39e4.el8.x86 6.4 MB/s | 4.6 MB 00:00 2023-08-25T04:42:10.486 INFO:teuthology.orchestra.run.smithi137.stdout:(9/144): ceph-selinux-18.0.0-5703.gba6b39e4.el8 293 kB/s | 24 kB 00:00 2023-08-25T04:42:10.730 INFO:teuthology.orchestra.run.smithi072.stdout:(1/144): ceph-18.0.0-5703.gba6b39e4.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-08-25T04:42:11.303 INFO:teuthology.orchestra.run.smithi137.stdout:(10/144): ceph-osd-18.0.0-5703.gba6b39e4.el8.x8 15 MB/s | 18 MB 00:01 2023-08-25T04:42:11.361 INFO:teuthology.orchestra.run.smithi137.stdout:(11/144): cephfs-mirror-18.0.0-5703.gba6b39e4.e 4.4 MB/s | 260 kB 00:00 2023-08-25T04:42:11.411 INFO:teuthology.orchestra.run.smithi137.stdout:(12/144): libcephfs-devel-18.0.0-5703.gba6b39e4 627 kB/s | 31 kB 00:00 2023-08-25T04:42:11.504 INFO:teuthology.orchestra.run.smithi137.stdout:(13/144): libcephfs2-18.0.0-5703.gba6b39e4.el8. 8.4 MB/s | 784 kB 00:00 2023-08-25T04:42:11.554 INFO:teuthology.orchestra.run.smithi137.stdout:(14/144): libcephsqlite-18.0.0-5703.gba6b39e4.e 2.7 MB/s | 139 kB 00:00 2023-08-25T04:42:11.572 INFO:teuthology.orchestra.run.smithi072.stdout:(2/144): ceph-fuse-18.0.0-5703.gba6b39e4.el8.x8 1.0 MB/s | 862 kB 00:00 2023-08-25T04:42:11.604 INFO:teuthology.orchestra.run.smithi137.stdout:(15/144): librados-devel-18.0.0-5703.gba6b39e4. 2.7 MB/s | 139 kB 00:00 2023-08-25T04:42:11.679 INFO:teuthology.orchestra.run.smithi137.stdout:(16/144): libradosstriper1-18.0.0-5703.gba6b39e 6.2 MB/s | 473 kB 00:00 2023-08-25T04:42:11.705 INFO:teuthology.orchestra.run.smithi072.stdout:(3/144): ceph-immutable-object-cache-18.0.0-570 1.2 MB/s | 167 kB 00:00 2023-08-25T04:42:12.305 INFO:teuthology.orchestra.run.smithi137.stdout:(17/144): librgw2-18.0.0-5703.gba6b39e4.el8.x86 11 MB/s | 6.8 MB 00:00 2023-08-25T04:42:12.380 INFO:teuthology.orchestra.run.smithi137.stdout:(18/144): python3-ceph-argparse-18.0.0-5703.gba 598 kB/s | 45 kB 00:00 2023-08-25T04:42:12.455 INFO:teuthology.orchestra.run.smithi137.stdout:(19/144): python3-ceph-common-18.0.0-5703.gba6b 1.6 MB/s | 126 kB 00:00 2023-08-25T04:42:12.555 INFO:teuthology.orchestra.run.smithi137.stdout:(20/144): python3-cephfs-18.0.0-5703.gba6b39e4. 1.9 MB/s | 197 kB 00:00 2023-08-25T04:42:12.647 INFO:teuthology.orchestra.run.smithi137.stdout:(21/144): python3-rados-18.0.0-5703.gba6b39e4.e 4.0 MB/s | 371 kB 00:00 2023-08-25T04:42:12.740 INFO:teuthology.orchestra.run.smithi137.stdout:(22/144): python3-rbd-18.0.0-5703.gba6b39e4.el8 3.9 MB/s | 364 kB 00:00 2023-08-25T04:42:12.814 INFO:teuthology.orchestra.run.smithi137.stdout:(23/144): python3-rgw-18.0.0-5703.gba6b39e4.el8 1.4 MB/s | 107 kB 00:00 2023-08-25T04:42:12.890 INFO:teuthology.orchestra.run.smithi137.stdout:(24/144): rbd-fuse-18.0.0-5703.gba6b39e4.el8.x8 1.2 MB/s | 94 kB 00:00 2023-08-25T04:42:12.907 INFO:teuthology.orchestra.run.smithi072.stdout:(4/144): ceph-mds-18.0.0-5703.gba6b39e4.el8.x86 1.9 MB/s | 2.3 MB 00:01 2023-08-25T04:42:13.499 INFO:teuthology.orchestra.run.smithi137.stdout:(25/144): rbd-mirror-18.0.0-5703.gba6b39e4.el8. 5.8 MB/s | 3.5 MB 00:00 2023-08-25T04:42:13.574 INFO:teuthology.orchestra.run.smithi137.stdout:(26/144): rbd-nbd-18.0.0-5703.gba6b39e4.el8.x86 2.3 MB/s | 179 kB 00:00 2023-08-25T04:42:13.598 INFO:teuthology.orchestra.run.smithi072.stdout:(5/144): ceph-base-18.0.0-5703.gba6b39e4.el8.x8 1.7 MB/s | 5.4 MB 00:03 2023-08-25T04:42:13.641 INFO:teuthology.orchestra.run.smithi137.stdout:(27/144): ceph-grafana-dashboards-18.0.0-5703.g 345 kB/s | 23 kB 00:00 2023-08-25T04:42:13.649 INFO:teuthology.orchestra.run.smithi072.stdout:(6/144): ceph-mgr-18.0.0-5703.gba6b39e4.el8.x86 2.1 MB/s | 1.6 MB 00:00 2023-08-25T04:42:13.717 INFO:teuthology.orchestra.run.smithi137.stdout:(28/144): ceph-mgr-cephadm-18.0.0-5703.gba6b39e 1.7 MB/s | 132 kB 00:00 2023-08-25T04:42:13.867 INFO:teuthology.orchestra.run.smithi137.stdout:(29/144): ceph-radosgw-18.0.0-5703.gba6b39e4.el 3.6 MB/s | 14 MB 00:03 2023-08-25T04:42:14.050 INFO:teuthology.orchestra.run.smithi137.stdout:(30/144): ceph-mgr-dashboard-18.0.0-5703.gba6b3 5.3 MB/s | 1.7 MB 00:00 2023-08-25T04:42:14.173 INFO:teuthology.orchestra.run.smithi137.stdout:(31/144): ceph-mgr-modules-core-18.0.0-5703.gba 1.9 MB/s | 242 kB 00:00 2023-08-25T04:42:14.276 INFO:teuthology.orchestra.run.smithi137.stdout:(32/144): ceph-mgr-rook-18.0.0-5703.gba6b39e4.e 463 kB/s | 47 kB 00:00 2023-08-25T04:42:14.376 INFO:teuthology.orchestra.run.smithi137.stdout:(33/144): ceph-prometheus-alerts-18.0.0-5703.gb 145 kB/s | 15 kB 00:00 2023-08-25T04:42:14.477 INFO:teuthology.orchestra.run.smithi137.stdout:(34/144): ceph-volume-18.0.0-5703.gba6b39e4.el8 2.5 MB/s | 261 kB 00:00 2023-08-25T04:42:14.569 INFO:teuthology.orchestra.run.smithi137.stdout:(35/144): cephadm-18.0.0-5703.gba6b39e4.el8.noa 1.8 MB/s | 171 kB 00:00 2023-08-25T04:42:14.652 INFO:teuthology.orchestra.run.smithi137.stdout:(36/144): cephfs-top-18.0.0-5703.gba6b39e4.el8. 216 kB/s | 18 kB 00:00 2023-08-25T04:42:15.427 INFO:teuthology.orchestra.run.smithi137.stdout:(37/144): automake-1.16.1-8.el8.noarch.rpm 955 kB/s | 740 kB 00:00 2023-08-25T04:42:15.474 INFO:teuthology.orchestra.run.smithi072.stdout:(7/144): ceph-mon-18.0.0-5703.gba6b39e4.el8.x86 2.5 MB/s | 4.6 MB 00:01 2023-08-25T04:42:16.194 INFO:teuthology.orchestra.run.smithi137.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 898 kB/s | 688 kB 00:00 2023-08-25T04:42:16.820 INFO:teuthology.orchestra.run.smithi137.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 511 kB/s | 320 kB 00:00 2023-08-25T04:42:17.412 INFO:teuthology.orchestra.run.smithi137.stdout:(40/144): ceph-mgr-diskprediction-local-18.0.0- 2.1 MB/s | 7.4 MB 00:03 2023-08-25T04:42:17.437 INFO:teuthology.orchestra.run.smithi137.stdout:(41/144): jq-1.6-7.el8.x86_64.rpm 328 kB/s | 202 kB 00:00 2023-08-25T04:42:17.962 INFO:teuthology.orchestra.run.smithi137.stdout:(42/144): libpq-13.5-1.el8.x86_64.rpm 359 kB/s | 198 kB 00:00 2023-08-25T04:42:18.121 INFO:teuthology.orchestra.run.smithi137.stdout:(43/144): librdkafka-0.11.4-3.el8.x86_64.rpm 518 kB/s | 354 kB 00:00 2023-08-25T04:42:18.400 INFO:teuthology.orchestra.run.smithi072.stdout:(8/144): ceph-osd-18.0.0-5703.gba6b39e4.el8.x86 3.7 MB/s | 18 MB 00:04 2023-08-25T04:42:18.517 INFO:teuthology.orchestra.run.smithi072.stdout:(9/144): ceph-selinux-18.0.0-5703.gba6b39e4.el8 209 kB/s | 24 kB 00:00 2023-08-25T04:42:18.679 INFO:teuthology.orchestra.run.smithi137.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 465 kB/s | 259 kB 00:00 2023-08-25T04:42:18.738 INFO:teuthology.orchestra.run.smithi137.stdout:(45/144): libtool-2.4.6-25.el8.x86_64.rpm 914 kB/s | 709 kB 00:00 2023-08-25T04:42:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:(46/144): ceph-test-18.0.0-5703.gba6b39e4.el8.x 5.3 MB/s | 48 MB 00:09 2023-08-25T04:42:19.612 INFO:teuthology.orchestra.run.smithi137.stdout:(47/144): oniguruma-6.8.2-2.el8.x86_64.rpm 202 kB/s | 187 kB 00:00 2023-08-25T04:42:20.389 INFO:teuthology.orchestra.run.smithi137.stdout:(48/144): openblas-0.3.15-4.el8.x86_64.rpm 2.9 MB/s | 4.7 MB 00:01 2023-08-25T04:42:20.947 INFO:teuthology.orchestra.run.smithi137.stdout:(49/144): postgresql-10.23-2.module_el8+572+929 1.2 MB/s | 1.6 MB 00:01 2023-08-25T04:42:21.323 INFO:teuthology.orchestra.run.smithi137.stdout:(50/144): postgresql-contrib-10.23-2.module_el8 966 kB/s | 901 kB 00:00 2023-08-25T04:42:22.148 INFO:teuthology.orchestra.run.smithi137.stdout:(51/144): openblas-threads-0.3.15-4.el8.x86_64. 1.9 MB/s | 4.9 MB 00:02 2023-08-25T04:42:22.640 INFO:teuthology.orchestra.run.smithi137.stdout:(52/144): postgresql-server-10.23-2.module_el8+ 3.0 MB/s | 5.1 MB 00:01 2023-08-25T04:42:22.857 INFO:teuthology.orchestra.run.smithi137.stdout:(53/144): python3-jinja2-2.10.1-3.el8.noarch.rp 759 kB/s | 538 kB 00:00 2023-08-25T04:42:22.932 INFO:teuthology.orchestra.run.smithi137.stdout:(54/144): python3-babel-2.5.1-7.el8.noarch.rpm 3.0 MB/s | 4.8 MB 00:01 2023-08-25T04:42:22.957 INFO:teuthology.orchestra.run.smithi137.stdout:(55/144): python3-jsonpatch-1.21-2.el8.noarch.r 84 kB/s | 27 kB 00:00 2023-08-25T04:42:23.076 INFO:teuthology.orchestra.run.smithi072.stdout:(10/144): ceph-radosgw-18.0.0-5703.gba6b39e4.el 1.8 MB/s | 14 MB 00:07 2023-08-25T04:42:23.116 INFO:teuthology.orchestra.run.smithi137.stdout:(56/144): python3-jsonpointer-1.10-11.el8.noarc 77 kB/s | 20 kB 00:00 2023-08-25T04:42:23.291 INFO:teuthology.orchestra.run.smithi137.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 116 kB/s | 39 kB 00:00 2023-08-25T04:42:23.351 INFO:teuthology.orchestra.run.smithi072.stdout:(11/144): cephfs-mirror-18.0.0-5703.gba6b39e4.e 948 kB/s | 260 kB 00:00 2023-08-25T04:42:23.470 INFO:teuthology.orchestra.run.smithi072.stdout:(12/144): libcephfs-devel-18.0.0-5703.gba6b39e4 263 kB/s | 31 kB 00:00 2023-08-25T04:42:23.483 INFO:teuthology.orchestra.run.smithi137.stdout:(58/144): python3-mako-1.0.6-14.el8.noarch.rpm 285 kB/s | 157 kB 00:00 2023-08-25T04:42:23.817 INFO:teuthology.orchestra.run.smithi137.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 132 kB/s | 44 kB 00:00 2023-08-25T04:42:23.850 INFO:teuthology.orchestra.run.smithi137.stdout:(60/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 403 kB/s | 225 kB 00:00 2023-08-25T04:42:23.887 INFO:teuthology.orchestra.run.smithi072.stdout:(13/144): libcephfs2-18.0.0-5703.gba6b39e4.el8. 1.8 MB/s | 784 kB 00:00 2023-08-25T04:42:23.979 INFO:teuthology.orchestra.run.smithi072.stdout:(14/144): libcephsqlite-18.0.0-5703.gba6b39e4.e 1.5 MB/s | 139 kB 00:00 2023-08-25T04:42:24.088 INFO:teuthology.orchestra.run.smithi072.stdout:(15/144): librados-devel-18.0.0-5703.gba6b39e4. 1.3 MB/s | 139 kB 00:00 2023-08-25T04:42:24.280 INFO:teuthology.orchestra.run.smithi072.stdout:(16/144): libradosstriper1-18.0.0-5703.gba6b39e 2.4 MB/s | 473 kB 00:00 2023-08-25T04:42:24.293 INFO:teuthology.orchestra.run.smithi137.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 218 kB/s | 103 kB 00:00 2023-08-25T04:42:24.393 INFO:teuthology.orchestra.run.smithi137.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 233 kB/s | 126 kB 00:00 2023-08-25T04:42:24.719 INFO:teuthology.orchestra.run.smithi137.stdout:(63/144): python3-pytz-2017.2-11.el8.noarch.rpm 176 kB/s | 57 kB 00:00 2023-08-25T04:42:24.768 INFO:teuthology.orchestra.run.smithi137.stdout:(64/144): python3-pyasn1-modules-0.3.7-6.el8.no 231 kB/s | 110 kB 00:00 2023-08-25T04:42:24.902 INFO:teuthology.orchestra.run.smithi137.stdout:(65/144): python3-numpy-1.14.3-10.el8.x86_64.rp 2.1 MB/s | 3.7 MB 00:01 2023-08-25T04:42:25.527 INFO:teuthology.orchestra.run.smithi137.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 517 kB/s | 323 kB 00:00 2023-08-25T04:42:25.611 INFO:teuthology.orchestra.run.smithi137.stdout:(67/144): python3-werkzeug-0.12.2-4.el8.noarch. 543 kB/s | 457 kB 00:00 2023-08-25T04:42:25.944 INFO:teuthology.orchestra.run.smithi137.stdout:(68/144): uuid-1.6.2-43.el8.x86_64.rpm 153 kB/s | 64 kB 00:00 2023-08-25T04:42:26.011 INFO:teuthology.orchestra.run.smithi137.stdout:(69/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 176 kB/s | 71 kB 00:00 2023-08-25T04:42:26.198 INFO:teuthology.orchestra.run.smithi072.stdout:(17/144): ceph-common-18.0.0-5703.gba6b39e4.el8 1.4 MB/s | 22 MB 00:15 2023-08-25T04:42:26.295 INFO:teuthology.orchestra.run.smithi137.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 176 kB/s | 61 kB 00:00 2023-08-25T04:42:26.323 INFO:teuthology.orchestra.run.smithi072.stdout:(18/144): python3-ceph-argparse-18.0.0-5703.gba 359 kB/s | 45 kB 00:00 2023-08-25T04:42:26.353 INFO:teuthology.orchestra.run.smithi137.stdout:(71/144): fuse-2.9.7-17.el8.x86_64.rpm 243 kB/s | 83 kB 00:00 2023-08-25T04:42:26.404 INFO:teuthology.orchestra.run.smithi137.stdout:(72/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 444 kB/s | 48 kB 00:00 2023-08-25T04:42:26.465 INFO:teuthology.orchestra.run.smithi072.stdout:(19/144): python3-ceph-common-18.0.0-5703.gba6b 886 kB/s | 126 kB 00:00 2023-08-25T04:42:26.513 INFO:teuthology.orchestra.run.smithi137.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 172 kB/s | 19 kB 00:00 2023-08-25T04:42:26.599 INFO:teuthology.orchestra.run.smithi072.stdout:(20/144): python3-cephfs-18.0.0-5703.gba6b39e4. 1.4 MB/s | 197 kB 00:00 2023-08-25T04:42:26.622 INFO:teuthology.orchestra.run.smithi137.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 358 kB/s | 39 kB 00:00 2023-08-25T04:42:26.696 INFO:teuthology.orchestra.run.smithi137.stdout:(75/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.6 MB/s | 561 kB 00:00 2023-08-25T04:42:26.750 INFO:teuthology.orchestra.run.smithi072.stdout:(21/144): python3-rados-18.0.0-5703.gba6b39e4.e 2.4 MB/s | 371 kB 00:00 2023-08-25T04:42:26.797 INFO:teuthology.orchestra.run.smithi137.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2023-08-25T04:42:26.900 INFO:teuthology.orchestra.run.smithi072.stdout:(22/144): python3-rbd-18.0.0-5703.gba6b39e4.el8 2.4 MB/s | 364 kB 00:00 2023-08-25T04:42:26.905 INFO:teuthology.orchestra.run.smithi137.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 434 kB/s | 47 kB 00:00 2023-08-25T04:42:26.972 INFO:teuthology.orchestra.run.smithi137.stdout:(78/144): libgfortran-8.5.0-20.el8.x86_64.rpm 1.8 MB/s | 645 kB 00:00 2023-08-25T04:42:26.984 INFO:teuthology.orchestra.run.smithi072.stdout:(23/144): python3-rgw-18.0.0-5703.gba6b39e4.el8 1.2 MB/s | 107 kB 00:00 2023-08-25T04:42:27.022 INFO:teuthology.orchestra.run.smithi137.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2023-08-25T04:42:27.068 INFO:teuthology.orchestra.run.smithi072.stdout:(24/144): rbd-fuse-18.0.0-5703.gba6b39e4.el8.x8 1.1 MB/s | 94 kB 00:00 2023-08-25T04:42:27.090 INFO:teuthology.orchestra.run.smithi137.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 743 kB/s | 87 kB 00:00 2023-08-25T04:42:27.210 INFO:teuthology.orchestra.run.smithi072.stdout:(25/144): librgw2-18.0.0-5703.gba6b39e4.el8.x86 2.3 MB/s | 6.8 MB 00:02 2023-08-25T04:42:27.240 INFO:teuthology.orchestra.run.smithi137.stdout:(81/144): python3-scipy-1.0.0-21.module_el8.5.0 5.4 MB/s | 14 MB 00:02 2023-08-25T04:42:27.265 INFO:teuthology.orchestra.run.smithi137.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 103 kB/s | 18 kB 00:00 2023-08-25T04:42:27.290 INFO:teuthology.orchestra.run.smithi137.stdout:(83/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 371 kB/s | 99 kB 00:00 2023-08-25T04:42:27.363 INFO:teuthology.orchestra.run.smithi072.stdout:(26/144): rbd-nbd-18.0.0-5703.gba6b39e4.el8.x86 1.2 MB/s | 179 kB 00:00 2023-08-25T04:42:27.446 INFO:teuthology.orchestra.run.smithi072.stdout:(27/144): ceph-grafana-dashboards-18.0.0-5703.g 276 kB/s | 23 kB 00:00 2023-08-25T04:42:27.482 INFO:teuthology.orchestra.run.smithi137.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2023-08-25T04:42:27.539 INFO:teuthology.orchestra.run.smithi072.stdout:(28/144): ceph-mgr-cephadm-18.0.0-5703.gba6b39e 1.4 MB/s | 132 kB 00:00 2023-08-25T04:42:27.574 INFO:teuthology.orchestra.run.smithi137.stdout:(85/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 10 MB/s | 3.2 MB 00:00 2023-08-25T04:42:27.599 INFO:teuthology.orchestra.run.smithi137.stdout:(86/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 122 kB/s | 44 kB 00:00 2023-08-25T04:42:27.625 INFO:teuthology.orchestra.run.smithi137.stdout:(87/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-08-25T04:42:27.692 INFO:teuthology.orchestra.run.smithi137.stdout:(88/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-08-25T04:42:27.734 INFO:teuthology.orchestra.run.smithi137.stdout:(89/144): python3-cryptography-3.2.1-6.el8.x86_ 5.8 MB/s | 641 kB 00:00 2023-08-25T04:42:27.792 INFO:teuthology.orchestra.run.smithi137.stdout:(90/144): python3-jwt-1.6.1-2.el8.noarch.rpm 426 kB/s | 43 kB 00:00 2023-08-25T04:42:27.834 INFO:teuthology.orchestra.run.smithi137.stdout:(91/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2023-08-25T04:42:27.868 INFO:teuthology.orchestra.run.smithi137.stdout:(92/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 929 kB/s | 249 kB 00:00 2023-08-25T04:42:27.901 INFO:teuthology.orchestra.run.smithi137.stdout:(93/144): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-08-25T04:42:27.935 INFO:teuthology.orchestra.run.smithi137.stdout:(94/144): python3-requests-oauthlib-1.0.0-1.el8 425 kB/s | 43 kB 00:00 2023-08-25T04:42:27.988 INFO:teuthology.orchestra.run.smithi137.stdout:(95/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 621 kB/s | 74 kB 00:00 2023-08-25T04:42:28.011 INFO:teuthology.orchestra.run.smithi137.stdout:(96/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 532 kB/s | 58 kB 00:00 2023-08-25T04:42:28.351 INFO:teuthology.orchestra.run.smithi072.stdout:(29/144): rbd-mirror-18.0.0-5703.gba6b39e4.el8. 2.8 MB/s | 3.5 MB 00:01 2023-08-25T04:42:28.407 INFO:teuthology.orchestra.run.smithi072.stdout:(30/144): ceph-mgr-dashboard-18.0.0-5703.gba6b3 2.0 MB/s | 1.7 MB 00:00 2023-08-25T04:42:28.411 INFO:teuthology.orchestra.run.smithi137.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 139 kB/s | 59 kB 00:00 2023-08-25T04:42:28.469 INFO:teuthology.orchestra.run.smithi137.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 164 kB/s | 75 kB 00:00 2023-08-25T04:42:28.549 INFO:teuthology.orchestra.run.smithi072.stdout:(31/144): ceph-mgr-modules-core-18.0.0-5703.gba 1.7 MB/s | 242 kB 00:00 2023-08-25T04:42:28.553 INFO:teuthology.orchestra.run.smithi137.stdout:(99/144): gperftools-libs-2.7-9.el8.x86_64.rpm 496 kB/s | 306 kB 00:00 2023-08-25T04:42:28.595 INFO:teuthology.orchestra.run.smithi137.stdout:(100/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 349 kB/s | 44 kB 00:00 2023-08-25T04:42:28.633 INFO:teuthology.orchestra.run.smithi072.stdout:(32/144): ceph-mgr-rook-18.0.0-5703.gba6b39e4.e 568 kB/s | 47 kB 00:00 2023-08-25T04:42:28.695 INFO:teuthology.orchestra.run.smithi137.stdout:(101/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.3 MB/s | 185 kB 00:00 2023-08-25T04:42:28.712 INFO:teuthology.orchestra.run.smithi137.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 282 kB/s | 33 kB 00:00 2023-08-25T04:42:28.725 INFO:teuthology.orchestra.run.smithi072.stdout:(33/144): ceph-prometheus-alerts-18.0.0-5703.gb 158 kB/s | 15 kB 00:00 2023-08-25T04:42:28.771 INFO:teuthology.orchestra.run.smithi137.stdout:(103/144): python3-asyncssh-2.7.0-2.el8.noarch. 1.3 MB/s | 476 kB 00:00 2023-08-25T04:42:28.796 INFO:teuthology.orchestra.run.smithi137.stdout:(104/144): python3-certifi-2018.10.15-7.el8.noa 163 kB/s | 16 kB 00:00 2023-08-25T04:42:28.884 INFO:teuthology.orchestra.run.smithi072.stdout:(34/144): ceph-volume-18.0.0-5703.gba6b39e4.el8 1.6 MB/s | 261 kB 00:00 2023-08-25T04:42:28.913 INFO:teuthology.orchestra.run.smithi137.stdout:(105/144): python3-google-auth-1.1.1-10.el8.noa 697 kB/s | 81 kB 00:00 2023-08-25T04:42:28.939 INFO:teuthology.orchestra.run.smithi137.stdout:(106/144): python3-cheroot-8.5.2-1.el8.noarch.r 764 kB/s | 173 kB 00:00 2023-08-25T04:42:28.964 INFO:teuthology.orchestra.run.smithi137.stdout:(107/144): python3-cherrypy-18.4.0-1.el8.noarch 2.0 MB/s | 384 kB 00:00 2023-08-25T04:42:28.976 INFO:teuthology.orchestra.run.smithi072.stdout:(35/144): cephadm-18.0.0-5703.gba6b39e4.el8.noa 1.8 MB/s | 171 kB 00:00 2023-08-25T04:42:29.006 INFO:teuthology.orchestra.run.smithi137.stdout:(108/144): python3-jaraco-6.2-6.el8.noarch.rpm 120 kB/s | 11 kB 00:00 2023-08-25T04:42:29.056 INFO:teuthology.orchestra.run.smithi137.stdout:(109/144): python3-jaraco-functools-2.0-4.el8.n 191 kB/s | 18 kB 00:00 2023-08-25T04:42:29.069 INFO:teuthology.orchestra.run.smithi072.stdout:(36/144): cephfs-top-18.0.0-5703.gba6b39e4.el8. 196 kB/s | 18 kB 00:00 2023-08-25T04:42:29.142 INFO:teuthology.orchestra.run.smithi137.stdout:(110/144): python3-logutils-0.3.5-11.el8.noarch 357 kB/s | 49 kB 00:00 2023-08-25T04:42:29.173 INFO:teuthology.orchestra.run.smithi137.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 502 kB/s | 59 kB 00:00 2023-08-25T04:42:29.257 INFO:teuthology.orchestra.run.smithi137.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 530 kB/s | 60 kB 00:00 2023-08-25T04:42:29.307 INFO:teuthology.orchestra.run.smithi137.stdout:(113/144): python3-kubernetes-11.0.0-6.el8.noar 3.4 MB/s | 1.2 MB 00:00 2023-08-25T04:42:29.332 INFO:teuthology.orchestra.run.smithi137.stdout:(114/144): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-08-25T04:42:29.358 INFO:teuthology.orchestra.run.smithi137.stdout:(115/144): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-08-25T04:42:29.417 INFO:teuthology.orchestra.run.smithi137.stdout:(116/144): python3-repoze-lru-0.7-6.el8.noarch. 309 kB/s | 34 kB 00:00 2023-08-25T04:42:29.458 INFO:teuthology.orchestra.run.smithi137.stdout:(117/144): python3-routes-2.4.1-12.el8.noarch.r 1.5 MB/s | 196 kB 00:00 2023-08-25T04:42:29.483 INFO:teuthology.orchestra.run.smithi137.stdout:(118/144): python3-rsa-4.9-2.el8.noarch.rpm 512 kB/s | 64 kB 00:00 2023-08-25T04:42:29.527 INFO:teuthology.orchestra.run.smithi137.stdout:(119/144): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-08-25T04:42:29.568 INFO:teuthology.orchestra.run.smithi137.stdout:(120/144): python3-singledispatch-3.4.0.3-18.el 220 kB/s | 24 kB 00:00 2023-08-25T04:42:29.593 INFO:teuthology.orchestra.run.smithi137.stdout:(121/144): python3-tempora-1.14.1-5.el8.noarch. 269 kB/s | 29 kB 00:00 2023-08-25T04:42:29.635 INFO:teuthology.orchestra.run.smithi137.stdout:(122/144): python3-trustme-0.6.0-4.el8.noarch.r 253 kB/s | 27 kB 00:00 2023-08-25T04:42:29.702 INFO:teuthology.orchestra.run.smithi137.stdout:(123/144): python3-waitress-1.4.3-1.el8.noarch. 1.9 MB/s | 255 kB 00:00 2023-08-25T04:42:29.744 INFO:teuthology.orchestra.run.smithi137.stdout:(124/144): python3-webob-1.8.5-1.el8.1.noarch.r 1.6 MB/s | 251 kB 00:00 2023-08-25T04:42:29.769 INFO:teuthology.orchestra.run.smithi137.stdout:(125/144): python3-websocket-client-0.56.0-5.el 457 kB/s | 61 kB 00:00 2023-08-25T04:42:29.811 INFO:teuthology.orchestra.run.smithi137.stdout:(126/144): python3-webtest-2.0.33-1.el8.noarch. 787 kB/s | 85 kB 00:00 2023-08-25T04:42:29.853 INFO:teuthology.orchestra.run.smithi137.stdout:(127/144): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2023-08-25T04:42:29.894 INFO:teuthology.orchestra.run.smithi072.stdout:(37/144): automake-1.16.1-8.el8.noarch.rpm 896 kB/s | 740 kB 00:00 2023-08-25T04:42:30.003 INFO:teuthology.orchestra.run.smithi137.stdout:(128/144): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-08-25T04:42:30.353 INFO:teuthology.orchestra.run.smithi137.stdout:(129/144): NetworkManager-initscripts-updown-1. 410 kB/s | 143 kB 00:00 2023-08-25T04:42:30.579 INFO:teuthology.orchestra.run.smithi137.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 337 kB/s | 76 kB 00:00 2023-08-25T04:42:30.763 INFO:teuthology.orchestra.run.smithi137.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2023-08-25T04:42:30.880 INFO:teuthology.orchestra.run.smithi137.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 2.5 MB/s | 302 kB 00:00 2023-08-25T04:42:30.937 INFO:teuthology.orchestra.run.smithi072.stdout:(38/144): ceph-test-18.0.0-5703.gba6b39e4.el8.x 3.9 MB/s | 48 MB 00:12 2023-08-25T04:42:31.071 INFO:teuthology.orchestra.run.smithi137.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 4.5 MB/s | 880 kB 00:00 2023-08-25T04:42:31.081 INFO:teuthology.orchestra.run.smithi072.stdout:(39/144): ceph-mgr-diskprediction-local-18.0.0- 2.7 MB/s | 7.4 MB 00:02 2023-08-25T04:42:31.180 INFO:teuthology.orchestra.run.smithi137.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-08-25T04:42:31.280 INFO:teuthology.orchestra.run.smithi137.stdout:(135/144): librbd1-18.0.0-5703.gba6b39e4.el8.x8 2.5 MB/s | 3.6 MB 00:01 2023-08-25T04:42:31.314 INFO:teuthology.orchestra.run.smithi137.stdout:(136/144): libfdisk-2.32.1-42.el8.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2023-08-25T04:42:31.448 INFO:teuthology.orchestra.run.smithi137.stdout:(137/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.3 MB/s | 179 kB 00:00 2023-08-25T04:42:31.531 INFO:teuthology.orchestra.run.smithi072.stdout:(40/144): bison-3.0.4-10.el8.x86_64.rpm 421 kB/s | 688 kB 00:01 2023-08-25T04:42:31.556 INFO:teuthology.orchestra.run.smithi137.stdout:(138/144): libuuid-2.32.1-42.el8.x86_64.rpm 909 kB/s | 98 kB 00:00 2023-08-25T04:42:31.707 INFO:teuthology.orchestra.run.smithi072.stdout:(41/144): jq-1.6-7.el8.x86_64.rpm 324 kB/s | 202 kB 00:00 2023-08-25T04:42:31.715 INFO:teuthology.orchestra.run.smithi137.stdout:(139/144): libmount-2.32.1-42.el8.x86_64.rpm 544 kB/s | 236 kB 00:00 2023-08-25T04:42:31.765 INFO:teuthology.orchestra.run.smithi137.stdout:(140/144): util-linux-2.32.1-42.el8.x86_64.rpm 12 MB/s | 2.6 MB 00:00 2023-08-25T04:42:31.782 INFO:teuthology.orchestra.run.smithi072.stdout:(42/144): flex-2.6.1-9.el8.x86_64.rpm 378 kB/s | 320 kB 00:00 2023-08-25T04:42:31.815 INFO:teuthology.orchestra.run.smithi137.stdout:(141/144): util-linux-user-2.32.1-42.el8.x86_64 1.0 MB/s | 102 kB 00:00 2023-08-25T04:42:31.874 INFO:teuthology.orchestra.run.smithi137.stdout:(142/144): xfsdump-3.1.8-6.el8.x86_64.rpm 3.0 MB/s | 334 kB 00:00 2023-08-25T04:42:32.083 INFO:teuthology.orchestra.run.smithi072.stdout:(43/144): libpq-13.5-1.el8.x86_64.rpm 359 kB/s | 198 kB 00:00 2023-08-25T04:42:32.099 INFO:teuthology.orchestra.run.smithi137.stdout:(143/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.8 MB/s | 1.1 MB 00:00 2023-08-25T04:42:32.274 INFO:teuthology.orchestra.run.smithi137.stdout:(144/144): librados2-18.0.0-5703.gba6b39e4.el8. 1.5 MB/s | 3.7 MB 00:02 2023-08-25T04:42:32.435 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2023-08-25T04:42:32.435 INFO:teuthology.orchestra.run.smithi137.stdout:Total 8.4 MB/s | 213 MB 00:25 2023-08-25T04:42:32.483 INFO:teuthology.orchestra.run.smithi072.stdout:(44/144): librdkafka-0.11.4-3.el8.x86_64.rpm 456 kB/s | 354 kB 00:00 2023-08-25T04:42:32.701 INFO:teuthology.orchestra.run.smithi072.stdout:(45/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 421 kB/s | 259 kB 00:00 2023-08-25T04:42:32.743 INFO:teuthology.orchestra.run.smithi072.stdout:(46/144): libtool-2.4.6-25.el8.x86_64.rpm 738 kB/s | 709 kB 00:00 2023-08-25T04:42:33.035 INFO:teuthology.orchestra.run.smithi072.stdout:(47/144): oniguruma-6.8.2-2.el8.x86_64.rpm 340 kB/s | 187 kB 00:00 2023-08-25T04:42:34.111 INFO:teuthology.orchestra.run.smithi072.stdout:(48/144): postgresql-10.23-2.module_el8+572+929 1.5 MB/s | 1.6 MB 00:01 2023-08-25T04:42:34.126 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2023-08-25T04:42:34.470 INFO:teuthology.orchestra.run.smithi072.stdout:(49/144): openblas-0.3.15-4.el8.x86_64.rpm 2.7 MB/s | 4.7 MB 00:01 2023-08-25T04:42:34.540 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2023-08-25T04:42:34.540 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2023-08-25T04:42:34.579 INFO:teuthology.orchestra.run.smithi072.stdout:(50/144): openblas-threads-0.3.15-4.el8.x86_64. 2.6 MB/s | 4.9 MB 00:01 2023-08-25T04:42:35.146 INFO:teuthology.orchestra.run.smithi072.stdout:(51/144): postgresql-contrib-10.23-2.module_el8 871 kB/s | 901 kB 00:01 2023-08-25T04:42:35.996 INFO:teuthology.orchestra.run.smithi072.stdout:(52/144): python3-babel-2.5.1-7.el8.noarch.rpm 3.4 MB/s | 4.8 MB 00:01 2023-08-25T04:42:36.032 INFO:teuthology.orchestra.run.smithi072.stdout:(53/144): python3-jinja2-2.10.1-3.el8.noarch.rp 607 kB/s | 538 kB 00:00 2023-08-25T04:42:36.051 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2023-08-25T04:42:36.055 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2023-08-25T04:42:36.141 INFO:teuthology.orchestra.run.smithi072.stdout:(54/144): postgresql-server-10.23-2.module_el8+ 3.1 MB/s | 5.1 MB 00:01 2023-08-25T04:42:36.316 INFO:teuthology.orchestra.run.smithi072.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 70 kB/s | 20 kB 00:00 2023-08-25T04:42:36.342 INFO:teuthology.orchestra.run.smithi072.stdout:(56/144): python3-jsonpatch-1.21-2.el8.noarch.r 77 kB/s | 27 kB 00:00 2023-08-25T04:42:36.643 INFO:teuthology.orchestra.run.smithi072.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 119 kB/s | 39 kB 00:00 2023-08-25T04:42:36.702 INFO:teuthology.orchestra.run.smithi072.stdout:(58/144): python3-mako-1.0.6-14.el8.noarch.rpm 280 kB/s | 157 kB 00:00 2023-08-25T04:42:37.027 INFO:teuthology.orchestra.run.smithi072.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 135 kB/s | 44 kB 00:00 2023-08-25T04:42:37.194 INFO:teuthology.orchestra.run.smithi072.stdout:(60/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 408 kB/s | 225 kB 00:00 2023-08-25T04:42:37.503 INFO:teuthology.orchestra.run.smithi072.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 217 kB/s | 103 kB 00:00 2023-08-25T04:42:37.746 INFO:teuthology.orchestra.run.smithi072.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 229 kB/s | 126 kB 00:00 2023-08-25T04:42:37.979 INFO:teuthology.orchestra.run.smithi072.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 231 kB/s | 110 kB 00:00 2023-08-25T04:42:38.071 INFO:teuthology.orchestra.run.smithi072.stdout:(64/144): python3-pytz-2017.2-11.el8.noarch.rpm 175 kB/s | 57 kB 00:00 2023-08-25T04:42:38.239 INFO:teuthology.orchestra.run.smithi072.stdout:(65/144): python3-numpy-1.14.3-10.el8.x86_64.rp 2.0 MB/s | 3.7 MB 00:01 2023-08-25T04:42:38.791 INFO:teuthology.orchestra.run.smithi072.stdout:(66/144): python3-werkzeug-0.12.2-4.el8.noarch. 636 kB/s | 457 kB 00:00 2023-08-25T04:42:39.017 INFO:teuthology.orchestra.run.smithi072.stdout:(67/144): socat-1.7.4.1-1.el8.x86_64.rpm 416 kB/s | 323 kB 00:00 2023-08-25T04:42:39.184 INFO:teuthology.orchestra.run.smithi072.stdout:(68/144): uuid-1.6.2-43.el8.x86_64.rpm 163 kB/s | 64 kB 00:00 2023-08-25T04:42:39.418 INFO:teuthology.orchestra.run.smithi072.stdout:(69/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 176 kB/s | 71 kB 00:00 2023-08-25T04:42:39.535 INFO:teuthology.orchestra.run.smithi072.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 175 kB/s | 61 kB 00:00 2023-08-25T04:42:39.635 INFO:teuthology.orchestra.run.smithi072.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 480 kB/s | 48 kB 00:00 2023-08-25T04:42:39.769 INFO:teuthology.orchestra.run.smithi072.stdout:(72/144): fuse-2.9.7-17.el8.x86_64.rpm 236 kB/s | 83 kB 00:00 2023-08-25T04:42:39.870 INFO:teuthology.orchestra.run.smithi072.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 186 kB/s | 19 kB 00:00 2023-08-25T04:42:39.920 INFO:teuthology.orchestra.run.smithi072.stdout:(74/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.9 MB/s | 561 kB 00:00 2023-08-25T04:42:39.971 INFO:teuthology.orchestra.run.smithi072.stdout:(75/144): libcom_err-devel-1.45.6-5.el8.x86_64. 384 kB/s | 39 kB 00:00 2023-08-25T04:42:40.038 INFO:teuthology.orchestra.run.smithi072.stdout:(76/144): libgfortran-8.5.0-20.el8.x86_64.rpm 5.4 MB/s | 645 kB 00:00 2023-08-25T04:42:40.155 INFO:teuthology.orchestra.run.smithi072.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 402 kB/s | 47 kB 00:00 2023-08-25T04:42:40.189 INFO:teuthology.orchestra.run.smithi072.stdout:(78/144): libquadmath-8.5.0-20.el8.x86_64.rpm 791 kB/s | 172 kB 00:00 2023-08-25T04:42:40.265 INFO:teuthology.orchestra.run.smithi072.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2023-08-25T04:42:40.299 INFO:teuthology.orchestra.run.smithi072.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 798 kB/s | 87 kB 00:00 2023-08-25T04:42:40.584 INFO:teuthology.orchestra.run.smithi072.stdout:(81/144): python3-scipy-1.0.0-21.module_el8.5.0 5.3 MB/s | 14 MB 00:02 2023-08-25T04:42:40.602 INFO:teuthology.orchestra.run.smithi072.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 60 kB/s | 18 kB 00:00 2023-08-25T04:42:40.635 INFO:teuthology.orchestra.run.smithi072.stdout:(83/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 268 kB/s | 99 kB 00:00 2023-08-25T04:42:40.753 INFO:teuthology.orchestra.run.smithi072.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2023-08-25T04:42:40.861 INFO:teuthology.orchestra.run.smithi072.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2023-08-25T04:42:40.929 INFO:teuthology.orchestra.run.smithi072.stdout:(86/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 127 kB/s | 44 kB 00:00 2023-08-25T04:42:40.979 INFO:teuthology.orchestra.run.smithi072.stdout:(87/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-08-25T04:42:41.105 INFO:teuthology.orchestra.run.smithi072.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 5.0 MB/s | 641 kB 00:00 2023-08-25T04:42:41.188 INFO:teuthology.orchestra.run.smithi072.stdout:(89/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 5.4 MB/s | 3.2 MB 00:00 2023-08-25T04:42:41.214 INFO:teuthology.orchestra.run.smithi072.stdout:(90/144): python3-jwt-1.6.1-2.el8.noarch.rpm 391 kB/s | 43 kB 00:00 2023-08-25T04:42:41.240 INFO:teuthology.orchestra.run.smithi072.stdout:(91/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 801 kB/s | 249 kB 00:00 2023-08-25T04:42:41.299 INFO:teuthology.orchestra.run.smithi072.stdout:(92/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.4 MB/s | 155 kB 00:00 2023-08-25T04:42:41.324 INFO:teuthology.orchestra.run.smithi072.stdout:(93/144): python3-pycparser-2.14-14.el8.noarch. 996 kB/s | 109 kB 00:00 2023-08-25T04:42:41.349 INFO:teuthology.orchestra.run.smithi072.stdout:(94/144): python3-requests-oauthlib-1.0.0-1.el8 389 kB/s | 43 kB 00:00 2023-08-25T04:42:41.400 INFO:teuthology.orchestra.run.smithi072.stdout:(95/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 736 kB/s | 74 kB 00:00 2023-08-25T04:42:41.417 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2023-08-25T04:42:41.436 INFO:teuthology.orchestra.run.smithi072.stdout:(96/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 522 kB/s | 58 kB 00:00 2023-08-25T04:42:41.644 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-08-25T04:42:41.753 INFO:teuthology.orchestra.run.smithi072.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 167 kB/s | 59 kB 00:00 2023-08-25T04:42:41.828 INFO:teuthology.orchestra.run.smithi072.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 191 kB/s | 75 kB 00:00 2023-08-25T04:42:41.861 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-08-25T04:42:41.946 INFO:teuthology.orchestra.run.smithi072.stdout:(99/144): gperftools-libs-2.7-9.el8.x86_64.rpm 514 kB/s | 306 kB 00:00 2023-08-25T04:42:41.963 INFO:teuthology.orchestra.run.smithi072.stdout:(100/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 324 kB/s | 44 kB 00:00 2023-08-25T04:42:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-08-25T04:42:42.080 INFO:teuthology.orchestra.run.smithi072.stdout:(101/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.4 MB/s | 185 kB 00:00 2023-08-25T04:42:42.106 INFO:teuthology.orchestra.run.smithi072.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 232 kB/s | 33 kB 00:00 2023-08-25T04:42:42.109 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-08-25T04:42:42.140 INFO:teuthology.orchestra.run.smithi072.stdout:(103/144): python3-asyncssh-2.7.0-2.el8.noarch. 1.2 MB/s | 476 kB 00:00 2023-08-25T04:42:42.182 INFO:teuthology.orchestra.run.smithi072.stdout:(104/144): python3-certifi-2018.10.15-7.el8.noa 161 kB/s | 16 kB 00:00 2023-08-25T04:42:42.282 INFO:teuthology.orchestra.run.smithi072.stdout:(105/144): python3-cherrypy-18.4.0-1.el8.noarch 2.6 MB/s | 384 kB 00:00 2023-08-25T04:42:42.307 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-08-25T04:42:42.308 INFO:teuthology.orchestra.run.smithi072.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 646 kB/s | 81 kB 00:00 2023-08-25T04:42:42.358 INFO:teuthology.orchestra.run.smithi072.stdout:(107/144): python3-cheroot-8.5.2-1.el8.noarch.r 684 kB/s | 173 kB 00:00 2023-08-25T04:42:42.383 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-08-25T04:42:42.384 INFO:teuthology.orchestra.run.smithi072.stdout:(108/144): python3-jaraco-6.2-6.el8.noarch.rpm 110 kB/s | 11 kB 00:00 2023-08-25T04:42:42.410 INFO:teuthology.orchestra.run.smithi072.stdout:(109/144): python3-jaraco-functools-2.0-4.el8.n 174 kB/s | 18 kB 00:00 2023-08-25T04:42:42.502 INFO:teuthology.orchestra.run.smithi072.stdout:(110/144): python3-logutils-0.3.5-11.el8.noarch 415 kB/s | 49 kB 00:00 2023-08-25T04:42:42.529 INFO:teuthology.orchestra.run.smithi072.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 493 kB/s | 59 kB 00:00 2023-08-25T04:42:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-08-25T04:42:42.596 INFO:teuthology.orchestra.run.smithi072.stdout:(112/144): python3-kubernetes-11.0.0-6.el8.noar 4.9 MB/s | 1.2 MB 00:00 2023-08-25T04:42:42.622 INFO:teuthology.orchestra.run.smithi072.stdout:(113/144): python3-natsort-7.1.1-2.el8.noarch.r 504 kB/s | 60 kB 00:00 2023-08-25T04:42:42.689 INFO:teuthology.orchestra.run.smithi072.stdout:(114/144): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-08-25T04:42:42.714 INFO:teuthology.orchestra.run.smithi072.stdout:(115/144): python3-portend-2.6-1.el8.noarch.rpm 132 kB/s | 16 kB 00:00 2023-08-25T04:42:42.740 INFO:teuthology.orchestra.run.smithi072.stdout:(116/144): python3-repoze-lru-0.7-6.el8.noarch. 285 kB/s | 34 kB 00:00 2023-08-25T04:42:42.795 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-08-25T04:42:42.815 INFO:teuthology.orchestra.run.smithi072.stdout:(117/144): python3-rsa-4.9-2.el8.noarch.rpm 638 kB/s | 64 kB 00:00 2023-08-25T04:42:42.841 INFO:teuthology.orchestra.run.smithi072.stdout:(118/144): python3-routes-2.4.1-12.el8.noarch.r 1.3 MB/s | 196 kB 00:00 2023-08-25T04:42:42.867 INFO:teuthology.orchestra.run.smithi072.stdout:(119/144): python3-simplegeneric-0.8.1-17.el8.n 148 kB/s | 19 kB 00:00 2023-08-25T04:42:42.917 INFO:teuthology.orchestra.run.smithi072.stdout:(120/144): python3-singledispatch-3.4.0.3-18.el 236 kB/s | 24 kB 00:00 2023-08-25T04:42:42.951 INFO:teuthology.orchestra.run.smithi072.stdout:(121/144): python3-tempora-1.14.1-5.el8.noarch. 267 kB/s | 29 kB 00:00 2023-08-25T04:42:42.968 INFO:teuthology.orchestra.run.smithi072.stdout:(122/144): python3-trustme-0.6.0-4.el8.noarch.r 272 kB/s | 27 kB 00:00 2023-08-25T04:42:43.017 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-08-25T04:42:43.027 INFO:teuthology.orchestra.run.smithi072.stdout:(123/144): python3-waitress-1.4.3-1.el8.noarch. 2.3 MB/s | 255 kB 00:00 2023-08-25T04:42:43.086 INFO:teuthology.orchestra.run.smithi072.stdout:(124/144): python3-websocket-client-0.56.0-5.el 522 kB/s | 61 kB 00:00 2023-08-25T04:42:43.120 INFO:teuthology.orchestra.run.smithi072.stdout:(125/144): python3-webob-1.8.5-1.el8.1.noarch.r 1.5 MB/s | 251 kB 00:00 2023-08-25T04:42:43.147 INFO:teuthology.orchestra.run.smithi072.stdout:(126/144): python3-webtest-2.0.33-1.el8.noarch. 714 kB/s | 85 kB 00:00 2023-08-25T04:42:43.189 INFO:teuthology.orchestra.run.smithi072.stdout:(127/144): python3-zc-lockfile-2.0-2.el8.noarch 223 kB/s | 23 kB 00:00 2023-08-25T04:42:43.215 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-08-25T04:42:43.456 INFO:teuthology.orchestra.run.smithi072.stdout:(128/144): thrift-0.13.0-2.el8.x86_64.rpm 5.2 MB/s | 1.7 MB 00:00 2023-08-25T04:42:43.684 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-08-25T04:42:43.832 INFO:teuthology.orchestra.run.smithi072.stdout:(129/144): librados2-18.0.0-5703.gba6b39e4.el8. 5.4 MB/s | 3.7 MB 00:00 2023-08-25T04:42:43.865 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/160 2023-08-25T04:42:43.866 INFO:teuthology.orchestra.run.smithi072.stdout:(130/144): NetworkManager-initscripts-updown-1. 350 kB/s | 143 kB 00:00 2023-08-25T04:42:44.050 INFO:teuthology.orchestra.run.smithi072.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2023-08-25T04:42:44.100 INFO:teuthology.orchestra.run.smithi072.stdout:(132/144): elfutils-debuginfod-client-0.189-2.e 283 kB/s | 76 kB 00:00 2023-08-25T04:42:44.184 INFO:teuthology.orchestra.run.smithi072.stdout:(133/144): librbd1-18.0.0-5703.gba6b39e4.el8.x8 3.6 MB/s | 3.6 MB 00:00 2023-08-25T04:42:44.218 INFO:teuthology.orchestra.run.smithi072.stdout:(134/144): elfutils-libs-0.189-2.el8.x86_64.rpm 1.8 MB/s | 302 kB 00:00 2023-08-25T04:42:44.312 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/160 2023-08-25T04:42:44.335 INFO:teuthology.orchestra.run.smithi072.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2023-08-25T04:42:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-08-25T04:42:44.465 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 9/160 2023-08-25T04:42:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:(137/144): iproute-6.2.0-2.el8.x86_64.rpm 2.2 MB/s | 880 kB 00:00 2023-08-25T04:42:44.554 INFO:teuthology.orchestra.run.smithi072.stdout:(138/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-08-25T04:42:44.596 INFO:teuthology.orchestra.run.smithi072.stdout:(139/144): libuuid-2.32.1-42.el8.x86_64.rpm 904 kB/s | 98 kB 00:00 2023-08-25T04:42:44.602 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 9/160 2023-08-25T04:42:44.621 INFO:teuthology.orchestra.run.smithi072.stdout:(140/144): libblkid-2.32.1-42.el8.x86_64.rpm 504 kB/s | 220 kB 00:00 2023-08-25T04:42:44.707 INFO:teuthology.orchestra.run.smithi072.stdout:(141/144): util-linux-user-2.32.1-42.el8.x86_64 925 kB/s | 102 kB 00:00 2023-08-25T04:42:44.748 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 10/160 2023-08-25T04:42:44.808 INFO:teuthology.orchestra.run.smithi072.stdout:(142/144): xfsdump-3.1.8-6.el8.x86_64.rpm 1.8 MB/s | 334 kB 00:00 2023-08-25T04:42:44.846 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 10/160 2023-08-25T04:42:44.883 INFO:teuthology.orchestra.run.smithi072.stdout:(143/144): util-linux-2.32.1-42.el8.x86_64.rpm 7.9 MB/s | 2.6 MB 00:00 2023-08-25T04:42:44.933 INFO:teuthology.orchestra.run.smithi072.stdout:(144/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.8 MB/s | 1.1 MB 00:00 2023-08-25T04:42:44.936 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-08-25T04:42:44.936 INFO:teuthology.orchestra.run.smithi072.stdout:Total 5.9 MB/s | 213 MB 00:36 2023-08-25T04:42:45.049 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 11/160 2023-08-25T04:42:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-08-25T04:42:45.482 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-08-25T04:42:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-08-25T04:42:45.792 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-08-25T04:42:45.988 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-08-25T04:42:46.182 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-08-25T04:42:46.659 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-08-25T04:42:46.762 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-08-25T04:42:46.845 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 17/160 2023-08-25T04:42:47.015 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 18/160 2023-08-25T04:42:47.122 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 18/160 2023-08-25T04:42:47.175 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-08-25T04:42:47.175 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-08-25T04:42:47.298 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 19/160 2023-08-25T04:42:47.428 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 19/160 2023-08-25T04:42:47.673 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-08-25T04:42:47.896 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-08-25T04:42:48.014 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-08-25T04:42:48.180 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-08-25T04:42:48.347 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-08-25T04:42:48.720 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-08-25T04:42:48.723 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-08-25T04:42:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-08-25T04:42:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-08-25T04:42:49.914 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-08-25T04:42:50.139 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-08-25T04:42:50.944 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-08-25T04:42:51.572 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-08-25T04:42:51.772 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-08-25T04:42:51.929 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 28/160 2023-08-25T04:42:52.133 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-08-25T04:42:52.388 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8. 30/160 2023-08-25T04:42:52.526 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 31/160 2023-08-25T04:42:52.753 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_6 32/160 2023-08-25T04:42:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-08-25T04:42:54.115 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-08-25T04:42:54.199 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-08-25T04:42:54.337 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-08-25T04:42:54.516 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-08-25T04:42:54.547 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-08-25T04:42:54.701 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-08-25T04:42:54.739 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-08-25T04:42:54.814 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-08-25T04:42:55.009 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-08-25T04:42:55.106 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-08-25T04:42:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-08-25T04:42:55.555 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-08-25T04:42:55.831 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-08-25T04:42:56.027 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-08-25T04:42:56.479 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-08-25T04:42:56.692 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/160 2023-08-25T04:42:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-08-25T04:42:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-08-25T04:42:57.157 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/160 2023-08-25T04:42:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-08-25T04:42:57.350 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 9/160 2023-08-25T04:42:57.532 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 9/160 2023-08-25T04:42:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/160 2023-08-25T04:42:57.725 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 10/160 2023-08-25T04:42:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 40/160 2023-08-25T04:42:57.845 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 10/160 2023-08-25T04:42:57.890 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_6 41/160 2023-08-25T04:42:58.060 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-08-25T04:42:58.085 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 11/160 2023-08-25T04:42:58.265 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-08-25T04:42:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-08-25T04:42:58.480 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-08-25T04:42:58.529 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-08-25T04:42:58.562 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-08-25T04:42:58.729 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-08-25T04:42:58.750 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-08-25T04:42:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-08-25T04:42:58.847 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-08-25T04:42:58.993 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-08-25T04:42:59.093 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-08-25T04:42:59.163 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-08-25T04:42:59.360 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-08-25T04:42:59.723 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-08-25T04:42:59.843 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-08-25T04:43:00.022 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-08-25T04:43:00.050 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-08-25T04:43:00.055 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 17/160 2023-08-25T04:43:00.200 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 18/160 2023-08-25T04:43:00.253 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-08-25T04:43:00.333 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 18/160 2023-08-25T04:43:00.533 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 19/160 2023-08-25T04:43:00.545 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-08-25T04:43:00.682 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 19/160 2023-08-25T04:43:00.762 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-08-25T04:43:00.934 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-08-25T04:43:00.971 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-08-25T04:43:01.109 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-08-25T04:43:01.143 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-08-25T04:43:01.308 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-08-25T04:43:01.319 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-08-25T04:43:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-08-25T04:43:01.537 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-08-25T04:43:01.641 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-08-25T04:43:01.778 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-08-25T04:43:01.983 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-08-25T04:43:02.129 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-08-25T04:43:02.303 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-08-25T04:43:02.329 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-08-25T04:43:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-08-25T04:43:02.550 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-08-25T04:43:02.639 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-08-25T04:43:02.834 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-08-25T04:43:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-08-25T04:43:03.262 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-08-25T04:43:03.311 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-08-25T04:43:03.491 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-08-25T04:43:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-08-25T04:43:03.851 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-08-25T04:43:04.114 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-08-25T04:43:04.317 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-08-25T04:43:04.344 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-08-25T04:43:04.692 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-08-25T04:43:04.900 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-08-25T04:43:05.097 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 28/160 2023-08-25T04:43:05.139 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-08-25T04:43:05.337 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 70/160 2023-08-25T04:43:05.345 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-08-25T04:43:05.433 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 70/160 2023-08-25T04:43:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8. 30/160 2023-08-25T04:43:05.647 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 71/160 2023-08-25T04:43:05.720 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 31/160 2023-08-25T04:43:05.873 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-08-25T04:43:06.000 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_6 32/160 2023-08-25T04:43:06.310 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-08-25T04:43:06.544 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-08-25T04:43:06.726 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-08-25T04:43:06.988 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-08-25T04:43:07.169 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-08-25T04:43:07.205 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-08-25T04:43:07.554 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-08-25T04:43:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-08-25T04:43:08.141 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-08-25T04:43:08.492 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-08-25T04:43:08.861 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-08-25T04:43:09.079 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-08-25T04:43:09.305 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-08-25T04:43:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-08-25T04:43:09.864 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-08-25T04:43:10.111 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-08-25T04:43:10.300 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-08-25T04:43:10.323 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-08-25T04:43:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-08-25T04:43:10.671 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-08-25T04:43:10.867 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-08-25T04:43:10.874 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-08-25T04:43:11.013 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-08-25T04:43:11.121 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/160 2023-08-25T04:43:11.197 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-08-25T04:43:11.395 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 40/160 2023-08-25T04:43:11.525 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-08-25T04:43:11.635 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_6 41/160 2023-08-25T04:43:11.724 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-08-25T04:43:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-08-25T04:43:11.875 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-08-25T04:43:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-08-25T04:43:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-08-25T04:43:12.290 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-08-25T04:43:12.296 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-08-25T04:43:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-08-25T04:43:12.513 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-08-25T04:43:12.573 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-08-25T04:43:12.665 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-08-25T04:43:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-08-25T04:43:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-08-25T04:43:12.903 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-08-25T04:43:13.010 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-08-25T04:43:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-08-25T04:43:13.220 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-08-25T04:43:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-08-25T04:43:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-08-25T04:43:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-08-25T04:43:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-08-25T04:43:14.239 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-08-25T04:43:14.523 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-08-25T04:43:14.773 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-08-25T04:43:14.953 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-08-25T04:43:15.153 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-08-25T04:43:15.371 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-08-25T04:43:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-08-25T04:43:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-08-25T04:43:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-08-25T04:43:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-08-25T04:43:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 100/160 2023-08-25T04:43:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-08-25T04:43:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-08-25T04:43:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-08-25T04:43:16.894 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 100/160 2023-08-25T04:43:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-08-25T04:43:17.276 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-08-25T04:43:17.529 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-08-25T04:43:17.580 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 100/160 2023-08-25T04:43:17.765 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-08-25T04:43:17.900 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 101/160 2023-08-25T04:43:18.099 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 101/160 2023-08-25T04:43:18.140 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-08-25T04:43:18.299 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 102/160 2023-08-25T04:43:18.433 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-08-25T04:43:18.672 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-08-25T04:43:19.537 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-08-25T04:43:19.773 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 70/160 2023-08-25T04:43:19.931 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 70/160 2023-08-25T04:43:20.192 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 71/160 2023-08-25T04:43:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-08-25T04:43:20.901 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-08-25T04:43:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-08-25T04:43:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-08-25T04:43:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-08-25T04:43:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-08-25T04:43:23.272 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-08-25T04:43:23.701 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-08-25T04:43:23.923 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-08-25T04:43:24.175 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-08-25T04:43:24.481 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-08-25T04:43:24.750 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-08-25T04:43:25.197 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-08-25T04:43:25.423 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-08-25T04:43:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-08-25T04:43:26.028 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-08-25T04:43:26.191 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-08-25T04:43:26.389 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-08-25T04:43:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-08-25T04:43:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-08-25T04:43:27.205 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-08-25T04:43:27.432 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-08-25T04:43:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-08-25T04:43:27.879 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-08-25T04:43:28.106 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-08-25T04:43:28.320 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-08-25T04:43:28.447 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-08-25T04:43:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-08-25T04:43:28.847 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-08-25T04:43:31.746 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 100/160 2023-08-25T04:43:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 100/160 2023-08-25T04:43:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 100/160 2023-08-25T04:43:33.029 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 101/160 2023-08-25T04:43:33.218 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 101/160 2023-08-25T04:43:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 102/160 2023-08-25T04:43:38.949 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 102/160 2023-08-25T04:43:38.949 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2023-08-25T04:43:38.949 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2023-08-25T04:43:38.949 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /dev 2023-08-25T04:43:38.949 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /run 2023-08-25T04:43:38.950 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2023-08-25T04:43:38.950 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2023-08-25T04:43:38.950 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2023-08-25T04:43:38.950 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2023-08-25T04:43:38.950 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /dev 2023-08-25T04:43:38.950 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:43:39.315 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 103/160 2023-08-25T04:43:41.042 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 103/160 2023-08-25T04:43:41.280 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 104/160 2023-08-25T04:43:41.546 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 104/160 2023-08-25T04:43:41.756 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 105/160 2023-08-25T04:43:42.278 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 105/160 2023-08-25T04:43:42.464 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 106/160 2023-08-25T04:43:42.514 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 106/160 2023-08-25T04:43:42.723 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-08-25T04:43:42.945 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-08-25T04:43:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-08-25T04:43:43.173 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-08-25T04:43:43.447 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-08-25T04:43:43.705 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : automake-1.16.1-8.el8.noarch 111/160 2023-08-25T04:43:44.286 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 112/160 2023-08-25T04:43:44.457 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 112/160 2023-08-25T04:43:44.580 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 113/160 2023-08-25T04:43:44.786 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 114/160 2023-08-25T04:43:45.033 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 115/160 2023-08-25T04:43:45.292 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 115/160 2023-08-25T04:43:45.553 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 116/160 2023-08-25T04:43:46.657 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 116/160 2023-08-25T04:43:46.846 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 117/160 2023-08-25T04:43:46.973 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 117/160 2023-08-25T04:43:47.394 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 118/160 2023-08-25T04:43:47.604 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 119/160 2023-08-25T04:43:47.669 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 119/160 2023-08-25T04:43:47.830 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 120/160 2023-08-25T04:43:47.857 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 120/160 2023-08-25T04:43:48.039 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 121/160 2023-08-25T04:43:48.213 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-08-25T04:43:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-08-25T04:43:54.727 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 123/160 2023-08-25T04:43:54.919 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 124/160 2023-08-25T04:43:54.982 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 124/160 2023-08-25T04:43:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 125/160 2023-08-25T04:43:55.266 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 125/160 2023-08-25T04:43:55.425 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 102/160 2023-08-25T04:43:55.425 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2023-08-25T04:43:55.426 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2023-08-25T04:43:55.426 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-08-25T04:43:55.426 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2023-08-25T04:43:55.427 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2023-08-25T04:43:55.427 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2023-08-25T04:43:55.427 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2023-08-25T04:43:55.427 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2023-08-25T04:43:55.428 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-08-25T04:43:55.428 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:43:55.446 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 126/160 2023-08-25T04:43:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 126/160 2023-08-25T04:43:55.902 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 103/160 2023-08-25T04:43:56.054 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 127/160 2023-08-25T04:43:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 127/160 2023-08-25T04:43:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-contrib-10.23-2.module_el8+572+929c87 128/160 2023-08-25T04:43:57.633 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 103/160 2023-08-25T04:43:57.880 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 129/160 2023-08-25T04:43:57.901 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 104/160 2023-08-25T04:43:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 104/160 2023-08-25T04:43:58.233 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-08-25T04:43:58.360 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 105/160 2023-08-25T04:43:58.452 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-08-25T04:43:58.666 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-08-25T04:43:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-08-25T04:43:58.883 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 105/160 2023-08-25T04:43:59.013 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_ 134/160 2023-08-25T04:43:59.095 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 106/160 2023-08-25T04:43:59.142 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 106/160 2023-08-25T04:43:59.410 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-08-25T04:43:59.635 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-08-25T04:43:59.810 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-08-25T04:43:59.904 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-08-25T04:44:00.106 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-08-25T04:44:00.219 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-08-25T04:44:00.362 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-08-25T04:44:00.443 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-08-25T04:44:00.467 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.1-8.el8.noarch 111/160 2023-08-25T04:44:00.674 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-08-25T04:44:00.895 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 137/160 2023-08-25T04:44:01.137 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 138/160 2023-08-25T04:44:01.193 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 112/160 2023-08-25T04:44:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 112/160 2023-08-25T04:44:01.501 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 139/160 2023-08-25T04:44:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 113/160 2023-08-25T04:44:01.699 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 114/160 2023-08-25T04:44:01.780 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-08-25T04:44:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-08-25T04:44:01.967 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 115/160 2023-08-25T04:44:01.975 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-08-25T04:44:02.183 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-08-25T04:44:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 115/160 2023-08-25T04:44:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-08-25T04:44:02.441 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 116/160 2023-08-25T04:44:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-08-25T04:44:02.777 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-08-25T04:44:02.803 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-08-25T04:44:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-08-25T04:44:03.219 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-08-25T04:44:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-08-25T04:44:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-08-25T04:44:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 116/160 2023-08-25T04:44:03.698 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-08-25T04:44:03.699 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-08-25T04:44:03.742 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 117/160 2023-08-25T04:44:03.870 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 117/160 2023-08-25T04:44:03.955 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-08-25T04:44:03.970 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-08-25T04:44:04.092 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-08-25T04:44:04.092 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-08-25T04:44:04.259 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 118/160 2023-08-25T04:44:04.368 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-08-25T04:44:04.517 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 119/160 2023-08-25T04:44:04.553 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-08-25T04:44:04.583 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 119/160 2023-08-25T04:44:04.724 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-08-25T04:44:04.750 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 120/160 2023-08-25T04:44:04.777 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 120/160 2023-08-25T04:44:04.962 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-08-25T04:44:04.963 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-08-25T04:44:04.968 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 121/160 2023-08-25T04:44:05.159 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-08-25T04:44:05.172 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-08-25T04:44:05.172 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-08-25T04:44:05.389 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-08-25T04:44:05.389 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-08-25T04:44:05.639 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-08-25T04:44:05.639 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-08-25T04:44:05.846 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-08-25T04:44:05.847 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-08-25T04:44:06.055 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-08-25T04:44:06.253 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-08-25T04:44:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-08-25T04:44:06.450 INFO:teuthology.orchestra.run.smithi137.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-25T04:44:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:07.169 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 1/160 2023-08-25T04:44:07.169 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 2/160 2023-08-25T04:44:07.170 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 3/160 2023-08-25T04:44:07.170 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 4/160 2023-08-25T04:44:07.170 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 5/160 2023-08-25T04:44:07.170 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 6/160 2023-08-25T04:44:07.170 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 7/160 2023-08-25T04:44:07.170 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/160 2023-08-25T04:44:07.171 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 9/160 2023-08-25T04:44:07.171 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 10/160 2023-08-25T04:44:07.171 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 11/160 2023-08-25T04:44:07.171 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 12/160 2023-08-25T04:44:07.171 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 13/160 2023-08-25T04:44:07.172 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_ 14/160 2023-08-25T04:44:07.172 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 15/160 2023-08-25T04:44:07.172 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 16/160 2023-08-25T04:44:07.172 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_6 17/160 2023-08-25T04:44:07.172 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 18/160 2023-08-25T04:44:07.172 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 19/160 2023-08-25T04:44:07.173 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 20/160 2023-08-25T04:44:07.173 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8. 21/160 2023-08-25T04:44:07.173 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_6 22/160 2023-08-25T04:44:07.174 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 23/160 2023-08-25T04:44:07.174 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 24/160 2023-08-25T04:44:07.174 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 25/160 2023-08-25T04:44:07.174 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 26/160 2023-08-25T04:44:07.174 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 27/160 2023-08-25T04:44:07.190 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 28/160 2023-08-25T04:44:07.190 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 29/160 2023-08-25T04:44:07.190 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 30/160 2023-08-25T04:44:07.191 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 31/160 2023-08-25T04:44:07.191 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 32/160 2023-08-25T04:44:07.191 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 33/160 2023-08-25T04:44:07.192 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 34/160 2023-08-25T04:44:07.192 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 35/160 2023-08-25T04:44:07.192 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 36/160 2023-08-25T04:44:07.192 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 37/160 2023-08-25T04:44:07.192 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 38/160 2023-08-25T04:44:07.193 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/160 2023-08-25T04:44:07.193 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-08-25T04:44:07.193 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-08-25T04:44:07.194 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-08-25T04:44:07.194 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-08-25T04:44:07.194 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-08-25T04:44:07.194 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-08-25T04:44:07.195 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-08-25T04:44:07.195 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-08-25T04:44:07.195 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-08-25T04:44:07.195 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-08-25T04:44:07.196 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 50/160 2023-08-25T04:44:07.196 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-contrib-10.23-2.module_el8+572+929c87 51/160 2023-08-25T04:44:07.196 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-server-10.23-2.module_el8+572+929c87a 52/160 2023-08-25T04:44:07.196 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-08-25T04:44:07.196 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-08-25T04:44:07.197 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-08-25T04:44:07.197 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-08-25T04:44:07.197 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-08-25T04:44:07.197 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-08-25T04:44:07.197 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-08-25T04:44:07.197 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-08-25T04:44:07.197 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-08-25T04:44:07.198 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-08-25T04:44:07.198 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-08-25T04:44:07.198 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-08-25T04:44:07.198 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 65/160 2023-08-25T04:44:07.198 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-08-25T04:44:07.199 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-08-25T04:44:07.199 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-08-25T04:44:07.199 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-08-25T04:44:07.199 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-08-25T04:44:07.199 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-08-25T04:44:07.199 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-08-25T04:44:07.199 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-08-25T04:44:07.200 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-08-25T04:44:07.200 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-08-25T04:44:07.200 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-08-25T04:44:07.200 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-08-25T04:44:07.200 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-08-25T04:44:07.200 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-08-25T04:44:07.201 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-08-25T04:44:07.201 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-08-25T04:44:07.201 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-08-25T04:44:07.201 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-08-25T04:44:07.201 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-08-25T04:44:07.202 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-08-25T04:44:07.202 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-08-25T04:44:07.202 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-08-25T04:44:07.202 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-08-25T04:44:07.202 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-08-25T04:44:07.203 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-08-25T04:44:07.203 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-08-25T04:44:07.203 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-08-25T04:44:07.203 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-08-25T04:44:07.203 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-08-25T04:44:07.203 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-08-25T04:44:07.204 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-08-25T04:44:07.204 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-08-25T04:44:07.204 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-08-25T04:44:07.204 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-08-25T04:44:07.204 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-08-25T04:44:07.205 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-08-25T04:44:07.205 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-08-25T04:44:07.205 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-08-25T04:44:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-08-25T04:44:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-08-25T04:44:07.207 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-08-25T04:44:07.207 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-08-25T04:44:07.207 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-08-25T04:44:07.208 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-08-25T04:44:07.208 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-08-25T04:44:07.209 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-08-25T04:44:07.209 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-08-25T04:44:07.209 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-08-25T04:44:07.210 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-08-25T04:44:07.210 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-08-25T04:44:07.210 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-08-25T04:44:07.211 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-08-25T04:44:07.211 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 118/160 2023-08-25T04:44:07.211 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-08-25T04:44:07.212 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-08-25T04:44:07.212 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-08-25T04:44:07.215 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-08-25T04:44:07.215 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-08-25T04:44:07.216 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-08-25T04:44:07.216 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-08-25T04:44:07.216 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-08-25T04:44:07.217 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-08-25T04:44:07.217 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-08-25T04:44:07.217 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 129/160 2023-08-25T04:44:07.218 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-08-25T04:44:07.219 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 131/160 2023-08-25T04:44:07.219 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-08-25T04:44:07.220 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-08-25T04:44:07.220 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-08-25T04:44:07.220 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-08-25T04:44:07.221 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-08-25T04:44:07.221 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-08-25T04:44:07.221 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-08-25T04:44:07.222 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-08-25T04:44:07.222 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-08-25T04:44:07.222 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-08-25T04:44:07.222 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-08-25T04:44:07.223 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-08-25T04:44:07.223 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-08-25T04:44:07.223 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-08-25T04:44:07.224 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-08-25T04:44:07.224 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-08-25T04:44:07.224 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-08-25T04:44:07.225 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-08-25T04:44:07.225 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-08-25T04:44:07.225 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-08-25T04:44:07.226 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-08-25T04:44:07.226 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-08-25T04:44:07.226 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-08-25T04:44:07.227 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-08-25T04:44:07.227 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-08-25T04:44:07.227 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-08-25T04:44:07.227 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-08-25T04:44:07.228 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-08-25T04:44:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-08-25T04:44:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:09.347 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2023-08-25T04:44:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-08-25T04:44:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-08-25T04:44:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-08-25T04:44:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-08-25T04:44:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: iproute-6.2.0-2.el8.x86_64 2023-08-25T04:44:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: libblkid-2.32.1-42.el8.x86_64 2023-08-25T04:44:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-08-25T04:44:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: libmount-2.32.1-42.el8.x86_64 2023-08-25T04:44:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-08-25T04:44:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-2.32.1-42.el8.x86_64 2023-08-25T04:44:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux-2.32.1-42.el8.x86_64 2023-08-25T04:44:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-08-25T04:44:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-08-25T04:44:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-25T04:44:09.349 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2023-08-25T04:44:09.350 INFO:teuthology.orchestra.run.smithi137.stdout: automake-1.16.1-8.el8.noarch 2023-08-25T04:44:09.350 INFO:teuthology.orchestra.run.smithi137.stdout: bison-3.0.4-10.el8.x86_64 2023-08-25T04:44:09.350 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.350 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.350 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.350 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.350 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:09.351 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.351 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.351 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.351 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:09.351 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:09.351 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:09.351 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:09.351 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:09.352 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.352 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.352 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:09.352 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.352 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.352 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.352 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:09.353 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:09.353 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.353 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:09.353 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-08-25T04:44:09.353 INFO:teuthology.orchestra.run.smithi137.stdout: flex-2.6.1-9.el8.x86_64 2023-08-25T04:44:09.353 INFO:teuthology.orchestra.run.smithi137.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-25T04:44:09.353 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-25T04:44:09.355 INFO:teuthology.orchestra.run.smithi137.stdout: jq-1.6-7.el8.x86_64 2023-08-25T04:44:09.355 INFO:teuthology.orchestra.run.smithi137.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-25T04:44:09.355 INFO:teuthology.orchestra.run.smithi137.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-25T04:44:09.356 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-25T04:44:09.356 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.356 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.357 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.357 INFO:teuthology.orchestra.run.smithi137.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-25T04:44:09.357 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-25T04:44:09.358 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-25T04:44:09.358 INFO:teuthology.orchestra.run.smithi137.stdout: libpq-13.5-1.el8.x86_64 2023-08-25T04:44:09.358 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-25T04:44:09.358 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-25T04:44:09.359 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.359 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.359 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-25T04:44:09.359 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.360 INFO:teuthology.orchestra.run.smithi137.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-25T04:44:09.361 INFO:teuthology.orchestra.run.smithi137.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-25T04:44:09.361 INFO:teuthology.orchestra.run.smithi137.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-25T04:44:09.362 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-25T04:44:09.362 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-08-25T04:44:09.362 INFO:teuthology.orchestra.run.smithi137.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-25T04:44:09.362 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-25T04:44:09.362 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-25T04:44:09.362 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-25T04:44:09.362 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-25T04:44:09.363 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-25T04:44:09.363 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-25T04:44:09.363 INFO:teuthology.orchestra.run.smithi137.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-25T04:44:09.363 INFO:teuthology.orchestra.run.smithi137.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-25T04:44:09.363 INFO:teuthology.orchestra.run.smithi137.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-25T04:44:09.363 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-10.23-2.module_el8+572+929c87ac.x86_64 2023-08-25T04:44:09.363 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib-10.23-2.module_el8+572+929c87ac.x86_64 2023-08-25T04:44:09.363 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server-10.23-2.module_el8+572+929c87ac.x86_64 2023-08-25T04:44:09.364 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-25T04:44:09.364 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-25T04:44:09.364 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-25T04:44:09.364 INFO:teuthology.orchestra.run.smithi137.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-25T04:44:09.364 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-25T04:44:09.364 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.364 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-25T04:44:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-25T04:44:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-25T04:44:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-25T04:44:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-25T04:44:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-25T04:44:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-25T04:44:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-25T04:44:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-25T04:44:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-25T04:44:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-25T04:44:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-25T04:44:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-25T04:44:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-25T04:44:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-25T04:44:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-25T04:44:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-25T04:44:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-25T04:44:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-25T04:44:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-25T04:44:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-25T04:44:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-25T04:44:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-2.6-1.el8.noarch 2023-08-25T04:44:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-25T04:44:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-25T04:44:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-25T04:44:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-25T04:44:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-25T04:44:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2017.2-11.el8.noarch 2023-08-25T04:44:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-25T04:44:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-25T04:44:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-25T04:44:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-25T04:44:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-25T04:44:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-25T04:44:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-25T04:44:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-25T04:44:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-25T04:44:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-25T04:44:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-25T04:44:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-25T04:44:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-25T04:44:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-25T04:44:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-25T04:44:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-25T04:44:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-25T04:44:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-25T04:44:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-25T04:44:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-25T04:44:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-25T04:44:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:09.373 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2023-08-25T04:44:09.666 DEBUG:teuthology.parallel:result is None 2023-08-25T04:44:10.119 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-08-25T04:44:11.695 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 123/160 2023-08-25T04:44:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 124/160 2023-08-25T04:44:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 124/160 2023-08-25T04:44:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 125/160 2023-08-25T04:44:12.246 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 125/160 2023-08-25T04:44:12.458 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 126/160 2023-08-25T04:44:12.874 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 126/160 2023-08-25T04:44:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 127/160 2023-08-25T04:44:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 127/160 2023-08-25T04:44:13.805 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-contrib-10.23-2.module_el8+572+929c87 128/160 2023-08-25T04:44:15.039 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 129/160 2023-08-25T04:44:15.388 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-08-25T04:44:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-08-25T04:44:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-08-25T04:44:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-08-25T04:44:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_ 134/160 2023-08-25T04:44:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-08-25T04:44:17.766 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-08-25T04:44:17.859 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 135/160 2023-08-25T04:44:18.112 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-08-25T04:44:18.349 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 137/160 2023-08-25T04:44:18.600 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 138/160 2023-08-25T04:44:19.003 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 139/160 2023-08-25T04:44:19.334 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-08-25T04:44:19.499 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-08-25T04:44:19.524 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-08-25T04:44:19.728 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-08-25T04:44:20.023 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-08-25T04:44:20.129 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-08-25T04:44:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-08-25T04:44:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-08-25T04:44:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-08-25T04:44:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-08-25T04:44:21.094 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-08-25T04:44:21.095 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-08-25T04:44:21.386 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-08-25T04:44:21.387 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-08-25T04:44:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-08-25T04:44:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-08-25T04:44:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-08-25T04:44:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-08-25T04:44:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-08-25T04:44:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-08-25T04:44:22.523 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-08-25T04:44:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-08-25T04:44:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-08-25T04:44:23.036 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-08-25T04:44:23.037 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-08-25T04:44:23.260 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-08-25T04:44:23.260 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-08-25T04:44:23.526 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-08-25T04:44:23.527 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-08-25T04:44:23.768 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-08-25T04:44:23.768 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-08-25T04:44:23.968 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-08-25T04:44:24.175 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-08-25T04:44:24.388 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-08-25T04:44:24.389 INFO:teuthology.orchestra.run.smithi072.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-25T04:44:24.389 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:25.131 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 1/160 2023-08-25T04:44:25.132 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 2/160 2023-08-25T04:44:25.132 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 3/160 2023-08-25T04:44:25.132 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 4/160 2023-08-25T04:44:25.132 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5703.gba6b3 5/160 2023-08-25T04:44:25.132 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 6/160 2023-08-25T04:44:25.132 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 7/160 2023-08-25T04:44:25.133 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 8/160 2023-08-25T04:44:25.133 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 9/160 2023-08-25T04:44:25.133 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 10/160 2023-08-25T04:44:25.133 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 11/160 2023-08-25T04:44:25.133 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 12/160 2023-08-25T04:44:25.133 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 13/160 2023-08-25T04:44:25.133 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_ 14/160 2023-08-25T04:44:25.133 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 15/160 2023-08-25T04:44:25.134 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 16/160 2023-08-25T04:44:25.134 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_6 17/160 2023-08-25T04:44:25.134 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86 18/160 2023-08-25T04:44:25.134 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 19/160 2023-08-25T04:44:25.134 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el 20/160 2023-08-25T04:44:25.134 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8. 21/160 2023-08-25T04:44:25.134 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_6 22/160 2023-08-25T04:44:25.135 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 23/160 2023-08-25T04:44:25.135 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 24/160 2023-08-25T04:44:25.135 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 25/160 2023-08-25T04:44:25.135 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 26/160 2023-08-25T04:44:25.135 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 27/160 2023-08-25T04:44:25.135 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 28/160 2023-08-25T04:44:25.135 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4. 29/160 2023-08-25T04:44:25.135 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noa 30/160 2023-08-25T04:44:25.136 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.n 31/160 2023-08-25T04:44:25.136 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6 32/160 2023-08-25T04:44:25.136 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el 33/160 2023-08-25T04:44:25.136 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 34/160 2023-08-25T04:44:25.136 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.e 35/160 2023-08-25T04:44:25.136 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 36/160 2023-08-25T04:44:25.136 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 37/160 2023-08-25T04:44:25.136 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 38/160 2023-08-25T04:44:25.137 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/160 2023-08-25T04:44:25.137 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-08-25T04:44:25.137 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-08-25T04:44:25.137 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-08-25T04:44:25.137 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-08-25T04:44:25.137 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-08-25T04:44:25.137 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-08-25T04:44:25.138 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-08-25T04:44:25.138 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-08-25T04:44:25.138 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-08-25T04:44:25.138 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-08-25T04:44:25.138 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 50/160 2023-08-25T04:44:25.138 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-contrib-10.23-2.module_el8+572+929c87 51/160 2023-08-25T04:44:25.138 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-server-10.23-2.module_el8+572+929c87a 52/160 2023-08-25T04:44:25.138 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-08-25T04:44:25.139 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-08-25T04:44:25.139 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-08-25T04:44:25.139 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-08-25T04:44:25.139 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-08-25T04:44:25.139 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-08-25T04:44:25.139 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-08-25T04:44:25.139 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-08-25T04:44:25.139 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-08-25T04:44:25.140 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-08-25T04:44:25.140 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-08-25T04:44:25.140 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-08-25T04:44:25.140 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 65/160 2023-08-25T04:44:25.140 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-08-25T04:44:25.140 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-08-25T04:44:25.140 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-08-25T04:44:25.140 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-08-25T04:44:25.141 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-08-25T04:44:25.141 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-08-25T04:44:25.141 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-08-25T04:44:25.141 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-08-25T04:44:25.141 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-08-25T04:44:25.141 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-08-25T04:44:25.141 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-08-25T04:44:25.141 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-08-25T04:44:25.142 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-08-25T04:44:25.142 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-08-25T04:44:25.142 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-08-25T04:44:25.142 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-08-25T04:44:25.142 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-08-25T04:44:25.142 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-08-25T04:44:25.142 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-08-25T04:44:25.142 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-08-25T04:44:25.143 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-08-25T04:44:25.143 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-08-25T04:44:25.143 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-08-25T04:44:25.143 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-08-25T04:44:25.143 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-08-25T04:44:25.143 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-08-25T04:44:25.143 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-08-25T04:44:25.143 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-08-25T04:44:25.144 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-08-25T04:44:25.144 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-08-25T04:44:25.144 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-08-25T04:44:25.144 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-08-25T04:44:25.144 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-08-25T04:44:25.144 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-08-25T04:44:25.144 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-08-25T04:44:25.145 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-08-25T04:44:25.145 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-08-25T04:44:25.145 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-08-25T04:44:25.145 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-08-25T04:44:25.145 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-08-25T04:44:25.145 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-08-25T04:44:25.145 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-08-25T04:44:25.145 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-08-25T04:44:25.146 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-08-25T04:44:25.146 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-08-25T04:44:25.146 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-08-25T04:44:25.146 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-08-25T04:44:25.146 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-08-25T04:44:25.146 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-08-25T04:44:25.146 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-08-25T04:44:25.146 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-08-25T04:44:25.147 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-08-25T04:44:25.147 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 118/160 2023-08-25T04:44:25.147 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-08-25T04:44:25.147 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-08-25T04:44:25.147 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-08-25T04:44:25.147 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-08-25T04:44:25.147 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-08-25T04:44:25.147 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-08-25T04:44:25.148 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-08-25T04:44:25.148 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-08-25T04:44:25.148 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-08-25T04:44:25.148 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-08-25T04:44:25.148 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 129/160 2023-08-25T04:44:25.148 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-08-25T04:44:25.148 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 131/160 2023-08-25T04:44:25.149 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-08-25T04:44:25.149 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-08-25T04:44:25.149 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-08-25T04:44:25.149 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-08-25T04:44:25.149 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-08-25T04:44:25.149 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-08-25T04:44:25.149 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-08-25T04:44:25.149 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-08-25T04:44:25.150 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-08-25T04:44:25.150 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-08-25T04:44:25.150 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-08-25T04:44:25.150 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-08-25T04:44:25.150 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-08-25T04:44:25.150 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-08-25T04:44:25.150 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-08-25T04:44:25.150 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-08-25T04:44:25.151 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-08-25T04:44:25.151 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-08-25T04:44:25.151 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-08-25T04:44:25.151 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-08-25T04:44:25.151 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-08-25T04:44:25.151 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-08-25T04:44:25.151 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-08-25T04:44:25.151 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-08-25T04:44:25.152 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-08-25T04:44:25.152 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-08-25T04:44:25.152 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-08-25T04:44:25.152 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-08-25T04:44:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-08-25T04:44:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:27.282 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-08-25T04:44:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-08-25T04:44:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-08-25T04:44:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-08-25T04:44:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-08-25T04:44:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: iproute-6.2.0-2.el8.x86_64 2023-08-25T04:44:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid-2.32.1-42.el8.x86_64 2023-08-25T04:44:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-08-25T04:44:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: libmount-2.32.1-42.el8.x86_64 2023-08-25T04:44:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.284 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.284 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-08-25T04:44:27.284 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-2.32.1-42.el8.x86_64 2023-08-25T04:44:27.284 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-2.32.1-42.el8.x86_64 2023-08-25T04:44:27.284 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-08-25T04:44:27.285 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-08-25T04:44:27.285 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-25T04:44:27.285 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-08-25T04:44:27.286 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.1-8.el8.noarch 2023-08-25T04:44:27.286 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2023-08-25T04:44:27.286 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.286 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.286 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.287 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.287 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:27.287 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:27.289 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:27.289 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:27.289 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:27.290 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.290 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.290 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:27.291 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.291 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.292 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.292 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:27.292 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:27.293 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.293 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:18.0.0-5703.gba6b39e4.el8.noarch 2023-08-25T04:44:27.293 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-08-25T04:44:27.294 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2023-08-25T04:44:27.294 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-25T04:44:27.294 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-25T04:44:27.294 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-7.el8.x86_64 2023-08-25T04:44:27.295 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-25T04:44:27.295 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-25T04:44:27.295 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-25T04:44:27.296 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.296 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-25T04:44:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-25T04:44:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-25T04:44:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: libpq-13.5-1.el8.x86_64 2023-08-25T04:44:27.298 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-25T04:44:27.298 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-25T04:44:27.298 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.298 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.299 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-25T04:44:27.299 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.299 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-25T04:44:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-25T04:44:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-25T04:44:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-25T04:44:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-08-25T04:44:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-25T04:44:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-25T04:44:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-25T04:44:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-25T04:44:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-25T04:44:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-25T04:44:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-25T04:44:27.302 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-25T04:44:27.302 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-25T04:44:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-25T04:44:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-10.23-2.module_el8+572+929c87ac.x86_64 2023-08-25T04:44:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib-10.23-2.module_el8+572+929c87ac.x86_64 2023-08-25T04:44:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server-10.23-2.module_el8+572+929c87ac.x86_64 2023-08-25T04:44:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-25T04:44:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-25T04:44:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-25T04:44:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-25T04:44:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-25T04:44:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-25T04:44:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-25T04:44:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-25T04:44:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-25T04:44:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-25T04:44:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-25T04:44:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-25T04:44:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-25T04:44:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-25T04:44:27.308 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-25T04:44:27.308 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-25T04:44:27.308 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-25T04:44:27.309 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-25T04:44:27.309 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-25T04:44:27.309 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-25T04:44:27.309 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-25T04:44:27.310 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-25T04:44:27.310 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-25T04:44:27.310 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-25T04:44:27.310 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-25T04:44:27.311 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-25T04:44:27.311 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-25T04:44:27.312 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2023-08-25T04:44:27.312 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-25T04:44:27.312 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-25T04:44:27.312 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-25T04:44:27.313 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-25T04:44:27.313 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-25T04:44:27.313 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-11.el8.noarch 2023-08-25T04:44:27.314 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.314 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.314 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-25T04:44:27.314 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-25T04:44:27.315 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.315 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-25T04:44:27.315 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-25T04:44:27.315 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-25T04:44:27.316 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-25T04:44:27.316 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-25T04:44:27.316 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-25T04:44:27.316 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-25T04:44:27.317 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-25T04:44:27.317 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-25T04:44:27.317 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-25T04:44:27.317 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-25T04:44:27.317 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-25T04:44:27.317 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-25T04:44:27.318 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.318 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.318 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:18.0.0-5703.gba6b39e4.el8.x86_64 2023-08-25T04:44:27.318 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-25T04:44:27.319 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-25T04:44:27.319 INFO:teuthology.orchestra.run.smithi072.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-25T04:44:27.319 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-25T04:44:27.320 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-25T04:44:27.320 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-25T04:44:27.320 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:27.320 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-08-25T04:44:27.618 DEBUG:teuthology.parallel:result is None 2023-08-25T04:44:27.619 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:44:27.763 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-25T04:44:27.819 INFO:teuthology.orchestra.run.smithi072.stdout:18.0.0-5703.gba6b39e4.el8 2023-08-25T04:44:27.820 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5703.gba6b39e4.el8 2023-08-25T04:44:27.821 INFO:teuthology.task.install:The correct ceph version 18.0.0-5703.gba6b39e4 is installed. 2023-08-25T04:44:27.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:44:27.963 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-25T04:44:28.024 INFO:teuthology.orchestra.run.smithi137.stdout:18.0.0-5703.gba6b39e4.el8 2023-08-25T04:44:28.024 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5703.gba6b39e4.el8 2023-08-25T04:44:28.025 INFO:teuthology.task.install:The correct ceph version 18.0.0-5703.gba6b39e4 is installed. 2023-08-25T04:44:28.026 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-25T04:44:28.026 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:28.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-25T04:44:28.101 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:44:28.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-25T04:44:28.179 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-25T04:44:28.180 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:28.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-08-25T04:44:28.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-25T04:44:28.362 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:44:28.362 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2023-08-25T04:44:28.433 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-25T04:44:28.542 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-25T04:44:28.543 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:28.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-25T04:44:28.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-25T04:44:28.727 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:44:28.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-25T04:44:28.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-25T04:44:28.905 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-25T04:44:28.905 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:28.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-08-25T04:44:29.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-25T04:44:29.544 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:44:29.544 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2023-08-25T04:44:29.615 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-25T04:44:29.723 INFO:teuthology.run_tasks:Running task ceph... 2023-08-25T04:44:29.806 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-25T04:44:29.807 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-08-25T04:44:29.813 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2023-08-25T04:44:29.883 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-25T04:44:29.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-25T04:44:29.888 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-25T04:44:29.956 INFO:tasks.ceph:Creating extra log directories... 2023-08-25T04:44:29.956 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-25T04:44:29.960 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-25T04:44:30.200 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-25T04:44:30.200 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-25T04:44:30.201 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-25T04:44:30.201 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:30.201 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-25T04:44:30.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:30.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:30.529 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:44:30.529 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-25T04:44:30.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:30.771 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:30.847 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-25T04:44:30.847 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-25T04:44:30.848 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379076', 'branch': 'wip-rishabh-2023aug3-b5', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7379076', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023aug3-b5'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023aug3-b5', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023aug3-b5', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNdk02F5Zp7DF6Kxc3VDjP2yFCkYkt6JpJvUOkgTLg+edCzIz+Uos56ai55M/5zQbSDoA/cV4PMDDFWeDwaN+wQ=', 'smithi137.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9JwuFW1WSAHQPuJIZ0mOzklryPugj6o4k1m5IWQ6tr2MZkU59M8E68oFm4XlAo9wmAeSuDe80Tg7GbOmBqT82OnBR7XA7eU590Zir7fT0OVe2UZIIni9nKexgwZrPAtqLRDLJM5FdpnE1cEEr65r6kQO//NXsKMEKcDfvzNSc4/2w7QrnoWQDxQRBzzGsGBLsd5AHO3EncR9EbWgBXpDqNsVusf9wAj4XGYKaiOYlcBI8IrrShLDSJ0QZHBOiQYSJId83GGhFI8C8RnL0de9xABu7LpRsralbSRmnq+DBuIpCVkPqZVL3R2njazZ6kza5si8OmKbVZOx21s9SvQeW6iyS6HJcl4W43x7QPnFgF9diBFgStcxX5oHQQ3bOfbS6e5kpNX6DQcEe0XJ/JpTWuy10tQKj2u39Z6k93wO/WButGq1k0uYD2KylNS6aTXKIxXOgES+1FZ0CmP5S1PgUTMpEVLY2GiQJfIAxka2T8gCJ/n8BJDeWrwAA0N+5RiM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-25_01:50:32', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-25T04:44:30.849 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-25T04:44:30.854 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-25T04:44:30.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-08-25T04:44:30.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2023-08-25T04:44:31.008 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:31.008 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2023-08-25T04:44:31.056 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-25T04:44:31.056 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2023-08-25T04:44:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-25T04:44:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:44:31.143 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 442 Links: 1 2023-08-25T04:44:31.143 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:31.143 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:44:31.143 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-08-25 04:44:24.614982113 +0000 2023-08-25T04:44:31.143 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-08-25 04:40:34.988915103 +0000 2023-08-25T04:44:31.143 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-08-25 04:40:34.988915103 +0000 2023-08-25T04:44:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-08-25 04:40:34.959915681 +0000 2023-08-25T04:44:31.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-25T04:44:31.213 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-08-25T04:44:31.214 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-08-25T04:44:31.214 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.00026128 s, 2.0 MB/s 2023-08-25T04:44:31.216 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-25T04:44:31.266 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2023-08-25T04:44:31.314 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-25T04:44:31.314 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:44:31.314 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-08-25T04:44:31.315 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:31.315 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:44:31.315 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-08-25 04:44:24.614982113 +0000 2023-08-25T04:44:31.315 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-08-25 04:40:35.855897839 +0000 2023-08-25T04:44:31.315 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-08-25 04:40:35.855897839 +0000 2023-08-25T04:44:31.315 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-08-25 04:40:35.827898396 +0000 2023-08-25T04:44:31.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-25T04:44:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-08-25T04:44:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-08-25T04:44:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000270069 s, 1.9 MB/s 2023-08-25T04:44:31.385 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-25T04:44:31.435 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2023-08-25T04:44:31.481 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-25T04:44:31.481 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:44:31.482 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-08-25T04:44:31.482 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:31.482 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:44:31.482 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-08-25 04:44:24.614982113 +0000 2023-08-25T04:44:31.482 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-08-25 04:40:36.715880713 +0000 2023-08-25T04:44:31.482 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-08-25 04:40:36.715880713 +0000 2023-08-25T04:44:31.482 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-08-25 04:40:36.692881171 +0000 2023-08-25T04:44:31.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-25T04:44:31.590 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-08-25T04:44:31.590 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-08-25T04:44:31.591 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000283092 s, 1.8 MB/s 2023-08-25T04:44:31.592 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-25T04:44:31.640 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2023-08-25T04:44:31.687 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-25T04:44:31.687 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:44:31.687 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-08-25T04:44:31.687 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:31.687 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:44:31.687 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-08-25 04:44:24.615982093 +0000 2023-08-25T04:44:31.688 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-08-25 04:40:37.623862632 +0000 2023-08-25T04:44:31.688 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-08-25 04:40:37.623862632 +0000 2023-08-25T04:44:31.688 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-08-25 04:40:37.595863190 +0000 2023-08-25T04:44:31.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-25T04:44:31.755 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-08-25T04:44:31.756 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-08-25T04:44:31.756 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000466418 s, 1.1 MB/s 2023-08-25T04:44:31.758 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-25T04:44:31.807 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:44:31.808 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:44:31.808 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2023-08-25T04:44:31.860 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-25T04:44:31.861 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2023-08-25T04:44:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-25T04:44:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:44:31.909 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-08-25T04:44:31.909 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:31.909 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:44:31.909 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2023-08-25 04:44:06.662764131 +0000 2023-08-25T04:44:31.910 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2023-08-25 04:40:23.588533811 +0000 2023-08-25T04:44:31.910 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2023-08-25 04:40:23.588533811 +0000 2023-08-25T04:44:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2023-08-25 04:40:23.564534243 +0000 2023-08-25T04:44:31.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-25T04:44:31.979 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2023-08-25T04:44:31.979 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2023-08-25T04:44:31.979 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.00031328 s, 1.6 MB/s 2023-08-25T04:44:31.981 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-25T04:44:32.029 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2023-08-25T04:44:32.076 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-25T04:44:32.077 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:44:32.077 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-08-25T04:44:32.077 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:32.077 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:44:32.078 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2023-08-25 04:44:06.662764131 +0000 2023-08-25T04:44:32.078 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2023-08-25 04:40:24.439518482 +0000 2023-08-25T04:44:32.078 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2023-08-25 04:40:24.439518482 +0000 2023-08-25T04:44:32.078 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2023-08-25 04:40:24.415518915 +0000 2023-08-25T04:44:32.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-25T04:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2023-08-25T04:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2023-08-25T04:44:32.183 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000511879 s, 1.0 MB/s 2023-08-25T04:44:32.186 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-25T04:44:32.234 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2023-08-25T04:44:32.280 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-25T04:44:32.280 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:44:32.280 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-08-25T04:44:32.280 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:32.280 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:44:32.281 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2023-08-25 04:44:06.662764131 +0000 2023-08-25T04:44:32.281 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2023-08-25 04:40:25.288503190 +0000 2023-08-25T04:44:32.281 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2023-08-25 04:40:25.288503190 +0000 2023-08-25T04:44:32.281 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2023-08-25 04:40:25.262503658 +0000 2023-08-25T04:44:32.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-25T04:44:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2023-08-25T04:44:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2023-08-25T04:44:32.385 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.00026237 s, 2.0 MB/s 2023-08-25T04:44:32.388 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-25T04:44:32.435 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2023-08-25T04:44:32.481 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-25T04:44:32.482 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:44:32.482 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-08-25T04:44:32.482 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:44:32.482 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2023-08-25T04:44:32.482 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2023-08-25 04:44:06.662764131 +0000 2023-08-25T04:44:32.483 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2023-08-25 04:40:26.198486799 +0000 2023-08-25T04:44:32.483 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2023-08-25 04:40:26.198486799 +0000 2023-08-25T04:44:32.483 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2023-08-25 04:40:26.173487249 +0000 2023-08-25T04:44:32.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-25T04:44:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2023-08-25T04:44:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2023-08-25T04:44:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000297198 s, 1.7 MB/s 2023-08-25T04:44:32.590 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-25T04:44:32.638 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:44:32.638 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-25T04:44:32.638 INFO:tasks.ceph:Generating config... 2023-08-25T04:44:32.641 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-25T04:44:32.641 INFO:tasks.ceph:[client] debug client = 20 2023-08-25T04:44:32.641 INFO:tasks.ceph:[client] debug ms = 1 2023-08-25T04:44:32.642 INFO:tasks.ceph:[client] pid file = 2023-08-25T04:44:32.642 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-25T04:44:32.642 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-25T04:44:32.643 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-25T04:44:32.643 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-25T04:44:32.643 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-25T04:44:32.643 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-25T04:44:32.644 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-25T04:44:32.644 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-25T04:44:32.644 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-25T04:44:32.645 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-25T04:44:32.645 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-25T04:44:32.646 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-25T04:44:32.646 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-25T04:44:32.646 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-25T04:44:32.647 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-25T04:44:32.647 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-25T04:44:32.647 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-25T04:44:32.647 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-25T04:44:32.648 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-25T04:44:32.648 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-25T04:44:32.648 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-08-25T04:44:32.648 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-08-25T04:44:32.648 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-25T04:44:32.649 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-25T04:44:32.649 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-08-25T04:44:32.649 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-25T04:44:32.649 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-25T04:44:32.650 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-25T04:44:32.650 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-25T04:44:32.650 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-25T04:44:32.651 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-25T04:44:32.651 INFO:tasks.ceph:Setting up mon.a... 2023-08-25T04:44:32.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-25T04:44:32.758 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.keyring 2023-08-25T04:44:32.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-25T04:44:32.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T04:44:32.937 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.72'), ('mon.b', '172.21.15.137'), ('mon.c', '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]')] 2023-08-25T04:44:32.937 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.72,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-25T04:44:32.938 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:32.938 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-25T04:44:32.985 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.72 --add b 172.21.15.137 --addv c '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:44:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:44:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: generated fsid 48882d5a-36fb-4a1e-9265-02d65750e322 2023-08-25T04:44:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = pacific 2023-08-25T04:44:33.116 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 0 2023-08-25T04:44:33.117 INFO:teuthology.orchestra.run.smithi072.stdout:fsid 48882d5a-36fb-4a1e-9265-02d65750e322 2023-08-25T04:44:33.117 INFO:teuthology.orchestra.run.smithi072.stdout:last_changed 2023-08-25T04:44:33.116436+0000 2023-08-25T04:44:33.117 INFO:teuthology.orchestra.run.smithi072.stdout:created 2023-08-25T04:44:33.116436+0000 2023-08-25T04:44:33.117 INFO:teuthology.orchestra.run.smithi072.stdout:min_mon_release 16 (pacific) 2023-08-25T04:44:33.117 INFO:teuthology.orchestra.run.smithi072.stdout:election_strategy: 1 2023-08-25T04:44:33.117 INFO:teuthology.orchestra.run.smithi072.stdout:0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2023-08-25T04:44:33.117 INFO:teuthology.orchestra.run.smithi072.stdout:1: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2023-08-25T04:44:33.118 INFO:teuthology.orchestra.run.smithi072.stdout:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2023-08-25T04:44:33.118 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-25T04:44:33.119 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-25T04:44:33.166 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 48882d5a-36fb-4a1e-9265-02d65750e322... 2023-08-25T04:44:33.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-25T04:44:33.172 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-25T04:44:33.289 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-08-25T04:44:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-08-25T04:44:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-25T04:44:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-08-25T04:44:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-08-25T04:44:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-08-25T04:44:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-08-25T04:44:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-08-25T04:44:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-08-25T04:44:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-08-25T04:44:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-25T04:44:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-08-25T04:44:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-08-25T04:44:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-25T04:44:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-08-25T04:44:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-08-25T04:44:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-08-25T04:44:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-08-25T04:44:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-08-25T04:44:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-08-25T04:44:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-08-25T04:44:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-08-25T04:44:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-25T04:44:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-25T04:44:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-08-25T04:44:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-25T04:44:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-08-25T04:44:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.296 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-08-25T04:44:33.296 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.296 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-08-25T04:44:33.296 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-08-25T04:44:33.296 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-08-25T04:44:33.296 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.72,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2023-08-25T04:44:33.297 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 48882d5a-36fb-4a1e-9265-02d65750e322 2023-08-25T04:44:33.297 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.297 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-08-25T04:44:33.297 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-08-25T04:44:33.297 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.297 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-08-25T04:44:33.297 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-08-25T04:44:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2023-08-25T04:44:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-08-25T04:44:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-08-25T04:44:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-08-25T04:44:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-08-25T04:44:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-08-25T04:44:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-08-25T04:44:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-08-25T04:44:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-08-25T04:44:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-08-25T04:44:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-08-25T04:44:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-08-25T04:44:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-08-25T04:44:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-08-25T04:44:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-08-25T04:44:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-08-25T04:44:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-08-25T04:44:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 20 2023-08-25T04:44:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 20 2023-08-25T04:44:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-08-25T04:44:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-08-25T04:44:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 10 2023-08-25T04:44:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-08-25T04:44:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-08-25T04:44:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-08-25T04:44:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-08-25T04:44:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-08-25T04:44:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-08-25T04:44:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.303 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-08-25T04:44:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-08-25T04:44:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-08-25T04:44:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-08-25T04:44:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-08-25T04:44:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:44:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:44:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-08-25T04:44:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.305 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-08-25T04:44:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-08-25T04:44:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-08-25T04:44:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-08-25T04:44:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-08-25T04:44:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-08-25T04:44:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-08-25T04:44:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:44:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-08-25T04:44:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-08-25T04:44:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:44:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-25T04:44:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-08-25T04:44:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-08-25T04:44:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-08-25T04:44:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-25T04:44:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-25T04:44:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2023-08-25T04:44:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2023-08-25T04:44:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2023-08-25T04:44:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2023-08-25T04:44:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:44:33.310 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-08-25T04:44:33.310 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-08-25T04:44:33.310 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-08-25T04:44:33.310 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-08-25T04:44:33.310 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-25T04:44:33.310 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-25T04:44:33.310 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2023-08-25T04:44:33.311 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-08-25T04:44:33.311 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-08-25T04:44:33.311 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = "" 2023-08-25T04:44:33.311 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-08-25T04:44:33.311 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-08-25T04:44:33.311 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-08-25T04:44:33.311 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-08-25T04:44:33.312 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-08-25T04:44:33.312 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-08-25T04:44:33.312 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-08-25T04:44:33.312 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-08-25T04:44:33.312 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-08-25T04:44:33.312 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2023-08-25T04:44:33.312 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2023-08-25T04:44:33.313 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2023-08-25T04:44:33.313 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-08-25T04:44:33.313 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2023-08-25T04:44:33.313 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2023-08-25T04:44:33.313 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2023-08-25T04:44:33.313 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2023-08-25T04:44:33.313 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-08-25T04:44:33.314 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-08-25T04:44:33.314 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-08-25T04:44:33.315 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2023-08-25T04:44:33.315 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2023-08-25T04:44:33.315 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-25T04:44:33.315 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2023-08-25T04:44:33.315 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.315 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2023-08-25T04:44:33.316 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.316 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2023-08-25T04:44:33.316 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.316 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2023-08-25T04:44:33.316 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2023-08-25T04:44:33.316 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.316 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2023-08-25T04:44:33.317 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2023-08-25T04:44:33.317 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.317 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-25T04:44:33.317 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2023-08-25T04:44:33.317 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.317 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2023-08-25T04:44:33.317 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-25T04:44:33.318 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.318 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2023-08-25T04:44:33.318 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.318 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2023-08-25T04:44:33.318 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2023-08-25T04:44:33.318 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2023-08-25T04:44:33.318 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2023-08-25T04:44:33.319 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2023-08-25T04:44:33.319 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2023-08-25T04:44:33.319 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2023-08-25T04:44:33.319 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-25T04:44:33.319 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-25T04:44:33.320 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2023-08-25T04:44:33.320 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.320 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-25T04:44:33.320 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.320 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2023-08-25T04:44:33.320 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.320 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2023-08-25T04:44:33.321 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.321 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2023-08-25T04:44:33.321 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2023-08-25T04:44:33.321 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2023-08-25T04:44:33.321 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.72,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2023-08-25T04:44:33.321 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 48882d5a-36fb-4a1e-9265-02d65750e322 2023-08-25T04:44:33.321 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.322 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2023-08-25T04:44:33.322 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2023-08-25T04:44:33.322 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.322 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2023-08-25T04:44:33.322 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2023-08-25T04:44:33.322 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2023-08-25T04:44:33.322 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.323 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2023-08-25T04:44:33.323 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2023-08-25T04:44:33.323 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.323 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2023-08-25T04:44:33.323 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2023-08-25T04:44:33.323 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2023-08-25T04:44:33.323 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.324 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2023-08-25T04:44:33.324 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2023-08-25T04:44:33.324 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.324 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2023-08-25T04:44:33.324 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.324 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2023-08-25T04:44:33.324 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.325 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2023-08-25T04:44:33.325 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.325 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2023-08-25T04:44:33.325 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2023-08-25T04:44:33.325 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.325 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2023-08-25T04:44:33.325 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2023-08-25T04:44:33.326 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2023-08-25T04:44:33.326 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2023-08-25T04:44:33.326 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 20 2023-08-25T04:44:33.326 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 20 2023-08-25T04:44:33.326 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2023-08-25T04:44:33.326 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2023-08-25T04:44:33.326 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 10 2023-08-25T04:44:33.327 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2023-08-25T04:44:33.327 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2023-08-25T04:44:33.327 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2023-08-25T04:44:33.327 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2023-08-25T04:44:33.327 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2023-08-25T04:44:33.327 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2023-08-25T04:44:33.328 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.328 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2023-08-25T04:44:33.328 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2023-08-25T04:44:33.328 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2023-08-25T04:44:33.328 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2023-08-25T04:44:33.328 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2023-08-25T04:44:33.328 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:44:33.329 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:44:33.329 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2023-08-25T04:44:33.329 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.329 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2023-08-25T04:44:33.329 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2023-08-25T04:44:33.329 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2023-08-25T04:44:33.329 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2023-08-25T04:44:33.330 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2023-08-25T04:44:33.330 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2023-08-25T04:44:33.330 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2023-08-25T04:44:33.330 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:44:33.330 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2023-08-25T04:44:33.330 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2023-08-25T04:44:33.330 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:44:33.330 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.331 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-25T04:44:33.331 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2023-08-25T04:44:33.331 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2023-08-25T04:44:33.331 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.331 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2023-08-25T04:44:33.331 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-25T04:44:33.331 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-25T04:44:33.332 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.332 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2023-08-25T04:44:33.332 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2023-08-25T04:44:33.332 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.332 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2023-08-25T04:44:33.332 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2023-08-25T04:44:33.333 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-08-25T04:44:33.333 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2023-08-25T04:44:33.333 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2023-08-25T04:44:33.333 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2023-08-25T04:44:33.333 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2023-08-25T04:44:33.333 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-25T04:44:33.333 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-25T04:44:33.334 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2023-08-25T04:44:33.334 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2023-08-25T04:44:33.334 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2023-08-25T04:44:33.334 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2023-08-25T04:44:33.334 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2023-08-25T04:44:33.334 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2023-08-25T04:44:33.334 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2023-08-25T04:44:33.335 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2023-08-25T04:44:33.335 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2023-08-25T04:44:33.335 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2023-08-25T04:44:33.335 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2023-08-25T04:44:33.335 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2023-08-25T04:44:33.335 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2023-08-25T04:44:33.335 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2023-08-25T04:44:33.336 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2023-08-25T04:44:33.336 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2023-08-25T04:44:33.336 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2023-08-25T04:44:33.336 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2023-08-25T04:44:33.336 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2023-08-25T04:44:33.336 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2023-08-25T04:44:33.336 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2023-08-25T04:44:33.337 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2023-08-25T04:44:33.337 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2023-08-25T04:44:33.337 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2023-08-25T04:44:33.338 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-25T04:44:33.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-25T04:44:33.456 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-25T04:44:33.456 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:33.457 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-25T04:44:33.502 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:33.503 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-25T04:44:33.590 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-08-25T04:44:33.590 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:33.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-25T04:44:33.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T04:44:33.728 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:44:33.729 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:44:33.814 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2023-08-25T04:44:33.815 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:44:33.815 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-25T04:44:33.815 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T04:44:33.912 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:44:33.913 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:44:33.999 INFO:tasks.ceph:Setting up mon nodes... 2023-08-25T04:44:33.999 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-25T04:44:34.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-25T04:44:34.124 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-25T04:44:34.130 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-25T04:44:34.264 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-25T04:44:34.264 INFO:tasks.ceph:Setting up mds nodes... 2023-08-25T04:44:34.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-25T04:44:34.390 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-25T04:44:34.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-25T04:44:34.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-25T04:44:34.593 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-25T04:44:34.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-25T04:44:34.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-25T04:44:34.795 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-25T04:44:34.800 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-25T04:44:34.872 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-25T04:44:34.994 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-25T04:44:34.999 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-25T04:44:35.069 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-25T04:44:35.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-25T04:44:35.165 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-25T04:44:35.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-25T04:44:35.296 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-25T04:44:35.326 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-25T04:44:35.423 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-25T04:44:35.453 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-25T04:44:35.549 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-25T04:44:35.581 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-25T04:44:35.581 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-25T04:44:35.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-25T04:44:35.652 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:44:35.653 INFO:tasks.ceph:role: osd.0 2023-08-25T04:44:35.653 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-25T04:44:35.653 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-25T04:44:35.729 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:44:35.729 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:44:35.729 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:44:35.729 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:44:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:44:35.730 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:44:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:44:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:44:35.730 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:44:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:44:36.163 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-08-25T04:44:36.624 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-08-25T04:44:36.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-25T04:44:36.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-25T04:44:36.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-25T04:44:36.886 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:44:36.887 INFO:tasks.ceph:role: osd.1 2023-08-25T04:44:36.888 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-25T04:44:36.888 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-25T04:44:36.963 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:44:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:44:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:44:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:44:36.964 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:44:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:44:36.964 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:44:36.964 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:44:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:44:36.964 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:44:37.402 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-08-25T04:44:37.406 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-08-25T04:44:37.407 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-25T04:44:37.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-25T04:44:37.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-25T04:44:37.699 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:44:37.699 INFO:tasks.ceph:role: osd.2 2023-08-25T04:44:37.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-25T04:44:37.700 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-25T04:44:37.776 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:44:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:44:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:44:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:44:37.777 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:44:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:44:37.777 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:44:37.777 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:44:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:44:37.778 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:44:38.232 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-08-25T04:44:38.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-08-25T04:44:38.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-25T04:44:38.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-25T04:44:38.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-25T04:44:38.590 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:44:38.591 INFO:tasks.ceph:role: osd.3 2023-08-25T04:44:38.591 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-25T04:44:38.591 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-25T04:44:38.667 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:44:38.668 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:44:38.668 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:44:38.668 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:44:38.668 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:44:38.669 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:44:38.669 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:44:38.669 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:44:38.669 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:44:38.669 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:44:39.095 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-08-25T04:44:39.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-08-25T04:44:39.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-25T04:44:39.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-25T04:44:39.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:44:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:39.404+0000 7f6d8cb3a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-25T04:44:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:39.405+0000 7f6d8cb3a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-25T04:44:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:39.405+0000 7f6d8cb3a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T04:44:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:39.405+0000 7f6d8cb3a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T04:44:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:39.405+0000 7f6d8cb3a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T04:44:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:39.407+0000 7f6d8cb3a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-25T04:44:42.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-25T04:44:42.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:44:42.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:42.472+0000 7fb275d4b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-25T04:44:42.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:42.473+0000 7fb275d4b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-25T04:44:42.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:42.473+0000 7fb275d4b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T04:44:42.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:42.473+0000 7fb275d4b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T04:44:42.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:42.473+0000 7fb275d4b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T04:44:42.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:42.474+0000 7fb275d4b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-25T04:44:45.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-25T04:44:45.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:44:45.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:45.787+0000 7fbc93251640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-25T04:44:45.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:45.788+0000 7fbc93251640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-25T04:44:45.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:45.788+0000 7fbc93251640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T04:44:45.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:45.788+0000 7fbc93251640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T04:44:45.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:45.788+0000 7fbc93251640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T04:44:45.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:45.789+0000 7fbc93251640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-25T04:44:48.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-25T04:44:48.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:44:48.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:48.846+0000 7fc17085f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-25T04:44:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:48.846+0000 7fc17085f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-25T04:44:48.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:48.846+0000 7fc17085f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T04:44:48.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:48.846+0000 7fc17085f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T04:44:48.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:48.846+0000 7fc17085f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T04:44:48.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:44:48.848+0000 7fc17085f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-25T04:44:51.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-25T04:44:51.808 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-25T04:44:51.884 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:44:51.885 INFO:tasks.ceph:role: osd.4 2023-08-25T04:44:51.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2023-08-25T04:44:51.885 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-25T04:44:51.963 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:44:51.964 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:44:51.964 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:44:51.965 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:44:51.965 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:44:51.965 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:44:51.965 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:44:51.965 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:44:51.965 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:44:51.966 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:44:52.398 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2023-08-25T04:44:52.403 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2023-08-25T04:44:52.403 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-25T04:44:52.583 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-25T04:44:52.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-25T04:44:52.729 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:44:52.729 INFO:tasks.ceph:role: osd.5 2023-08-25T04:44:52.729 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2023-08-25T04:44:52.730 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-25T04:44:52.806 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:44:52.806 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:44:52.806 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:44:52.806 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:44:52.807 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:44:52.807 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:44:52.807 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:44:52.807 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:44:52.807 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:44:52.807 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:44:53.214 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2023-08-25T04:44:53.219 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2023-08-25T04:44:53.219 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-25T04:44:53.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-25T04:44:53.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-25T04:44:53.506 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:44:53.507 INFO:tasks.ceph:role: osd.6 2023-08-25T04:44:53.507 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2023-08-25T04:44:53.508 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-25T04:44:53.585 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:44:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:44:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:44:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:44:53.586 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:44:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:44:53.587 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:44:53.587 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:44:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:44:53.588 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:44:54.036 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2023-08-25T04:44:54.040 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2023-08-25T04:44:54.040 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-25T04:44:54.231 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-25T04:44:54.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-25T04:44:54.375 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:44:54.376 INFO:tasks.ceph:role: osd.7 2023-08-25T04:44:54.376 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com 2023-08-25T04:44:54.376 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-25T04:44:54.452 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:44:54.452 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:44:54.452 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:44:54.453 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:44:54.453 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:44:54.453 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:44:54.453 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:44:54.453 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:44:54.453 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:44:54.454 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:44:54.887 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2023-08-25T04:44:54.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2023-08-25T04:44:54.891 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-25T04:44:55.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-25T04:44:55.084 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:44:55.205 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:55.204+0000 7fcf7f389640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-25T04:44:55.206 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:55.205+0000 7fcf7f389640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-25T04:44:55.206 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:55.205+0000 7fcf7f389640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T04:44:55.206 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:55.205+0000 7fcf7f389640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T04:44:55.207 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:55.205+0000 7fcf7f389640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T04:44:55.208 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:55.207+0000 7fcf7f389640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-25T04:44:58.085 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-25T04:44:58.156 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:44:58.260 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:58.259+0000 7faa65881640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-25T04:44:58.261 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:58.260+0000 7faa65881640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-25T04:44:58.261 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:58.260+0000 7faa65881640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T04:44:58.261 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:58.260+0000 7faa65881640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T04:44:58.261 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:58.260+0000 7faa65881640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T04:44:58.262 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:44:58.261+0000 7faa65881640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-25T04:45:00.850 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:00.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:01.133 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-25T04:45:01.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:45:01.307 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:01.306+0000 7f3b39c67640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-25T04:45:01.308 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:01.306+0000 7f3b39c67640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-25T04:45:01.308 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:01.306+0000 7f3b39c67640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T04:45:01.308 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:01.307+0000 7f3b39c67640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T04:45:01.308 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:01.307+0000 7f3b39c67640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T04:45:01.309 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:01.308+0000 7f3b39c67640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-25T04:45:04.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-25T04:45:04.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:45:04.361 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:04.360+0000 7f2c26f22640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-25T04:45:04.362 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:04.360+0000 7f2c26f22640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-25T04:45:04.362 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:04.360+0000 7f2c26f22640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T04:45:04.362 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:04.360+0000 7f2c26f22640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T04:45:04.362 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:04.360+0000 7f2c26f22640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T04:45:04.363 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:04.362+0000 7f2c26f22640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-25T04:45:07.242 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-25T04:45:07.312 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-25T04:45:07.313 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:07.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-25T04:45:07.388 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:07.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-25T04:45:07.458 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:07.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-25T04:45:07.566 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:07.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-25T04:45:07.674 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:07.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-25T04:45:07.782 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:07.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-25T04:45:07.890 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:07.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-25T04:45:07.999 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:08.000 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-25T04:45:08.075 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:08.076 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-25T04:45:08.144 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:08.145 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-25T04:45:08.253 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:08.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-25T04:45:08.361 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:08.361 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-25T04:45:08.469 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:08.469 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-25T04:45:08.577 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:08.577 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-25T04:45:08.685 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:08.686 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-25T04:45:08.734 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:08.734 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-25T04:45:08.781 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:08.781 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-25T04:45:08.827 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:08.828 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-25T04:45:08.913 INFO:tasks.ceph:Adding keys to all mons... 2023-08-25T04:45:08.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-25T04:45:08.917 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-25T04:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2023-08-25T04:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCyMehkClVvBxAA44K6j5FqscADcuhreEKghw== 2023-08-25T04:45:08.980 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-08-25T04:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCyMehkfbVIFxAAWWNregS9iZvkpvOEDJ4TEw== 2023-08-25T04:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-08-25T04:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCyMehkXRBdIxAA7v1mR2qJDWv2dOr0809k5w== 2023-08-25T04:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2023-08-25T04:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQC3MehkeowxGBAAdfLfv49cradHQgBwjB3p2A== 2023-08-25T04:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2023-08-25T04:45:08.981 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQC6MehkIfE+HBAALDhHjxDLI+phk4hmktQsIQ== 2023-08-25T04:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2023-08-25T04:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQC9MehkYbYHLxAA9TV5t8cF/uJ2YpXnfLHivA== 2023-08-25T04:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2023-08-25T04:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDAMehkPu2BMhAAIq21LrF4iC884d1S+lVOwA== 2023-08-25T04:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2023-08-25T04:45:08.982 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCyMehk33RZDxAABIj8EsUDjqm4wtepBsiUmw== 2023-08-25T04:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-08-25T04:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCyMehkKnVmLxAA9HDj0N7GKb4iXGDuuO5v4Q== 2023-08-25T04:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-08-25T04:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCyMehk9D5MOxAAd7zkt5YLn4XGWrCNpPTytA== 2023-08-25T04:45:08.983 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2023-08-25T04:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDHMehkE35KDBAAUrpHvzydL16wxT9piuE+Ig== 2023-08-25T04:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2023-08-25T04:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDKMehkRXWLDxAAGATWxMXtkSttsOo4RSXPeg== 2023-08-25T04:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2023-08-25T04:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDNMehkRKZYEhAAZroscH7VwD5hZ5OW/ZNGxg== 2023-08-25T04:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2023-08-25T04:45:08.984 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDQMehkYSOOFRAAVQFCeof4ei6MKtxDrLQvJg== 2023-08-25T04:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-08-25T04:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCzMehkm9HlCRAAFQVBmTswDkoqPJVY2o1K/Q== 2023-08-25T04:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout:[client.2] 2023-08-25T04:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCzMehkzhasERAA8er45ZkwFgFagQLriDI2Xg== 2023-08-25T04:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-08-25T04:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCzMehkmZg+GRAASPWJw08ad+UzjwJxHQU30Q== 2023-08-25T04:45:08.985 INFO:teuthology.orchestra.run.smithi072.stdout:[client.3] 2023-08-25T04:45:08.986 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCzMehk8IHCIBAAPsuQzLkEO9aZwYq4KDZxyg== 2023-08-25T04:45:09.018 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.y] 2023-08-25T04:45:09.018 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCyMehkClVvBxAA44K6j5FqscADcuhreEKghw== 2023-08-25T04:45:09.018 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2023-08-25T04:45:09.018 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCyMehkfbVIFxAAWWNregS9iZvkpvOEDJ4TEw== 2023-08-25T04:45:09.018 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2023-08-25T04:45:09.019 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCyMehkXRBdIxAA7v1mR2qJDWv2dOr0809k5w== 2023-08-25T04:45:09.019 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2023-08-25T04:45:09.019 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQC3MehkeowxGBAAdfLfv49cradHQgBwjB3p2A== 2023-08-25T04:45:09.019 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2023-08-25T04:45:09.019 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQC6MehkIfE+HBAALDhHjxDLI+phk4hmktQsIQ== 2023-08-25T04:45:09.019 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2023-08-25T04:45:09.019 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQC9MehkYbYHLxAA9TV5t8cF/uJ2YpXnfLHivA== 2023-08-25T04:45:09.019 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2023-08-25T04:45:09.020 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDAMehkPu2BMhAAIq21LrF4iC884d1S+lVOwA== 2023-08-25T04:45:09.020 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2023-08-25T04:45:09.020 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCyMehk33RZDxAABIj8EsUDjqm4wtepBsiUmw== 2023-08-25T04:45:09.020 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2023-08-25T04:45:09.020 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCyMehkKnVmLxAA9HDj0N7GKb4iXGDuuO5v4Q== 2023-08-25T04:45:09.020 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2023-08-25T04:45:09.020 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCyMehk9D5MOxAAd7zkt5YLn4XGWrCNpPTytA== 2023-08-25T04:45:09.021 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2023-08-25T04:45:09.021 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDHMehkE35KDBAAUrpHvzydL16wxT9piuE+Ig== 2023-08-25T04:45:09.021 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2023-08-25T04:45:09.021 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDKMehkRXWLDxAAGATWxMXtkSttsOo4RSXPeg== 2023-08-25T04:45:09.022 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.6] 2023-08-25T04:45:09.022 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDNMehkRKZYEhAAZroscH7VwD5hZ5OW/ZNGxg== 2023-08-25T04:45:09.022 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.7] 2023-08-25T04:45:09.023 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDQMehkYSOOFRAAVQFCeof4ei6MKtxDrLQvJg== 2023-08-25T04:45:09.023 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2023-08-25T04:45:09.024 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCzMehkm9HlCRAAFQVBmTswDkoqPJVY2o1K/Q== 2023-08-25T04:45:09.024 INFO:teuthology.orchestra.run.smithi137.stdout:[client.2] 2023-08-25T04:45:09.025 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCzMehkzhasERAA8er45ZkwFgFagQLriDI2Xg== 2023-08-25T04:45:09.025 INFO:teuthology.orchestra.run.smithi137.stdout:[client.1] 2023-08-25T04:45:09.025 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCzMehkmZg+GRAASPWJw08ad+UzjwJxHQU30Q== 2023-08-25T04:45:09.025 INFO:teuthology.orchestra.run.smithi137.stdout:[client.3] 2023-08-25T04:45:09.026 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCzMehk8IHCIBAAPsuQzLkEO9aZwYq4KDZxyg== 2023-08-25T04:45:09.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:45:09.034 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:45:09.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:45:09.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:45:09.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:45:09.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:45:09.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:09.414 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:09.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:09.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:09.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:09.642 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:09.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:09.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:09.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:45:09.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:45:09.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:45:09.980 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:45:10.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:45:10.096 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:45:10.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:10.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:10.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:10.328 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:10.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:10.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:10.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:10.555 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:45:10.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:45:10.675 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:45:10.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:45:10.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:45:10.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:45:11.148 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:45:11.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:45:11.267 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:45:11.378 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-25T04:45:11.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-25T04:45:11.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T04:45:11.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-25T04:45:11.640 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-25T04:45:11.711 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T04:45:11.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-25T04:45:11.901 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-25T04:45:11.970 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T04:45:12.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-25T04:45:12.163 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:45:12.169 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:45:12.214 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-25T04:45:12.215 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-25T04:45:12.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-25T04:45:12.255 INFO:tasks.ceph.mon.a:Started 2023-08-25T04:45:12.256 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-25T04:45:12.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-25T04:45:12.261 INFO:tasks.ceph.mon.b:Started 2023-08-25T04:45:12.261 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-25T04:45:12.262 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-25T04:45:12.266 INFO:tasks.ceph.mon.c:Started 2023-08-25T04:45:12.266 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-25T04:45:12.267 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-25T04:45:12.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-25T04:45:12.272 INFO:tasks.ceph.mgr.y:Started 2023-08-25T04:45:12.272 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-25T04:45:12.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-25T04:45:12.277 INFO:tasks.ceph.mgr.x:Started 2023-08-25T04:45:12.278 INFO:tasks.ceph:Setting crush tunables to default 2023-08-25T04:45:12.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd crush tunables default 2023-08-25T04:45:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.475+0000 7fc566dff700 1 Processor -- start 2023-08-25T04:45:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.476+0000 7fc566dff700 1 -- start start 2023-08-25T04:45:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.477+0000 7fc566dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc56015d090 0x7fc5600d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.477+0000 7fc566dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5600ce260 0x7fc5600b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.477+0000 7fc566dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56015d470 con 0x7fc5600b8aa0 2023-08-25T04:45:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.477+0000 7fc566dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5600d17e0 con 0x7fc5600ce260 2023-08-25T04:45:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.477+0000 7fc566dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5600d1ac0 con 0x7fc56015d090 2023-08-25T04:45:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.477+0000 7fc56539c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5600ce260 0x7fc5600b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.477+0000 7fc564b9b700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc56015d090 0x7fc5600d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.477+0000 7fc55ffff700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc5600b8aa0 0x7fc5600cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:40970/0 (socket says 172.21.15.72:40970) 2023-08-25T04:45:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.477+0000 7fc55ffff700 1 -- 172.21.15.72:0/4059314310 learned_addr learned my addr 172.21.15.72:0/4059314310 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.478+0000 7fc56539c700 1 -- 172.21.15.72:0/4059314310 >> v2:172.21.15.72:3300/0 conn(0x7fc5600ce260 msgr2=0x7fc5600b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-25T04:45:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.478+0000 7fc56539c700 1 -- 172.21.15.72:0/4059314310 >> v2:172.21.15.72:3300/0 conn(0x7fc5600ce260 msgr2=0x7fc5600b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:45:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.478+0000 7fc56539c700 1 --2- 172.21.15.72:0/4059314310 >> v2:172.21.15.72:3300/0 conn(0x7fc5600ce260 0x7fc5600b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:45:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.478+0000 7fc564b9b700 1 -- 172.21.15.72:0/4059314310 >> v2:172.21.15.137:3300/0 conn(0x7fc56015d090 msgr2=0x7fc5600d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-25T04:45:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.478+0000 7fc564b9b700 1 -- 172.21.15.72:0/4059314310 >> v2:172.21.15.137:3300/0 conn(0x7fc56015d090 msgr2=0x7fc5600d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:45:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.478+0000 7fc564b9b700 1 --2- 172.21.15.72:0/4059314310 >> v2:172.21.15.137:3300/0 conn(0x7fc56015d090 0x7fc5600d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:45:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.478+0000 7fc564b9b700 1 --2- 172.21.15.72:0/4059314310 >> v2:172.21.15.137:3300/0 conn(0x7fc56015d090 0x7fc5600d0e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:45:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.478+0000 7fc56539c700 1 --2- 172.21.15.72:0/4059314310 >> v2:172.21.15.72:3300/0 conn(0x7fc5600ce260 0x7fc5600b5eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:45:12.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.650+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847470420 0 0) 0x7fc56015d470 con 0x7fc5600b8aa0 2023-08-25T04:45:12.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.651+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5500035b0 con 0x7fc5600b8aa0 2023-08-25T04:45:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3834211179 0 0) 0x7fc5500035b0 con 0x7fc5600b8aa0 2023-08-25T04:45:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 >> v2:172.21.15.137:3300/0 conn(0x7fc56015d090 msgr2=0x7fc5600d0e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:45:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 --2- 172.21.15.72:0/4059314310 >> v2:172.21.15.137:3300/0 conn(0x7fc56015d090 0x7fc5600d0e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:12.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 >> v2:172.21.15.72:3300/0 conn(0x7fc5600ce260 msgr2=0x7fc5600b5eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:45:12.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 --2- 172.21.15.72:0/4059314310 >> v2:172.21.15.72:3300/0 conn(0x7fc5600ce260 0x7fc5600b5eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:12.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5600d1da0 con 0x7fc5600b8aa0 2023-08-25T04:45:12.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fc54c001670 con 0x7fc5600b8aa0 2023-08-25T04:45:12.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 >> v1:172.21.15.137:6789/0 conn(0x7fc5600b8aa0 legacy=0x7fc5600cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:12.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550003a50 0x7fc550003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc550004850 0x7fc550004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc550005210 0x7fc55000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5600d17e0 con 0x7fc550005210 2023-08-25T04:45:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5600d1ac0 con 0x7fc550004850 2023-08-25T04:45:12.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55000c160 con 0x7fc550003a50 2023-08-25T04:45:12.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc55ffff700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc550004850 0x7fc550004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:12.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc564b9b700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550003a50 0x7fc550003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.653+0000 7fc56539c700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc550005210 0x7fc55000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.654+0000 7fc55ffff700 1 -- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550003a50 msgr2=0x7fc550003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.654+0000 7fc55ffff700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550003a50 0x7fc550003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.654+0000 7fc55ffff700 1 -- 172.21.15.72:0/4059314310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc550005210 msgr2=0x7fc55000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.654+0000 7fc55ffff700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc550005210 0x7fc55000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:12.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.654+0000 7fc55ffff700 1 -- 172.21.15.72:0/4059314310 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500035b0 con 0x7fc550004850 2023-08-25T04:45:12.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.654+0000 7fc56539c700 1 -- 172.21.15.72:0/4059314310 reap_dead start 2023-08-25T04:45:12.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.654+0000 7fc564b9b700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550003a50 0x7fc550003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:12.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.654+0000 7fc55ffff700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc550004850 0x7fc550004cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00c240 tx=0x7fc550005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37fe0c54afbfcc4e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.655+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c00cd40 con 0x7fc550004850 2023-08-25T04:45:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.655+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c005960 con 0x7fc550004850 2023-08-25T04:45:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.655+0000 7fc55f7fe700 1 -- 172.21.15.72:0/4059314310 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c00cea0 con 0x7fc550004850 2023-08-25T04:45:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.655+0000 7fc566dff700 1 -- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc550004850 msgr2=0x7fc550004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.655+0000 7fc566dff700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc550004850 0x7fc550004cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00c240 tx=0x7fc550005880 comp rx=0 tx=0).stop 2023-08-25T04:45:12.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.656+0000 7fc566dff700 1 -- 172.21.15.72:0/4059314310 shutdown_connections 2023-08-25T04:45:12.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.656+0000 7fc566dff700 1 --2- 172.21.15.72:0/4059314310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc550004850 0x7fc550004cd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:12.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.656+0000 7fc566dff700 1 -- 172.21.15.72:0/4059314310 >> 172.21.15.72:0/4059314310 conn(0x7fc560071e10 msgr2=0x7fc560072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:12.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.656+0000 7fc566dff700 1 -- 172.21.15.72:0/4059314310 shutdown_connections 2023-08-25T04:45:12.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.656+0000 7fc566dff700 1 -- 172.21.15.72:0/4059314310 wait complete. 2023-08-25T04:45:12.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.659+0000 7fc566dff700 1 Processor -- start 2023-08-25T04:45:12.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.659+0000 7fc566dff700 1 -- start start 2023-08-25T04:45:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.660+0000 7fc566dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550004850 0x7fc560155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.660+0000 7fc566dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc56015eb40 0x7fc56015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.660+0000 7fc566dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560159390 0x7fc560159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.660+0000 7fc566dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56015f500 con 0x7fc560159390 2023-08-25T04:45:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.660+0000 7fc566dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc560159d60 con 0x7fc56015eb40 2023-08-25T04:45:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.660+0000 7fc566dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5601f3c70 con 0x7fc550004850 2023-08-25T04:45:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc56539c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560159390 0x7fc560159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc56539c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560159390 0x7fc560159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39184/0 (socket says 172.21.15.72:39184) 2023-08-25T04:45:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc56539c700 1 -- 172.21.15.72:0/18841681 learned_addr learned my addr 172.21.15.72:0/18841681 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc55ffff700 1 --2- 172.21.15.72:0/18841681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc56015eb40 0x7fc56015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc564b9b700 1 --2- 172.21.15.72:0/18841681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550004850 0x7fc560155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc56539c700 1 -- 172.21.15.72:0/18841681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550004850 msgr2=0x7fc560155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc56539c700 1 --2- 172.21.15.72:0/18841681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550004850 0x7fc560155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc56539c700 1 -- 172.21.15.72:0/18841681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc56015eb40 msgr2=0x7fc56015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc56539c700 1 --2- 172.21.15.72:0/18841681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc56015eb40 0x7fc56015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc56539c700 1 -- 172.21.15.72:0/18841681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5601f3f50 con 0x7fc560159390 2023-08-25T04:45:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc564b9b700 1 --2- 172.21.15.72:0/18841681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550004850 0x7fc560155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.661+0000 7fc56539c700 1 --2- 172.21.15.72:0/18841681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560159390 0x7fc560159820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc560072990 tx=0x7fc55800f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.662+0000 7fc55d7fa700 1 -- 172.21.15.72:0/18841681 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55800fe00 con 0x7fc560159390 2023-08-25T04:45:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.662+0000 7fc55d7fa700 1 -- 172.21.15.72:0/18841681 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558009a90 con 0x7fc560159390 2023-08-25T04:45:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.662+0000 7fc55d7fa700 1 -- 172.21.15.72:0/18841681 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558009e40 con 0x7fc560159390 2023-08-25T04:45:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.662+0000 7fc566dff700 1 -- 172.21.15.72:0/18841681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5601f4230 con 0x7fc560159390 2023-08-25T04:45:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.662+0000 7fc566dff700 1 -- 172.21.15.72:0/18841681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5601566f0 con 0x7fc560159390 2023-08-25T04:45:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.662+0000 7fc55d7fa700 1 -- 172.21.15.72:0/18841681 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc558003a20 con 0x7fc560159390 2023-08-25T04:45:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.662+0000 7fc55d7fa700 1 -- 172.21.15.72:0/18841681 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc55800a360 con 0x7fc560159390 2023-08-25T04:45:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.663+0000 7fc566dff700 1 -- 172.21.15.72:0/18841681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5601f4750 con 0x7fc560159390 2023-08-25T04:45:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.666+0000 7fc55d7fa700 1 -- 172.21.15.72:0/18841681 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc5601f4750 con 0x7fc560159390 2023-08-25T04:45:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.741+0000 7fc566dff700 1 -- 172.21.15.72:0/18841681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc56006a2f0 con 0x7fc560159390 2023-08-25T04:45:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.744+0000 7fc55d7fa700 1 -- 172.21.15.72:0/18841681 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc558018070 con 0x7fc560159390 2023-08-25T04:45:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.746+0000 7fc566dff700 1 -- 172.21.15.72:0/18841681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560159390 msgr2=0x7fc560159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.746+0000 7fc566dff700 1 --2- 172.21.15.72:0/18841681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560159390 0x7fc560159820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc560072990 tx=0x7fc55800f430 comp rx=0 tx=0).stop 2023-08-25T04:45:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.746+0000 7fc566dff700 1 -- 172.21.15.72:0/18841681 shutdown_connections 2023-08-25T04:45:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.746+0000 7fc566dff700 1 --2- 172.21.15.72:0/18841681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc560159390 0x7fc560159820 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.746+0000 7fc566dff700 1 --2- 172.21.15.72:0/18841681 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc550004850 0x7fc560155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:12.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.746+0000 7fc566dff700 1 --2- 172.21.15.72:0/18841681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc56015eb40 0x7fc56015efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:12.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.746+0000 7fc566dff700 1 -- 172.21.15.72:0/18841681 >> 172.21.15.72:0/18841681 conn(0x7fc560071e10 msgr2=0x7fc5600b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:12.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.746+0000 7fc566dff700 1 -- 172.21.15.72:0/18841681 shutdown_connections 2023-08-25T04:45:12.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:12.746+0000 7fc566dff700 1 -- 172.21.15.72:0/18841681 wait complete. 2023-08-25T04:45:12.747 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2023-08-25T04:45:12.764 INFO:tasks.ceph:check_enable_crimson: False 2023-08-25T04:45:12.765 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-25T04:45:12.765 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:12.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-25T04:45:12.821 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:12.816+0000 7f7d16c78200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:45:12.834 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:12.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-25T04:45:12.953 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:12.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-25T04:45:13.035 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:13.035+0000 7f7d16c78200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:45:13.067 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:13.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-25T04:45:13.176 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:13.176 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-25T04:45:13.193 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:13.192+0000 7f747bba3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:45:13.247 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:13.247 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-25T04:45:13.388 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:13.388 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-25T04:45:13.408 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:13.406+0000 7f747bba3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:45:13.458 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:45:13.459 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-25T04:45:13.493 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:13.490+0000 7f7d16c78200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:45:13.566 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 49e4adfe-93dd-4c4d-ac81-3a22fa022560 0 2023-08-25T04:45:13.799 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.798+0000 7f8fd37ff700 1 Processor -- start 2023-08-25T04:45:13.800 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.798+0000 7f8fd37ff700 1 -- start start 2023-08-25T04:45:13.800 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.799+0000 7f8fd37ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 0x7f8fcc0d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:13.801 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd37ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8fcc0b8aa0 0x7f8fcc0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:13.801 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd37ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc0ce4b0 con 0x7f8fcc0ce090 2023-08-25T04:45:13.801 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd37ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc15d470 con 0x7f8fcc0b8aa0 2023-08-25T04:45:13.801 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd37ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0b6ec0 con 0x7f8fcc15d090 2023-08-25T04:45:13.802 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd159b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 0x7f8fcc0d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:13.802 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd0d9a700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8fcc0b8aa0 0x7f8fcc0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:13.802 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd159b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 0x7f8fcc0d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:57526/0 (socket says 172.21.15.137:57526) 2023-08-25T04:45:13.802 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd0d9a700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8fcc0b8aa0 0x7f8fcc0cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47566/0 (socket says 172.21.15.137:47566) 2023-08-25T04:45:13.802 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd159b700 1 -- 172.21.15.137:0/3561412658 learned_addr learned my addr 172.21.15.137:0/3561412658 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:13.803 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd0d9a700 1 -- 172.21.15.137:0/3561412658 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 msgr2=0x7f8fcc0d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:13.803 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd0d9a700 1 --2- 172.21.15.137:0/3561412658 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 0x7f8fcc0d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:13.803 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd0d9a700 1 -- 172.21.15.137:0/3561412658 >> v1:172.21.15.72:6789/0 conn(0x7f8fcc0ce090 legacy=0x7f8fcc0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:13.803 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fd0d9a700 1 -- 172.21.15.137:0/3561412658 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0d17e0 con 0x7f8fcc0b8aa0 2023-08-25T04:45:13.803 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.800+0000 7f8fc3fff700 1 -- 172.21.15.137:0/3561412658 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845403988 0 0) 0x7f8fcc0ce4b0 con 0x7f8fcc0ce090 2023-08-25T04:45:13.803 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.801+0000 7f8fd0d9a700 1 --2- 172.21.15.137:0/3561412658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fcc0b8aa0 0x7f8fcc0cdb50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009840 tx=0x7f8fbc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a266f893a30fd51 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:13.803 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.801+0000 7f8fc3fff700 1 -- 172.21.15.137:0/3561412658 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc011830 con 0x7f8fcc0b8aa0 2023-08-25T04:45:13.804 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.801+0000 7f8fc3fff700 1 -- 172.21.15.137:0/3561412658 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc011990 con 0x7f8fcc0b8aa0 2023-08-25T04:45:13.804 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.801+0000 7f8fc3fff700 1 -- 172.21.15.137:0/3561412658 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc011d20 con 0x7f8fcc0b8aa0 2023-08-25T04:45:13.805 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.801+0000 7f8fd37ff700 1 -- 172.21.15.137:0/3561412658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fcc0b8aa0 msgr2=0x7f8fcc0cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:13.805 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.801+0000 7f8fd37ff700 1 --2- 172.21.15.137:0/3561412658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fcc0b8aa0 0x7f8fcc0cdb50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009840 tx=0x7f8fbc009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:13.805 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.802+0000 7f8fd37ff700 1 -- 172.21.15.137:0/3561412658 shutdown_connections 2023-08-25T04:45:13.805 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.802+0000 7f8fd37ff700 1 --2- 172.21.15.137:0/3561412658 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 0x7f8fcc0d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:13.805 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.802+0000 7f8fd37ff700 1 --2- 172.21.15.137:0/3561412658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fcc0b8aa0 0x7f8fcc0cdb50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:13.805 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.802+0000 7f8fd37ff700 1 -- 172.21.15.137:0/3561412658 >> 172.21.15.137:0/3561412658 conn(0x7f8fcc071e10 msgr2=0x7f8fcc072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:13.806 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.802+0000 7f8fd37ff700 1 -- 172.21.15.137:0/3561412658 shutdown_connections 2023-08-25T04:45:13.806 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.802+0000 7f8fd37ff700 1 -- 172.21.15.137:0/3561412658 wait complete. 2023-08-25T04:45:13.806 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.803+0000 7f8fd37ff700 1 Processor -- start 2023-08-25T04:45:13.806 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.804+0000 7f8fd37ff700 1 -- start start 2023-08-25T04:45:13.808 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd37ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fcc0b8aa0 0x7f8fcc15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:13.808 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd37ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fcc0ce090 0x7f8fcc15ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:13.808 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd37ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 0x7f8fcc0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:13.808 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd37ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc15e560 con 0x7f8fcc0ce090 2023-08-25T04:45:13.808 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd37ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc160500 con 0x7f8fcc0b8aa0 2023-08-25T04:45:13.808 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd37ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0cd3b0 con 0x7f8fcc15d090 2023-08-25T04:45:13.809 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd159b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fcc0b8aa0 0x7f8fcc15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:13.809 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd159b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fcc0b8aa0 0x7f8fcc15e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47580/0 (socket says 172.21.15.137:47580) 2023-08-25T04:45:13.809 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd1d9c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 0x7f8fcc0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:13.809 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd159b700 1 -- 172.21.15.137:0/1253013444 learned_addr learned my addr 172.21.15.137:0/1253013444 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:13.809 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd1d9c700 1 -- 172.21.15.137:0/1253013444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fcc0b8aa0 msgr2=0x7f8fcc15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:13.809 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd1d9c700 1 --2- 172.21.15.137:0/1253013444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fcc0b8aa0 0x7f8fcc15e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:13.810 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd1d9c700 1 -- 172.21.15.137:0/1253013444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fcc0ce090 msgr2=0x7f8fcc15ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:13.810 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd1d9c700 1 --2- 172.21.15.137:0/1253013444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fcc0ce090 0x7f8fcc15ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:13.810 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.805+0000 7f8fd1d9c700 1 -- 172.21.15.137:0/1253013444 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc0094a0 con 0x7f8fcc15d090 2023-08-25T04:45:13.810 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.806+0000 7f8fd1d9c700 1 --2- 172.21.15.137:0/1253013444 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 0x7f8fcc0cce70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c7c0 tx=0x7f8fc400cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:13.810 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.806+0000 7f8fc1ffb700 1 -- 172.21.15.137:0/1253013444 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4003e30 con 0x7f8fcc15d090 2023-08-25T04:45:13.810 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.806+0000 7f8fc1ffb700 1 -- 172.21.15.137:0/1253013444 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4005070 con 0x7f8fcc15d090 2023-08-25T04:45:13.810 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.806+0000 7f8fd37ff700 1 -- 172.21.15.137:0/1253013444 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc15e750 con 0x7f8fcc15d090 2023-08-25T04:45:13.811 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.806+0000 7f8fc1ffb700 1 -- 172.21.15.137:0/1253013444 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4005420 con 0x7f8fcc15d090 2023-08-25T04:45:13.811 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.806+0000 7f8fd37ff700 1 -- 172.21.15.137:0/1253013444 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc15ed10 con 0x7f8fcc15d090 2023-08-25T04:45:13.811 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.806+0000 7f8fc1ffb700 1 -- 172.21.15.137:0/1253013444 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8fc401c440 con 0x7f8fcc15d090 2023-08-25T04:45:13.811 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.806+0000 7f8fc1ffb700 1 -- 172.21.15.137:0/1253013444 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8fc4012740 con 0x7f8fcc15d090 2023-08-25T04:45:13.811 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.807+0000 7f8fd37ff700 1 -- 172.21.15.137:0/1253013444 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc06a2f0 con 0x7f8fcc15d090 2023-08-25T04:45:13.811 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.810+0000 7f8fc1ffb700 1 -- 172.21.15.137:0/1253013444 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8fc4017070 con 0x7f8fcc15d090 2023-08-25T04:45:13.853 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:13.852+0000 7f747bba3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:45:13.897 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.896+0000 7f8fd37ff700 1 -- 172.21.15.137:0/1253013444 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "49e4adfe-93dd-4c4d-ac81-3a22fa022560", "id": 0} v 0) v1 -- 0x7f8fcc08a000 con 0x7f8fcc15d090 2023-08-25T04:45:13.905 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.904+0000 7f8fc1ffb700 1 -- 172.21.15.137:0/1253013444 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49e4adfe-93dd-4c4d-ac81-3a22fa022560", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8fc4012900 con 0x7f8fcc15d090 2023-08-25T04:45:13.906 INFO:teuthology.orchestra.run.smithi137.stdout:0 2023-08-25T04:45:13.907 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.905+0000 7f8fd37ff700 1 -- 172.21.15.137:0/1253013444 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 msgr2=0x7f8fcc0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:13.907 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.905+0000 7f8fd37ff700 1 --2- 172.21.15.137:0/1253013444 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 0x7f8fcc0cce70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c7c0 tx=0x7f8fc400cb80 comp rx=0 tx=0).stop 2023-08-25T04:45:13.907 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.906+0000 7f8fd37ff700 1 -- 172.21.15.137:0/1253013444 shutdown_connections 2023-08-25T04:45:13.907 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.906+0000 7f8fd37ff700 1 --2- 172.21.15.137:0/1253013444 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8fcc15d090 0x7f8fcc0cce70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:13.907 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.906+0000 7f8fd37ff700 1 --2- 172.21.15.137:0/1253013444 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fcc0b8aa0 0x7f8fcc15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:13.908 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.906+0000 7f8fd37ff700 1 --2- 172.21.15.137:0/1253013444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fcc0ce090 0x7f8fcc15ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:13.908 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.906+0000 7f8fd37ff700 1 -- 172.21.15.137:0/1253013444 >> 172.21.15.137:0/1253013444 conn(0x7f8fcc071e10 msgr2=0x7f8fcc0721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:13.908 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.906+0000 7f8fd37ff700 1 -- 172.21.15.137:0/1253013444 shutdown_connections 2023-08-25T04:45:13.908 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:13.906+0000 7f8fd37ff700 1 -- 172.21.15.137:0/1253013444 wait complete. 2023-08-25T04:45:13.925 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 10424aa9-0e4e-45fe-9ea4-5a9feb833c47 1 2023-08-25T04:45:14.083 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:14.082+0000 7f7d16c78200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-25T04:45:14.115 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.114+0000 7f74587ff700 1 Processor -- start 2023-08-25T04:45:14.115 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.114+0000 7f74587ff700 1 -- start start 2023-08-25T04:45:14.117 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.115+0000 7f74587ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 0x7f74500b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.117 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.115+0000 7f74587ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f74500d10c0 0x7f74500b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.117 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f74587ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500b5190 con 0x7f74500b4d40 2023-08-25T04:45:14.117 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f74587ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500b56f0 con 0x7f74500d10c0 2023-08-25T04:45:14.117 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f74587ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500b6e90 con 0x7f745015d000 2023-08-25T04:45:14.117 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f745659b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 0x7f74500b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.118 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f7455d9a700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f74500d10c0 0x7f74500b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.118 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f745659b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 0x7f74500b8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:57540/0 (socket says 172.21.15.137:57540) 2023-08-25T04:45:14.118 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f745659b700 1 -- 172.21.15.137:0/3954033678 learned_addr learned my addr 172.21.15.137:0/3954033678 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:14.119 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f7455d9a700 1 -- 172.21.15.137:0/3954033678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 msgr2=0x7f74500b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:14.119 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f7455d9a700 1 --2- 172.21.15.137:0/3954033678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 0x7f74500b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.120 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f7455d9a700 1 -- 172.21.15.137:0/3954033678 >> v1:172.21.15.72:6789/0 conn(0x7f74500b4d40 legacy=0x7f7450160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.120 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f7455d9a700 1 -- 172.21.15.137:0/3954033678 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745015d3e0 con 0x7f74500d10c0 2023-08-25T04:45:14.120 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.116+0000 7f745659b700 1 --2- 172.21.15.137:0/3954033678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 0x7f74500b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:14.120 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.117+0000 7f7455d9a700 1 --2- 172.21.15.137:0/3954033678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500d10c0 0x7f74500b4800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7440009840 tx=0x7f7440009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b99d03f102df90 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:14.120 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.117+0000 7f7455599700 1 -- 172.21.15.137:0/3954033678 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440011830 con 0x7f74500d10c0 2023-08-25T04:45:14.121 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.117+0000 7f7455599700 1 -- 172.21.15.137:0/3954033678 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440011990 con 0x7f74500d10c0 2023-08-25T04:45:14.121 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.117+0000 7f7455599700 1 -- 172.21.15.137:0/3954033678 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440011d20 con 0x7f74500d10c0 2023-08-25T04:45:14.121 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.117+0000 7f74587ff700 1 -- 172.21.15.137:0/3954033678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500d10c0 msgr2=0x7f74500b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.121 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.117+0000 7f74587ff700 1 --2- 172.21.15.137:0/3954033678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500d10c0 0x7f74500b4800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7440009840 tx=0x7f7440009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:14.121 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.117+0000 7f74587ff700 1 -- 172.21.15.137:0/3954033678 shutdown_connections 2023-08-25T04:45:14.121 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.117+0000 7f74587ff700 1 --2- 172.21.15.137:0/3954033678 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 0x7f74500b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.121 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.117+0000 7f74587ff700 1 --2- 172.21.15.137:0/3954033678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500d10c0 0x7f74500b4800 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.122 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.117+0000 7f74587ff700 1 -- 172.21.15.137:0/3954033678 >> 172.21.15.137:0/3954033678 conn(0x7f7450071e10 msgr2=0x7f7450072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:14.122 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.118+0000 7f74587ff700 1 -- 172.21.15.137:0/3954033678 shutdown_connections 2023-08-25T04:45:14.122 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.118+0000 7f74587ff700 1 -- 172.21.15.137:0/3954033678 wait complete. 2023-08-25T04:45:14.124 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.119+0000 7f74587ff700 1 Processor -- start 2023-08-25T04:45:14.124 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.119+0000 7f74587ff700 1 -- start start 2023-08-25T04:45:14.124 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.120+0000 7f74587ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500b4d40 0x7f7450159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.124 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.120+0000 7f74587ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74500d10c0 0x7f7450152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.124 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.120+0000 7f74587ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 0x7f74501e87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.124 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.120+0000 7f74587ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745015aa90 con 0x7f74500d10c0 2023-08-25T04:45:14.125 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.120+0000 7f74587ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500ca960 con 0x7f74500b4d40 2023-08-25T04:45:14.125 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.120+0000 7f74587ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7450159f50 con 0x7f745015d000 2023-08-25T04:45:14.125 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f745659b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500b4d40 0x7f7450159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.125 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f745659b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500b4d40 0x7f7450159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47606/0 (socket says 172.21.15.137:47606) 2023-08-25T04:45:14.125 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f745659b700 1 -- 172.21.15.137:0/4178928046 learned_addr learned my addr 172.21.15.137:0/4178928046 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:14.125 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f7455d9a700 1 --2- 172.21.15.137:0/4178928046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74500d10c0 0x7f7450152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.125 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f7456d9c700 1 --2- 172.21.15.137:0/4178928046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 0x7f74501e87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.125 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f745659b700 1 -- 172.21.15.137:0/4178928046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 msgr2=0x7f74501e87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f745659b700 1 --2- 172.21.15.137:0/4178928046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 0x7f74501e87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f745659b700 1 -- 172.21.15.137:0/4178928046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74500d10c0 msgr2=0x7f7450152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f745659b700 1 --2- 172.21.15.137:0/4178928046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74500d10c0 0x7f7450152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f745659b700 1 -- 172.21.15.137:0/4178928046 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c009550 con 0x7f74500b4d40 2023-08-25T04:45:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.121+0000 7f745659b700 1 --2- 172.21.15.137:0/4178928046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500b4d40 0x7f7450159a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f744c00e9b0 tx=0x7f744c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:14.126 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.122+0000 7f7446ffd700 1 -- 172.21.15.137:0/4178928046 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00ee50 con 0x7f74500b4d40 2023-08-25T04:45:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.122+0000 7f7446ffd700 1 -- 172.21.15.137:0/4178928046 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c00c850 con 0x7f74500b4d40 2023-08-25T04:45:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.122+0000 7f7446ffd700 1 -- 172.21.15.137:0/4178928046 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00cbc0 con 0x7f74500b4d40 2023-08-25T04:45:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.122+0000 7f74587ff700 1 -- 172.21.15.137:0/4178928046 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74400094a0 con 0x7f74500b4d40 2023-08-25T04:45:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.122+0000 7f74587ff700 1 -- 172.21.15.137:0/4178928046 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745015a4d0 con 0x7f74500b4d40 2023-08-25T04:45:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.122+0000 7f7446ffd700 1 -- 172.21.15.137:0/4178928046 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f744c005d20 con 0x7f74500b4d40 2023-08-25T04:45:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.122+0000 7f7446ffd700 1 -- 172.21.15.137:0/4178928046 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f744c013820 con 0x7f74500b4d40 2023-08-25T04:45:14.127 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.123+0000 7f74587ff700 1 -- 172.21.15.137:0/4178928046 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745006a2f0 con 0x7f74500b4d40 2023-08-25T04:45:14.128 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.126+0000 7f7446ffd700 1 -- 172.21.15.137:0/4178928046 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f744c021060 con 0x7f74500b4d40 2023-08-25T04:45:14.213 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.212+0000 7f74587ff700 1 -- 172.21.15.137:0/4178928046 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "10424aa9-0e4e-45fe-9ea4-5a9feb833c47", "id": 1} v 0) v1 -- 0x7f745008a000 con 0x7f74500b4d40 2023-08-25T04:45:14.220 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.219+0000 7f7446ffd700 1 -- 172.21.15.137:0/4178928046 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10424aa9-0e4e-45fe-9ea4-5a9feb833c47", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f744c017070 con 0x7f74500b4d40 2023-08-25T04:45:14.221 INFO:teuthology.orchestra.run.smithi137.stdout:1 2023-08-25T04:45:14.221 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.221+0000 7f74587ff700 1 -- 172.21.15.137:0/4178928046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500b4d40 msgr2=0x7f7450159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.222 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.221+0000 7f74587ff700 1 --2- 172.21.15.137:0/4178928046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500b4d40 0x7f7450159a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f744c00e9b0 tx=0x7f744c00ecc0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.222 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.221+0000 7f74587ff700 1 -- 172.21.15.137:0/4178928046 shutdown_connections 2023-08-25T04:45:14.222 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.221+0000 7f74587ff700 1 --2- 172.21.15.137:0/4178928046 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f745015d000 0x7f74501e87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.222 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.221+0000 7f74587ff700 1 --2- 172.21.15.137:0/4178928046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74500b4d40 0x7f7450159a10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.222 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.221+0000 7f74587ff700 1 --2- 172.21.15.137:0/4178928046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74500d10c0 0x7f7450152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.222 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.221+0000 7f74587ff700 1 -- 172.21.15.137:0/4178928046 >> 172.21.15.137:0/4178928046 conn(0x7f7450071e10 msgr2=0x7f74500d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:14.223 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.221+0000 7f74587ff700 1 -- 172.21.15.137:0/4178928046 shutdown_connections 2023-08-25T04:45:14.223 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.221+0000 7f74587ff700 1 -- 172.21.15.137:0/4178928046 wait complete. 2023-08-25T04:45:14.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new cc19cb37-3f4b-49e4-821f-d17e72c31af9 2 2023-08-25T04:45:14.325 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:14.325+0000 7f7d16c78200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-25T04:45:14.428 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.427+0000 7f41219ff700 1 Processor -- start 2023-08-25T04:45:14.428 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.427+0000 7f41219ff700 1 -- start start 2023-08-25T04:45:14.431 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.428+0000 7f41219ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c15d090 0x7f411c0d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.431 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.428+0000 7f41219ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f411c0ce260 0x7f411c0b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.431 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.428+0000 7f41219ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c15d470 con 0x7f411c0b8aa0 2023-08-25T04:45:14.431 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.428+0000 7f41219ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c0d17e0 con 0x7f411c0ce260 2023-08-25T04:45:14.431 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.428+0000 7f41219ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0d1ac0 con 0x7f411c15d090 2023-08-25T04:45:14.431 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.428+0000 7f411affd700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c15d090 0x7f411c0d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.428+0000 7f411b7fe700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f411c0ce260 0x7f411c0b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.428+0000 7f411affd700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c15d090 0x7f411c0d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:57556/0 (socket says 172.21.15.137:57556) 2023-08-25T04:45:14.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.428+0000 7f411affd700 1 -- 172.21.15.137:0/1848601979 learned_addr learned my addr 172.21.15.137:0/1848601979 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:14.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.429+0000 7f411b7fe700 1 -- 172.21.15.137:0/1848601979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c15d090 msgr2=0x7f411c0d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:14.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.429+0000 7f411b7fe700 1 --2- 172.21.15.137:0/1848601979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c15d090 0x7f411c0d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.429+0000 7f411b7fe700 1 -- 172.21.15.137:0/1848601979 >> v1:172.21.15.72:6789/0 conn(0x7f411c0b8aa0 legacy=0x7f411c0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.429+0000 7f411b7fe700 1 -- 172.21.15.137:0/1848601979 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0d1da0 con 0x7f411c0ce260 2023-08-25T04:45:14.433 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.429+0000 7f411affd700 1 --2- 172.21.15.137:0/1848601979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c15d090 0x7f411c0d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:14.433 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.429+0000 7f411a7fc700 1 -- 172.21.15.137:0/1848601979 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413785445 0 0) 0x7f411c15d470 con 0x7f411c0b8aa0 2023-08-25T04:45:14.433 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.429+0000 7f411b7fe700 1 --2- 172.21.15.137:0/1848601979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f411c0ce260 0x7f411c0b5eb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4114009d90 tx=0x7f411400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc4db8abb3fb3aa8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:14.433 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.429+0000 7f411a7fc700 1 -- 172.21.15.137:0/1848601979 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411400e070 con 0x7f411c0ce260 2023-08-25T04:45:14.433 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.429+0000 7f411a7fc700 1 -- 172.21.15.137:0/1848601979 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411400bb20 con 0x7f411c0ce260 2023-08-25T04:45:14.433 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.429+0000 7f411a7fc700 1 -- 172.21.15.137:0/1848601979 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114012430 con 0x7f411c0ce260 2023-08-25T04:45:14.433 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.430+0000 7f41219ff700 1 -- 172.21.15.137:0/1848601979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f411c0ce260 msgr2=0x7f411c0b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.434 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.430+0000 7f41219ff700 1 --2- 172.21.15.137:0/1848601979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f411c0ce260 0x7f411c0b5eb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4114009d90 tx=0x7f411400b330 comp rx=0 tx=0).stop 2023-08-25T04:45:14.434 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.430+0000 7f41219ff700 1 -- 172.21.15.137:0/1848601979 shutdown_connections 2023-08-25T04:45:14.434 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.430+0000 7f41219ff700 1 --2- 172.21.15.137:0/1848601979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f411c0ce260 0x7f411c0b5eb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.435 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.430+0000 7f41219ff700 1 --2- 172.21.15.137:0/1848601979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c15d090 0x7f411c0d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.435 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.430+0000 7f41219ff700 1 -- 172.21.15.137:0/1848601979 >> 172.21.15.137:0/1848601979 conn(0x7f411c071e10 msgr2=0x7f411c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:14.435 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.430+0000 7f41219ff700 1 -- 172.21.15.137:0/1848601979 shutdown_connections 2023-08-25T04:45:14.435 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.430+0000 7f41219ff700 1 -- 172.21.15.137:0/1848601979 wait complete. 2023-08-25T04:45:14.435 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.433+0000 7f41219ff700 1 Processor -- start 2023-08-25T04:45:14.435 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.433+0000 7f41219ff700 1 -- start start 2023-08-25T04:45:14.437 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f41219ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c0b8aa0 0x7f411c1f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.437 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f41219ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c0ce260 0x7f411c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.437 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f41219ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f411c15d090 0x7f411c0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.437 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f41219ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c1f2640 con 0x7f411c0b8aa0 2023-08-25T04:45:14.437 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f41219ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c1f60c0 con 0x7f411c15d090 2023-08-25T04:45:14.438 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f41219ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c1f63a0 con 0x7f411c0ce260 2023-08-25T04:45:14.438 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f411b7fe700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f411c15d090 0x7f411c0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.438 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f4113fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c0ce260 0x7f411c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.438 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f411affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c0b8aa0 0x7f411c1f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.438 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f4113fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c0ce260 0x7f411c156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:57572/0 (socket says 172.21.15.137:57572) 2023-08-25T04:45:14.438 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.434+0000 7f4113fff700 1 -- 172.21.15.137:0/278747383 learned_addr learned my addr 172.21.15.137:0/278747383 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:14.438 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f411b7fe700 1 -- 172.21.15.137:0/278747383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c0ce260 msgr2=0x7f411c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.439 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f411b7fe700 1 --2- 172.21.15.137:0/278747383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c0ce260 0x7f411c156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.439 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f411b7fe700 1 -- 172.21.15.137:0/278747383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c0b8aa0 msgr2=0x7f411c1f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.439 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f411b7fe700 1 --2- 172.21.15.137:0/278747383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c0b8aa0 0x7f411c1f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.439 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f411b7fe700 1 -- 172.21.15.137:0/278747383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c009550 con 0x7f411c15d090 2023-08-25T04:45:14.439 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f411b7fe700 1 --2- 172.21.15.137:0/278747383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f411c15d090 0x7f411c0c7da0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4114016000 tx=0x7f4114004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:14.439 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f4118ff9700 1 -- 172.21.15.137:0/278747383 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114012430 con 0x7f411c15d090 2023-08-25T04:45:14.439 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f4118ff9700 1 -- 172.21.15.137:0/278747383 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4114020070 con 0x7f411c15d090 2023-08-25T04:45:14.439 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f41219ff700 1 -- 172.21.15.137:0/278747383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4114009a70 con 0x7f411c15d090 2023-08-25T04:45:14.440 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f4118ff9700 1 -- 172.21.15.137:0/278747383 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114004280 con 0x7f411c15d090 2023-08-25T04:45:14.440 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.435+0000 7f41219ff700 1 -- 172.21.15.137:0/278747383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c1f5db0 con 0x7f411c15d090 2023-08-25T04:45:14.440 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.436+0000 7f4118ff9700 1 -- 172.21.15.137:0/278747383 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f41140046e0 con 0x7f411c15d090 2023-08-25T04:45:14.440 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.436+0000 7f4118ff9700 1 -- 172.21.15.137:0/278747383 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4114022070 con 0x7f411c15d090 2023-08-25T04:45:14.440 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.437+0000 7f41219ff700 1 -- 172.21.15.137:0/278747383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c1f64e0 con 0x7f411c15d090 2023-08-25T04:45:14.441 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.439+0000 7f4118ff9700 1 -- 172.21.15.137:0/278747383 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f411c1f64e0 con 0x7f411c15d090 2023-08-25T04:45:14.490 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:14.489+0000 7f747bba3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-25T04:45:14.564 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.563+0000 7f41219ff700 1 -- 172.21.15.137:0/278747383 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cc19cb37-3f4b-49e4-821f-d17e72c31af9", "id": 2} v 0) v1 -- 0x7f411c06a2f0 con 0x7f411c15d090 2023-08-25T04:45:14.572 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.571+0000 7f4118ff9700 1 -- 172.21.15.137:0/278747383 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc19cb37-3f4b-49e4-821f-d17e72c31af9", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4114012e40 con 0x7f411c15d090 2023-08-25T04:45:14.572 INFO:teuthology.orchestra.run.smithi137.stdout:2 2023-08-25T04:45:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.572+0000 7f41219ff700 1 -- 172.21.15.137:0/278747383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f411c15d090 msgr2=0x7f411c0c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.572+0000 7f41219ff700 1 --2- 172.21.15.137:0/278747383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f411c15d090 0x7f411c0c7da0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4114016000 tx=0x7f4114004ad0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.573 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.572+0000 7f41219ff700 1 -- 172.21.15.137:0/278747383 shutdown_connections 2023-08-25T04:45:14.574 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.572+0000 7f41219ff700 1 --2- 172.21.15.137:0/278747383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f411c15d090 0x7f411c0c7da0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.574 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.572+0000 7f41219ff700 1 --2- 172.21.15.137:0/278747383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c0b8aa0 0x7f411c1f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.574 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.572+0000 7f41219ff700 1 --2- 172.21.15.137:0/278747383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f411c0ce260 0x7f411c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.574 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.572+0000 7f41219ff700 1 -- 172.21.15.137:0/278747383 >> 172.21.15.137:0/278747383 conn(0x7f411c071e10 msgr2=0x7f411c0cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:14.574 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.572+0000 7f41219ff700 1 -- 172.21.15.137:0/278747383 shutdown_connections 2023-08-25T04:45:14.574 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.572+0000 7f41219ff700 1 -- 172.21.15.137:0/278747383 wait complete. 2023-08-25T04:45:14.590 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 02f4db2b-3677-4549-907a-bda8b3c43272 3 2023-08-25T04:45:14.751 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:14.750+0000 7f747bba3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-25T04:45:14.772 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:14.771+0000 7f7d16c78200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:45:14.785 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.784+0000 7f76f57ff700 1 Processor -- start 2023-08-25T04:45:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.784+0000 7f76f57ff700 1 -- start start 2023-08-25T04:45:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76f57ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76f00c71b0 0x7f76f00cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76f57ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f76f00cd4f0 0x7f76f00cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76f57ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f00cba40 con 0x7f76f00cdeb0 2023-08-25T04:45:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76f57ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f00d04f0 con 0x7f76f00c71b0 2023-08-25T04:45:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76f57ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f00ce320 con 0x7f76f00cd4f0 2023-08-25T04:45:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76ee7fc700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f76f00cd4f0 0x7f76f00cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.789 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76ee7fc700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f76f00cd4f0 0x7f76f00cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47644/0 (socket says 172.21.15.137:47644) 2023-08-25T04:45:14.789 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76ee7fc700 1 -- 172.21.15.137:0/1802138220 learned_addr learned my addr 172.21.15.137:0/1802138220 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:14.789 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76eeffd700 1 --2- 172.21.15.137:0/1802138220 >> v2:172.21.15.72:3300/0 conn(0x7f76f00c71b0 0x7f76f00cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.789 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76ee7fc700 1 -- 172.21.15.137:0/1802138220 >> v2:172.21.15.72:3300/0 conn(0x7f76f00c71b0 msgr2=0x7f76f00cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:14.789 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76ee7fc700 1 --2- 172.21.15.137:0/1802138220 >> v2:172.21.15.72:3300/0 conn(0x7f76f00c71b0 0x7f76f00cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.789 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76ee7fc700 1 -- 172.21.15.137:0/1802138220 >> v1:172.21.15.137:6789/0 conn(0x7f76f00cdeb0 legacy=0x7f76f006b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.789 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.786+0000 7f76ee7fc700 1 -- 172.21.15.137:0/1802138220 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f00d0210 con 0x7f76f00cd4f0 2023-08-25T04:45:14.790 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.787+0000 7f76ee7fc700 1 --2- 172.21.15.137:0/1802138220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00cd4f0 0x7f76f00cd970 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f76f0160d90 tx=0x7f76e4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7cba7317770063d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:14.794 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.787+0000 7f76edffb700 1 -- 172.21.15.137:0/1802138220 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4011830 con 0x7f76f00cd4f0 2023-08-25T04:45:14.794 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.787+0000 7f76edffb700 1 -- 172.21.15.137:0/1802138220 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e4011990 con 0x7f76f00cd4f0 2023-08-25T04:45:14.794 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.787+0000 7f76edffb700 1 -- 172.21.15.137:0/1802138220 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4011d20 con 0x7f76f00cd4f0 2023-08-25T04:45:14.795 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.787+0000 7f76f57ff700 1 -- 172.21.15.137:0/1802138220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00cd4f0 msgr2=0x7f76f00cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.795 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.787+0000 7f76f57ff700 1 --2- 172.21.15.137:0/1802138220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00cd4f0 0x7f76f00cd970 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f76f0160d90 tx=0x7f76e4009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.795 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.788+0000 7f76f57ff700 1 -- 172.21.15.137:0/1802138220 shutdown_connections 2023-08-25T04:45:14.795 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.788+0000 7f76f57ff700 1 --2- 172.21.15.137:0/1802138220 >> v2:172.21.15.72:3300/0 conn(0x7f76f00c71b0 0x7f76f00cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.795 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.788+0000 7f76f57ff700 1 --2- 172.21.15.137:0/1802138220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00cd4f0 0x7f76f00cd970 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.795 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.788+0000 7f76f57ff700 1 -- 172.21.15.137:0/1802138220 >> 172.21.15.137:0/1802138220 conn(0x7f76f00d0c70 msgr2=0x7f76f00d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:14.795 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.788+0000 7f76f57ff700 1 -- 172.21.15.137:0/1802138220 shutdown_connections 2023-08-25T04:45:14.796 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.788+0000 7f76f57ff700 1 -- 172.21.15.137:0/1802138220 wait complete. 2023-08-25T04:45:14.796 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.789+0000 7f76f57ff700 1 Processor -- start 2023-08-25T04:45:14.796 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.790+0000 7f76f57ff700 1 -- start start 2023-08-25T04:45:14.796 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.790+0000 7f76f57ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00c71b0 0x7f76f009acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.796 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.790+0000 7f76f57ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76f00cd4f0 0x7f76f00c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.796 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.790+0000 7f76f57ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f00cdeb0 0x7f76f009d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:14.797 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76f57ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f009bf50 con 0x7f76f00cdeb0 2023-08-25T04:45:14.797 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76f57ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f009b2d0 con 0x7f76f00c71b0 2023-08-25T04:45:14.797 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76f57ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f009b5b0 con 0x7f76f00cd4f0 2023-08-25T04:45:14.798 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76eeffd700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00c71b0 0x7f76f009acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.798 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76eeffd700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00c71b0 0x7f76f009acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47650/0 (socket says 172.21.15.137:47650) 2023-08-25T04:45:14.798 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76eeffd700 1 -- 172.21.15.137:0/4248388297 learned_addr learned my addr 172.21.15.137:0/4248388297 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:14.798 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76ee7fc700 1 --2- 172.21.15.137:0/4248388297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76f00cd4f0 0x7f76f00c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.799 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76ef7fe700 1 --2- 172.21.15.137:0/4248388297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f00cdeb0 0x7f76f009d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:14.799 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76ee7fc700 1 -- 172.21.15.137:0/4248388297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00c71b0 msgr2=0x7f76f009acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.799 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76ee7fc700 1 --2- 172.21.15.137:0/4248388297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00c71b0 0x7f76f009acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.799 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76ee7fc700 1 -- 172.21.15.137:0/4248388297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f00cdeb0 msgr2=0x7f76f009d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.799 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76ee7fc700 1 --2- 172.21.15.137:0/4248388297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f00cdeb0 0x7f76f009d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.800 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76ee7fc700 1 -- 172.21.15.137:0/4248388297 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4009550 con 0x7f76f00cd4f0 2023-08-25T04:45:14.801 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76eeffd700 1 --2- 172.21.15.137:0/4248388297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00c71b0 0x7f76f009acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:14.801 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.791+0000 7f76ee7fc700 1 --2- 172.21.15.137:0/4248388297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76f00cd4f0 0x7f76f00c9260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76e4016000 tx=0x7f76e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:14.801 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.792+0000 7f76d77fe700 1 -- 172.21.15.137:0/4248388297 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4004510 con 0x7f76f00cd4f0 2023-08-25T04:45:14.801 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.792+0000 7f76d77fe700 1 -- 172.21.15.137:0/4248388297 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e401e070 con 0x7f76f00cd4f0 2023-08-25T04:45:14.802 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.792+0000 7f76d77fe700 1 -- 172.21.15.137:0/4248388297 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40038e0 con 0x7f76f00cd4f0 2023-08-25T04:45:14.802 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.792+0000 7f76f57ff700 1 -- 172.21.15.137:0/4248388297 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f009b890 con 0x7f76f00cd4f0 2023-08-25T04:45:14.802 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.792+0000 7f76f57ff700 1 -- 172.21.15.137:0/4248388297 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f00c97a0 con 0x7f76f00cd4f0 2023-08-25T04:45:14.802 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.792+0000 7f76d77fe700 1 -- 172.21.15.137:0/4248388297 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f76e4003d40 con 0x7f76f00cd4f0 2023-08-25T04:45:14.803 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.792+0000 7f76d77fe700 1 -- 172.21.15.137:0/4248388297 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f76e402db30 con 0x7f76f00cd4f0 2023-08-25T04:45:14.803 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.793+0000 7f76f57ff700 1 -- 172.21.15.137:0/4248388297 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f009c090 con 0x7f76f00cd4f0 2023-08-25T04:45:14.804 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.797+0000 7f76d77fe700 1 -- 172.21.15.137:0/4248388297 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f76f009c090 con 0x7f76f00cd4f0 2023-08-25T04:45:14.884 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.884+0000 7f76f57ff700 1 -- 172.21.15.137:0/4248388297 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "02f4db2b-3677-4549-907a-bda8b3c43272", "id": 3} v 0) v1 -- 0x7f76f00cb3a0 con 0x7f76f00cd4f0 2023-08-25T04:45:14.890 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.890+0000 7f76d77fe700 1 -- 172.21.15.137:0/4248388297 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02f4db2b-3677-4549-907a-bda8b3c43272", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f76e4020070 con 0x7f76f00cd4f0 2023-08-25T04:45:14.891 INFO:teuthology.orchestra.run.smithi137.stdout:3 2023-08-25T04:45:14.892 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.891+0000 7f76f57ff700 1 -- 172.21.15.137:0/4248388297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76f00cd4f0 msgr2=0x7f76f00c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:14.892 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.891+0000 7f76f57ff700 1 --2- 172.21.15.137:0/4248388297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76f00cd4f0 0x7f76f00c9260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76e4016000 tx=0x7f76e4004750 comp rx=0 tx=0).stop 2023-08-25T04:45:14.892 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.891+0000 7f76f57ff700 1 -- 172.21.15.137:0/4248388297 shutdown_connections 2023-08-25T04:45:14.892 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.891+0000 7f76f57ff700 1 --2- 172.21.15.137:0/4248388297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f00cdeb0 0x7f76f009d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.892 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.891+0000 7f76f57ff700 1 --2- 172.21.15.137:0/4248388297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76f00c71b0 0x7f76f009acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.892 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.891+0000 7f76f57ff700 1 --2- 172.21.15.137:0/4248388297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f76f00cd4f0 0x7f76f00c9260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:14.893 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.891+0000 7f76f57ff700 1 -- 172.21.15.137:0/4248388297 >> 172.21.15.137:0/4248388297 conn(0x7f76f00d0c70 msgr2=0x7f76f0160560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:14.893 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.891+0000 7f76f57ff700 1 -- 172.21.15.137:0/4248388297 shutdown_connections 2023-08-25T04:45:14.893 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:14.891+0000 7f76f57ff700 1 -- 172.21.15.137:0/4248388297 wait complete. 2023-08-25T04:45:14.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new b0bf2795-9ea7-4796-bbb9-1340d4af8c5e 4 2023-08-25T04:45:15.102 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.101+0000 7f1d897ff700 1 Processor -- start 2023-08-25T04:45:15.102 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.101+0000 7f1d897ff700 1 -- start start 2023-08-25T04:45:15.103 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.102+0000 7f1d897ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.103 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.102+0000 7f1d897ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d840b8d10 con 0x7f1d8415d000 2023-08-25T04:45:15.103 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.102+0000 7f1d897ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d840b6e90 con 0x7f1d840d10c0 2023-08-25T04:45:15.104 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.102+0000 7f1d897ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840b56f0 con 0x7f1d840b4f10 2023-08-25T04:45:15.104 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.102+0000 7f1d7bfff700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1d840d10c0 0x7f1d840b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49562/0 (socket says 172.21.15.137:49562) 2023-08-25T04:45:15.104 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.102+0000 7f1d837fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.104 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.102+0000 7f1d7bfff700 1 -- 172.21.15.137:0/1425900064 learned_addr learned my addr 172.21.15.137:0/1425900064 (peer_addr_for_me v1:172.21.15.137:0/0) 2023-08-25T04:45:15.105 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.103+0000 7f1d827fc700 1 -- 172.21.15.137:0/1425900064 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269006070 0 0) 0x7f1d840b6e90 con 0x7f1d840d10c0 2023-08-25T04:45:15.105 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.103+0000 7f1d837fe700 1 -- 172.21.15.137:0/1425900064 >> v1:172.21.15.137:6789/0 conn(0x7f1d840d10c0 legacy=0x7f1d840b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.105 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.103+0000 7f1d837fe700 1 -- 172.21.15.137:0/1425900064 >> v1:172.21.15.72:6789/0 conn(0x7f1d8415d000 legacy=0x7f1d840b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.106 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.103+0000 7f1d837fe700 1 -- 172.21.15.137:0/1425900064 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8415d3e0 con 0x7f1d840b4f10 2023-08-25T04:45:15.106 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.103+0000 7f1d837fe700 1 --2- 172.21.15.137:0/1425900064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84167be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009dc0 tx=0x7f1d7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee0f95844a07cc21 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:15.106 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.103+0000 7f1d827fc700 1 -- 172.21.15.137:0/1425900064 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c00e070 con 0x7f1d840b4f10 2023-08-25T04:45:15.106 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.104+0000 7f1d827fc700 1 -- 172.21.15.137:0/1425900064 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c00bbd0 con 0x7f1d840b4f10 2023-08-25T04:45:15.106 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.104+0000 7f1d827fc700 1 -- 172.21.15.137:0/1425900064 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c012430 con 0x7f1d840b4f10 2023-08-25T04:45:15.106 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.104+0000 7f1d897ff700 1 -- 172.21.15.137:0/1425900064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 msgr2=0x7f1d84167be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.106 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.104+0000 7f1d897ff700 1 --2- 172.21.15.137:0/1425900064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84167be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009dc0 tx=0x7f1d7c00b330 comp rx=0 tx=0).stop 2023-08-25T04:45:15.106 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.104+0000 7f1d897ff700 1 -- 172.21.15.137:0/1425900064 shutdown_connections 2023-08-25T04:45:15.107 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.104+0000 7f1d897ff700 1 --2- 172.21.15.137:0/1425900064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84167be0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.107 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.104+0000 7f1d897ff700 1 -- 172.21.15.137:0/1425900064 >> 172.21.15.137:0/1425900064 conn(0x7f1d84071e10 msgr2=0x7f1d84072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:15.107 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.104+0000 7f1d897ff700 1 -- 172.21.15.137:0/1425900064 shutdown_connections 2023-08-25T04:45:15.107 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.104+0000 7f1d897ff700 1 -- 172.21.15.137:0/1425900064 wait complete. 2023-08-25T04:45:15.109 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.106+0000 7f1d897ff700 1 Processor -- start 2023-08-25T04:45:15.109 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.106+0000 7f1d897ff700 1 -- start start 2023-08-25T04:45:15.109 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.107+0000 7f1d897ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.109 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.107+0000 7f1d897ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d840d10c0 0x7f1d840c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.109 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.107+0000 7f1d897ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8415d000 0x7f1d840cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.109 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.107+0000 7f1d897ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d84149c90 con 0x7f1d8415d000 2023-08-25T04:45:15.110 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.107+0000 7f1d897ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8414d040 con 0x7f1d840d10c0 2023-08-25T04:45:15.110 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.107+0000 7f1d897ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8414cae0 con 0x7f1d840b4f10 2023-08-25T04:45:15.110 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.107+0000 7f1d82ffd700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.110 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.107+0000 7f1d82ffd700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84146c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:57586/0 (socket says 172.21.15.137:57586) 2023-08-25T04:45:15.110 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.107+0000 7f1d82ffd700 1 -- 172.21.15.137:0/3743078112 learned_addr learned my addr 172.21.15.137:0/3743078112 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:15.110 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.107+0000 7f1d7bfff700 1 --2- 172.21.15.137:0/3743078112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d840d10c0 0x7f1d840c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.110 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d837fe700 1 --2- 172.21.15.137:0/3743078112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8415d000 0x7f1d840cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.111 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d82ffd700 1 -- 172.21.15.137:0/3743078112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d840d10c0 msgr2=0x7f1d840c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.111 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d82ffd700 1 --2- 172.21.15.137:0/3743078112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d840d10c0 0x7f1d840c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.111 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d82ffd700 1 -- 172.21.15.137:0/3743078112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8415d000 msgr2=0x7f1d840cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.111 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d82ffd700 1 --2- 172.21.15.137:0/3743078112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8415d000 0x7f1d840cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.111 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d82ffd700 1 -- 172.21.15.137:0/3743078112 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c009a70 con 0x7f1d840b4f10 2023-08-25T04:45:15.111 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d837fe700 1 --2- 172.21.15.137:0/3743078112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8415d000 0x7f1d840cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:15.111 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d82ffd700 1 --2- 172.21.15.137:0/3743078112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84146c30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400c450 tx=0x7f1d7400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:15.112 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d7b7fe700 1 -- 172.21.15.137:0/3743078112 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740052d0 con 0x7f1d840b4f10 2023-08-25T04:45:15.112 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d7b7fe700 1 -- 172.21.15.137:0/3743078112 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d74005430 con 0x7f1d840b4f10 2023-08-25T04:45:15.112 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d897ff700 1 -- 172.21.15.137:0/3743078112 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d84149010 con 0x7f1d840b4f10 2023-08-25T04:45:15.113 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d7b7fe700 1 -- 172.21.15.137:0/3743078112 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740038c0 con 0x7f1d840b4f10 2023-08-25T04:45:15.113 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.108+0000 7f1d897ff700 1 -- 172.21.15.137:0/3743078112 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d841495d0 con 0x7f1d840b4f10 2023-08-25T04:45:15.113 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.109+0000 7f1d7b7fe700 1 -- 172.21.15.137:0/3743078112 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1d74003d20 con 0x7f1d840b4f10 2023-08-25T04:45:15.113 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.109+0000 7f1d7b7fe700 1 -- 172.21.15.137:0/3743078112 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f1d74011d60 con 0x7f1d840b4f10 2023-08-25T04:45:15.113 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.110+0000 7f1d897ff700 1 -- 172.21.15.137:0/3743078112 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8406a2f0 con 0x7f1d840b4f10 2023-08-25T04:45:15.113 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.112+0000 7f1d7b7fe700 1 -- 172.21.15.137:0/3743078112 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1d74017070 con 0x7f1d840b4f10 2023-08-25T04:45:15.199 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.198+0000 7f1d897ff700 1 -- 172.21.15.137:0/3743078112 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b0bf2795-9ea7-4796-bbb9-1340d4af8c5e", "id": 4} v 0) v1 -- 0x7f1d8408a000 con 0x7f1d840b4f10 2023-08-25T04:45:15.207 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.206+0000 7f1d7b7fe700 1 -- 172.21.15.137:0/3743078112 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0bf2795-9ea7-4796-bbb9-1340d4af8c5e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1d74011590 con 0x7f1d840b4f10 2023-08-25T04:45:15.207 INFO:teuthology.orchestra.run.smithi137.stdout:4 2023-08-25T04:45:15.208 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.207+0000 7f1d897ff700 1 -- 172.21.15.137:0/3743078112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 msgr2=0x7f1d84146c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.209 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.207+0000 7f1d897ff700 1 --2- 172.21.15.137:0/3743078112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84146c30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400c450 tx=0x7f1d7400c760 comp rx=0 tx=0).stop 2023-08-25T04:45:15.209 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.207+0000 7f1d897ff700 1 -- 172.21.15.137:0/3743078112 shutdown_connections 2023-08-25T04:45:15.209 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.207+0000 7f1d897ff700 1 --2- 172.21.15.137:0/3743078112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d8415d000 0x7f1d840cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.209 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.207+0000 7f1d897ff700 1 --2- 172.21.15.137:0/3743078112 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1d840b4f10 0x7f1d84146c30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.209 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.207+0000 7f1d897ff700 1 --2- 172.21.15.137:0/3743078112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d840d10c0 0x7f1d840c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.209 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.207+0000 7f1d897ff700 1 -- 172.21.15.137:0/3743078112 >> 172.21.15.137:0/3743078112 conn(0x7f1d84071e10 msgr2=0x7f1d840d1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:15.209 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.208+0000 7f1d897ff700 1 -- 172.21.15.137:0/3743078112 shutdown_connections 2023-08-25T04:45:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.208+0000 7f1d897ff700 1 -- 172.21.15.137:0/3743078112 wait complete. 2023-08-25T04:45:15.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 4b332a5c-432c-42ed-86b8-4c4aed4ad634 5 2023-08-25T04:45:15.226 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:15.225+0000 7f747bba3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:45:15.418 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.417+0000 7fde2e1ff700 1 Processor -- start 2023-08-25T04:45:15.418 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.417+0000 7fde2e1ff700 1 -- start start 2023-08-25T04:45:15.421 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.418+0000 7fde2e1ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fde280b4f10 0x7fde28167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.418+0000 7fde2e1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde280b8d10 con 0x7fde2815d000 2023-08-25T04:45:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.418+0000 7fde2e1ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde280b6e90 con 0x7fde280d10c0 2023-08-25T04:45:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.418+0000 7fde2e1ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280b56f0 con 0x7fde280b4f10 2023-08-25T04:45:15.422 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.418+0000 7fde26ffd700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fde280d10c0 0x7fde280b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49564/0 (socket says 172.21.15.137:49564) 2023-08-25T04:45:15.423 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.418+0000 7fde26ffd700 1 -- 172.21.15.137:0/768752570 learned_addr learned my addr 172.21.15.137:0/768752570 (peer_addr_for_me v1:172.21.15.137:0/0) 2023-08-25T04:45:15.423 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.418+0000 7fde27fff700 1 --2- 172.21.15.137:0/768752570 >> v2:172.21.15.137:3300/0 conn(0x7fde280b4f10 0x7fde28167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.423 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.419+0000 7fde27fff700 1 -- 172.21.15.137:0/768752570 >> v1:172.21.15.137:6789/0 conn(0x7fde280d10c0 legacy=0x7fde280b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.423 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.419+0000 7fde27fff700 1 -- 172.21.15.137:0/768752570 >> v1:172.21.15.72:6789/0 conn(0x7fde2815d000 legacy=0x7fde280b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.424 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.419+0000 7fde27fff700 1 -- 172.21.15.137:0/768752570 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2815d3e0 con 0x7fde280b4f10 2023-08-25T04:45:15.424 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.419+0000 7fde27fff700 1 --2- 172.21.15.137:0/768752570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde280b4f10 0x7fde28167be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fde20009d90 tx=0x7fde2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae30cd10530d7823 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:15.424 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.419+0000 7fde267fc700 1 -- 172.21.15.137:0/768752570 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000e070 con 0x7fde280b4f10 2023-08-25T04:45:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.419+0000 7fde267fc700 1 -- 172.21.15.137:0/768752570 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2000bbd0 con 0x7fde280b4f10 2023-08-25T04:45:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.419+0000 7fde267fc700 1 -- 172.21.15.137:0/768752570 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20012430 con 0x7fde280b4f10 2023-08-25T04:45:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.420+0000 7fde2e1ff700 1 -- 172.21.15.137:0/768752570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde280b4f10 msgr2=0x7fde28167be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.425 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.420+0000 7fde2e1ff700 1 --2- 172.21.15.137:0/768752570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde280b4f10 0x7fde28167be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fde20009d90 tx=0x7fde2000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:15.426 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.420+0000 7fde2e1ff700 1 -- 172.21.15.137:0/768752570 shutdown_connections 2023-08-25T04:45:15.426 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.420+0000 7fde2e1ff700 1 --2- 172.21.15.137:0/768752570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde280b4f10 0x7fde28167be0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.426 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.420+0000 7fde2e1ff700 1 -- 172.21.15.137:0/768752570 >> 172.21.15.137:0/768752570 conn(0x7fde28071e10 msgr2=0x7fde28072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:15.426 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.420+0000 7fde2e1ff700 1 -- 172.21.15.137:0/768752570 shutdown_connections 2023-08-25T04:45:15.427 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.420+0000 7fde2e1ff700 1 -- 172.21.15.137:0/768752570 wait complete. 2023-08-25T04:45:15.430 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.422+0000 7fde2e1ff700 1 Processor -- start 2023-08-25T04:45:15.430 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.422+0000 7fde2e1ff700 1 -- start start 2023-08-25T04:45:15.431 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde2e1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde280b4f10 0x7fde280c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.431 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde2e1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde280d10c0 0x7fde2815e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.431 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde2e1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde2815d000 0x7fde281efba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde2e1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280c77a0 con 0x7fde280d10c0 2023-08-25T04:45:15.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde2e1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2815e5e0 con 0x7fde2815d000 2023-08-25T04:45:15.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde2e1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde281f5e80 con 0x7fde280b4f10 2023-08-25T04:45:15.432 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde27fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde2815d000 0x7fde281efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.433 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde277fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde280b4f10 0x7fde280c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.433 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde27fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde2815d000 0x7fde281efba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47682/0 (socket says 172.21.15.137:47682) 2023-08-25T04:45:15.433 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde27fff700 1 -- 172.21.15.137:0/2871791632 learned_addr learned my addr 172.21.15.137:0/2871791632 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:15.434 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde26ffd700 1 --2- 172.21.15.137:0/2871791632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde280d10c0 0x7fde2815e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.434 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde277fe700 1 -- 172.21.15.137:0/2871791632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde2815d000 msgr2=0x7fde281efba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.434 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde277fe700 1 --2- 172.21.15.137:0/2871791632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde2815d000 0x7fde281efba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.434 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde277fe700 1 -- 172.21.15.137:0/2871791632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde280d10c0 msgr2=0x7fde2815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.435 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde277fe700 1 --2- 172.21.15.137:0/2871791632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde280d10c0 0x7fde2815e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.435 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.423+0000 7fde277fe700 1 -- 172.21.15.137:0/2871791632 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde20009a70 con 0x7fde280b4f10 2023-08-25T04:45:15.435 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.424+0000 7fde277fe700 1 --2- 172.21.15.137:0/2871791632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde280b4f10 0x7fde280c7260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde18000f60 tx=0x7fde1800c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:15.435 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.424+0000 7fde0ffff700 1 -- 172.21.15.137:0/2871791632 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180052d0 con 0x7fde280b4f10 2023-08-25T04:45:15.436 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.424+0000 7fde0ffff700 1 -- 172.21.15.137:0/2871791632 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1800ce90 con 0x7fde280b4f10 2023-08-25T04:45:15.436 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.424+0000 7fde2e1ff700 1 -- 172.21.15.137:0/2871791632 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde281f6160 con 0x7fde280b4f10 2023-08-25T04:45:15.436 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.424+0000 7fde0ffff700 1 -- 172.21.15.137:0/2871791632 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18003680 con 0x7fde280b4f10 2023-08-25T04:45:15.437 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.424+0000 7fde2e1ff700 1 -- 172.21.15.137:0/2871791632 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde281f6720 con 0x7fde280b4f10 2023-08-25T04:45:15.437 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.424+0000 7fde0ffff700 1 -- 172.21.15.137:0/2871791632 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fde18003ae0 con 0x7fde280b4f10 2023-08-25T04:45:15.437 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.424+0000 7fde0ffff700 1 -- 172.21.15.137:0/2871791632 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fde18003d90 con 0x7fde280b4f10 2023-08-25T04:45:15.437 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.425+0000 7fde2e1ff700 1 -- 172.21.15.137:0/2871791632 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde281f2900 con 0x7fde280b4f10 2023-08-25T04:45:15.438 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.427+0000 7fde0ffff700 1 -- 172.21.15.137:0/2871791632 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fde18017070 con 0x7fde280b4f10 2023-08-25T04:45:15.514 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.513+0000 7fde2e1ff700 1 -- 172.21.15.137:0/2871791632 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4b332a5c-432c-42ed-86b8-4c4aed4ad634", "id": 5} v 0) v1 -- 0x7fde2806a2f0 con 0x7fde280b4f10 2023-08-25T04:45:15.520 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.519+0000 7fde0ffff700 1 -- 172.21.15.137:0/2871791632 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b332a5c-432c-42ed-86b8-4c4aed4ad634", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde18011cc0 con 0x7fde280b4f10 2023-08-25T04:45:15.520 INFO:teuthology.orchestra.run.smithi137.stdout:5 2023-08-25T04:45:15.521 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.520+0000 7fde2e1ff700 1 -- 172.21.15.137:0/2871791632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde280b4f10 msgr2=0x7fde280c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.521 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.520+0000 7fde2e1ff700 1 --2- 172.21.15.137:0/2871791632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde280b4f10 0x7fde280c7260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde18000f60 tx=0x7fde1800c6e0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.521 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.520+0000 7fde2e1ff700 1 -- 172.21.15.137:0/2871791632 shutdown_connections 2023-08-25T04:45:15.522 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.520+0000 7fde2e1ff700 1 --2- 172.21.15.137:0/2871791632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde2815d000 0x7fde281efba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.522 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.520+0000 7fde2e1ff700 1 --2- 172.21.15.137:0/2871791632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fde280b4f10 0x7fde280c7260 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.522 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.520+0000 7fde2e1ff700 1 --2- 172.21.15.137:0/2871791632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde280d10c0 0x7fde2815e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.522 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.520+0000 7fde2e1ff700 1 -- 172.21.15.137:0/2871791632 >> 172.21.15.137:0/2871791632 conn(0x7fde28071e10 msgr2=0x7fde280d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:15.522 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.520+0000 7fde2e1ff700 1 -- 172.21.15.137:0/2871791632 shutdown_connections 2023-08-25T04:45:15.522 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.520+0000 7fde2e1ff700 1 -- 172.21.15.137:0/2871791632 wait complete. 2023-08-25T04:45:15.538 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 6743bebc-9f70-4a48-ad13-6d028c6fadc1 6 2023-08-25T04:45:15.588 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:15.587+0000 7f7d16c78200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:45:15.679 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:15.679+0000 7f7d16c78200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:45:15.735 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.734+0000 7fb05d7ff700 1 Processor -- start 2023-08-25T04:45:15.735 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.734+0000 7fb05d7ff700 1 -- start start 2023-08-25T04:45:15.736 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.735+0000 7fb05d7ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb05815d090 0x7fb0580d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.736 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.735+0000 7fb05d7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0580ce260 0x7fb0580b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.737 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.735+0000 7fb05d7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05815d470 con 0x7fb0580b8aa0 2023-08-25T04:45:15.737 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.735+0000 7fb05d7ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0580d17e0 con 0x7fb05815d090 2023-08-25T04:45:15.737 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.735+0000 7fb05d7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0580d1ac0 con 0x7fb0580ce260 2023-08-25T04:45:15.737 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.735+0000 7fb056ffd700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb05815d090 0x7fb0580d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.737 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.735+0000 7fb0577fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0580ce260 0x7fb0580b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.737 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb0577fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0580ce260 0x7fb0580b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:57608/0 (socket says 172.21.15.137:57608) 2023-08-25T04:45:15.737 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb0577fe700 1 -- 172.21.15.137:0/1893121248 learned_addr learned my addr 172.21.15.137:0/1893121248 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:15.737 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb056ffd700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb05815d090 0x7fb0580d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47686/0 (socket says 172.21.15.137:47686) 2023-08-25T04:45:15.739 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb0577fe700 1 -- 172.21.15.137:0/1893121248 >> v2:172.21.15.137:3300/0 conn(0x7fb05815d090 msgr2=0x7fb0580d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:15.739 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb0577fe700 1 --2- 172.21.15.137:0/1893121248 >> v2:172.21.15.137:3300/0 conn(0x7fb05815d090 0x7fb0580d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.739 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb0577fe700 1 -- 172.21.15.137:0/1893121248 >> v1:172.21.15.72:6789/0 conn(0x7fb0580b8aa0 legacy=0x7fb0580cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.739 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb055ffb700 1 -- 172.21.15.137:0/1893121248 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020251822 0 0) 0x7fb05815d470 con 0x7fb0580b8aa0 2023-08-25T04:45:15.739 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb0577fe700 1 -- 172.21.15.137:0/1893121248 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0580d1da0 con 0x7fb0580ce260 2023-08-25T04:45:15.739 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb056ffd700 1 --2- 172.21.15.137:0/1893121248 >> v2:172.21.15.137:3300/0 conn(0x7fb05815d090 0x7fb0580d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:15.740 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb0577fe700 1 --2- 172.21.15.137:0/1893121248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0580ce260 0x7fb0580b5eb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb050009e50 tx=0x7fb05000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1166aac091492bd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:15.740 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb055ffb700 1 -- 172.21.15.137:0/1893121248 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000e070 con 0x7fb0580ce260 2023-08-25T04:45:15.740 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.736+0000 7fb055ffb700 1 -- 172.21.15.137:0/1893121248 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05000b910 con 0x7fb0580ce260 2023-08-25T04:45:15.740 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.737+0000 7fb055ffb700 1 -- 172.21.15.137:0/1893121248 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000bcc0 con 0x7fb0580ce260 2023-08-25T04:45:15.740 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.737+0000 7fb05d7ff700 1 -- 172.21.15.137:0/1893121248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0580ce260 msgr2=0x7fb0580b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.740 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.737+0000 7fb05d7ff700 1 --2- 172.21.15.137:0/1893121248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0580ce260 0x7fb0580b5eb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb050009e50 tx=0x7fb05000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:15.740 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.737+0000 7fb05d7ff700 1 -- 172.21.15.137:0/1893121248 shutdown_connections 2023-08-25T04:45:15.741 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.737+0000 7fb05d7ff700 1 --2- 172.21.15.137:0/1893121248 >> v2:172.21.15.137:3300/0 conn(0x7fb05815d090 0x7fb0580d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.741 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.737+0000 7fb05d7ff700 1 --2- 172.21.15.137:0/1893121248 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0580ce260 0x7fb0580b5eb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.741 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.737+0000 7fb05d7ff700 1 -- 172.21.15.137:0/1893121248 >> 172.21.15.137:0/1893121248 conn(0x7fb058071e10 msgr2=0x7fb058072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:15.741 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.737+0000 7fb05d7ff700 1 -- 172.21.15.137:0/1893121248 shutdown_connections 2023-08-25T04:45:15.741 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.737+0000 7fb05d7ff700 1 -- 172.21.15.137:0/1893121248 wait complete. 2023-08-25T04:45:15.742 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.740+0000 7fb05d7ff700 1 Processor -- start 2023-08-25T04:45:15.742 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.740+0000 7fb05d7ff700 1 -- start start 2023-08-25T04:45:15.743 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb05d7ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0580b8aa0 0x7fb058156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.743 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb05d7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580ce260 0x7fb0580b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.743 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb05d7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb05815d090 0x7fb0580b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:15.743 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb05d7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0581482f0 con 0x7fb0580ce260 2023-08-25T04:45:15.743 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb05d7ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb058157d80 con 0x7fb0580b8aa0 2023-08-25T04:45:15.743 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb05d7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0581577c0 con 0x7fb05815d090 2023-08-25T04:45:15.744 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb056ffd700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0580b8aa0 0x7fb058156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.744 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb056ffd700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0580b8aa0 0x7fb058156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47702/0 (socket says 172.21.15.137:47702) 2023-08-25T04:45:15.744 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb056ffd700 1 -- 172.21.15.137:0/2754120804 learned_addr learned my addr 172.21.15.137:0/2754120804 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:15.744 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb0577fe700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb05815d090 0x7fb0580b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.744 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb0567fc700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580ce260 0x7fb0580b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:15.745 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb056ffd700 1 -- 172.21.15.137:0/2754120804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb05815d090 msgr2=0x7fb0580b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.745 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb056ffd700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb05815d090 0x7fb0580b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.746 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb056ffd700 1 -- 172.21.15.137:0/2754120804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580ce260 msgr2=0x7fb0580b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.746 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb056ffd700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580ce260 0x7fb0580b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.746 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb056ffd700 1 -- 172.21.15.137:0/2754120804 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480094a0 con 0x7fb0580b8aa0 2023-08-25T04:45:15.747 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.742+0000 7fb0577fe700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb05815d090 0x7fb0580b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:15.747 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.743+0000 7fb0567fc700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580ce260 0x7fb0580b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:15.747 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.743+0000 7fb056ffd700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0580b8aa0 0x7fb058156ec0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb04800ebe0 tx=0x7fb04800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:15.747 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.743+0000 7fb03f7fe700 1 -- 172.21.15.137:0/2754120804 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04800c850 con 0x7fb0580b8aa0 2023-08-25T04:45:15.747 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.743+0000 7fb03f7fe700 1 -- 172.21.15.137:0/2754120804 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04800c9b0 con 0x7fb0580b8aa0 2023-08-25T04:45:15.748 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.743+0000 7fb03f7fe700 1 -- 172.21.15.137:0/2754120804 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04800cd40 con 0x7fb0580b8aa0 2023-08-25T04:45:15.748 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.743+0000 7fb05d7ff700 1 -- 172.21.15.137:0/2754120804 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb050009b30 con 0x7fb0580b8aa0 2023-08-25T04:45:15.748 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.743+0000 7fb05d7ff700 1 -- 172.21.15.137:0/2754120804 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb058147f80 con 0x7fb0580b8aa0 2023-08-25T04:45:15.748 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.743+0000 7fb03f7fe700 1 -- 172.21.15.137:0/2754120804 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb048005d20 con 0x7fb0580b8aa0 2023-08-25T04:45:15.748 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.744+0000 7fb03f7fe700 1 -- 172.21.15.137:0/2754120804 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb048006840 con 0x7fb0580b8aa0 2023-08-25T04:45:15.748 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.744+0000 7fb05d7ff700 1 -- 172.21.15.137:0/2754120804 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05806a2f0 con 0x7fb0580b8aa0 2023-08-25T04:45:15.749 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.747+0000 7fb03f7fe700 1 -- 172.21.15.137:0/2754120804 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb048021060 con 0x7fb0580b8aa0 2023-08-25T04:45:15.833 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.832+0000 7fb05d7ff700 1 -- 172.21.15.137:0/2754120804 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6743bebc-9f70-4a48-ad13-6d028c6fadc1", "id": 6} v 0) v1 -- 0x7fb05808a000 con 0x7fb0580b8aa0 2023-08-25T04:45:15.838 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.837+0000 7fb03f7fe700 1 -- 172.21.15.137:0/2754120804 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6743bebc-9f70-4a48-ad13-6d028c6fadc1", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb048029020 con 0x7fb0580b8aa0 2023-08-25T04:45:15.839 INFO:teuthology.orchestra.run.smithi137.stdout:6 2023-08-25T04:45:15.839 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.838+0000 7fb05d7ff700 1 -- 172.21.15.137:0/2754120804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0580b8aa0 msgr2=0x7fb058156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.838+0000 7fb05d7ff700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0580b8aa0 0x7fb058156ec0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb04800ebe0 tx=0x7fb04800eef0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.838+0000 7fb05d7ff700 1 -- 172.21.15.137:0/2754120804 shutdown_connections 2023-08-25T04:45:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.838+0000 7fb05d7ff700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb05815d090 0x7fb0580b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.841 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.838+0000 7fb05d7ff700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0580b8aa0 0x7fb058156ec0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.841 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.838+0000 7fb05d7ff700 1 --2- 172.21.15.137:0/2754120804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580ce260 0x7fb0580b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:15.841 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.838+0000 7fb05d7ff700 1 -- 172.21.15.137:0/2754120804 >> 172.21.15.137:0/2754120804 conn(0x7fb058071e10 msgr2=0x7fb0580721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:15.841 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.839+0000 7fb05d7ff700 1 -- 172.21.15.137:0/2754120804 shutdown_connections 2023-08-25T04:45:15.841 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:15.839+0000 7fb05d7ff700 1 -- 172.21.15.137:0/2754120804 wait complete. 2023-08-25T04:45:15.847 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:15.847+0000 7f7d16c78200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:45:15.856 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 09b80551-f07b-43ba-9f98-7430f71f1dea 7 2023-08-25T04:45:15.936 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:15.936+0000 7f7d16c78200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:45:16.054 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.053+0000 7faed8dff700 1 Processor -- start 2023-08-25T04:45:16.054 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.053+0000 7faed8dff700 1 -- start start 2023-08-25T04:45:16.056 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.054+0000 7faed8dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faed40ade30 0x7faed40ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:16.057 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.054+0000 7faed8dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed40ae750 con 0x7faed40710a0 2023-08-25T04:45:16.057 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.054+0000 7faed8dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed40ae9d0 con 0x7faed415da20 2023-08-25T04:45:16.057 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.054+0000 7faed8dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed4159d70 con 0x7faed40ade30 2023-08-25T04:45:16.057 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.054+0000 7faed259c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faed40ade30 0x7faed40ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:16.058 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.054+0000 7faed259c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faed40ade30 0x7faed40ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47716/0 (socket says 172.21.15.137:47716) 2023-08-25T04:45:16.058 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.054+0000 7faed259c700 1 -- 172.21.15.137:0/1209968568 learned_addr learned my addr 172.21.15.137:0/1209968568 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:16.058 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.055+0000 7faed259c700 1 -- 172.21.15.137:0/1209968568 >> v1:172.21.15.137:6789/0 conn(0x7faed415da20 legacy=0x7faed4070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.058 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.055+0000 7faed259c700 1 -- 172.21.15.137:0/1209968568 >> v1:172.21.15.72:6789/0 conn(0x7faed40710a0 legacy=0x7faed40c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.058 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.055+0000 7faed259c700 1 -- 172.21.15.137:0/1209968568 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed415a050 con 0x7faed40ade30 2023-08-25T04:45:16.060 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.055+0000 7faed259c700 1 --2- 172.21.15.137:0/1209968568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faed40ade30 0x7faed40ae210 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faec400bb90 tx=0x7faec400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7e179c1487ea45d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:16.060 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.055+0000 7faed159a700 1 -- 172.21.15.137:0/1209968568 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400dd50 con 0x7faed40ade30 2023-08-25T04:45:16.060 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.055+0000 7faed159a700 1 -- 172.21.15.137:0/1209968568 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4010470 con 0x7faed40ade30 2023-08-25T04:45:16.060 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.055+0000 7faed159a700 1 -- 172.21.15.137:0/1209968568 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4010800 con 0x7faed40ade30 2023-08-25T04:45:16.061 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.056+0000 7faed8dff700 1 -- 172.21.15.137:0/1209968568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faed40ade30 msgr2=0x7faed40ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.061 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.056+0000 7faed8dff700 1 --2- 172.21.15.137:0/1209968568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faed40ade30 0x7faed40ae210 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faec400bb90 tx=0x7faec400bea0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.061 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.056+0000 7faed8dff700 1 -- 172.21.15.137:0/1209968568 shutdown_connections 2023-08-25T04:45:16.061 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.056+0000 7faed8dff700 1 --2- 172.21.15.137:0/1209968568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faed40ade30 0x7faed40ae210 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.061 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.056+0000 7faed8dff700 1 -- 172.21.15.137:0/1209968568 >> 172.21.15.137:0/1209968568 conn(0x7faed406a710 msgr2=0x7faed406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:16.061 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.056+0000 7faed8dff700 1 -- 172.21.15.137:0/1209968568 shutdown_connections 2023-08-25T04:45:16.061 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.056+0000 7faed8dff700 1 -- 172.21.15.137:0/1209968568 wait complete. 2023-08-25T04:45:16.062 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.058+0000 7faed8dff700 1 Processor -- start 2023-08-25T04:45:16.062 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.058+0000 7faed8dff700 1 -- start start 2023-08-25T04:45:16.062 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed8dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faed40710a0 0x7faed4157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:16.062 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed8dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faed40ade30 0x7faed4155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:16.062 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed8dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed415da20 0x7faed4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:16.062 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed8dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed4156520 con 0x7faed415da20 2023-08-25T04:45:16.062 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed8dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40b1dc0 con 0x7faed40ade30 2023-08-25T04:45:16.062 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed8dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed40b2060 con 0x7faed40710a0 2023-08-25T04:45:16.063 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed259c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faed40710a0 0x7faed4157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:16.063 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed259c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faed40710a0 0x7faed4157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:57630/0 (socket says 172.21.15.137:57630) 2023-08-25T04:45:16.063 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed259c700 1 -- 172.21.15.137:0/865316376 learned_addr learned my addr 172.21.15.137:0/865316376 (peer_addr_for_me v2:172.21.15.137:0/0) 2023-08-25T04:45:16.063 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed1d9b700 1 --2- 172.21.15.137:0/865316376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faed40ade30 0x7faed4155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:16.063 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed2d9d700 1 --2- 172.21.15.137:0/865316376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed415da20 0x7faed4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:16.064 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed259c700 1 -- 172.21.15.137:0/865316376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faed40ade30 msgr2=0x7faed4155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.064 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed259c700 1 --2- 172.21.15.137:0/865316376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faed40ade30 0x7faed4155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.065 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.059+0000 7faed259c700 1 -- 172.21.15.137:0/865316376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed415da20 msgr2=0x7faed4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.065 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.060+0000 7faed259c700 1 --2- 172.21.15.137:0/865316376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed415da20 0x7faed4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.065 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.060+0000 7faed259c700 1 -- 172.21.15.137:0/865316376 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec400b7f0 con 0x7faed40710a0 2023-08-25T04:45:16.065 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.060+0000 7faed259c700 1 --2- 172.21.15.137:0/865316376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faed40710a0 0x7faed4157890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faec400bee0 tx=0x7faec4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:16.065 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.060+0000 7faec2ffd700 1 -- 172.21.15.137:0/865316376 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec401f070 con 0x7faed40710a0 2023-08-25T04:45:16.065 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.060+0000 7faec2ffd700 1 -- 172.21.15.137:0/865316376 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec40038b0 con 0x7faed40710a0 2023-08-25T04:45:16.065 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.060+0000 7faed8dff700 1 -- 172.21.15.137:0/865316376 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed40b2340 con 0x7faed40710a0 2023-08-25T04:45:16.065 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.060+0000 7faec2ffd700 1 -- 172.21.15.137:0/865316376 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4003c60 con 0x7faed40710a0 2023-08-25T04:45:16.066 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.060+0000 7faed8dff700 1 -- 172.21.15.137:0/865316376 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed40b2900 con 0x7faed40710a0 2023-08-25T04:45:16.066 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.060+0000 7faec2ffd700 1 -- 172.21.15.137:0/865316376 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faec40105e0 con 0x7faed40710a0 2023-08-25T04:45:16.066 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.060+0000 7faec2ffd700 1 -- 172.21.15.137:0/865316376 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7faec4019400 con 0x7faed40710a0 2023-08-25T04:45:16.066 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.061+0000 7faed8dff700 1 -- 172.21.15.137:0/865316376 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed40cf8c0 con 0x7faed40710a0 2023-08-25T04:45:16.066 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.064+0000 7faec2ffd700 1 -- 172.21.15.137:0/865316376 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7faec4019650 con 0x7faed40710a0 2023-08-25T04:45:16.107 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:16.106+0000 7f747bba3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:45:16.150 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.149+0000 7faed8dff700 1 -- 172.21.15.137:0/865316376 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "09b80551-f07b-43ba-9f98-7430f71f1dea", "id": 7} v 0) v1 -- 0x7faed4072320 con 0x7faed40710a0 2023-08-25T04:45:16.152 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:16.152+0000 7f7d16c78200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:45:16.156 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.156+0000 7faec2ffd700 1 -- 172.21.15.137:0/865316376 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09b80551-f07b-43ba-9f98-7430f71f1dea", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7faec4031020 con 0x7faed40710a0 2023-08-25T04:45:16.157 INFO:teuthology.orchestra.run.smithi137.stdout:7 2023-08-25T04:45:16.158 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.157+0000 7faed8dff700 1 -- 172.21.15.137:0/865316376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faed40710a0 msgr2=0x7faed4157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.158 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.157+0000 7faed8dff700 1 --2- 172.21.15.137:0/865316376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faed40710a0 0x7faed4157890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faec400bee0 tx=0x7faec4004750 comp rx=0 tx=0).stop 2023-08-25T04:45:16.158 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.157+0000 7faed8dff700 1 -- 172.21.15.137:0/865316376 shutdown_connections 2023-08-25T04:45:16.158 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.157+0000 7faed8dff700 1 --2- 172.21.15.137:0/865316376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed415da20 0x7faed4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.158 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.157+0000 7faed8dff700 1 --2- 172.21.15.137:0/865316376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faed40710a0 0x7faed4157890 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.159 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.157+0000 7faed8dff700 1 --2- 172.21.15.137:0/865316376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faed40ade30 0x7faed4155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.159 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.157+0000 7faed8dff700 1 -- 172.21.15.137:0/865316376 >> 172.21.15.137:0/865316376 conn(0x7faed406a710 msgr2=0x7faed40ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:16.159 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.157+0000 7faed8dff700 1 -- 172.21.15.137:0/865316376 shutdown_connections 2023-08-25T04:45:16.159 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:45:16.157+0000 7faed8dff700 1 -- 172.21.15.137:0/865316376 wait complete. 2023-08-25T04:45:16.175 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-25T04:45:16.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-25T04:45:16.179 INFO:tasks.ceph.osd.0:Started 2023-08-25T04:45:16.180 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-25T04:45:16.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-25T04:45:16.184 INFO:tasks.ceph.osd.1:Started 2023-08-25T04:45:16.184 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-25T04:45:16.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-25T04:45:16.190 INFO:tasks.ceph.osd.2:Started 2023-08-25T04:45:16.190 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-25T04:45:16.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-25T04:45:16.196 INFO:tasks.ceph.osd.3:Started 2023-08-25T04:45:16.196 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-25T04:45:16.197 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-25T04:45:16.201 INFO:tasks.ceph.osd.4:Started 2023-08-25T04:45:16.201 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-25T04:45:16.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-25T04:45:16.205 INFO:tasks.ceph.osd.5:Started 2023-08-25T04:45:16.206 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-25T04:45:16.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-25T04:45:16.207 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:16.202+0000 7f747bba3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:45:16.211 INFO:tasks.ceph.osd.6:Started 2023-08-25T04:45:16.212 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-25T04:45:16.212 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-25T04:45:16.217 INFO:tasks.ceph.osd.7:Started 2023-08-25T04:45:16.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:16.288 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:16.287+0000 7f7d16c78200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:45:16.424 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:16.423+0000 7f7d16c78200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:45:16.432 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:16.431+0000 7f747bba3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:45:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.483+0000 7fefdcfff700 1 Processor -- start 2023-08-25T04:45:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.483+0000 7fefdcfff700 1 -- start start 2023-08-25T04:45:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.484+0000 7fefdcfff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fefd80b47c0 0x7fefd80b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.484+0000 7fefdcfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefd80b86b0 0x7fefd80b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.484+0000 7fefdcfff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd80b50e0 con 0x7fefd815d130 2023-08-25T04:45:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.484+0000 7fefdcfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd80d1590 con 0x7fefd80b86b0 2023-08-25T04:45:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.484+0000 7fefdcfff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd80d1780 con 0x7fefd80b47c0 2023-08-25T04:45:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.485+0000 7fefd6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefd80b86b0 0x7fefd80b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.485+0000 7fefd659c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fefd80b47c0 0x7fefd80b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.485+0000 7fefd659c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fefd80b47c0 0x7fefd80b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:56722/0 (socket says 172.21.15.72:56722) 2023-08-25T04:45:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.485+0000 7fefd6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefd80b86b0 0x7fefd80b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60884/0 (socket says 172.21.15.72:60884) 2023-08-25T04:45:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.485+0000 7fefd659c700 1 -- 172.21.15.72:0/309249850 learned_addr learned my addr 172.21.15.72:0/309249850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.485+0000 7fefd6d9d700 1 -- 172.21.15.72:0/309249850 >> v2:172.21.15.137:3300/0 conn(0x7fefd80b47c0 msgr2=0x7fefd80b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.485+0000 7fefd6d9d700 1 --2- 172.21.15.72:0/309249850 >> v2:172.21.15.137:3300/0 conn(0x7fefd80b47c0 0x7fefd80b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.485+0000 7fefd6d9d700 1 -- 172.21.15.72:0/309249850 >> v1:172.21.15.137:6789/0 conn(0x7fefd815d130 legacy=0x7fefd80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.485+0000 7fefd6d9d700 1 -- 172.21.15.72:0/309249850 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80d1a60 con 0x7fefd80b86b0 2023-08-25T04:45:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.485+0000 7fefd6d9d700 1 --2- 172.21.15.72:0/309249850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b86b0 0x7fefd80b5da0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fefd806c9a0 tx=0x7fefd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e77e6a169af1927 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.486+0000 7fefd559a700 1 -- 172.21.15.72:0/309249850 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000e070 con 0x7fefd80b86b0 2023-08-25T04:45:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.486+0000 7fefd559a700 1 -- 172.21.15.72:0/309249850 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd000bb20 con 0x7fefd80b86b0 2023-08-25T04:45:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.486+0000 7fefd559a700 1 -- 172.21.15.72:0/309249850 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0012430 con 0x7fefd80b86b0 2023-08-25T04:45:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.486+0000 7fefdcfff700 1 -- 172.21.15.72:0/309249850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b86b0 msgr2=0x7fefd80b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.486+0000 7fefdcfff700 1 --2- 172.21.15.72:0/309249850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b86b0 0x7fefd80b5da0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fefd806c9a0 tx=0x7fefd000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.486+0000 7fefdcfff700 1 -- 172.21.15.72:0/309249850 shutdown_connections 2023-08-25T04:45:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.486+0000 7fefdcfff700 1 --2- 172.21.15.72:0/309249850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b86b0 0x7fefd80b5da0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.487+0000 7fefdcfff700 1 --2- 172.21.15.72:0/309249850 >> v2:172.21.15.137:3300/0 conn(0x7fefd80b47c0 0x7fefd80b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.487+0000 7fefdcfff700 1 -- 172.21.15.72:0/309249850 >> 172.21.15.72:0/309249850 conn(0x7fefd8072050 msgr2=0x7fefd80d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.487+0000 7fefdcfff700 1 -- 172.21.15.72:0/309249850 shutdown_connections 2023-08-25T04:45:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.487+0000 7fefdcfff700 1 -- 172.21.15.72:0/309249850 wait complete. 2023-08-25T04:45:16.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.488+0000 7fefdcfff700 1 Processor -- start 2023-08-25T04:45:16.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.488+0000 7fefdcfff700 1 -- start start 2023-08-25T04:45:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.489+0000 7fefdcfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b47c0 0x7fefd80cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.489+0000 7fefdcfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefd80b86b0 0x7fefd814a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.489+0000 7fefdcfff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefd815d130 0x7fefd81581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.489+0000 7fefdcfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80c8520 con 0x7fefd80b47c0 2023-08-25T04:45:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.489+0000 7fefdcfff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80cad40 con 0x7fefd815d130 2023-08-25T04:45:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.489+0000 7fefdcfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80cb020 con 0x7fefd80b86b0 2023-08-25T04:45:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b47c0 0x7fefd80cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b47c0 0x7fefd80cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60894/0 (socket says 172.21.15.72:60894) 2023-08-25T04:45:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd659c700 1 -- 172.21.15.72:0/2130223194 learned_addr learned my addr 172.21.15.72:0/2130223194 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd5d9b700 1 --2- 172.21.15.72:0/2130223194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefd80b86b0 0x7fefd814a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd6d9d700 1 --2- 172.21.15.72:0/2130223194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefd815d130 0x7fefd81581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd659c700 1 -- 172.21.15.72:0/2130223194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefd80b86b0 msgr2=0x7fefd814a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd659c700 1 --2- 172.21.15.72:0/2130223194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefd80b86b0 0x7fefd814a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd659c700 1 -- 172.21.15.72:0/2130223194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefd815d130 msgr2=0x7fefd81581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd659c700 1 --2- 172.21.15.72:0/2130223194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefd815d130 0x7fefd81581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd659c700 1 -- 172.21.15.72:0/2130223194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0009a70 con 0x7fefd80b47c0 2023-08-25T04:45:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd6d9d700 1 --2- 172.21.15.72:0/2130223194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefd815d130 0x7fefd81581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.490+0000 7fefd659c700 1 --2- 172.21.15.72:0/2130223194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b47c0 0x7fefd80cbde0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fefc800e8b0 tx=0x7fefc800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.491+0000 7fefc6ffd700 1 -- 172.21.15.72:0/2130223194 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8009600 con 0x7fefd80b47c0 2023-08-25T04:45:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.491+0000 7fefc6ffd700 1 -- 172.21.15.72:0/2130223194 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8013680 con 0x7fefd80b47c0 2023-08-25T04:45:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.491+0000 7fefdcfff700 1 -- 172.21.15.72:0/2130223194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd80cb300 con 0x7fefd80b47c0 2023-08-25T04:45:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.491+0000 7fefc6ffd700 1 -- 172.21.15.72:0/2130223194 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8013a30 con 0x7fefd80b47c0 2023-08-25T04:45:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.491+0000 7fefdcfff700 1 -- 172.21.15.72:0/2130223194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd80cb8c0 con 0x7fefd80b47c0 2023-08-25T04:45:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.491+0000 7fefc6ffd700 1 -- 172.21.15.72:0/2130223194 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fefc8005a20 con 0x7fefd80b47c0 2023-08-25T04:45:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.491+0000 7fefc6ffd700 1 -- 172.21.15.72:0/2130223194 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fefc80066b0 con 0x7fefd80b47c0 2023-08-25T04:45:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.492+0000 7fefdcfff700 1 -- 172.21.15.72:0/2130223194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd80cbc30 con 0x7fefd80b47c0 2023-08-25T04:45:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.495+0000 7fefc6ffd700 1 -- 172.21.15.72:0/2130223194 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fefc8021060 con 0x7fefd80b47c0 2023-08-25T04:45:16.521 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:16.520+0000 7f747bba3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:45:16.556 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:16.555+0000 7f7d16c78200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:45:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.567+0000 7fefdcfff700 1 -- 172.21.15.72:0/2130223194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefd804e620 con 0x7fefd80b47c0 2023-08-25T04:45:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.568+0000 7fefc6ffd700 1 -- 172.21.15.72:0/2130223194 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fefc8017070 con 0x7fefd80b47c0 2023-08-25T04:45:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:16.569 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":10,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:16.151544+0000","last_up_change":"0.000000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.569+0000 7fefdcfff700 1 -- 172.21.15.72:0/2130223194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b47c0 msgr2=0x7fefd80cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.569+0000 7fefdcfff700 1 --2- 172.21.15.72:0/2130223194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b47c0 0x7fefd80cbde0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fefc800e8b0 tx=0x7fefc800ebc0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.569+0000 7fefdcfff700 1 -- 172.21.15.72:0/2130223194 shutdown_connections 2023-08-25T04:45:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.569+0000 7fefdcfff700 1 --2- 172.21.15.72:0/2130223194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefd815d130 0x7fefd81581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.569+0000 7fefdcfff700 1 --2- 172.21.15.72:0/2130223194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd80b47c0 0x7fefd80cbde0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.569+0000 7fefdcfff700 1 --2- 172.21.15.72:0/2130223194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fefd80b86b0 0x7fefd814a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.569+0000 7fefdcfff700 1 -- 172.21.15.72:0/2130223194 >> 172.21.15.72:0/2130223194 conn(0x7fefd8072050 msgr2=0x7fefd815b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.569+0000 7fefdcfff700 1 -- 172.21.15.72:0/2130223194 shutdown_connections 2023-08-25T04:45:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:16.569+0000 7fefdcfff700 1 -- 172.21.15.72:0/2130223194 wait complete. 2023-08-25T04:45:16.588 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-25T04:45:16.589 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-25T04:45:16.742 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:16.741+0000 7f747bba3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:45:16.790 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:16.789+0000 7f7d16c78200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:45:16.841 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:16.840+0000 7f747bba3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:45:16.890 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-25T04:45:16.889+0000 7f34d3791640 -1 Falling back to public interface 2023-08-25T04:45:16.892 INFO:tasks.ceph.osd.5.smithi137.stderr:2023-08-25T04:45:16.891+0000 7f8d8cc35640 -1 Falling back to public interface 2023-08-25T04:45:16.903 INFO:tasks.ceph.osd.6.smithi137.stderr:2023-08-25T04:45:16.902+0000 7feac3b59640 -1 Falling back to public interface 2023-08-25T04:45:16.910 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-25T04:45:16.909+0000 7f5728d3c640 -1 Falling back to public interface 2023-08-25T04:45:16.915 INFO:tasks.ceph.osd.7.smithi137.stderr:2023-08-25T04:45:16.914+0000 7fac4f8a3640 -1 Falling back to public interface 2023-08-25T04:45:16.932 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-25T04:45:16.931+0000 7f517687f640 -1 Falling back to public interface 2023-08-25T04:45:16.932 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-25T04:45:16.932+0000 7f9db3f0e640 -1 Falling back to public interface 2023-08-25T04:45:16.940 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:16.940+0000 7f747bba3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:45:16.947 INFO:tasks.ceph.osd.4.smithi137.stderr:2023-08-25T04:45:16.947+0000 7fe1ebf94640 -1 Falling back to public interface 2023-08-25T04:45:17.050 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:17.049+0000 7f747bba3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:45:17.051 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:17.050+0000 7f7d16c78200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:45:17.248 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:17.247+0000 7f7d16c78200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:45:17.280 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:17.279+0000 7f747bba3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:45:17.338 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:17.337+0000 7f7d16c78200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:45:17.394 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:17.542 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:17.541+0000 7f747bba3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:45:17.569 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.568+0000 7efc25bff700 1 Processor -- start 2023-08-25T04:45:17.569 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.568+0000 7efc25bff700 1 -- start start 2023-08-25T04:45:17.570 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.569+0000 7efc25bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc20159e90 0x7efc2015a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:17.570 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.569+0000 7efc25bff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc2006a9f0 0x7efc2006ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:17.571 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.569+0000 7efc25bff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc200cde80 con 0x7efc2015a7b0 2023-08-25T04:45:17.571 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.569+0000 7efc25bff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2006ca40 con 0x7efc2006a9f0 2023-08-25T04:45:17.571 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.569+0000 7efc25bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc200ce160 con 0x7efc20159e90 2023-08-25T04:45:17.573 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.570+0000 7efc1f7fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc20159e90 0x7efc2015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:17.573 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.570+0000 7efc1f7fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc20159e90 0x7efc2015a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:38536/0 (socket says 172.21.15.72:38536) 2023-08-25T04:45:17.573 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.570+0000 7efc1f7fe700 1 -- 172.21.15.72:0/2591590881 learned_addr learned my addr 172.21.15.72:0/2591590881 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:17.573 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.570+0000 7efc1ffff700 1 --2- 172.21.15.72:0/2591590881 >> v2:172.21.15.137:3300/0 conn(0x7efc2006a9f0 0x7efc2006ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:17.574 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.570+0000 7efc1f7fe700 1 -- 172.21.15.72:0/2591590881 >> v2:172.21.15.137:3300/0 conn(0x7efc2006a9f0 msgr2=0x7efc2006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:17.574 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.570+0000 7efc1f7fe700 1 --2- 172.21.15.72:0/2591590881 >> v2:172.21.15.137:3300/0 conn(0x7efc2006a9f0 0x7efc2006ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:17.574 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.570+0000 7efc1f7fe700 1 -- 172.21.15.72:0/2591590881 >> v1:172.21.15.137:6789/0 conn(0x7efc2015a7b0 legacy=0x7efc2006a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:17.574 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.570+0000 7efc1f7fe700 1 -- 172.21.15.72:0/2591590881 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc200ce440 con 0x7efc20159e90 2023-08-25T04:45:17.574 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.571+0000 7efc1f7fe700 1 --2- 172.21.15.72:0/2591590881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc20159e90 0x7efc2015a270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efc100098f0 tx=0x7efc10009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=814ac9e924f2e884 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:17.574 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.571+0000 7efc1e7fc700 1 -- 172.21.15.72:0/2591590881 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10011830 con 0x7efc20159e90 2023-08-25T04:45:17.574 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.571+0000 7efc1e7fc700 1 -- 172.21.15.72:0/2591590881 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10011990 con 0x7efc20159e90 2023-08-25T04:45:17.575 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.571+0000 7efc1e7fc700 1 -- 172.21.15.72:0/2591590881 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10011d20 con 0x7efc20159e90 2023-08-25T04:45:17.575 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.571+0000 7efc25bff700 1 -- 172.21.15.72:0/2591590881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc20159e90 msgr2=0x7efc2015a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:17.575 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.571+0000 7efc25bff700 1 --2- 172.21.15.72:0/2591590881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc20159e90 0x7efc2015a270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efc100098f0 tx=0x7efc10009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:17.575 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.572+0000 7efc25bff700 1 -- 172.21.15.72:0/2591590881 shutdown_connections 2023-08-25T04:45:17.575 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.572+0000 7efc25bff700 1 --2- 172.21.15.72:0/2591590881 >> v2:172.21.15.137:3300/0 conn(0x7efc2006a9f0 0x7efc2006ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:17.575 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.572+0000 7efc25bff700 1 --2- 172.21.15.72:0/2591590881 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc20159e90 0x7efc2015a270 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:17.576 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.572+0000 7efc25bff700 1 -- 172.21.15.72:0/2591590881 >> 172.21.15.72:0/2591590881 conn(0x7efc200b1fa0 msgr2=0x7efc200cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:17.576 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.572+0000 7efc25bff700 1 -- 172.21.15.72:0/2591590881 shutdown_connections 2023-08-25T04:45:17.576 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.572+0000 7efc25bff700 1 -- 172.21.15.72:0/2591590881 wait complete. 2023-08-25T04:45:17.578 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.573+0000 7efc25bff700 1 Processor -- start 2023-08-25T04:45:17.578 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.573+0000 7efc25bff700 1 -- start start 2023-08-25T04:45:17.578 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.574+0000 7efc25bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc2006a9f0 0x7efc2014d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:17.578 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.574+0000 7efc25bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc20159e90 0x7efc200ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:17.578 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.574+0000 7efc25bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2015a7b0 0x7efc200c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:17.578 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.574+0000 7efc25bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc200c84e0 con 0x7efc20159e90 2023-08-25T04:45:17.579 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.574+0000 7efc25bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc200c2dd0 con 0x7efc2006a9f0 2023-08-25T04:45:17.579 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.574+0000 7efc25bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc200c30b0 con 0x7efc2015a7b0 2023-08-25T04:45:17.579 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc20159e90 0x7efc200ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:17.579 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1f7fe700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc2006a9f0 0x7efc2014d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:17.579 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc20159e90 0x7efc200ad9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60906/0 (socket says 172.21.15.72:60906) 2023-08-25T04:45:17.579 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1effd700 1 -- 172.21.15.72:0/171072404 learned_addr learned my addr 172.21.15.72:0/171072404 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:17.579 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1ffff700 1 --2- 172.21.15.72:0/171072404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2015a7b0 0x7efc200c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:17.580 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1effd700 1 -- 172.21.15.72:0/171072404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2015a7b0 msgr2=0x7efc200c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:17.580 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1effd700 1 --2- 172.21.15.72:0/171072404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2015a7b0 0x7efc200c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:17.580 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1effd700 1 -- 172.21.15.72:0/171072404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc2006a9f0 msgr2=0x7efc2014d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:17.580 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1effd700 1 --2- 172.21.15.72:0/171072404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc2006a9f0 0x7efc2014d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:17.580 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1effd700 1 -- 172.21.15.72:0/171072404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10009550 con 0x7efc20159e90 2023-08-25T04:45:17.580 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.575+0000 7efc1effd700 1 --2- 172.21.15.72:0/171072404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc20159e90 0x7efc200ad9c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efc1400c450 tx=0x7efc1400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:17.580 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.576+0000 7efc07fff700 1 -- 172.21.15.72:0/171072404 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140052d0 con 0x7efc20159e90 2023-08-25T04:45:17.581 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.576+0000 7efc07fff700 1 -- 172.21.15.72:0/171072404 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc14005430 con 0x7efc20159e90 2023-08-25T04:45:17.581 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.576+0000 7efc25bff700 1 -- 172.21.15.72:0/171072404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc200c3390 con 0x7efc20159e90 2023-08-25T04:45:17.581 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.576+0000 7efc07fff700 1 -- 172.21.15.72:0/171072404 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140038c0 con 0x7efc20159e90 2023-08-25T04:45:17.581 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.576+0000 7efc25bff700 1 -- 172.21.15.72:0/171072404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc200c6d20 con 0x7efc20159e90 2023-08-25T04:45:17.581 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.576+0000 7efc07fff700 1 -- 172.21.15.72:0/171072404 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc14003d20 con 0x7efc20159e90 2023-08-25T04:45:17.581 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.576+0000 7efc07fff700 1 -- 172.21.15.72:0/171072404 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7efc14011cc0 con 0x7efc20159e90 2023-08-25T04:45:17.581 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.577+0000 7efc25bff700 1 -- 172.21.15.72:0/171072404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc200c38b0 con 0x7efc20159e90 2023-08-25T04:45:17.582 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.579+0000 7efc07fff700 1 -- 172.21.15.72:0/171072404 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7efc200c38b0 con 0x7efc20159e90 2023-08-25T04:45:17.653 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.652+0000 7efc25bff700 1 -- 172.21.15.72:0/171072404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc2006dab0 con 0x7efc20159e90 2023-08-25T04:45:17.653 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.653+0000 7efc07fff700 1 -- 172.21.15.72:0/171072404 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7efc14017070 con 0x7efc20159e90 2023-08-25T04:45:17.654 INFO:teuthology.misc.health.smithi072.stdout: 2023-08-25T04:45:17.654 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":10,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:16.151544+0000","last_up_change":"0.000000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:17.655 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.653+0000 7efc25bff700 1 -- 172.21.15.72:0/171072404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc20159e90 msgr2=0x7efc200ad9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:17.655 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.653+0000 7efc25bff700 1 --2- 172.21.15.72:0/171072404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc20159e90 0x7efc200ad9c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efc1400c450 tx=0x7efc1400c760 comp rx=0 tx=0).stop 2023-08-25T04:45:17.655 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.654+0000 7efc25bff700 1 -- 172.21.15.72:0/171072404 shutdown_connections 2023-08-25T04:45:17.655 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.654+0000 7efc25bff700 1 --2- 172.21.15.72:0/171072404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2015a7b0 0x7efc200c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:17.655 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.654+0000 7efc25bff700 1 --2- 172.21.15.72:0/171072404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc2006a9f0 0x7efc2014d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:17.656 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.654+0000 7efc25bff700 1 --2- 172.21.15.72:0/171072404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc20159e90 0x7efc200ad9c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:17.656 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.654+0000 7efc25bff700 1 -- 172.21.15.72:0/171072404 >> 172.21.15.72:0/171072404 conn(0x7efc200b1fa0 msgr2=0x7efc200cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:17.656 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.654+0000 7efc25bff700 1 -- 172.21.15.72:0/171072404 shutdown_connections 2023-08-25T04:45:17.656 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:17.654+0000 7efc25bff700 1 -- 172.21.15.72:0/171072404 wait complete. 2023-08-25T04:45:17.669 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-25T04:45:17.738 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:17.738+0000 7f747bba3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:45:17.830 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:17.829+0000 7f747bba3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:45:17.977 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:17.976+0000 7f7d16c78200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:45:18.365 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:18.364+0000 7f7d16c78200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:45:18.456 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:18.456+0000 7f747bba3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:45:18.547 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:18.547+0000 7f7d16c78200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:45:18.845 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:18.844+0000 7f747bba3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:45:19.027 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:19.027+0000 7f747bba3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:45:19.037 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:19.036+0000 7f7d16c78200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:45:19.226 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:19.225+0000 7f7d16c78200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:45:19.427 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:19.426+0000 7f7d16c78200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:45:19.536 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:19.535+0000 7f747bba3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:45:19.763 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:19.762+0000 7f747bba3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:45:19.834 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:19.833+0000 7f7d16c78200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:45:20.015 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:20.014+0000 7f747bba3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:45:20.387 INFO:tasks.ceph.mgr.x.smithi137.stderr:2023-08-25T04:45:20.386+0000 7f747bba3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:45:20.453 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-25T04:45:20.453+0000 7f34d3791640 -1 osd.2 0 log_to_monitors true 2023-08-25T04:45:20.464 INFO:tasks.ceph.osd.7.smithi137.stderr:2023-08-25T04:45:20.463+0000 7fac4f8a3640 -1 osd.7 0 log_to_monitors true 2023-08-25T04:45:20.513 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-25T04:45:20.512+0000 7f517687f640 -1 osd.1 0 log_to_monitors true 2023-08-25T04:45:20.710 INFO:tasks.ceph.osd.5.smithi137.stderr:2023-08-25T04:45:20.710+0000 7f8d8cc35640 -1 osd.5 0 log_to_monitors true 2023-08-25T04:45:20.736 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-25T04:45:20.735+0000 7f5728d3c640 -1 osd.0 0 log_to_monitors true 2023-08-25T04:45:20.742 INFO:tasks.ceph.osd.6.smithi137.stderr:2023-08-25T04:45:20.741+0000 7feac3b59640 -1 osd.6 0 log_to_monitors true 2023-08-25T04:45:20.766 INFO:tasks.ceph.osd.4.smithi137.stderr:2023-08-25T04:45:20.765+0000 7fe1ebf94640 -1 osd.4 0 log_to_monitors true 2023-08-25T04:45:20.778 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-25T04:45:20.777+0000 7f9db3f0e640 -1 osd.3 0 log_to_monitors true 2023-08-25T04:45:20.854 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:20.853+0000 7f7cd05fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-25T04:45:20.855 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-25T04:45:20.854+0000 7f7cd05fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-25T04:45:23.743 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-25T04:45:23.742+0000 7f5165ff8700 -1 osd.1 0 waiting for initial osdmap 2023-08-25T04:45:23.768 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-25T04:45:23.765+0000 7f515cffa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:45:23.776 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-25T04:45:23.774+0000 7f34c25f7700 -1 osd.2 0 waiting for initial osdmap 2023-08-25T04:45:23.791 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-25T04:45:23.790+0000 7f9da35f8700 -1 osd.3 0 waiting for initial osdmap 2023-08-25T04:45:23.814 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-25T04:45:23.813+0000 7f34b9dfa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:45:23.818 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-25T04:45:23.817+0000 7f9d9a5fa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:45:24.047 INFO:tasks.ceph.osd.7.smithi137.stderr:2023-08-25T04:45:24.044+0000 7fac3e7f7700 -1 osd.7 0 waiting for initial osdmap 2023-08-25T04:45:24.067 INFO:tasks.ceph.osd.7.smithi137.stderr:2023-08-25T04:45:24.066+0000 7fac35ffa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:45:24.091 INFO:tasks.ceph.osd.6.smithi137.stderr:2023-08-25T04:45:24.090+0000 7feab29f7700 -1 osd.6 0 waiting for initial osdmap 2023-08-25T04:45:24.108 INFO:tasks.ceph.osd.6.smithi137.stderr:2023-08-25T04:45:24.107+0000 7feaaa1fa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:45:24.113 INFO:tasks.ceph.osd.4.smithi137.stderr:2023-08-25T04:45:24.107+0000 7fe1dadf7700 -1 osd.4 0 waiting for initial osdmap 2023-08-25T04:45:24.124 INFO:tasks.ceph.osd.4.smithi137.stderr:2023-08-25T04:45:24.123+0000 7fe1d25fa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:45:24.288 INFO:tasks.ceph.osd.5.smithi137.stderr:2023-08-25T04:45:24.287+0000 7f8d7bbf7700 -1 osd.5 0 waiting for initial osdmap 2023-08-25T04:45:24.303 INFO:tasks.ceph.osd.5.smithi137.stderr:2023-08-25T04:45:24.302+0000 7f8d733fa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:45:24.444 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-25T04:45:24.443+0000 7f5717bf7700 -1 osd.0 0 waiting for initial osdmap 2023-08-25T04:45:24.455 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-25T04:45:24.454+0000 7f570f3fa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:45:24.473 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:24.645 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.644+0000 7f9d569ff700 1 Processor -- start 2023-08-25T04:45:24.645 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.644+0000 7f9d569ff700 1 -- start start 2023-08-25T04:45:24.647 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.645+0000 7f9d569ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9d500b89a0 0x7f9d500cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:24.648 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.645+0000 7f9d569ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d500ce050 0x7f9d500d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:24.648 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.645+0000 7f9d569ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d500b8300 con 0x7f9d5015d050 2023-08-25T04:45:24.648 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.645+0000 7f9d569ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d500ce4c0 con 0x7f9d500ce050 2023-08-25T04:45:24.649 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.645+0000 7f9d569ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5015d430 con 0x7f9d500b89a0 2023-08-25T04:45:24.649 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d54f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d500ce050 0x7f9d500d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:24.649 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d54f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d500ce050 0x7f9d500d0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60168/0 (socket says 172.21.15.72:60168) 2023-08-25T04:45:24.649 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d54f9c700 1 -- 172.21.15.72:0/2485979479 learned_addr learned my addr 172.21.15.72:0/2485979479 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:24.649 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d47fff700 1 --2- 172.21.15.72:0/2485979479 >> v2:172.21.15.137:3300/0 conn(0x7f9d500b89a0 0x7f9d500cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:24.649 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d54f9c700 1 -- 172.21.15.72:0/2485979479 >> v2:172.21.15.137:3300/0 conn(0x7f9d500b89a0 msgr2=0x7f9d500cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:24.649 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d54f9c700 1 --2- 172.21.15.72:0/2485979479 >> v2:172.21.15.137:3300/0 conn(0x7f9d500b89a0 0x7f9d500cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:24.650 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d54f9c700 1 -- 172.21.15.72:0/2485979479 >> v1:172.21.15.137:6789/0 conn(0x7f9d5015d050 legacy=0x7f9d500b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:24.650 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d54f9c700 1 -- 172.21.15.72:0/2485979479 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d500b7260 con 0x7f9d500ce050 2023-08-25T04:45:24.650 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d47fff700 1 --2- 172.21.15.72:0/2485979479 >> v2:172.21.15.137:3300/0 conn(0x7f9d500b89a0 0x7f9d500cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:24.650 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/2485979479 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794486196 0 0) 0x7f9d500b8300 con 0x7f9d5015d050 2023-08-25T04:45:24.650 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.646+0000 7f9d54f9c700 1 --2- 172.21.15.72:0/2485979479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 0x7f9d500d0dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9d50160aa0 tx=0x7f9d4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5c44a29fcb9dd6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:24.650 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/2485979479 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4800e070 con 0x7f9d500ce050 2023-08-25T04:45:24.651 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/2485979479 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4800b9c0 con 0x7f9d500ce050 2023-08-25T04:45:24.651 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/2485979479 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4800bd70 con 0x7f9d500ce050 2023-08-25T04:45:24.653 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d569ff700 1 -- 172.21.15.72:0/2485979479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 msgr2=0x7f9d500d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:24.653 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d569ff700 1 --2- 172.21.15.72:0/2485979479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 0x7f9d500d0dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9d50160aa0 tx=0x7f9d4800b330 comp rx=0 tx=0).stop 2023-08-25T04:45:24.653 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d569ff700 1 -- 172.21.15.72:0/2485979479 shutdown_connections 2023-08-25T04:45:24.653 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d569ff700 1 --2- 172.21.15.72:0/2485979479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 0x7f9d500d0dd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:24.653 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d569ff700 1 --2- 172.21.15.72:0/2485979479 >> v2:172.21.15.137:3300/0 conn(0x7f9d500b89a0 0x7f9d500cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:24.653 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d569ff700 1 -- 172.21.15.72:0/2485979479 >> 172.21.15.72:0/2485979479 conn(0x7f9d50071e00 msgr2=0x7f9d50072210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:24.654 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d569ff700 1 -- 172.21.15.72:0/2485979479 shutdown_connections 2023-08-25T04:45:24.654 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.647+0000 7f9d569ff700 1 -- 172.21.15.72:0/2485979479 wait complete. 2023-08-25T04:45:24.654 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.649+0000 7f9d569ff700 1 Processor -- start 2023-08-25T04:45:24.654 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.649+0000 7f9d569ff700 1 -- start start 2023-08-25T04:45:24.654 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.650+0000 7f9d569ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d500b89a0 0x7f9d5014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:24.654 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.650+0000 7f9d569ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 0x7f9d5015d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:24.654 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.650+0000 7f9d569ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d5015d050 0x7f9d500cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:24.655 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.650+0000 7f9d569ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5015eb10 con 0x7f9d500ce050 2023-08-25T04:45:24.655 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.650+0000 7f9d569ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5015df00 con 0x7f9d500b89a0 2023-08-25T04:45:24.655 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.650+0000 7f9d569ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5015e1e0 con 0x7f9d5015d050 2023-08-25T04:45:24.655 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.650+0000 7f9d47fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 0x7f9d5015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:24.656 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.650+0000 7f9d47fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 0x7f9d5015d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60178/0 (socket says 172.21.15.72:60178) 2023-08-25T04:45:24.656 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.650+0000 7f9d47fff700 1 -- 172.21.15.72:0/4103408726 learned_addr learned my addr 172.21.15.72:0/4103408726 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:24.656 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d54f9c700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d5015d050 0x7f9d500cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:24.656 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d4ffff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d500b89a0 0x7f9d5014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:24.657 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d47fff700 1 -- 172.21.15.72:0/4103408726 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d5015d050 msgr2=0x7f9d500cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:24.657 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d47fff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d5015d050 0x7f9d500cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:24.657 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d47fff700 1 -- 172.21.15.72:0/4103408726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d500b89a0 msgr2=0x7f9d5014e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:24.657 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d47fff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d500b89a0 0x7f9d5014e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:24.658 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d47fff700 1 -- 172.21.15.72:0/4103408726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48009b30 con 0x7f9d500ce050 2023-08-25T04:45:24.658 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d4ffff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d500b89a0 0x7f9d5014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:24.658 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d47fff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 0x7f9d5015d600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800e810 tx=0x7f9d3800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:24.658 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d4d7fa700 1 -- 172.21.15.72:0/4103408726 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38013610 con 0x7f9d500ce050 2023-08-25T04:45:24.659 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d4d7fa700 1 -- 172.21.15.72:0/4103408726 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d38013770 con 0x7f9d500ce050 2023-08-25T04:45:24.659 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d569ff700 1 -- 172.21.15.72:0/4103408726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5015e4c0 con 0x7f9d500ce050 2023-08-25T04:45:24.659 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d4d7fa700 1 -- 172.21.15.72:0/4103408726 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38013b20 con 0x7f9d500ce050 2023-08-25T04:45:24.659 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.651+0000 7f9d569ff700 1 -- 172.21.15.72:0/4103408726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5015efa0 con 0x7f9d500ce050 2023-08-25T04:45:24.660 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.653+0000 7f9d569ff700 1 -- 172.21.15.72:0/4103408726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5004e620 con 0x7f9d500ce050 2023-08-25T04:45:24.660 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.653+0000 7f9d4d7fa700 1 -- 172.21.15.72:0/4103408726 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f9d38013c80 con 0x7f9d500ce050 2023-08-25T04:45:24.660 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.654+0000 7f9d4d7fa700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9d3006a050 0x7f9d3006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:24.660 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.654+0000 7f9d4d7fa700 1 -- 172.21.15.72:0/4103408726 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f9d38087330 con 0x7f9d500ce050 2023-08-25T04:45:24.661 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.655+0000 7f9d4ffff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9d3006a050 0x7f9d3006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:24.661 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.655+0000 7f9d4ffff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9d3006a050 0x7f9d3006c510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d40000f60 tx=0x7f9d40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:24.661 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.659+0000 7f9d4d7fa700 1 -- 172.21.15.72:0/4103408726 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9d38053950 con 0x7f9d500ce050 2023-08-25T04:45:24.869 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.869+0000 7f9d569ff700 1 -- 172.21.15.72:0/4103408726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d5015ec50 con 0x7f9d500ce050 2023-08-25T04:45:24.870 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.869+0000 7f9d4d7fa700 1 -- 172.21.15.72:0/4103408726 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10908 (secure 0 0 0) 0x7f9d38056f70 con 0x7f9d500ce050 2023-08-25T04:45:24.870 INFO:teuthology.misc.health.smithi072.stdout: 2023-08-25T04:45:24.871 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":13,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:24.747887+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:24.873 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 -- 172.21.15.72:0/4103408726 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9d3006a050 msgr2=0x7f9d3006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:24.873 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9d3006a050 0x7f9d3006c510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d40000f60 tx=0x7f9d40009040 comp rx=0 tx=0).stop 2023-08-25T04:45:24.873 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 -- 172.21.15.72:0/4103408726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 msgr2=0x7f9d5015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:24.874 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 0x7f9d5015d600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800e810 tx=0x7f9d3800ebd0 comp rx=0 tx=0).stop 2023-08-25T04:45:24.874 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 -- 172.21.15.72:0/4103408726 shutdown_connections 2023-08-25T04:45:24.874 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9d3006a050 0x7f9d3006c510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:24.874 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9d5015d050 0x7f9d500cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:24.874 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d500b89a0 0x7f9d5014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:24.874 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 --2- 172.21.15.72:0/4103408726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d500ce050 0x7f9d5015d600 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:24.874 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 -- 172.21.15.72:0/4103408726 >> 172.21.15.72:0/4103408726 conn(0x7f9d50071e00 msgr2=0x7f9d500d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:24.875 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 -- 172.21.15.72:0/4103408726 shutdown_connections 2023-08-25T04:45:24.875 INFO:teuthology.misc.health.smithi072.stderr:2023-08-25T04:45:24.872+0000 7f9d569ff700 1 -- 172.21.15.72:0/4103408726 wait complete. 2023-08-25T04:45:24.888 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-25T04:45:24.889 INFO:tasks.ceph:Creating RBD pool 2023-08-25T04:45:24.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-25T04:45:25.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.080+0000 7fee55dff700 1 Processor -- start 2023-08-25T04:45:25.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.080+0000 7fee55dff700 1 -- start start 2023-08-25T04:45:25.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.081+0000 7fee55dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee5015d090 0x7fee500d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.081+0000 7fee55dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee500b8aa0 0x7fee500cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.081+0000 7fee55dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee500ce4d0 con 0x7fee500ce090 2023-08-25T04:45:25.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.081+0000 7fee55dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5015d470 con 0x7fee5015d090 2023-08-25T04:45:25.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.081+0000 7fee55dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee500b6ec0 con 0x7fee500b8aa0 2023-08-25T04:45:25.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.081+0000 7fee4f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee5015d090 0x7fee500d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.081+0000 7fee4f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee5015d090 0x7fee500d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60180/0 (socket says 172.21.15.72:60180) 2023-08-25T04:45:25.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.081+0000 7fee4f7fe700 1 -- 172.21.15.72:0/1752756714 learned_addr learned my addr 172.21.15.72:0/1752756714 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:25.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.082+0000 7fee4effd700 1 --2- 172.21.15.72:0/1752756714 >> v2:172.21.15.137:3300/0 conn(0x7fee500b8aa0 0x7fee500cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.082+0000 7fee4f7fe700 1 -- 172.21.15.72:0/1752756714 >> v2:172.21.15.137:3300/0 conn(0x7fee500b8aa0 msgr2=0x7fee500cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:25.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.082+0000 7fee4f7fe700 1 --2- 172.21.15.72:0/1752756714 >> v2:172.21.15.137:3300/0 conn(0x7fee500b8aa0 0x7fee500cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.082+0000 7fee4f7fe700 1 -- 172.21.15.72:0/1752756714 >> v1:172.21.15.137:6789/0 conn(0x7fee500ce090 legacy=0x7fee500b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.082+0000 7fee4f7fe700 1 -- 172.21.15.72:0/1752756714 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500d17e0 con 0x7fee5015d090 2023-08-25T04:45:25.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.082+0000 7fee4f7fe700 1 --2- 172.21.15.72:0/1752756714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 0x7fee500d0e70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee500b5970 tx=0x7fee40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9223d29695ce80 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:25.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.082+0000 7fee4e7fc700 1 -- 172.21.15.72:0/1752756714 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4000b870 con 0x7fee5015d090 2023-08-25T04:45:25.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.082+0000 7fee4e7fc700 1 -- 172.21.15.72:0/1752756714 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4000b9d0 con 0x7fee5015d090 2023-08-25T04:45:25.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.082+0000 7fee4e7fc700 1 -- 172.21.15.72:0/1752756714 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4000bd60 con 0x7fee5015d090 2023-08-25T04:45:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.083+0000 7fee55dff700 1 -- 172.21.15.72:0/1752756714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 msgr2=0x7fee500d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.083+0000 7fee55dff700 1 --2- 172.21.15.72:0/1752756714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 0x7fee500d0e70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee500b5970 tx=0x7fee40009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.083+0000 7fee55dff700 1 -- 172.21.15.72:0/1752756714 shutdown_connections 2023-08-25T04:45:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.083+0000 7fee55dff700 1 --2- 172.21.15.72:0/1752756714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 0x7fee500d0e70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.083+0000 7fee55dff700 1 --2- 172.21.15.72:0/1752756714 >> v2:172.21.15.137:3300/0 conn(0x7fee500b8aa0 0x7fee500cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.083+0000 7fee55dff700 1 -- 172.21.15.72:0/1752756714 >> 172.21.15.72:0/1752756714 conn(0x7fee50071e10 msgr2=0x7fee50072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:25.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.083+0000 7fee55dff700 1 -- 172.21.15.72:0/1752756714 shutdown_connections 2023-08-25T04:45:25.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.083+0000 7fee55dff700 1 -- 172.21.15.72:0/1752756714 wait complete. 2023-08-25T04:45:25.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.085+0000 7fee55dff700 1 Processor -- start 2023-08-25T04:45:25.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.086+0000 7fee55dff700 1 -- start start 2023-08-25T04:45:25.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee55dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee500b8aa0 0x7fee500cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee55dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee500ce090 0x7fee50153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee55dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 0x7fee50153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee55dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50153a80 con 0x7fee5015d090 2023-08-25T04:45:25.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee55dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5015e840 con 0x7fee500ce090 2023-08-25T04:45:25.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee55dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5015e420 con 0x7fee500b8aa0 2023-08-25T04:45:25.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee4ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 0x7fee50153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee4ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 0x7fee50153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60192/0 (socket says 172.21.15.72:60192) 2023-08-25T04:45:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee4ffff700 1 -- 172.21.15.72:0/215321890 learned_addr learned my addr 172.21.15.72:0/215321890 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee4f7fe700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee500b8aa0 0x7fee500cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee4effd700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee500ce090 0x7fee50153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee4ffff700 1 -- 172.21.15.72:0/215321890 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee500b8aa0 msgr2=0x7fee500cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee4ffff700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee500b8aa0 0x7fee500cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee4ffff700 1 -- 172.21.15.72:0/215321890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee500ce090 msgr2=0x7fee50153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee4ffff700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee500ce090 0x7fee50153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.087+0000 7fee4ffff700 1 -- 172.21.15.72:0/215321890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee40009550 con 0x7fee5015d090 2023-08-25T04:45:25.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.088+0000 7fee4ffff700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 0x7fee50153540 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fee4800cc50 tx=0x7fee4800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:25.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.088+0000 7fee37fff700 1 -- 172.21.15.72:0/215321890 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48003c00 con 0x7fee5015d090 2023-08-25T04:45:25.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.088+0000 7fee37fff700 1 -- 172.21.15.72:0/215321890 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee48003d60 con 0x7fee5015d090 2023-08-25T04:45:25.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.088+0000 7fee55dff700 1 -- 172.21.15.72:0/215321890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5015ea50 con 0x7fee5015d090 2023-08-25T04:45:25.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.088+0000 7fee37fff700 1 -- 172.21.15.72:0/215321890 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800aab0 con 0x7fee5015d090 2023-08-25T04:45:25.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.088+0000 7fee55dff700 1 -- 172.21.15.72:0/215321890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5015f010 con 0x7fee5015d090 2023-08-25T04:45:25.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.089+0000 7fee55dff700 1 -- 172.21.15.72:0/215321890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5006a2f0 con 0x7fee5015d090 2023-08-25T04:45:25.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.090+0000 7fee37fff700 1 -- 172.21.15.72:0/215321890 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fee4800ac10 con 0x7fee5015d090 2023-08-25T04:45:25.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.091+0000 7fee37fff700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee3c06a050 0x7fee3c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.091+0000 7fee37fff700 1 -- 172.21.15.72:0/215321890 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fee48087e40 con 0x7fee5015d090 2023-08-25T04:45:25.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.091+0000 7fee4f7fe700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee3c06a050 0x7fee3c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.091+0000 7fee4f7fe700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee3c06a050 0x7fee3c06c510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee40000c00 tx=0x7fee40008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:25.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.095+0000 7fee37fff700 1 -- 172.21.15.72:0/215321890 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fee48053ba0 con 0x7fee5015d090 2023-08-25T04:45:25.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.292+0000 7fee55dff700 1 -- 172.21.15.72:0/215321890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fee5008a000 con 0x7fee5015d090 2023-08-25T04:45:25.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.756+0000 7fee37fff700 1 -- 172.21.15.72:0/215321890 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7fee480571c0 con 0x7fee5015d090 2023-08-25T04:45:25.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.758+0000 7fee55dff700 1 -- 172.21.15.72:0/215321890 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee3c06a050 msgr2=0x7fee3c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.758+0000 7fee55dff700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee3c06a050 0x7fee3c06c510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee40000c00 tx=0x7fee40008030 comp rx=0 tx=0).stop 2023-08-25T04:45:25.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.758+0000 7fee55dff700 1 -- 172.21.15.72:0/215321890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 msgr2=0x7fee50153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.758+0000 7fee55dff700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 0x7fee50153540 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fee4800cc50 tx=0x7fee4800cf60 comp rx=0 tx=0).stop 2023-08-25T04:45:25.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.759+0000 7fee55dff700 1 -- 172.21.15.72:0/215321890 shutdown_connections 2023-08-25T04:45:25.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.759+0000 7fee55dff700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee3c06a050 0x7fee3c06c510 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.759+0000 7fee55dff700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee5015d090 0x7fee50153540 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.759+0000 7fee55dff700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee500b8aa0 0x7fee500cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.759+0000 7fee55dff700 1 --2- 172.21.15.72:0/215321890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee500ce090 0x7fee50153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.759+0000 7fee55dff700 1 -- 172.21.15.72:0/215321890 >> 172.21.15.72:0/215321890 conn(0x7fee50071e10 msgr2=0x7fee500d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:25.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.759+0000 7fee55dff700 1 -- 172.21.15.72:0/215321890 shutdown_connections 2023-08-25T04:45:25.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.759+0000 7fee55dff700 1 -- 172.21.15.72:0/215321890 wait complete. 2023-08-25T04:45:25.761 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'rbd' created 2023-08-25T04:45:25.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-25T04:45:25.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.974+0000 7fe6df1ff700 1 Processor -- start 2023-08-25T04:45:25.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.974+0000 7fe6df1ff700 1 -- start start 2023-08-25T04:45:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.975+0000 7fe6df1ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe6d80cc500 0x7fe6d80ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.975+0000 7fe6df1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80cb7c0 con 0x7fe6d80cc980 2023-08-25T04:45:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.975+0000 7fe6df1ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80cba60 con 0x7fe6d80b27c0 2023-08-25T04:45:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.975+0000 7fe6df1ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d80cc0e0 con 0x7fe6d80cc500 2023-08-25T04:45:25.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.975+0000 7fe6dd79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe6d80cc980 0x7fe6d8160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51712/0 (socket says 172.21.15.72:51712) 2023-08-25T04:45:25.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.975+0000 7fe6dd79c700 1 -- 172.21.15.72:0/327406551 learned_addr learned my addr 172.21.15.72:0/327406551 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:25.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.975+0000 7fe6d7fff700 1 --2- 172.21.15.72:0/327406551 >> v2:172.21.15.137:3300/0 conn(0x7fe6d80cc500 0x7fe6d80ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.976+0000 7fe6d77fe700 1 -- 172.21.15.72:0/327406551 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164034133 0 0) 0x7fe6d80cb7c0 con 0x7fe6d80cc980 2023-08-25T04:45:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.976+0000 7fe6d77fe700 1 -- 172.21.15.72:0/327406551 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c80035b0 con 0x7fe6d80cc980 2023-08-25T04:45:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.976+0000 7fe6d7fff700 1 -- 172.21.15.72:0/327406551 >> v1:172.21.15.137:6789/0 conn(0x7fe6d80b27c0 legacy=0x7fe6d80b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.976+0000 7fe6d7fff700 1 -- 172.21.15.72:0/327406551 >> v1:172.21.15.72:6789/0 conn(0x7fe6d80cc980 legacy=0x7fe6d8160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.976+0000 7fe6d7fff700 1 -- 172.21.15.72:0/327406551 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d81619a0 con 0x7fe6d80cc500 2023-08-25T04:45:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.976+0000 7fe6d7fff700 1 --2- 172.21.15.72:0/327406551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d80cc500 0x7fe6d80ce880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009840 tx=0x7fe6c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16de632ce9090b1e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.976+0000 7fe6d77fe700 1 -- 172.21.15.72:0/327406551 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4011830 con 0x7fe6d80cc500 2023-08-25T04:45:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.976+0000 7fe6d77fe700 1 -- 172.21.15.72:0/327406551 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c4011990 con 0x7fe6d80cc500 2023-08-25T04:45:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.976+0000 7fe6d77fe700 1 -- 172.21.15.72:0/327406551 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4011d20 con 0x7fe6d80cc500 2023-08-25T04:45:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.977+0000 7fe6df1ff700 1 -- 172.21.15.72:0/327406551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d80cc500 msgr2=0x7fe6d80ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.977+0000 7fe6df1ff700 1 --2- 172.21.15.72:0/327406551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d80cc500 0x7fe6d80ce880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009840 tx=0x7fe6c4009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.977+0000 7fe6df1ff700 1 -- 172.21.15.72:0/327406551 shutdown_connections 2023-08-25T04:45:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.977+0000 7fe6df1ff700 1 --2- 172.21.15.72:0/327406551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d80cc500 0x7fe6d80ce880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.977+0000 7fe6df1ff700 1 -- 172.21.15.72:0/327406551 >> 172.21.15.72:0/327406551 conn(0x7fe6d80cd7c0 msgr2=0x7fe6d80cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.977+0000 7fe6df1ff700 1 -- 172.21.15.72:0/327406551 shutdown_connections 2023-08-25T04:45:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.977+0000 7fe6df1ff700 1 -- 172.21.15.72:0/327406551 wait complete. 2023-08-25T04:45:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.979+0000 7fe6df1ff700 1 Processor -- start 2023-08-25T04:45:25.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.979+0000 7fe6df1ff700 1 -- start start 2023-08-25T04:45:25.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6df1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d80b27c0 0x7fe6d8160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6df1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d80cc500 0x7fe6d80c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6df1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d80cc980 0x7fe6d815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6df1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d815b0d0 con 0x7fe6d80cc980 2023-08-25T04:45:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6df1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80c5230 con 0x7fe6d80b27c0 2023-08-25T04:45:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6df1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80c43d0 con 0x7fe6d80cc500 2023-08-25T04:45:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6dd79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d80cc980 0x7fe6d815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6dd79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d80cc980 0x7fe6d815a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60200/0 (socket says 172.21.15.72:60200) 2023-08-25T04:45:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6dd79c700 1 -- 172.21.15.72:0/4130658275 learned_addr learned my addr 172.21.15.72:0/4130658275 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6dcf9b700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d80b27c0 0x7fe6d8160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.980+0000 7fe6d7fff700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d80cc500 0x7fe6d80c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6dd79c700 1 -- 172.21.15.72:0/4130658275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d80cc500 msgr2=0x7fe6d80c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6dd79c700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d80cc500 0x7fe6d80c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6dd79c700 1 -- 172.21.15.72:0/4130658275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d80b27c0 msgr2=0x7fe6d8160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6dd79c700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d80b27c0 0x7fe6d8160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6dd79c700 1 -- 172.21.15.72:0/4130658275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c40094a0 con 0x7fe6d80cc980 2023-08-25T04:45:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6dd79c700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d80cc980 0x7fe6d815a190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000cbb0 tx=0x7fe6d000cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6d57fa700 1 -- 172.21.15.72:0/4130658275 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000a9e0 con 0x7fe6d80cc980 2023-08-25T04:45:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6d57fa700 1 -- 172.21.15.72:0/4130658275 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d000ab40 con 0x7fe6d80cc980 2023-08-25T04:45:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6d57fa700 1 -- 172.21.15.72:0/4130658275 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0012400 con 0x7fe6d80cc980 2023-08-25T04:45:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6df1ff700 1 -- 172.21.15.72:0/4130658275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d80c4620 con 0x7fe6d80cc980 2023-08-25T04:45:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.981+0000 7fe6df1ff700 1 -- 172.21.15.72:0/4130658275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d80c4be0 con 0x7fe6d80cc980 2023-08-25T04:45:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.982+0000 7fe6df1ff700 1 -- 172.21.15.72:0/4130658275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d80c53e0 con 0x7fe6d80cc980 2023-08-25T04:45:25.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.983+0000 7fe6d57fa700 1 -- 172.21.15.72:0/4130658275 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fe6d001b3b0 con 0x7fe6d80cc980 2023-08-25T04:45:25.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.985+0000 7fe6d57fa700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe6bc06a050 0x7fe6bc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:25.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.985+0000 7fe6d57fa700 1 -- 172.21.15.72:0/4130658275 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4813+0+0 (secure 0 0 0) 0x7fe6d0087de0 con 0x7fe6d80cc980 2023-08-25T04:45:25.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.985+0000 7fe6dcf9b700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe6bc06a050 0x7fe6bc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:25.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.985+0000 7fe6dcf9b700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe6bc06a050 0x7fe6bc06c510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc007fd0 tx=0x7fe6cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:25.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:25.988+0000 7fe6d57fa700 1 -- 172.21.15.72:0/4130658275 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe6d0053b90 con 0x7fe6d80cc980 2023-08-25T04:45:26.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.189+0000 7fe6df1ff700 1 -- 172.21.15.72:0/4130658275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe6d80c53e0 con 0x7fe6d80cc980 2023-08-25T04:45:26.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.760+0000 7fe6d57fa700 1 -- 172.21.15.72:0/4130658275 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe6d80c53e0 con 0x7fe6d80cc980 2023-08-25T04:45:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 -- 172.21.15.72:0/4130658275 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe6bc06a050 msgr2=0x7fe6bc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe6bc06a050 0x7fe6bc06c510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc007fd0 tx=0x7fe6cc009040 comp rx=0 tx=0).stop 2023-08-25T04:45:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 -- 172.21.15.72:0/4130658275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d80cc980 msgr2=0x7fe6d815a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d80cc980 0x7fe6d815a190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000cbb0 tx=0x7fe6d000cec0 comp rx=0 tx=0).stop 2023-08-25T04:45:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 -- 172.21.15.72:0/4130658275 shutdown_connections 2023-08-25T04:45:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe6bc06a050 0x7fe6bc06c510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d80cc980 0x7fe6d815a190 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6d80b27c0 0x7fe6d8160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 --2- 172.21.15.72:0/4130658275 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe6d80cc500 0x7fe6d80c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 -- 172.21.15.72:0/4130658275 >> 172.21.15.72:0/4130658275 conn(0x7fe6d80cd7c0 msgr2=0x7fe6d806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 -- 172.21.15.72:0/4130658275 shutdown_connections 2023-08-25T04:45:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:26.764+0000 7fe6df1ff700 1 -- 172.21.15.72:0/4130658275 wait complete. 2023-08-25T04:45:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-25T04:45:26.967 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-25T04:45:26.967 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:45:26.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:45:26.972 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:45:26.972 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:45:26.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:45:26.976 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:45:26.977 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:45:26.977 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:45:26.982 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:45:26.982 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:45:26.982 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:45:26.986 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:45:26.986 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-25T04:45:26.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:27.123 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-25T04:45:27.124 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-25T04:45:27.140 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2023-08-25T04:45:27.140 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2023-08-25T04:45:27.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.194+0000 7fb93ffff700 1 Processor -- start 2023-08-25T04:45:27.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.194+0000 7fb93ffff700 1 -- start start 2023-08-25T04:45:27.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.195+0000 7fb93ffff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb9380b47c0 0x7fb9380b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.195+0000 7fb93ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb93815d130 0x7fb9380d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.195+0000 7fb93ffff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9380b50e0 con 0x7fb9380b86b0 2023-08-25T04:45:27.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.195+0000 7fb93ffff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9380b6db0 con 0x7fb93815d130 2023-08-25T04:45:27.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.196+0000 7fb93ffff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9380d1780 con 0x7fb9380b47c0 2023-08-25T04:45:27.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.196+0000 7fb93d59a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb93815d130 0x7fb9380d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.196+0000 7fb93d59a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb93815d130 0x7fb9380d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60236/0 (socket says 172.21.15.72:60236) 2023-08-25T04:45:27.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.196+0000 7fb93d59a700 1 -- 172.21.15.72:0/861477081 learned_addr learned my addr 172.21.15.72:0/861477081 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:27.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.196+0000 7fb93dd9b700 1 --2- 172.21.15.72:0/861477081 >> v2:172.21.15.137:3300/0 conn(0x7fb9380b47c0 0x7fb9380b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.196+0000 7fb93d59a700 1 -- 172.21.15.72:0/861477081 >> v2:172.21.15.137:3300/0 conn(0x7fb9380b47c0 msgr2=0x7fb9380b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:27.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.196+0000 7fb93d59a700 1 --2- 172.21.15.72:0/861477081 >> v2:172.21.15.137:3300/0 conn(0x7fb9380b47c0 0x7fb9380b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.196+0000 7fb93d59a700 1 -- 172.21.15.72:0/861477081 >> v1:172.21.15.137:6789/0 conn(0x7fb9380b86b0 legacy=0x7fb93806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.196+0000 7fb93d59a700 1 -- 172.21.15.72:0/861477081 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380d1a60 con 0x7fb93815d130 2023-08-25T04:45:27.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.196+0000 7fb93d59a700 1 --2- 172.21.15.72:0/861477081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb93815d130 0x7fb9380d0e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb93806c9a0 tx=0x7fb928009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5629680819f7d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:27.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93cd99700 1 -- 172.21.15.72:0/861477081 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928011830 con 0x7fb93815d130 2023-08-25T04:45:27.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93cd99700 1 -- 172.21.15.72:0/861477081 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb928011990 con 0x7fb93815d130 2023-08-25T04:45:27.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93cd99700 1 -- 172.21.15.72:0/861477081 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928011d20 con 0x7fb93815d130 2023-08-25T04:45:27.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93ffff700 1 -- 172.21.15.72:0/861477081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb93815d130 msgr2=0x7fb9380d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93ffff700 1 --2- 172.21.15.72:0/861477081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb93815d130 0x7fb9380d0e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb93806c9a0 tx=0x7fb928009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93ffff700 1 -- 172.21.15.72:0/861477081 shutdown_connections 2023-08-25T04:45:27.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93ffff700 1 --2- 172.21.15.72:0/861477081 >> v2:172.21.15.137:3300/0 conn(0x7fb9380b47c0 0x7fb9380b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93ffff700 1 --2- 172.21.15.72:0/861477081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb93815d130 0x7fb9380d0e80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93ffff700 1 -- 172.21.15.72:0/861477081 >> 172.21.15.72:0/861477081 conn(0x7fb938072050 msgr2=0x7fb9380d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:27.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93ffff700 1 -- 172.21.15.72:0/861477081 shutdown_connections 2023-08-25T04:45:27.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.197+0000 7fb93ffff700 1 -- 172.21.15.72:0/861477081 wait complete. 2023-08-25T04:45:27.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.199+0000 7fb93ffff700 1 Processor -- start 2023-08-25T04:45:27.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.199+0000 7fb93ffff700 1 -- start start 2023-08-25T04:45:27.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.200+0000 7fb93ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9380b47c0 0x7fb9381556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.200+0000 7fb93ffff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9380b86b0 0x7fb9380cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.200+0000 7fb93ffff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb93815d130 0x7fb93815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.200+0000 7fb93ffff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9381599f0 con 0x7fb9380b47c0 2023-08-25T04:45:27.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.200+0000 7fb93ffff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9381f3130 con 0x7fb9380b86b0 2023-08-25T04:45:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.200+0000 7fb93ffff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9381f2e50 con 0x7fb93815d130 2023-08-25T04:45:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.200+0000 7fb93dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9380b47c0 0x7fb9381556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.200+0000 7fb93dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9380b47c0 0x7fb9381556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60242/0 (socket says 172.21.15.72:60242) 2023-08-25T04:45:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.200+0000 7fb93dd9b700 1 -- 172.21.15.72:0/493533044 learned_addr learned my addr 172.21.15.72:0/493533044 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93d59a700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9380b86b0 0x7fb9380cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93e59c700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb93815d130 0x7fb93815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93dd9b700 1 -- 172.21.15.72:0/493533044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb93815d130 msgr2=0x7fb93815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93dd9b700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb93815d130 0x7fb93815d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93dd9b700 1 -- 172.21.15.72:0/493533044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9380b86b0 msgr2=0x7fb9380cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93dd9b700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9380b86b0 0x7fb9380cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93dd9b700 1 -- 172.21.15.72:0/493533044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb928009550 con 0x7fb9380b47c0 2023-08-25T04:45:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93e59c700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb93815d130 0x7fb93815d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93d59a700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9380b86b0 0x7fb9380cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93dd9b700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9380b47c0 0x7fb9381556a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb93400e870 tx=0x7fb93400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:27.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb92e7fc700 1 -- 172.21.15.72:0/493533044 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934009590 con 0x7fb9380b47c0 2023-08-25T04:45:27.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb92e7fc700 1 -- 172.21.15.72:0/493533044 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93400ee70 con 0x7fb9380b47c0 2023-08-25T04:45:27.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93ffff700 1 -- 172.21.15.72:0/493533044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb938159330 con 0x7fb9380b47c0 2023-08-25T04:45:27.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb92e7fc700 1 -- 172.21.15.72:0/493533044 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400ca50 con 0x7fb9380b47c0 2023-08-25T04:45:27.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.201+0000 7fb93ffff700 1 -- 172.21.15.72:0/493533044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9380cc780 con 0x7fb9380b47c0 2023-08-25T04:45:27.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.202+0000 7fb93ffff700 1 -- 172.21.15.72:0/493533044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93804e620 con 0x7fb9380b47c0 2023-08-25T04:45:27.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.203+0000 7fb92e7fc700 1 -- 172.21.15.72:0/493533044 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fb93400cbb0 con 0x7fb9380b47c0 2023-08-25T04:45:27.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.204+0000 7fb92e7fc700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb91c06a050 0x7fb91c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.204+0000 7fb92e7fc700 1 -- 172.21.15.72:0/493533044 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fb934088120 con 0x7fb9380b47c0 2023-08-25T04:45:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.204+0000 7fb93d59a700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb91c06a050 0x7fb91c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.205+0000 7fb93d59a700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb91c06a050 0x7fb91c06c510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb928009c10 tx=0x7fb928008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.209+0000 7fb92e7fc700 1 -- 172.21.15.72:0/493533044 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb934053c40 con 0x7fb9380b47c0 2023-08-25T04:45:27.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.407+0000 7fb93ffff700 1 -- 172.21.15.72:0/493533044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9380b5ed0 con 0x7fb9380b47c0 2023-08-25T04:45:27.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.408+0000 7fb92e7fc700 1 -- 172.21.15.72:0/493533044 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+14597 (secure 0 0 0) 0x7fb93400ce60 con 0x7fb9380b47c0 2023-08-25T04:45:27.409 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:27.409 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:26.752521+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:27.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.410+0000 7fb93ffff700 1 -- 172.21.15.72:0/493533044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb91c06a050 msgr2=0x7fb91c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.410+0000 7fb93ffff700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb91c06a050 0x7fb91c06c510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb928009c10 tx=0x7fb928008030 comp rx=0 tx=0).stop 2023-08-25T04:45:27.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.410+0000 7fb93ffff700 1 -- 172.21.15.72:0/493533044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9380b47c0 msgr2=0x7fb9381556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.410+0000 7fb93ffff700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9380b47c0 0x7fb9381556a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb93400e870 tx=0x7fb93400ec30 comp rx=0 tx=0).stop 2023-08-25T04:45:27.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.410+0000 7fb93ffff700 1 -- 172.21.15.72:0/493533044 shutdown_connections 2023-08-25T04:45:27.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.410+0000 7fb93ffff700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb91c06a050 0x7fb91c06c510 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.410+0000 7fb93ffff700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb93815d130 0x7fb93815d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.410+0000 7fb93ffff700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9380b47c0 0x7fb9381556a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.410+0000 7fb93ffff700 1 --2- 172.21.15.72:0/493533044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9380b86b0 0x7fb9380cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.410+0000 7fb93ffff700 1 -- 172.21.15.72:0/493533044 >> 172.21.15.72:0/493533044 conn(0x7fb938072050 msgr2=0x7fb9380cd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:27.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.411+0000 7fb93ffff700 1 -- 172.21.15.72:0/493533044 shutdown_connections 2023-08-25T04:45:27.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.411+0000 7fb93ffff700 1 -- 172.21.15.72:0/493533044 wait complete. 2023-08-25T04:45:27.429 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:45:27.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:45:27.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.627+0000 7f2b2f3ff700 1 Processor -- start 2023-08-25T04:45:27.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.627+0000 7f2b2f3ff700 1 -- start start 2023-08-25T04:45:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.628+0000 7f2b2f3ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2b2815d090 0x7f2b280d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.628+0000 7f2b2f3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b280b8aa0 0x7f2b280cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.628+0000 7f2b2f3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b280ce090 0x7f2b280b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.628+0000 7f2b2f3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b280ce4d0 con 0x7f2b280b8aa0 2023-08-25T04:45:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.628+0000 7f2b2f3ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2815d470 con 0x7f2b2815d090 2023-08-25T04:45:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.628+0000 7f2b2f3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280d17e0 con 0x7f2b280ce090 2023-08-25T04:45:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2c99a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b280b8aa0 0x7f2b280cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2c99a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b280b8aa0 0x7f2b280cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60254/0 (socket says 172.21.15.72:60254) 2023-08-25T04:45:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2c99a700 1 -- 172.21.15.72:0/2223640519 learned_addr learned my addr 172.21.15.72:0/2223640519 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2d19b700 1 --2- 172.21.15.72:0/2223640519 >> v2:172.21.15.137:3300/0 conn(0x7f2b2815d090 0x7f2b280d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2d99c700 1 --2- 172.21.15.72:0/2223640519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b280ce090 0x7f2b280b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2c99a700 1 -- 172.21.15.72:0/2223640519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b280ce090 msgr2=0x7f2b280b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2c99a700 1 --2- 172.21.15.72:0/2223640519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b280ce090 0x7f2b280b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2c99a700 1 -- 172.21.15.72:0/2223640519 >> v2:172.21.15.137:3300/0 conn(0x7f2b2815d090 msgr2=0x7f2b280d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2c99a700 1 --2- 172.21.15.72:0/2223640519 >> v2:172.21.15.137:3300/0 conn(0x7f2b2815d090 0x7f2b280d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2c99a700 1 -- 172.21.15.72:0/2223640519 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b280d1ac0 con 0x7f2b280b8aa0 2023-08-25T04:45:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.629+0000 7f2b2c99a700 1 --2- 172.21.15.72:0/2223640519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b280b8aa0 0x7f2b280cdb50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2b280d0030 tx=0x7f2b18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1cf8fac7ca3329 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b1ffff700 1 -- 172.21.15.72:0/2223640519 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18011830 con 0x7f2b280b8aa0 2023-08-25T04:45:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b1ffff700 1 -- 172.21.15.72:0/2223640519 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b18011990 con 0x7f2b280b8aa0 2023-08-25T04:45:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b1ffff700 1 -- 172.21.15.72:0/2223640519 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18011d20 con 0x7f2b280b8aa0 2023-08-25T04:45:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/2223640519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b280b8aa0 msgr2=0x7f2b280cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b2f3ff700 1 --2- 172.21.15.72:0/2223640519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b280b8aa0 0x7f2b280cdb50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2b280d0030 tx=0x7f2b18009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/2223640519 shutdown_connections 2023-08-25T04:45:27.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b2f3ff700 1 --2- 172.21.15.72:0/2223640519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b280ce090 0x7f2b280b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b2f3ff700 1 --2- 172.21.15.72:0/2223640519 >> v2:172.21.15.137:3300/0 conn(0x7f2b2815d090 0x7f2b280d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b2f3ff700 1 --2- 172.21.15.72:0/2223640519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b280b8aa0 0x7f2b280cdb50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/2223640519 >> 172.21.15.72:0/2223640519 conn(0x7f2b28071e10 msgr2=0x7f2b28072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:27.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/2223640519 shutdown_connections 2023-08-25T04:45:27.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.630+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/2223640519 wait complete. 2023-08-25T04:45:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.632+0000 7f2b2f3ff700 1 Processor -- start 2023-08-25T04:45:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.632+0000 7f2b2f3ff700 1 -- start start 2023-08-25T04:45:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2f3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b280b8aa0 0x7f2b280c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2f3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b280ce090 0x7f2b281553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2f3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2815d090 0x7f2b28155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2f3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28155e50 con 0x7f2b2815d090 2023-08-25T04:45:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2f3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28156100 con 0x7f2b280b8aa0 2023-08-25T04:45:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2f3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b281563e0 con 0x7f2b280ce090 2023-08-25T04:45:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2d99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2815d090 0x7f2b28155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2d19b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b280b8aa0 0x7f2b280c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2d19b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b280b8aa0 0x7f2b280c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:37600/0 (socket says 172.21.15.72:37600) 2023-08-25T04:45:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2d99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2815d090 0x7f2b28155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60270/0 (socket says 172.21.15.72:60270) 2023-08-25T04:45:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2d19b700 1 -- 172.21.15.72:0/3254916596 learned_addr learned my addr 172.21.15.72:0/3254916596 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.633+0000 7f2b2c99a700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b280ce090 0x7f2b281553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b2d99c700 1 -- 172.21.15.72:0/3254916596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b280ce090 msgr2=0x7f2b281553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b2d99c700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b280ce090 0x7f2b281553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b2d99c700 1 -- 172.21.15.72:0/3254916596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b280b8aa0 msgr2=0x7f2b280c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b2d99c700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b280b8aa0 0x7f2b280c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b2d99c700 1 -- 172.21.15.72:0/3254916596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b18009550 con 0x7f2b2815d090 2023-08-25T04:45:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b2d99c700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2815d090 0x7f2b28155910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000efc0 tx=0x7f2b2000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b1dffb700 1 -- 172.21.15.72:0/3254916596 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000cc90 con 0x7f2b2815d090 2023-08-25T04:45:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b1dffb700 1 -- 172.21.15.72:0/3254916596 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000f040 con 0x7f2b2815d090 2023-08-25T04:45:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/3254916596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b281566c0 con 0x7f2b2815d090 2023-08-25T04:45:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b1dffb700 1 -- 172.21.15.72:0/3254916596 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b200146c0 con 0x7f2b2815d090 2023-08-25T04:45:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.634+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/3254916596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b28157180 con 0x7f2b2815d090 2023-08-25T04:45:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.636+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/3254916596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2806a2f0 con 0x7f2b2815d090 2023-08-25T04:45:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.636+0000 7f2b1dffb700 1 -- 172.21.15.72:0/3254916596 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f2b20014820 con 0x7f2b2815d090 2023-08-25T04:45:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.637+0000 7f2b1dffb700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2b0c06a050 0x7f2b0c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.637+0000 7f2b1dffb700 1 -- 172.21.15.72:0/3254916596 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f2b20088c10 con 0x7f2b2815d090 2023-08-25T04:45:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.637+0000 7f2b2d19b700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2b0c06a050 0x7f2b0c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:27.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.638+0000 7f2b2d19b700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2b0c06a050 0x7f2b0c06c510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009b80 tx=0x7f2b24009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:27.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.642+0000 7f2b1dffb700 1 -- 172.21.15.72:0/3254916596 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2b20054730 con 0x7f2b2815d090 2023-08-25T04:45:27.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.860+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/3254916596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2b28157370 con 0x7f2b2815d090 2023-08-25T04:45:27.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.860+0000 7f2b1dffb700 1 -- 172.21.15.72:0/3254916596 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2b200180a0 con 0x7f2b2815d090 2023-08-25T04:45:27.861 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:45:27.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/3254916596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2b0c06a050 msgr2=0x7f2b0c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2b0c06a050 0x7f2b0c06c510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009b80 tx=0x7f2b24009210 comp rx=0 tx=0).stop 2023-08-25T04:45:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/3254916596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2815d090 msgr2=0x7f2b28155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2815d090 0x7f2b28155910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000efc0 tx=0x7f2b2000c3a0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/3254916596 shutdown_connections 2023-08-25T04:45:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2b0c06a050 0x7f2b0c06c510 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2815d090 0x7f2b28155910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b280b8aa0 0x7f2b280c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 --2- 172.21.15.72:0/3254916596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2b280ce090 0x7f2b281553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:27.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/3254916596 >> 172.21.15.72:0/3254916596 conn(0x7f2b28071e10 msgr2=0x7f2b280c8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:27.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/3254916596 shutdown_connections 2023-08-25T04:45:27.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:27.863+0000 7f2b2f3ff700 1 -- 172.21.15.72:0/3254916596 wait complete. 2023-08-25T04:45:27.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:45:28.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.090+0000 7f9312dff700 1 Processor -- start 2023-08-25T04:45:28.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.090+0000 7f9312dff700 1 -- start start 2023-08-25T04:45:28.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.092+0000 7f9312dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f930c06a2f0 0x7f930c0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.092+0000 7f9312dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f930c06fe90 0x7f930c0b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.092+0000 7f9312dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c0ca640 con 0x7f930c06a6d0 2023-08-25T04:45:28.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.092+0000 7f9312dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c0ca920 con 0x7f930c06a2f0 2023-08-25T04:45:28.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.092+0000 7f9312dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c0cac00 con 0x7f930c06fe90 2023-08-25T04:45:28.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.092+0000 7f9310b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f930c06a2f0 0x7f930c0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.092+0000 7f9310b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f930c06a2f0 0x7f930c0b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60296/0 (socket says 172.21.15.72:60296) 2023-08-25T04:45:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.092+0000 7f9310b9b700 1 -- 172.21.15.72:0/3885931653 learned_addr learned my addr 172.21.15.72:0/3885931653 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.093+0000 7f930bfff700 1 --2- 172.21.15.72:0/3885931653 >> v2:172.21.15.137:3300/0 conn(0x7f930c06fe90 0x7f930c0b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.093+0000 7f9310b9b700 1 -- 172.21.15.72:0/3885931653 >> v2:172.21.15.137:3300/0 conn(0x7f930c06fe90 msgr2=0x7f930c0b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.093+0000 7f9310b9b700 1 --2- 172.21.15.72:0/3885931653 >> v2:172.21.15.137:3300/0 conn(0x7f930c06fe90 0x7f930c0b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.093+0000 7f9310b9b700 1 -- 172.21.15.72:0/3885931653 >> v1:172.21.15.137:6789/0 conn(0x7f930c06a6d0 legacy=0x7f930c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.093+0000 7f9310b9b700 1 -- 172.21.15.72:0/3885931653 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c0caee0 con 0x7f930c06a2f0 2023-08-25T04:45:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.093+0000 7f9310b9b700 1 --2- 172.21.15.72:0/3885931653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f930c06a2f0 0x7f930c0b1d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f930c0c6ad0 tx=0x7f9300009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6da60a5dac2e08 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.093+0000 7f930b7fe700 1 -- 172.21.15.72:0/3885931653 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300011830 con 0x7f930c06a2f0 2023-08-25T04:45:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.093+0000 7f930b7fe700 1 -- 172.21.15.72:0/3885931653 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9300011990 con 0x7f930c06a2f0 2023-08-25T04:45:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.093+0000 7f930b7fe700 1 -- 172.21.15.72:0/3885931653 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300011d20 con 0x7f930c06a2f0 2023-08-25T04:45:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.094+0000 7f9312dff700 1 -- 172.21.15.72:0/3885931653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f930c06a2f0 msgr2=0x7f930c0b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.094+0000 7f9312dff700 1 --2- 172.21.15.72:0/3885931653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f930c06a2f0 0x7f930c0b1d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f930c0c6ad0 tx=0x7f9300009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.094+0000 7f9312dff700 1 -- 172.21.15.72:0/3885931653 shutdown_connections 2023-08-25T04:45:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.094+0000 7f9312dff700 1 --2- 172.21.15.72:0/3885931653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f930c06a2f0 0x7f930c0b1d90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.094+0000 7f9312dff700 1 --2- 172.21.15.72:0/3885931653 >> v2:172.21.15.137:3300/0 conn(0x7f930c06fe90 0x7f930c0b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.094+0000 7f9312dff700 1 -- 172.21.15.72:0/3885931653 >> 172.21.15.72:0/3885931653 conn(0x7f930c06daa0 msgr2=0x7f930c06de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.094+0000 7f9312dff700 1 -- 172.21.15.72:0/3885931653 shutdown_connections 2023-08-25T04:45:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.094+0000 7f9312dff700 1 -- 172.21.15.72:0/3885931653 wait complete. 2023-08-25T04:45:28.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.096+0000 7f9312dff700 1 Processor -- start 2023-08-25T04:45:28.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.096+0000 7f9312dff700 1 -- start start 2023-08-25T04:45:28.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f9312dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f930c06a2f0 0x7f930c1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f9312dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f930c06a6d0 0x7f930c0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f9312dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f930c06fe90 0x7f930c0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f9312dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0ae1f0 con 0x7f930c06fe90 2023-08-25T04:45:28.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f9312dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1f2720 con 0x7f930c06a2f0 2023-08-25T04:45:28.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f9312dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0adc30 con 0x7f930c06a6d0 2023-08-25T04:45:28.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f9310b9b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f930c06a2f0 0x7f930c1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f9310b9b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f930c06a2f0 0x7f930c1f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:37650/0 (socket says 172.21.15.72:37650) 2023-08-25T04:45:28.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f9310b9b700 1 -- 172.21.15.72:0/1391785183 learned_addr learned my addr 172.21.15.72:0/1391785183 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:28.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f931139c700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f930c06fe90 0x7f930c0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.097+0000 7f930bfff700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f930c06a6d0 0x7f930c0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.098+0000 7f9310b9b700 1 -- 172.21.15.72:0/1391785183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f930c06a6d0 msgr2=0x7f930c0ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.098+0000 7f9310b9b700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f930c06a6d0 0x7f930c0ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.098+0000 7f9310b9b700 1 -- 172.21.15.72:0/1391785183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f930c06fe90 msgr2=0x7f930c0c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.098+0000 7f9310b9b700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f930c06fe90 0x7f930c0c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.098+0000 7f9310b9b700 1 -- 172.21.15.72:0/1391785183 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9300009550 con 0x7f930c06a2f0 2023-08-25T04:45:28.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.098+0000 7f9310b9b700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f930c06a2f0 0x7f930c1f21e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9300009c10 tx=0x7f9300004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:28.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.098+0000 7f93097fa700 1 -- 172.21.15.72:0/1391785183 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300004380 con 0x7f930c06a2f0 2023-08-25T04:45:28.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.098+0000 7f93097fa700 1 -- 172.21.15.72:0/1391785183 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930001f070 con 0x7f930c06a2f0 2023-08-25T04:45:28.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.098+0000 7f9312dff700 1 -- 172.21.15.72:0/1391785183 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c0adf10 con 0x7f930c06a2f0 2023-08-25T04:45:28.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.098+0000 7f93097fa700 1 -- 172.21.15.72:0/1391785183 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000036a0 con 0x7f930c06a2f0 2023-08-25T04:45:28.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.099+0000 7f9312dff700 1 -- 172.21.15.72:0/1391785183 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c15dbf0 con 0x7f930c06a2f0 2023-08-25T04:45:28.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.100+0000 7f9312dff700 1 -- 172.21.15.72:0/1391785183 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930c15d770 con 0x7f930c06a2f0 2023-08-25T04:45:28.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.100+0000 7f93097fa700 1 -- 172.21.15.72:0/1391785183 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f9300021030 con 0x7f930c06a2f0 2023-08-25T04:45:28.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.101+0000 7f93097fa700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f92f006a050 0x7f92f006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.102+0000 7f93097fa700 1 -- 172.21.15.72:0/1391785183 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9300089440 con 0x7f930c06a2f0 2023-08-25T04:45:28.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.102+0000 7f930bfff700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f92f006a050 0x7f92f006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.102+0000 7f930bfff700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f92f006a050 0x7f92f006c510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f930c15d060 tx=0x7f92f8009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:28.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.107+0000 7f93097fa700 1 -- 172.21.15.72:0/1391785183 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f930c15d770 con 0x7f930c06a2f0 2023-08-25T04:45:28.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.317+0000 7f9312dff700 1 -- 172.21.15.72:0/1391785183 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f930c15d770 con 0x7f930c06a2f0 2023-08-25T04:45:28.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.317+0000 7f93097fa700 1 -- 172.21.15.72:0/1391785183 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9300015020 con 0x7f930c06a2f0 2023-08-25T04:45:28.318 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:45:28.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 -- 172.21.15.72:0/1391785183 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f92f006a050 msgr2=0x7f92f006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f92f006a050 0x7f92f006c510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f930c15d060 tx=0x7f92f8009210 comp rx=0 tx=0).stop 2023-08-25T04:45:28.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 -- 172.21.15.72:0/1391785183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f930c06a2f0 msgr2=0x7f930c1f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f930c06a2f0 0x7f930c1f21e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9300009c10 tx=0x7f9300004750 comp rx=0 tx=0).stop 2023-08-25T04:45:28.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 -- 172.21.15.72:0/1391785183 shutdown_connections 2023-08-25T04:45:28.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f92f006a050 0x7f92f006c510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f930c06fe90 0x7f930c0c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f930c06a2f0 0x7f930c1f21e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 --2- 172.21.15.72:0/1391785183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f930c06a6d0 0x7f930c0ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 -- 172.21.15.72:0/1391785183 >> 172.21.15.72:0/1391785183 conn(0x7f930c06daa0 msgr2=0x7f930c0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:28.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 -- 172.21.15.72:0/1391785183 shutdown_connections 2023-08-25T04:45:28.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.320+0000 7f9312dff700 1 -- 172.21.15.72:0/1391785183 wait complete. 2023-08-25T04:45:28.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:45:28.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.542+0000 7ff14f1ff700 1 Processor -- start 2023-08-25T04:45:28.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.542+0000 7ff14f1ff700 1 -- start start 2023-08-25T04:45:28.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.543+0000 7ff14f1ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff14815ce60 0x7ff1480d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.543+0000 7ff14f1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1480d1fe0 con 0x7ff1480cda40 2023-08-25T04:45:28.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.543+0000 7ff14f1ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1480d13d0 con 0x7ff1480b8770 2023-08-25T04:45:28.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.543+0000 7ff14f1ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1480d2b80 con 0x7ff14815ce60 2023-08-25T04:45:28.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff14d79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff1480cda40 0x7ff1480b5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51742/0 (socket says 172.21.15.72:51742) 2023-08-25T04:45:28.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff14d79c700 1 -- 172.21.15.72:0/2111970490 learned_addr learned my addr 172.21.15.72:0/2111970490 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:28.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff14cf9b700 1 --2- 172.21.15.72:0/2111970490 >> v2:172.21.15.137:3300/0 conn(0x7ff14815ce60 0x7ff1480d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737969998 0 0) 0x7ff1480d1fe0 con 0x7ff1480cda40 2023-08-25T04:45:28.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1380035b0 con 0x7ff1480cda40 2023-08-25T04:45:28.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462501069 0 0) 0x7ff1480d13d0 con 0x7ff1480b8770 2023-08-25T04:45:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1480d1fe0 con 0x7ff1480b8770 2023-08-25T04:45:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1179241589 0 0) 0x7ff1380035b0 con 0x7ff1480cda40 2023-08-25T04:45:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 >> v2:172.21.15.137:3300/0 conn(0x7ff14815ce60 msgr2=0x7ff1480d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff1477fe700 1 --2- 172.21.15.72:0/2111970490 >> v2:172.21.15.137:3300/0 conn(0x7ff14815ce60 0x7ff1480d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 >> v1:172.21.15.137:6789/0 conn(0x7ff1480b8770 legacy=0x7ff1480d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1480d16b0 con 0x7ff1480cda40 2023-08-25T04:45:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7ff1400019f0 con 0x7ff1480cda40 2023-08-25T04:45:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.544+0000 7ff14cf9b700 1 --2- 172.21.15.72:0/2111970490 >> v2:172.21.15.137:3300/0 conn(0x7ff14815ce60 0x7ff1480d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 >> v1:172.21.15.72:6789/0 conn(0x7ff1480cda40 legacy=0x7ff1480b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff1477fe700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff138003be0 0x7ff138003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff1477fe700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138004850 0x7ff138004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff1477fe700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff138005260 0x7ff13800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13800c160 con 0x7ff138003be0 2023-08-25T04:45:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13800c2d0 con 0x7ff138004850 2023-08-25T04:45:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13800c490 con 0x7ff138005260 2023-08-25T04:45:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff14cf9b700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff138003be0 0x7ff138003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff14d79c700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff138005260 0x7ff13800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff147fff700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138004850 0x7ff138004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff14cf9b700 1 -- 172.21.15.72:0/2111970490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff138005260 msgr2=0x7ff13800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff14cf9b700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff138005260 0x7ff13800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff14cf9b700 1 -- 172.21.15.72:0/2111970490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138004850 msgr2=0x7ff138004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff14cf9b700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138004850 0x7ff138004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff14cf9b700 1 -- 172.21.15.72:0/2111970490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1380035b0 con 0x7ff138003be0 2023-08-25T04:45:28.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff147fff700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138004850 0x7ff138004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:28.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.545+0000 7ff14d79c700 1 -- 172.21.15.72:0/2111970490 reap_dead start 2023-08-25T04:45:28.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.546+0000 7ff14cf9b700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff138003be0 0x7ff138003fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009d30 tx=0x7ff138005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98b18f92fff5e13 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:28.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.546+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c009e80 con 0x7ff138003be0 2023-08-25T04:45:28.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.546+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c00e9a0 con 0x7ff138003be0 2023-08-25T04:45:28.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.546+0000 7ff1477fe700 1 -- 172.21.15.72:0/2111970490 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c00ed10 con 0x7ff138003be0 2023-08-25T04:45:28.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.547+0000 7ff14f1ff700 1 -- 172.21.15.72:0/2111970490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff138003be0 msgr2=0x7ff138003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.547+0000 7ff14f1ff700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff138003be0 0x7ff138003fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009d30 tx=0x7ff138005880 comp rx=0 tx=0).stop 2023-08-25T04:45:28.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.547+0000 7ff14f1ff700 1 -- 172.21.15.72:0/2111970490 shutdown_connections 2023-08-25T04:45:28.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.547+0000 7ff14f1ff700 1 --2- 172.21.15.72:0/2111970490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff138003be0 0x7ff138003fe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.547+0000 7ff14f1ff700 1 -- 172.21.15.72:0/2111970490 >> 172.21.15.72:0/2111970490 conn(0x7ff148071e10 msgr2=0x7ff148072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:28.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.547+0000 7ff14f1ff700 1 -- 172.21.15.72:0/2111970490 shutdown_connections 2023-08-25T04:45:28.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.547+0000 7ff14f1ff700 1 -- 172.21.15.72:0/2111970490 wait complete. 2023-08-25T04:45:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.549+0000 7ff14f1ff700 1 Processor -- start 2023-08-25T04:45:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.549+0000 7ff14f1ff700 1 -- start start 2023-08-25T04:45:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff14f1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff138003be0 0x7ff148150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff14f1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1480c93e0 0x7ff1480c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff14f1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1480c7ea0 0x7ff14815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff14f1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1480c8fc0 con 0x7ff1480c93e0 2023-08-25T04:45:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff14f1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1480c8340 con 0x7ff1480c7ea0 2023-08-25T04:45:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff14f1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1480c8620 con 0x7ff138003be0 2023-08-25T04:45:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff147fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1480c93e0 0x7ff1480c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff147fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1480c93e0 0x7ff1480c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60314/0 (socket says 172.21.15.72:60314) 2023-08-25T04:45:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff147fff700 1 -- 172.21.15.72:0/62750052 learned_addr learned my addr 172.21.15.72:0/62750052 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff14d79c700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1480c7ea0 0x7ff14815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff14cf9b700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff138003be0 0x7ff148150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff147fff700 1 -- 172.21.15.72:0/62750052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff138003be0 msgr2=0x7ff148150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff147fff700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff138003be0 0x7ff148150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff147fff700 1 -- 172.21.15.72:0/62750052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1480c7ea0 msgr2=0x7ff14815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff147fff700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1480c7ea0 0x7ff14815ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff147fff700 1 -- 172.21.15.72:0/62750052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1480c8900 con 0x7ff1480c93e0 2023-08-25T04:45:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.550+0000 7ff14cf9b700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff138003be0 0x7ff148150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.551+0000 7ff147fff700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1480c93e0 0x7ff1480c7960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1340078e0 tx=0x7ff13400e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.551+0000 7ff1457fa700 1 -- 172.21.15.72:0/62750052 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340052e0 con 0x7ff1480c93e0 2023-08-25T04:45:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.551+0000 7ff1457fa700 1 -- 172.21.15.72:0/62750052 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134005440 con 0x7ff1480c93e0 2023-08-25T04:45:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.551+0000 7ff14f1ff700 1 -- 172.21.15.72:0/62750052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1480c8be0 con 0x7ff1480c93e0 2023-08-25T04:45:28.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.551+0000 7ff1457fa700 1 -- 172.21.15.72:0/62750052 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340038c0 con 0x7ff1480c93e0 2023-08-25T04:45:28.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.551+0000 7ff14f1ff700 1 -- 172.21.15.72:0/62750052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1481600b0 con 0x7ff1480c93e0 2023-08-25T04:45:28.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.552+0000 7ff14f1ff700 1 -- 172.21.15.72:0/62750052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14804e620 con 0x7ff1480c93e0 2023-08-25T04:45:28.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.553+0000 7ff1457fa700 1 -- 172.21.15.72:0/62750052 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7ff134003a20 con 0x7ff1480c93e0 2023-08-25T04:45:28.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.554+0000 7ff1457fa700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff12c06a050 0x7ff12c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:28.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.554+0000 7ff1457fa700 1 -- 172.21.15.72:0/62750052 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff1340875b0 con 0x7ff1480c93e0 2023-08-25T04:45:28.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.554+0000 7ff14cf9b700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff12c06a050 0x7ff12c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:28.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.555+0000 7ff14cf9b700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff12c06a050 0x7ff12c06c510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff13c000c00 tx=0x7ff13c01e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:28.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.559+0000 7ff1457fa700 1 -- 172.21.15.72:0/62750052 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff1340530c0 con 0x7ff1480c93e0 2023-08-25T04:45:28.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.811+0000 7ff14f1ff700 1 -- 172.21.15.72:0/62750052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1480d1960 con 0x7ff1480c93e0 2023-08-25T04:45:28.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.812+0000 7ff1457fa700 1 -- 172.21.15.72:0/62750052 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7ff134019e90 con 0x7ff1480c93e0 2023-08-25T04:45:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:28.813 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-25T04:45:28.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.814+0000 7ff14f1ff700 1 -- 172.21.15.72:0/62750052 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff12c06a050 msgr2=0x7ff12c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.814+0000 7ff14f1ff700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff12c06a050 0x7ff12c06c510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff13c000c00 tx=0x7ff13c01e040 comp rx=0 tx=0).stop 2023-08-25T04:45:28.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.815+0000 7ff14f1ff700 1 -- 172.21.15.72:0/62750052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1480c93e0 msgr2=0x7ff1480c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:28.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.815+0000 7ff14f1ff700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1480c93e0 0x7ff1480c7960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1340078e0 tx=0x7ff13400e8e0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.815+0000 7ff14f1ff700 1 -- 172.21.15.72:0/62750052 shutdown_connections 2023-08-25T04:45:28.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.815+0000 7ff14f1ff700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff12c06a050 0x7ff12c06c510 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.815+0000 7ff14f1ff700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1480c7ea0 0x7ff14815ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.815+0000 7ff14f1ff700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff138003be0 0x7ff148150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.815+0000 7ff14f1ff700 1 --2- 172.21.15.72:0/62750052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1480c93e0 0x7ff1480c7960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:28.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.815+0000 7ff14f1ff700 1 -- 172.21.15.72:0/62750052 >> 172.21.15.72:0/62750052 conn(0x7ff148071e10 msgr2=0x7ff148072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:28.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.815+0000 7ff14f1ff700 1 -- 172.21.15.72:0/62750052 shutdown_connections 2023-08-25T04:45:28.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:28.815+0000 7ff14f1ff700 1 -- 172.21.15.72:0/62750052 wait complete. 2023-08-25T04:45:28.818 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 3 2023-08-25T04:45:28.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:29.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.027+0000 7f38b89ff700 1 Processor -- start 2023-08-25T04:45:29.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.027+0000 7f38b89ff700 1 -- start start 2023-08-25T04:45:29.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.028+0000 7f38b89ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38b4159b90 0x7f38b40b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.028+0000 7f38b89ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38b40ce3c0 0x7f38b40c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.028+0000 7f38b89ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b40c48f0 con 0x7f38b40b0ab0 2023-08-25T04:45:29.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.028+0000 7f38b89ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b40c5470 con 0x7f38b40ce3c0 2023-08-25T04:45:29.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.028+0000 7f38b89ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4159f70 con 0x7f38b4159b90 2023-08-25T04:45:29.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38b40ce3c0 0x7f38b40c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38b40ce3c0 0x7f38b40c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60318/0 (socket says 172.21.15.72:60318) 2023-08-25T04:45:29.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b2d9d700 1 -- 172.21.15.72:0/2638569431 learned_addr learned my addr 172.21.15.72:0/2638569431 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:29.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b259c700 1 --2- 172.21.15.72:0/2638569431 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38b4159b90 0x7f38b40b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b2d9d700 1 -- 172.21.15.72:0/2638569431 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38b4159b90 msgr2=0x7f38b40b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b2d9d700 1 --2- 172.21.15.72:0/2638569431 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38b4159b90 0x7f38b40b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b2d9d700 1 -- 172.21.15.72:0/2638569431 >> v1:172.21.15.137:6789/0 conn(0x7f38b40b0ab0 legacy=0x7f38b40cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b2d9d700 1 -- 172.21.15.72:0/2638569431 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b40c4b40 con 0x7f38b40ce3c0 2023-08-25T04:45:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b2d9d700 1 --2- 172.21.15.72:0/2638569431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 0x7f38b40c8f50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009e50 tx=0x7f38ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89722172221d597b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b1d9b700 1 -- 172.21.15.72:0/2638569431 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00bbc0 con 0x7f38b40ce3c0 2023-08-25T04:45:29.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b1d9b700 1 -- 172.21.15.72:0/2638569431 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac00bd20 con 0x7f38b40ce3c0 2023-08-25T04:45:29.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.029+0000 7f38b1d9b700 1 -- 172.21.15.72:0/2638569431 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0116a0 con 0x7f38b40ce3c0 2023-08-25T04:45:29.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.030+0000 7f38b89ff700 1 -- 172.21.15.72:0/2638569431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 msgr2=0x7f38b40c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.030+0000 7f38b89ff700 1 --2- 172.21.15.72:0/2638569431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 0x7f38b40c8f50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009e50 tx=0x7f38ac00b330 comp rx=0 tx=0).stop 2023-08-25T04:45:29.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.030+0000 7f38b89ff700 1 -- 172.21.15.72:0/2638569431 shutdown_connections 2023-08-25T04:45:29.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.030+0000 7f38b89ff700 1 --2- 172.21.15.72:0/2638569431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 0x7f38b40c8f50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.030+0000 7f38b89ff700 1 --2- 172.21.15.72:0/2638569431 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38b4159b90 0x7f38b40b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.030+0000 7f38b89ff700 1 -- 172.21.15.72:0/2638569431 >> 172.21.15.72:0/2638569431 conn(0x7f38b40ce990 msgr2=0x7f38b40ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:29.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.030+0000 7f38b89ff700 1 -- 172.21.15.72:0/2638569431 shutdown_connections 2023-08-25T04:45:29.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.030+0000 7f38b89ff700 1 -- 172.21.15.72:0/2638569431 wait complete. 2023-08-25T04:45:29.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.032+0000 7f38b89ff700 1 Processor -- start 2023-08-25T04:45:29.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.033+0000 7f38b89ff700 1 -- start start 2023-08-25T04:45:29.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38b89ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38b40b0ab0 0x7f38b41f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38b89ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 0x7f38b40afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38b89ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38b4159b90 0x7f38b415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38b89ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b40b0400 con 0x7f38b40ce3c0 2023-08-25T04:45:29.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38b89ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b415c620 con 0x7f38b40b0ab0 2023-08-25T04:45:29.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38b89ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b41f5d40 con 0x7f38b4159b90 2023-08-25T04:45:29.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 0x7f38b40afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38b259c700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38b40b0ab0 0x7f38b41f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 0x7f38b40afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60332/0 (socket says 172.21.15.72:60332) 2023-08-25T04:45:29.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38abfff700 1 -- 172.21.15.72:0/2195370834 learned_addr learned my addr 172.21.15.72:0/2195370834 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:29.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.034+0000 7f38b2d9d700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38b4159b90 0x7f38b415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38abfff700 1 -- 172.21.15.72:0/2195370834 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38b4159b90 msgr2=0x7f38b415c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38abfff700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38b4159b90 0x7f38b415c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38abfff700 1 -- 172.21.15.72:0/2195370834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38b40b0ab0 msgr2=0x7f38b41f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38abfff700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38b40b0ab0 0x7f38b41f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38abfff700 1 -- 172.21.15.72:0/2195370834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac009b30 con 0x7f38b40ce3c0 2023-08-25T04:45:29.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38abfff700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 0x7f38b40afec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f389c00c4e0 tx=0x7f389c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:29.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38aaffd700 1 -- 172.21.15.72:0/2195370834 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c0052d0 con 0x7f38b40ce3c0 2023-08-25T04:45:29.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38aaffd700 1 -- 172.21.15.72:0/2195370834 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c005430 con 0x7f38b40ce3c0 2023-08-25T04:45:29.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38aaffd700 1 -- 172.21.15.72:0/2195370834 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c0038c0 con 0x7f38b40ce3c0 2023-08-25T04:45:29.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38b89ff700 1 -- 172.21.15.72:0/2195370834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b41f6020 con 0x7f38b40ce3c0 2023-08-25T04:45:29.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.035+0000 7f38b89ff700 1 -- 172.21.15.72:0/2195370834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b41f2240 con 0x7f38b40ce3c0 2023-08-25T04:45:29.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.036+0000 7f38b89ff700 1 -- 172.21.15.72:0/2195370834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b404e620 con 0x7f38b40ce3c0 2023-08-25T04:45:29.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.037+0000 7f38aaffd700 1 -- 172.21.15.72:0/2195370834 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f389c003a20 con 0x7f38b40ce3c0 2023-08-25T04:45:29.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.038+0000 7f38aaffd700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f389406a050 0x7f389406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.038+0000 7f38aaffd700 1 -- 172.21.15.72:0/2195370834 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f389c087540 con 0x7f38b40ce3c0 2023-08-25T04:45:29.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.038+0000 7f38b259c700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f389406a050 0x7f389406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.039+0000 7f38b259c700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f389406a050 0x7f389406c510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f38a4006b20 tx=0x7f38a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:29.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.042+0000 7f38aaffd700 1 -- 172.21.15.72:0/2195370834 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f389c052fc0 con 0x7f38b40ce3c0 2023-08-25T04:45:29.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.246+0000 7f38b89ff700 1 -- 172.21.15.72:0/2195370834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38b406e340 con 0x7f38b40ce3c0 2023-08-25T04:45:29.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.365+0000 7f38aaffd700 1 -- 172.21.15.72:0/2195370834 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14579 (secure 0 0 0) 0x7f389c0565e0 con 0x7f38b40ce3c0 2023-08-25T04:45:29.367 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:29.367 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:28.761587+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.368+0000 7f38b89ff700 1 -- 172.21.15.72:0/2195370834 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f389406a050 msgr2=0x7f389406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.368+0000 7f38b89ff700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f389406a050 0x7f389406c510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f38a4006b20 tx=0x7f38a4008040 comp rx=0 tx=0).stop 2023-08-25T04:45:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.368+0000 7f38b89ff700 1 -- 172.21.15.72:0/2195370834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 msgr2=0x7f38b40afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.368+0000 7f38b89ff700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 0x7f38b40afec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f389c00c4e0 tx=0x7f389c00c7f0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.368+0000 7f38b89ff700 1 -- 172.21.15.72:0/2195370834 shutdown_connections 2023-08-25T04:45:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.368+0000 7f38b89ff700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f389406a050 0x7f389406c510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.368+0000 7f38b89ff700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38b4159b90 0x7f38b415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.368+0000 7f38b89ff700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38b40b0ab0 0x7f38b41f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.368+0000 7f38b89ff700 1 --2- 172.21.15.72:0/2195370834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b40ce3c0 0x7f38b40afec0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.368+0000 7f38b89ff700 1 -- 172.21.15.72:0/2195370834 >> 172.21.15.72:0/2195370834 conn(0x7f38b40ce990 msgr2=0x7f38b4156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.369+0000 7f38b89ff700 1 -- 172.21.15.72:0/2195370834 shutdown_connections 2023-08-25T04:45:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.369+0000 7f38b89ff700 1 -- 172.21.15.72:0/2195370834 wait complete. 2023-08-25T04:45:29.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:45:29.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:45:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.586+0000 7fc4587ff700 1 Processor -- start 2023-08-25T04:45:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.586+0000 7fc4587ff700 1 -- start start 2023-08-25T04:45:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.587+0000 7fc4587ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4500d10c0 0x7fc4500b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.587+0000 7fc4587ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4500b8d10 con 0x7fc4500b4d40 2023-08-25T04:45:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.587+0000 7fc4587ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4500b5190 con 0x7fc45015d000 2023-08-25T04:45:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc4587ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500b56f0 con 0x7fc4500d10c0 2023-08-25T04:45:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc456d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc4500b4d40 0x7fc4500b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51748/0 (socket says 172.21.15.72:51748) 2023-08-25T04:45:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc456d9c700 1 -- 172.21.15.72:0/3154010181 learned_addr learned my addr 172.21.15.72:0/3154010181 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:29.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672454936 0 0) 0x7fc4500b8d10 con 0x7fc4500b4d40 2023-08-25T04:45:29.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc43c0035b0 con 0x7fc4500b4d40 2023-08-25T04:45:29.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 968007902 0 0) 0x7fc43c0035b0 con 0x7fc4500b4d40 2023-08-25T04:45:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4500d10c0 msgr2=0x7fc4500b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc455599700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4500d10c0 0x7fc4500b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 >> v1:172.21.15.137:6789/0 conn(0x7fc45015d000 legacy=0x7fc4500b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500b6e90 con 0x7fc4500b4d40 2023-08-25T04:45:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.588+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fc4480019f0 con 0x7fc4500b4d40 2023-08-25T04:45:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 >> v1:172.21.15.72:6789/0 conn(0x7fc4500b4d40 legacy=0x7fc4500b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455599700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4500d10c0 0x7fc43c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455599700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c004100 0x7fc43c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455599700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc43c004d90 0x7fc43c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c00bc20 con 0x7fc43c004100 2023-08-25T04:45:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c00bd90 con 0x7fc43c004d90 2023-08-25T04:45:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c00bf50 con 0x7fc4500d10c0 2023-08-25T04:45:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455d9a700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c004100 0x7fc43c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc456d9c700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc43c004d90 0x7fc43c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc45659b700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4500d10c0 0x7fc43c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455d9a700 1 -- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4500d10c0 msgr2=0x7fc43c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455d9a700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4500d10c0 0x7fc43c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455d9a700 1 -- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc43c004d90 msgr2=0x7fc43c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455d9a700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc43c004d90 0x7fc43c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc455d9a700 1 -- 172.21.15.72:0/3154010181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0035b0 con 0x7fc43c004100 2023-08-25T04:45:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.589+0000 7fc456d9c700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc43c004d90 0x7fc43c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.590+0000 7fc455d9a700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c004100 0x7fc43c004850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc4400098e0 tx=0x7fc43c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e322d8ddfd10054b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.590+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440004230 con 0x7fc43c004100 2023-08-25T04:45:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.590+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4400043b0 con 0x7fc43c004100 2023-08-25T04:45:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.590+0000 7fc455599700 1 -- 172.21.15.72:0/3154010181 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4400038c0 con 0x7fc43c004100 2023-08-25T04:45:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.590+0000 7fc4587ff700 1 -- 172.21.15.72:0/3154010181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c004100 msgr2=0x7fc43c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.590+0000 7fc4587ff700 1 --2- 172.21.15.72:0/3154010181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc43c004100 0x7fc43c004850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc4400098e0 tx=0x7fc43c005880 comp rx=0 tx=0).stop 2023-08-25T04:45:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.590+0000 7fc456d9c700 1 -- 172.21.15.72:0/3154010181 reap_dead start 2023-08-25T04:45:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.590+0000 7fc4587ff700 1 -- 172.21.15.72:0/3154010181 shutdown_connections 2023-08-25T04:45:29.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.590+0000 7fc4587ff700 1 -- 172.21.15.72:0/3154010181 >> 172.21.15.72:0/3154010181 conn(0x7fc450071e10 msgr2=0x7fc450072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:29.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.590+0000 7fc4587ff700 1 -- 172.21.15.72:0/3154010181 shutdown_connections 2023-08-25T04:45:29.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.591+0000 7fc4587ff700 1 -- 172.21.15.72:0/3154010181 wait complete. 2023-08-25T04:45:29.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.592+0000 7fc4587ff700 1 Processor -- start 2023-08-25T04:45:29.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.592+0000 7fc4587ff700 1 -- start start 2023-08-25T04:45:29.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.593+0000 7fc4587ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc43c004100 0x7fc450150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.593+0000 7fc4587ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4500c8a20 0x7fc4500c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.593+0000 7fc4587ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45015ee60 0x7fc45015f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.593+0000 7fc4587ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500c93e0 con 0x7fc45015ee60 2023-08-25T04:45:29.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.593+0000 7fc4587ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc450160470 con 0x7fc4500c8a20 2023-08-25T04:45:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.593+0000 7fc4587ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4501507c0 con 0x7fc43c004100 2023-08-25T04:45:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc456d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45015ee60 0x7fc45015f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc455d9a700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4500c8a20 0x7fc4500c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc456d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45015ee60 0x7fc45015f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60352/0 (socket says 172.21.15.72:60352) 2023-08-25T04:45:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc456d9c700 1 -- 172.21.15.72:0/4243594095 learned_addr learned my addr 172.21.15.72:0/4243594095 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc45659b700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc43c004100 0x7fc450150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc456d9c700 1 -- 172.21.15.72:0/4243594095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc43c004100 msgr2=0x7fc450150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc456d9c700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc43c004100 0x7fc450150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc456d9c700 1 -- 172.21.15.72:0/4243594095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4500c8a20 msgr2=0x7fc4500c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc456d9c700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4500c8a20 0x7fc4500c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc456d9c700 1 -- 172.21.15.72:0/4243594095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45015fbd0 con 0x7fc45015ee60 2023-08-25T04:45:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.594+0000 7fc456d9c700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45015ee60 0x7fc45015f2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc448005080 tx=0x7fc448008340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.595+0000 7fc446ffd700 1 -- 172.21.15.72:0/4243594095 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448005e20 con 0x7fc45015ee60 2023-08-25T04:45:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.595+0000 7fc446ffd700 1 -- 172.21.15.72:0/4243594095 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc448008a30 con 0x7fc45015ee60 2023-08-25T04:45:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.595+0000 7fc446ffd700 1 -- 172.21.15.72:0/4243594095 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448014610 con 0x7fc45015ee60 2023-08-25T04:45:29.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.595+0000 7fc4587ff700 1 -- 172.21.15.72:0/4243594095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45015feb0 con 0x7fc45015ee60 2023-08-25T04:45:29.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.595+0000 7fc4587ff700 1 -- 172.21.15.72:0/4243594095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4500c9f80 con 0x7fc45015ee60 2023-08-25T04:45:29.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.596+0000 7fc4587ff700 1 -- 172.21.15.72:0/4243594095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45006a2f0 con 0x7fc45015ee60 2023-08-25T04:45:29.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.598+0000 7fc446ffd700 1 -- 172.21.15.72:0/4243594095 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fc448014770 con 0x7fc45015ee60 2023-08-25T04:45:29.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.599+0000 7fc446ffd700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc43406a050 0x7fc43406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:29.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.599+0000 7fc446ffd700 1 -- 172.21.15.72:0/4243594095 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc448089030 con 0x7fc45015ee60 2023-08-25T04:45:29.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.599+0000 7fc45659b700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc43406a050 0x7fc43406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:29.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.599+0000 7fc45659b700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc43406a050 0x7fc43406c510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc44c007fd0 tx=0x7fc44c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:29.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.602+0000 7fc446ffd700 1 -- 172.21.15.72:0/4243594095 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc448054cc0 con 0x7fc45015ee60 2023-08-25T04:45:29.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.805+0000 7fc4587ff700 1 -- 172.21.15.72:0/4243594095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc45008a000 con 0x7fc45015ee60 2023-08-25T04:45:29.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.805+0000 7fc446ffd700 1 -- 172.21.15.72:0/4243594095 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc4480056e0 con 0x7fc45015ee60 2023-08-25T04:45:29.806 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:45:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 -- 172.21.15.72:0/4243594095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc43406a050 msgr2=0x7fc43406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc43406a050 0x7fc43406c510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc44c007fd0 tx=0x7fc44c009040 comp rx=0 tx=0).stop 2023-08-25T04:45:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 -- 172.21.15.72:0/4243594095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45015ee60 msgr2=0x7fc45015f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45015ee60 0x7fc45015f2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc448005080 tx=0x7fc448008340 comp rx=0 tx=0).stop 2023-08-25T04:45:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 -- 172.21.15.72:0/4243594095 shutdown_connections 2023-08-25T04:45:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc43406a050 0x7fc43406c510 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc45015ee60 0x7fc45015f2e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc43c004100 0x7fc450150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 --2- 172.21.15.72:0/4243594095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4500c8a20 0x7fc4500c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 -- 172.21.15.72:0/4243594095 >> 172.21.15.72:0/4243594095 conn(0x7fc450071e10 msgr2=0x7fc45015bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 -- 172.21.15.72:0/4243594095 shutdown_connections 2023-08-25T04:45:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:29.808+0000 7fc4587ff700 1 -- 172.21.15.72:0/4243594095 wait complete. 2023-08-25T04:45:29.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:45:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.025+0000 7f5c74dff700 1 Processor -- start 2023-08-25T04:45:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.025+0000 7f5c74dff700 1 -- start start 2023-08-25T04:45:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.026+0000 7f5c74dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c7015d090 0x7f5c700d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.026+0000 7f5c74dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c700b8aa0 0x7f5c700cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.026+0000 7f5c74dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5c700ce090 0x7f5c700b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.026+0000 7f5c74dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c700ce4b0 con 0x7f5c700b8aa0 2023-08-25T04:45:30.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.026+0000 7f5c74dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7015d470 con 0x7f5c700ce090 2023-08-25T04:45:30.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.026+0000 7f5c74dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c700d17e0 con 0x7f5c7015d090 2023-08-25T04:45:30.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.026+0000 7f5c6dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c700b8aa0 0x7f5c700cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c700b8aa0 0x7f5c700cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60358/0 (socket says 172.21.15.72:60358) 2023-08-25T04:45:30.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6dd9b700 1 -- 172.21.15.72:0/4184788925 learned_addr learned my addr 172.21.15.72:0/4184788925 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6ed9d700 1 --2- 172.21.15.72:0/4184788925 >> v2:172.21.15.137:3300/0 conn(0x7f5c700ce090 0x7f5c700b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6e59c700 1 --2- 172.21.15.72:0/4184788925 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c7015d090 0x7f5c700d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6dd9b700 1 -- 172.21.15.72:0/4184788925 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c7015d090 msgr2=0x7f5c700d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6dd9b700 1 --2- 172.21.15.72:0/4184788925 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c7015d090 0x7f5c700d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6dd9b700 1 -- 172.21.15.72:0/4184788925 >> v2:172.21.15.137:3300/0 conn(0x7f5c700ce090 msgr2=0x7f5c700b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6dd9b700 1 --2- 172.21.15.72:0/4184788925 >> v2:172.21.15.137:3300/0 conn(0x7f5c700ce090 0x7f5c700b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6dd9b700 1 -- 172.21.15.72:0/4184788925 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c700d1ac0 con 0x7f5c700b8aa0 2023-08-25T04:45:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6ed9d700 1 --2- 172.21.15.72:0/4184788925 >> v2:172.21.15.137:3300/0 conn(0x7f5c700ce090 0x7f5c700b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6dd9b700 1 --2- 172.21.15.72:0/4184788925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 0x7f5c700cdb50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c70072990 tx=0x7f5c64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f141a632552a7ec server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6d59a700 1 -- 172.21.15.72:0/4184788925 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6400b870 con 0x7f5c700b8aa0 2023-08-25T04:45:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6d59a700 1 -- 172.21.15.72:0/4184788925 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6400b9d0 con 0x7f5c700b8aa0 2023-08-25T04:45:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.027+0000 7f5c6d59a700 1 -- 172.21.15.72:0/4184788925 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6400bd60 con 0x7f5c700b8aa0 2023-08-25T04:45:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.028+0000 7f5c74dff700 1 -- 172.21.15.72:0/4184788925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 msgr2=0x7f5c700cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.028+0000 7f5c74dff700 1 --2- 172.21.15.72:0/4184788925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 0x7f5c700cdb50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c70072990 tx=0x7f5c64009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.028+0000 7f5c74dff700 1 -- 172.21.15.72:0/4184788925 shutdown_connections 2023-08-25T04:45:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.028+0000 7f5c74dff700 1 --2- 172.21.15.72:0/4184788925 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c7015d090 0x7f5c700d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.028+0000 7f5c74dff700 1 --2- 172.21.15.72:0/4184788925 >> v2:172.21.15.137:3300/0 conn(0x7f5c700ce090 0x7f5c700b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.028+0000 7f5c74dff700 1 --2- 172.21.15.72:0/4184788925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 0x7f5c700cdb50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.028+0000 7f5c74dff700 1 -- 172.21.15.72:0/4184788925 >> 172.21.15.72:0/4184788925 conn(0x7f5c70071e10 msgr2=0x7f5c70072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.028+0000 7f5c74dff700 1 -- 172.21.15.72:0/4184788925 shutdown_connections 2023-08-25T04:45:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.028+0000 7f5c74dff700 1 -- 172.21.15.72:0/4184788925 wait complete. 2023-08-25T04:45:30.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.030+0000 7f5c74dff700 1 Processor -- start 2023-08-25T04:45:30.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.030+0000 7f5c74dff700 1 -- start start 2023-08-25T04:45:30.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c74dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 0x7f5c700a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c74dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700ce090 0x7f5c7014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c74dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c7015d090 0x7f5c701f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c74dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c700cc7d0 con 0x7f5c700b8aa0 2023-08-25T04:45:30.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c74dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70152410 con 0x7f5c7015d090 2023-08-25T04:45:30.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c74dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c700cbc50 con 0x7f5c700ce090 2023-08-25T04:45:30.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c6e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 0x7f5c700a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c6e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 0x7f5c700a9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60374/0 (socket says 172.21.15.72:60374) 2023-08-25T04:45:30.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c6e59c700 1 -- 172.21.15.72:0/3562142596 learned_addr learned my addr 172.21.15.72:0/3562142596 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:30.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c6e59c700 1 -- 172.21.15.72:0/3562142596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700ce090 msgr2=0x7f5c7014e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c6ed9d700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c7015d090 0x7f5c701f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c6dd9b700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700ce090 0x7f5c7014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c6e59c700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700ce090 0x7f5c7014e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c6e59c700 1 -- 172.21.15.72:0/3562142596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c7015d090 msgr2=0x7f5c701f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.031+0000 7f5c6e59c700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c7015d090 0x7f5c701f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.032+0000 7f5c6e59c700 1 -- 172.21.15.72:0/3562142596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c64009550 con 0x7f5c700b8aa0 2023-08-25T04:45:30.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.032+0000 7f5c6ed9d700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c7015d090 0x7f5c701f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:30.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.032+0000 7f5c6dd9b700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700ce090 0x7f5c7014e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:30.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.032+0000 7f5c6e59c700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 0x7f5c700a9780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000e810 tx=0x7f5c6000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:30.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.032+0000 7f5c5effd700 1 -- 172.21.15.72:0/3562142596 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c60013610 con 0x7f5c700b8aa0 2023-08-25T04:45:30.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.032+0000 7f5c5effd700 1 -- 172.21.15.72:0/3562142596 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c60013770 con 0x7f5c700b8aa0 2023-08-25T04:45:30.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.032+0000 7f5c74dff700 1 -- 172.21.15.72:0/3562142596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c700cbf30 con 0x7f5c700b8aa0 2023-08-25T04:45:30.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.032+0000 7f5c5effd700 1 -- 172.21.15.72:0/3562142596 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c60013b20 con 0x7f5c700b8aa0 2023-08-25T04:45:30.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.032+0000 7f5c74dff700 1 -- 172.21.15.72:0/3562142596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c700cc4f0 con 0x7f5c700b8aa0 2023-08-25T04:45:30.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.033+0000 7f5c74dff700 1 -- 172.21.15.72:0/3562142596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7006a2f0 con 0x7f5c700b8aa0 2023-08-25T04:45:30.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.034+0000 7f5c5effd700 1 -- 172.21.15.72:0/3562142596 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f5c60013c80 con 0x7f5c700b8aa0 2023-08-25T04:45:30.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.035+0000 7f5c5effd700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c5006a050 0x7f5c5006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.035+0000 7f5c5effd700 1 -- 172.21.15.72:0/3562142596 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5c60087dd0 con 0x7f5c700b8aa0 2023-08-25T04:45:30.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.035+0000 7f5c6dd9b700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c5006a050 0x7f5c5006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.035+0000 7f5c6dd9b700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c5006a050 0x7f5c5006c510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c700b8ec0 tx=0x7f5c64008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:30.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.039+0000 7f5c5effd700 1 -- 172.21.15.72:0/3562142596 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5c60053860 con 0x7f5c700b8aa0 2023-08-25T04:45:30.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.160+0000 7f5c5effd700 1 -- 172.21.15.72:0/3562142596 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5c60053c30 con 0x7f5c700b8aa0 2023-08-25T04:45:30.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.244+0000 7f5c74dff700 1 -- 172.21.15.72:0/3562142596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c7008a000 con 0x7f5c700b8aa0 2023-08-25T04:45:30.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.245+0000 7f5c5effd700 1 -- 172.21.15.72:0/3562142596 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c600572f0 con 0x7f5c700b8aa0 2023-08-25T04:45:30.246 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:45:30.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 -- 172.21.15.72:0/3562142596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c5006a050 msgr2=0x7f5c5006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c5006a050 0x7f5c5006c510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c700b8ec0 tx=0x7f5c64008030 comp rx=0 tx=0).stop 2023-08-25T04:45:30.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 -- 172.21.15.72:0/3562142596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 msgr2=0x7f5c700a9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 0x7f5c700a9780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000e810 tx=0x7f5c6000ebd0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 -- 172.21.15.72:0/3562142596 shutdown_connections 2023-08-25T04:45:30.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c5006a050 0x7f5c5006c510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c7015d090 0x7f5c701f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c700b8aa0 0x7f5c700a9780 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 --2- 172.21.15.72:0/3562142596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c700ce090 0x7f5c7014e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 -- 172.21.15.72:0/3562142596 >> 172.21.15.72:0/3562142596 conn(0x7f5c70071e10 msgr2=0x7f5c7015f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:30.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 -- 172.21.15.72:0/3562142596 shutdown_connections 2023-08-25T04:45:30.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.247+0000 7f5c74dff700 1 -- 172.21.15.72:0/3562142596 wait complete. 2023-08-25T04:45:30.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:45:30.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.460+0000 7f240a5ff700 1 Processor -- start 2023-08-25T04:45:30.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.460+0000 7f240a5ff700 1 -- start start 2023-08-25T04:45:30.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.461+0000 7f240a5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240415ce60 0x7f24040d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.461+0000 7f240a5ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f24040cda40 0x7f24040cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.461+0000 7f240a5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24040d1fe0 con 0x7f24040b8770 2023-08-25T04:45:30.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.461+0000 7f240a5ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24040d2b80 con 0x7f24040cda40 2023-08-25T04:45:30.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.461+0000 7f240a5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24040ce410 con 0x7f240415ce60 2023-08-25T04:45:30.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f24037fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f24040b8770 0x7f24040d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51754/0 (socket says 172.21.15.72:51754) 2023-08-25T04:45:30.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f24037fe700 1 -- 172.21.15.72:0/3117232264 learned_addr learned my addr 172.21.15.72:0/3117232264 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:30.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f2408b9c700 1 --2- 172.21.15.72:0/3117232264 >> v2:172.21.15.137:3300/0 conn(0x7f24040cda40 0x7f24040cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f2403fff700 1 --2- 172.21.15.72:0/3117232264 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240415ce60 0x7f24040d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f2402ffd700 1 -- 172.21.15.72:0/3117232264 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313869797 0 0) 0x7f24040d1fe0 con 0x7f24040b8770 2023-08-25T04:45:30.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f2402ffd700 1 -- 172.21.15.72:0/3117232264 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f00035b0 con 0x7f24040b8770 2023-08-25T04:45:30.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f2402ffd700 1 -- 172.21.15.72:0/3117232264 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1280335631 0 0) 0x7f23f00035b0 con 0x7f24040b8770 2023-08-25T04:45:30.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f2408b9c700 1 -- 172.21.15.72:0/3117232264 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240415ce60 msgr2=0x7f24040d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:30.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f2408b9c700 1 --2- 172.21.15.72:0/3117232264 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240415ce60 0x7f24040d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f2408b9c700 1 -- 172.21.15.72:0/3117232264 >> v1:172.21.15.72:6789/0 conn(0x7f24040b8770 legacy=0x7f24040d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f2408b9c700 1 -- 172.21.15.72:0/3117232264 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24040d13d0 con 0x7f24040cda40 2023-08-25T04:45:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.462+0000 7f2403fff700 1 --2- 172.21.15.72:0/3117232264 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240415ce60 0x7f24040d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.463+0000 7f2408b9c700 1 --2- 172.21.15.72:0/3117232264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24040cda40 0x7f24040cded0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009d90 tx=0x7f23fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b058a7ce579c5a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.463+0000 7f2402ffd700 1 -- 172.21.15.72:0/3117232264 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc00e070 con 0x7f24040cda40 2023-08-25T04:45:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.463+0000 7f2402ffd700 1 -- 172.21.15.72:0/3117232264 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc003a20 con 0x7f24040cda40 2023-08-25T04:45:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.463+0000 7f2402ffd700 1 -- 172.21.15.72:0/3117232264 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec001670 con 0x7f24040cda40 2023-08-25T04:45:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.463+0000 7f240a5ff700 1 -- 172.21.15.72:0/3117232264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24040cda40 msgr2=0x7f24040cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.463+0000 7f240a5ff700 1 --2- 172.21.15.72:0/3117232264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24040cda40 0x7f24040cded0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009d90 tx=0x7f23fc00b330 comp rx=0 tx=0).stop 2023-08-25T04:45:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.464+0000 7f240a5ff700 1 -- 172.21.15.72:0/3117232264 shutdown_connections 2023-08-25T04:45:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.464+0000 7f240a5ff700 1 --2- 172.21.15.72:0/3117232264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24040cda40 0x7f24040cded0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.464+0000 7f240a5ff700 1 --2- 172.21.15.72:0/3117232264 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f240415ce60 0x7f24040d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.464+0000 7f240a5ff700 1 -- 172.21.15.72:0/3117232264 >> 172.21.15.72:0/3117232264 conn(0x7f2404071e10 msgr2=0x7f2404072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.464+0000 7f240a5ff700 1 -- 172.21.15.72:0/3117232264 shutdown_connections 2023-08-25T04:45:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.464+0000 7f240a5ff700 1 -- 172.21.15.72:0/3117232264 wait complete. 2023-08-25T04:45:30.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.465+0000 7f240a5ff700 1 Processor -- start 2023-08-25T04:45:30.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.465+0000 7f240a5ff700 1 -- start start 2023-08-25T04:45:30.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.466+0000 7f240a5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24040b8770 0x7f240415db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.466+0000 7f240a5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24040cda40 0x7f24040cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.466+0000 7f240a5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240415ce60 0x7f24040a9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.466+0000 7f240a5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240414eeb0 con 0x7f24040cda40 2023-08-25T04:45:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.466+0000 7f240a5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24040ccc40 con 0x7f240415ce60 2023-08-25T04:45:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.466+0000 7f240a5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240415e1d0 con 0x7f24040b8770 2023-08-25T04:45:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f24037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24040cda40 0x7f24040cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f24037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24040cda40 0x7f24040cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60380/0 (socket says 172.21.15.72:60380) 2023-08-25T04:45:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f24037fe700 1 -- 172.21.15.72:0/1442793761 learned_addr learned my addr 172.21.15.72:0/1442793761 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f2403fff700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24040b8770 0x7f240415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f2408b9c700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240415ce60 0x7f24040a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f24037fe700 1 -- 172.21.15.72:0/1442793761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24040b8770 msgr2=0x7f240415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f24037fe700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24040b8770 0x7f240415db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f24037fe700 1 -- 172.21.15.72:0/1442793761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240415ce60 msgr2=0x7f24040a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f24037fe700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240415ce60 0x7f24040a9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f24037fe700 1 -- 172.21.15.72:0/1442793761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f40094a0 con 0x7f24040cda40 2023-08-25T04:45:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f2408b9c700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240415ce60 0x7f24040a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:30.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f24037fe700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24040cda40 0x7f24040cc700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00c750 tx=0x7f23ec00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:30.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.467+0000 7f2400ff9700 1 -- 172.21.15.72:0/1442793761 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec004c80 con 0x7f24040cda40 2023-08-25T04:45:30.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.468+0000 7f2400ff9700 1 -- 172.21.15.72:0/1442793761 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec004de0 con 0x7f24040cda40 2023-08-25T04:45:30.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.468+0000 7f240a5ff700 1 -- 172.21.15.72:0/1442793761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc009a70 con 0x7f24040cda40 2023-08-25T04:45:30.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.468+0000 7f2400ff9700 1 -- 172.21.15.72:0/1442793761 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec0072d0 con 0x7f24040cda40 2023-08-25T04:45:30.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.468+0000 7f240a5ff700 1 -- 172.21.15.72:0/1442793761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240415e790 con 0x7f24040cda40 2023-08-25T04:45:30.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.469+0000 7f240a5ff700 1 -- 172.21.15.72:0/1442793761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240404e620 con 0x7f24040cda40 2023-08-25T04:45:30.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.469+0000 7f2400ff9700 1 -- 172.21.15.72:0/1442793761 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f23ec007430 con 0x7f24040cda40 2023-08-25T04:45:30.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.470+0000 7f2400ff9700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f23e406a0e0 0x7f23e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.470+0000 7f2400ff9700 1 -- 172.21.15.72:0/1442793761 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f23ec087ff0 con 0x7f24040cda40 2023-08-25T04:45:30.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.471+0000 7f2403fff700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f23e406a0e0 0x7f23e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.471+0000 7f2403fff700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f23e406a0e0 0x7f23e406c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009d70 tx=0x7f23f4009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.475+0000 7f2400ff9700 1 -- 172.21.15.72:0/1442793761 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f23ec0539f0 con 0x7f24040cda40 2023-08-25T04:45:30.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.674+0000 7f240a5ff700 1 -- 172.21.15.72:0/1442793761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f24040722f0 con 0x7f24040cda40 2023-08-25T04:45:30.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.674+0000 7f2400ff9700 1 -- 172.21.15.72:0/1442793761 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f23ec057010 con 0x7f24040cda40 2023-08-25T04:45:30.675 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:30.676 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-25T04:45:30.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:45:30.676 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-25T04:45:30.676 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-25T04:45:30.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:45:30.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:45:30.676 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-25T04:45:30.676 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-08-25T04:45:30.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:45:30.677 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-25T04:45:30.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 -- 172.21.15.72:0/1442793761 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f23e406a0e0 msgr2=0x7f23e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f23e406a0e0 0x7f23e406c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009d70 tx=0x7f23f4009210 comp rx=0 tx=0).stop 2023-08-25T04:45:30.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 -- 172.21.15.72:0/1442793761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24040cda40 msgr2=0x7f24040cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24040cda40 0x7f24040cc700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00c750 tx=0x7f23ec00ca60 comp rx=0 tx=0).stop 2023-08-25T04:45:30.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 -- 172.21.15.72:0/1442793761 shutdown_connections 2023-08-25T04:45:30.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f23e406a0e0 0x7f23e406c5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240415ce60 0x7f24040a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f24040b8770 0x7f240415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 --2- 172.21.15.72:0/1442793761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24040cda40 0x7f24040cc700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 -- 172.21.15.72:0/1442793761 >> 172.21.15.72:0/1442793761 conn(0x7f2404071e10 msgr2=0x7f24040d2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:30.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 -- 172.21.15.72:0/1442793761 shutdown_connections 2023-08-25T04:45:30.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.677+0000 7f240a5ff700 1 -- 172.21.15.72:0/1442793761 wait complete. 2023-08-25T04:45:30.695 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:45:30.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:45:30.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.894+0000 7f88ec5ff700 1 Processor -- start 2023-08-25T04:45:30.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.894+0000 7f88ec5ff700 1 -- start start 2023-08-25T04:45:30.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.895+0000 7f88ec5ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f88e415d000 0x7f88e40d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.895+0000 7f88ec5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e40b5e80 0x7f88e40cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.895+0000 7f88ec5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e40d1fb0 con 0x7f88e40d2890 2023-08-25T04:45:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.895+0000 7f88ec5ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e415d3e0 con 0x7f88e415d000 2023-08-25T04:45:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.895+0000 7f88ec5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e4160b80 con 0x7f88e40b5e80 2023-08-25T04:45:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.896+0000 7f88eab9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f88e40d2890 0x7f88e40b4900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51762/0 (socket says 172.21.15.72:51762) 2023-08-25T04:45:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.896+0000 7f88eab9c700 1 -- 172.21.15.72:0/1356772914 learned_addr learned my addr 172.21.15.72:0/1356772914 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.896+0000 7f88e9b9a700 1 --2- 172.21.15.72:0/1356772914 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e40b5e80 0x7f88e40cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.896+0000 7f88ea39b700 1 --2- 172.21.15.72:0/1356772914 >> v2:172.21.15.137:3300/0 conn(0x7f88e415d000 0x7f88e40d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.896+0000 7f88e9399700 1 -- 172.21.15.72:0/1356772914 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208207667 0 0) 0x7f88e40d1fb0 con 0x7f88e40d2890 2023-08-25T04:45:30.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.896+0000 7f88e9b9a700 1 -- 172.21.15.72:0/1356772914 >> v2:172.21.15.137:3300/0 conn(0x7f88e415d000 msgr2=0x7f88e40d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:30.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.896+0000 7f88e9b9a700 1 --2- 172.21.15.72:0/1356772914 >> v2:172.21.15.137:3300/0 conn(0x7f88e415d000 0x7f88e40d2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.896+0000 7f88e9b9a700 1 -- 172.21.15.72:0/1356772914 >> v1:172.21.15.72:6789/0 conn(0x7f88e40d2890 legacy=0x7f88e40b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.896+0000 7f88e9b9a700 1 -- 172.21.15.72:0/1356772914 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e4160e60 con 0x7f88e40b5e80 2023-08-25T04:45:30.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88e9b9a700 1 --2- 172.21.15.72:0/1356772914 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e40b5e80 0x7f88e40cf890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009840 tx=0x7f88d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ee0fd638eb4d2d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:30.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88e9399700 1 -- 172.21.15.72:0/1356772914 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4011830 con 0x7f88e40b5e80 2023-08-25T04:45:30.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88e9399700 1 -- 172.21.15.72:0/1356772914 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d4011990 con 0x7f88e40b5e80 2023-08-25T04:45:30.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88e9399700 1 -- 172.21.15.72:0/1356772914 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4011d20 con 0x7f88e40b5e80 2023-08-25T04:45:30.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88ec5ff700 1 -- 172.21.15.72:0/1356772914 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e40b5e80 msgr2=0x7f88e40cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88ec5ff700 1 --2- 172.21.15.72:0/1356772914 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e40b5e80 0x7f88e40cf890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009840 tx=0x7f88d4009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:30.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88ec5ff700 1 -- 172.21.15.72:0/1356772914 shutdown_connections 2023-08-25T04:45:30.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88ec5ff700 1 --2- 172.21.15.72:0/1356772914 >> v2:172.21.15.137:3300/0 conn(0x7f88e415d000 0x7f88e40d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88ec5ff700 1 --2- 172.21.15.72:0/1356772914 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e40b5e80 0x7f88e40cf890 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88ec5ff700 1 -- 172.21.15.72:0/1356772914 >> 172.21.15.72:0/1356772914 conn(0x7f88e406ba80 msgr2=0x7f88e406be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:30.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.897+0000 7f88ec5ff700 1 -- 172.21.15.72:0/1356772914 shutdown_connections 2023-08-25T04:45:30.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.898+0000 7f88ec5ff700 1 -- 172.21.15.72:0/1356772914 wait complete. 2023-08-25T04:45:30.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.899+0000 7f88ec5ff700 1 Processor -- start 2023-08-25T04:45:30.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.899+0000 7f88ec5ff700 1 -- start start 2023-08-25T04:45:30.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.900+0000 7f88ec5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88e40b5e80 0x7f88e41505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.900+0000 7f88ec5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88e40d2890 0x7f88e40b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.900+0000 7f88ec5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e415d000 0x7f88e40cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.900+0000 7f88ec5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40b4c50 con 0x7f88e40b5e80 2023-08-25T04:45:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.900+0000 7f88ec5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40b4040 con 0x7f88e40d2890 2023-08-25T04:45:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.900+0000 7f88ec5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40b4320 con 0x7f88e415d000 2023-08-25T04:45:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.900+0000 7f88ea39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88e40b5e80 0x7f88e41505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.900+0000 7f88ea39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88e40b5e80 0x7f88e41505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60396/0 (socket says 172.21.15.72:60396) 2023-08-25T04:45:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88ea39b700 1 -- 172.21.15.72:0/681296638 learned_addr learned my addr 172.21.15.72:0/681296638 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88e9b9a700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88e40d2890 0x7f88e40b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88eab9c700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e415d000 0x7f88e40cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88ea39b700 1 -- 172.21.15.72:0/681296638 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e415d000 msgr2=0x7f88e40cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88ea39b700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e415d000 0x7f88e40cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88ea39b700 1 -- 172.21.15.72:0/681296638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88e40d2890 msgr2=0x7f88e40b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88ea39b700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88e40d2890 0x7f88e40b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88ea39b700 1 -- 172.21.15.72:0/681296638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d40094a0 con 0x7f88e40b5e80 2023-08-25T04:45:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88eab9c700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e415d000 0x7f88e40cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88ea39b700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88e40b5e80 0x7f88e41505a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f88e000e870 tx=0x7f88e000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88daffd700 1 -- 172.21.15.72:0/681296638 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0009590 con 0x7f88e40b5e80 2023-08-25T04:45:30.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88daffd700 1 -- 172.21.15.72:0/681296638 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e000ee70 con 0x7f88e40b5e80 2023-08-25T04:45:30.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88ec5ff700 1 -- 172.21.15.72:0/681296638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e40b4600 con 0x7f88e40b5e80 2023-08-25T04:45:30.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.901+0000 7f88daffd700 1 -- 172.21.15.72:0/681296638 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000ca50 con 0x7f88e40b5e80 2023-08-25T04:45:30.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.902+0000 7f88ec5ff700 1 -- 172.21.15.72:0/681296638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e40b3cd0 con 0x7f88e40b5e80 2023-08-25T04:45:30.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.902+0000 7f88ec5ff700 1 -- 172.21.15.72:0/681296638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e40b4f30 con 0x7f88e40b5e80 2023-08-25T04:45:30.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.903+0000 7f88daffd700 1 -- 172.21.15.72:0/681296638 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f88e000cbb0 con 0x7f88e40b5e80 2023-08-25T04:45:30.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.904+0000 7f88daffd700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f88c806a0e0 0x7f88c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:30.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.904+0000 7f88daffd700 1 -- 172.21.15.72:0/681296638 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f88e0088240 con 0x7f88e40b5e80 2023-08-25T04:45:30.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.904+0000 7f88e9b9a700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f88c806a0e0 0x7f88c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:30.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.905+0000 7f88e9b9a700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f88c806a0e0 0x7f88c806c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88e40b6260 tx=0x7f88d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:30.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:30.909+0000 7f88daffd700 1 -- 172.21.15.72:0/681296638 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f88e0057710 con 0x7f88e40b5e80 2023-08-25T04:45:31.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:31.084 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:31.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.111+0000 7f88ec5ff700 1 -- 172.21.15.72:0/681296638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f88e404e690 con 0x7f88e40b5e80 2023-08-25T04:45:31.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.207+0000 7f88daffd700 1 -- 172.21.15.72:0/681296638 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f88e000ce60 con 0x7f88e40b5e80 2023-08-25T04:45:31.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.211+0000 7f88ec5ff700 1 -- 172.21.15.72:0/681296638 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f88c806a0e0 msgr2=0x7f88c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:31.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.211+0000 7f88ec5ff700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f88c806a0e0 0x7f88c806c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88e40b6260 tx=0x7f88d4008030 comp rx=0 tx=0).stop 2023-08-25T04:45:31.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.211+0000 7f88ec5ff700 1 -- 172.21.15.72:0/681296638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88e40b5e80 msgr2=0x7f88e41505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:31.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.211+0000 7f88ec5ff700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88e40b5e80 0x7f88e41505a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f88e000e870 tx=0x7f88e000ec30 comp rx=0 tx=0).stop 2023-08-25T04:45:31.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.212+0000 7f88ec5ff700 1 -- 172.21.15.72:0/681296638 shutdown_connections 2023-08-25T04:45:31.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.212+0000 7f88ec5ff700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f88c806a0e0 0x7f88c806c5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:31.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.212+0000 7f88ec5ff700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88e415d000 0x7f88e40cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:31.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.212+0000 7f88ec5ff700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88e40b5e80 0x7f88e41505a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:31.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.212+0000 7f88ec5ff700 1 --2- 172.21.15.72:0/681296638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88e40d2890 0x7f88e40b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:31.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.212+0000 7f88ec5ff700 1 -- 172.21.15.72:0/681296638 >> 172.21.15.72:0/681296638 conn(0x7f88e406ba80 msgr2=0x7f88e40b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:31.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.212+0000 7f88ec5ff700 1 -- 172.21.15.72:0/681296638 shutdown_connections 2023-08-25T04:45:31.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.212+0000 7f88ec5ff700 1 -- 172.21.15.72:0/681296638 wait complete. 2023-08-25T04:45:31.218 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-25T04:45:31.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-08-25T04:45:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.474+0000 7fd76fdff700 1 Processor -- start 2023-08-25T04:45:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.474+0000 7fd76fdff700 1 -- start start 2023-08-25T04:45:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.475+0000 7fd76fdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd7680b18f0 0x7fd7680b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.475+0000 7fd76fdff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd76815d370 0x7fd76806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76fdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7680b2210 con 0x7fd76806a830 2023-08-25T04:45:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76fdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76815dfe0 con 0x7fd7680b18f0 2023-08-25T04:45:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76fdff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd768070500 con 0x7fd76815d370 2023-08-25T04:45:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76db9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd7680b18f0 0x7fd7680b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:31.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76e39c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd76806a830 0x7fd7680cc480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51768/0 (socket says 172.21.15.72:51768) 2023-08-25T04:45:31.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76e39c700 1 -- 172.21.15.72:0/400606471 learned_addr learned my addr 172.21.15.72:0/400606471 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:31.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76d39a700 1 --2- 172.21.15.72:0/400606471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd76815d370 0x7fd76806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76db9b700 1 -- 172.21.15.72:0/400606471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd76815d370 msgr2=0x7fd76806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76db9b700 1 --2- 172.21.15.72:0/400606471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd76815d370 0x7fd76806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76db9b700 1 -- 172.21.15.72:0/400606471 >> v1:172.21.15.72:6789/0 conn(0x7fd76806a830 legacy=0x7fd7680cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76db9b700 1 -- 172.21.15.72:0/400606471 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76806acd0 con 0x7fd7680b18f0 2023-08-25T04:45:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76d39a700 1 --2- 172.21.15.72:0/400606471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd76815d370 0x7fd76806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.476+0000 7fd76cb99700 1 -- 172.21.15.72:0/400606471 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002058604 0 0) 0x7fd7680b2210 con 0x7fd76806a830 2023-08-25T04:45:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76db9b700 1 --2- 172.21.15.72:0/400606471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7680b18f0 0x7fd7680b1cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd764009840 tx=0x7fd764009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35992dbe60b06ed8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76cb99700 1 -- 172.21.15.72:0/400606471 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764011830 con 0x7fd7680b18f0 2023-08-25T04:45:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76cb99700 1 -- 172.21.15.72:0/400606471 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd764011990 con 0x7fd7680b18f0 2023-08-25T04:45:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76cb99700 1 -- 172.21.15.72:0/400606471 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764011d20 con 0x7fd7680b18f0 2023-08-25T04:45:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76fdff700 1 -- 172.21.15.72:0/400606471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7680b18f0 msgr2=0x7fd7680b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76fdff700 1 --2- 172.21.15.72:0/400606471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7680b18f0 0x7fd7680b1cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd764009840 tx=0x7fd764009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76fdff700 1 -- 172.21.15.72:0/400606471 shutdown_connections 2023-08-25T04:45:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76fdff700 1 --2- 172.21.15.72:0/400606471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7680b18f0 0x7fd7680b1cd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76fdff700 1 --2- 172.21.15.72:0/400606471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd76815d370 0x7fd76806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76fdff700 1 -- 172.21.15.72:0/400606471 >> 172.21.15.72:0/400606471 conn(0x7fd76806daa0 msgr2=0x7fd76806de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.477+0000 7fd76fdff700 1 -- 172.21.15.72:0/400606471 shutdown_connections 2023-08-25T04:45:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.478+0000 7fd76fdff700 1 -- 172.21.15.72:0/400606471 wait complete. 2023-08-25T04:45:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.479+0000 7fd76fdff700 1 Processor -- start 2023-08-25T04:45:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.479+0000 7fd76fdff700 1 -- start start 2023-08-25T04:45:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.480+0000 7fd76fdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76806a830 0x7fd768155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.480+0000 7fd76fdff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7680b18f0 0x7fd768160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.480+0000 7fd76fdff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd76815d370 0x7fd7680b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.480+0000 7fd76fdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681555a0 con 0x7fd76806a830 2023-08-25T04:45:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.480+0000 7fd76fdff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7680c4f50 con 0x7fd76815d370 2023-08-25T04:45:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.480+0000 7fd76fdff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7680c51f0 con 0x7fd7680b18f0 2023-08-25T04:45:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd76db9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76806a830 0x7fd768155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd76db9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76806a830 0x7fd768155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60408/0 (socket says 172.21.15.72:60408) 2023-08-25T04:45:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd76db9b700 1 -- 172.21.15.72:0/1671974529 learned_addr learned my addr 172.21.15.72:0/1671974529 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd76db9b700 1 -- 172.21.15.72:0/1671974529 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7680b18f0 msgr2=0x7fd768160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd76db9b700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7680b18f0 0x7fd768160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd76db9b700 1 -- 172.21.15.72:0/1671974529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd76815d370 msgr2=0x7fd7680b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd76db9b700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd76815d370 0x7fd7680b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd76db9b700 1 -- 172.21.15.72:0/1671974529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7640094a0 con 0x7fd76806a830 2023-08-25T04:45:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd76db9b700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76806a830 0x7fd768155060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd764000c00 tx=0x7fd764004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd75e7fc700 1 -- 172.21.15.72:0/1671974529 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640036a0 con 0x7fd76806a830 2023-08-25T04:45:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd75e7fc700 1 -- 172.21.15.72:0/1671974529 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76401e070 con 0x7fd76806a830 2023-08-25T04:45:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd76fdff700 1 -- 172.21.15.72:0/1671974529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7680c54d0 con 0x7fd76806a830 2023-08-25T04:45:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.481+0000 7fd75e7fc700 1 -- 172.21.15.72:0/1671974529 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764003a60 con 0x7fd76806a830 2023-08-25T04:45:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.482+0000 7fd76fdff700 1 -- 172.21.15.72:0/1671974529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7680c5a90 con 0x7fd76806a830 2023-08-25T04:45:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.483+0000 7fd76fdff700 1 -- 172.21.15.72:0/1671974529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76804e620 con 0x7fd76806a830 2023-08-25T04:45:31.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.484+0000 7fd75e7fc700 1 -- 172.21.15.72:0/1671974529 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd764003bc0 con 0x7fd76806a830 2023-08-25T04:45:31.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.485+0000 7fd75e7fc700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd74c06a0e0 0x7fd74c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:31.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.485+0000 7fd75e7fc700 1 -- 172.21.15.72:0/1671974529 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fd7640893d0 con 0x7fd76806a830 2023-08-25T04:45:31.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.485+0000 7fd76d39a700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd74c06a0e0 0x7fd74c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:31.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.485+0000 7fd76d39a700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd74c06a0e0 0x7fd74c06c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd758006fd0 tx=0x7fd758008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:31.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.490+0000 7fd75e7fc700 1 -- 172.21.15.72:0/1671974529 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd764054d30 con 0x7fd76806a830 2023-08-25T04:45:31.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:31.691+0000 7fd76fdff700 1 -- 172.21.15.72:0/1671974529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fd7680b16d0 con 0x7fd76806a830 2023-08-25T04:45:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.213+0000 7fd75e7fc700 1 -- 172.21.15.72:0/1671974529 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fd764058350 con 0x7fd76806a830 2023-08-25T04:45:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.224+0000 7fd76fdff700 1 -- 172.21.15.72:0/1671974529 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd74c06a0e0 msgr2=0x7fd74c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.224+0000 7fd76fdff700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd74c06a0e0 0x7fd74c06c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd758006fd0 tx=0x7fd758008040 comp rx=0 tx=0).stop 2023-08-25T04:45:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.224+0000 7fd76fdff700 1 -- 172.21.15.72:0/1671974529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76806a830 msgr2=0x7fd768155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.224+0000 7fd76fdff700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76806a830 0x7fd768155060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd764000c00 tx=0x7fd764004750 comp rx=0 tx=0).stop 2023-08-25T04:45:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.224+0000 7fd76fdff700 1 -- 172.21.15.72:0/1671974529 shutdown_connections 2023-08-25T04:45:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.224+0000 7fd76fdff700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd74c06a0e0 0x7fd74c06c5a0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd758006fd0 tx=0x7fd758008040 comp rx=0 tx=0).stop 2023-08-25T04:45:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.224+0000 7fd76fdff700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd76815d370 0x7fd7680b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.224+0000 7fd76fdff700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76806a830 0x7fd768155060 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.224+0000 7fd76fdff700 1 --2- 172.21.15.72:0/1671974529 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7680b18f0 0x7fd768160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.224+0000 7fd76fdff700 1 -- 172.21.15.72:0/1671974529 >> 172.21.15.72:0/1671974529 conn(0x7fd76806daa0 msgr2=0x7fd7680ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:32.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.229+0000 7fd76fdff700 1 -- 172.21.15.72:0/1671974529 shutdown_connections 2023-08-25T04:45:32.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.231+0000 7fd76fdff700 1 -- 172.21.15.72:0/1671974529 wait complete. 2023-08-25T04:45:32.237 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-25T04:45:32.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:45:32.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.455+0000 7fe93a5ff700 1 Processor -- start 2023-08-25T04:45:32.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.455+0000 7fe93a5ff700 1 -- start start 2023-08-25T04:45:32.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.456+0000 7fe93a5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 0x7fe9340d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.456+0000 7fe93a5ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe9340ce260 0x7fe9340b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.456+0000 7fe93a5ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93415d470 con 0x7fe9340b8aa0 2023-08-25T04:45:32.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.456+0000 7fe93a5ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9340d17e0 con 0x7fe9340ce260 2023-08-25T04:45:32.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.456+0000 7fe93a5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340d1ac0 con 0x7fe93415d090 2023-08-25T04:45:32.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.457+0000 7fe933fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 0x7fe9340d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.457+0000 7fe938b9c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe9340ce260 0x7fe9340b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.457+0000 7fe9337fe700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe9340b8aa0 0x7fe9340cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:54968/0 (socket says 172.21.15.72:54968) 2023-08-25T04:45:32.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.457+0000 7fe938b9c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe9340ce260 0x7fe9340b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:37796/0 (socket says 172.21.15.72:37796) 2023-08-25T04:45:32.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.457+0000 7fe9337fe700 1 -- 172.21.15.72:0/2019734404 learned_addr learned my addr 172.21.15.72:0/2019734404 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:32.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.457+0000 7fe932ffd700 1 -- 172.21.15.72:0/2019734404 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30335025 0 0) 0x7fe93415d470 con 0x7fe9340b8aa0 2023-08-25T04:45:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.457+0000 7fe932ffd700 1 -- 172.21.15.72:0/2019734404 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe91c0035b0 con 0x7fe9340b8aa0 2023-08-25T04:45:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.458+0000 7fe933fff700 1 -- 172.21.15.72:0/2019734404 >> v2:172.21.15.137:3300/0 conn(0x7fe9340ce260 msgr2=0x7fe9340b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.458+0000 7fe933fff700 1 --2- 172.21.15.72:0/2019734404 >> v2:172.21.15.137:3300/0 conn(0x7fe9340ce260 0x7fe9340b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.458+0000 7fe933fff700 1 -- 172.21.15.72:0/2019734404 >> v1:172.21.15.137:6789/0 conn(0x7fe9340b8aa0 legacy=0x7fe9340cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.458+0000 7fe933fff700 1 -- 172.21.15.72:0/2019734404 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9340d1da0 con 0x7fe93415d090 2023-08-25T04:45:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.458+0000 7fe938b9c700 1 --2- 172.21.15.72:0/2019734404 >> v2:172.21.15.137:3300/0 conn(0x7fe9340ce260 0x7fe9340b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.458+0000 7fe933fff700 1 --2- 172.21.15.72:0/2019734404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 0x7fe9340d0e70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe924009840 tx=0x7fe924009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89a917b0d2028344 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:32.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.458+0000 7fe932ffd700 1 -- 172.21.15.72:0/2019734404 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924011830 con 0x7fe93415d090 2023-08-25T04:45:32.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.458+0000 7fe932ffd700 1 -- 172.21.15.72:0/2019734404 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe924011990 con 0x7fe93415d090 2023-08-25T04:45:32.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.458+0000 7fe932ffd700 1 -- 172.21.15.72:0/2019734404 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924011d20 con 0x7fe93415d090 2023-08-25T04:45:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.459+0000 7fe93a5ff700 1 -- 172.21.15.72:0/2019734404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 msgr2=0x7fe9340d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.459+0000 7fe93a5ff700 1 --2- 172.21.15.72:0/2019734404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 0x7fe9340d0e70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe924009840 tx=0x7fe924009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.459+0000 7fe93a5ff700 1 -- 172.21.15.72:0/2019734404 shutdown_connections 2023-08-25T04:45:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.459+0000 7fe93a5ff700 1 --2- 172.21.15.72:0/2019734404 >> v2:172.21.15.137:3300/0 conn(0x7fe9340ce260 0x7fe9340b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.459+0000 7fe93a5ff700 1 --2- 172.21.15.72:0/2019734404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 0x7fe9340d0e70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.459+0000 7fe93a5ff700 1 -- 172.21.15.72:0/2019734404 >> 172.21.15.72:0/2019734404 conn(0x7fe934071e10 msgr2=0x7fe934072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:32.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.459+0000 7fe93a5ff700 1 -- 172.21.15.72:0/2019734404 shutdown_connections 2023-08-25T04:45:32.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.459+0000 7fe93a5ff700 1 -- 172.21.15.72:0/2019734404 wait complete. 2023-08-25T04:45:32.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.460+0000 7fe93a5ff700 1 Processor -- start 2023-08-25T04:45:32.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.461+0000 7fe93a5ff700 1 -- start start 2023-08-25T04:45:32.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe93a5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9340b8aa0 0x7fe9340cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe93a5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9340ce260 0x7fe9341541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe93a5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 0x7fe9340c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe93a5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340c69e0 con 0x7fe9340ce260 2023-08-25T04:45:32.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe93a5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340cbf00 con 0x7fe9340b8aa0 2023-08-25T04:45:32.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe93a5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9340cc1e0 con 0x7fe93415d090 2023-08-25T04:45:32.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe933fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9340b8aa0 0x7fe9340cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe9337fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9340ce260 0x7fe9341541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe933fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9340b8aa0 0x7fe9340cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:37808/0 (socket says 172.21.15.72:37808) 2023-08-25T04:45:32.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe933fff700 1 -- 172.21.15.72:0/3803526116 learned_addr learned my addr 172.21.15.72:0/3803526116 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:32.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe938b9c700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 0x7fe9340c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe9337fe700 1 -- 172.21.15.72:0/3803526116 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 msgr2=0x7fe9340c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe9337fe700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 0x7fe9340c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe9337fe700 1 -- 172.21.15.72:0/3803526116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9340b8aa0 msgr2=0x7fe9340cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:32.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe9337fe700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9340b8aa0 0x7fe9340cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:32.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.462+0000 7fe9337fe700 1 -- 172.21.15.72:0/3803526116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c009a70 con 0x7fe9340ce260 2023-08-25T04:45:32.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.463+0000 7fe9337fe700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9340ce260 0x7fe9341541c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe92800c400 tx=0x7fe92800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:32.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.463+0000 7fe930ff9700 1 -- 172.21.15.72:0/3803526116 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928005d70 con 0x7fe9340ce260 2023-08-25T04:45:32.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.463+0000 7fe930ff9700 1 -- 172.21.15.72:0/3803526116 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92800ce80 con 0x7fe9340ce260 2023-08-25T04:45:32.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.463+0000 7fe93a5ff700 1 -- 172.21.15.72:0/3803526116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9240094a0 con 0x7fe9340ce260 2023-08-25T04:45:32.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.463+0000 7fe930ff9700 1 -- 172.21.15.72:0/3803526116 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9280072f0 con 0x7fe9340ce260 2023-08-25T04:45:32.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.463+0000 7fe93a5ff700 1 -- 172.21.15.72:0/3803526116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9340cc7a0 con 0x7fe9340ce260 2023-08-25T04:45:32.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.464+0000 7fe93a5ff700 1 -- 172.21.15.72:0/3803526116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9340c6b90 con 0x7fe9340ce260 2023-08-25T04:45:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.465+0000 7fe930ff9700 1 -- 172.21.15.72:0/3803526116 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe928007450 con 0x7fe9340ce260 2023-08-25T04:45:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.466+0000 7fe930ff9700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe92006a0e0 0x7fe92006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.466+0000 7fe930ff9700 1 -- 172.21.15.72:0/3803526116 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe9280876a0 con 0x7fe9340ce260 2023-08-25T04:45:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.466+0000 7fe933fff700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe92006a0e0 0x7fe92006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.467+0000 7fe933fff700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe92006a0e0 0x7fe92006c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe924009b90 tx=0x7fe924008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:32.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.471+0000 7fe930ff9700 1 -- 172.21.15.72:0/3803526116 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe9340c6b90 con 0x7fe9340ce260 2023-08-25T04:45:32.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:32.713+0000 7fe93a5ff700 1 -- 172.21.15.72:0/3803526116 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe93406a2f0 con 0x7fe9340ce260 2023-08-25T04:45:33.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.434+0000 7fe930ff9700 1 -- 172.21.15.72:0/3803526116 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe928052df0 con 0x7fe9340ce260 2023-08-25T04:45:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 -- 172.21.15.72:0/3803526116 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe92006a0e0 msgr2=0x7fe92006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe92006a0e0 0x7fe92006c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe924009b90 tx=0x7fe924008030 comp rx=0 tx=0).stop 2023-08-25T04:45:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 -- 172.21.15.72:0/3803526116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9340ce260 msgr2=0x7fe9341541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9340ce260 0x7fe9341541c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe92800c400 tx=0x7fe92800c710 comp rx=0 tx=0).stop 2023-08-25T04:45:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 -- 172.21.15.72:0/3803526116 shutdown_connections 2023-08-25T04:45:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe92006a0e0 0x7fe92006c5a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe93415d090 0x7fe9340c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9340b8aa0 0x7fe9340cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 --2- 172.21.15.72:0/3803526116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9340ce260 0x7fe9341541c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 -- 172.21.15.72:0/3803526116 >> 172.21.15.72:0/3803526116 conn(0x7fe934071e10 msgr2=0x7fe9340cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:33.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 -- 172.21.15.72:0/3803526116 shutdown_connections 2023-08-25T04:45:33.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.437+0000 7fe93a5ff700 1 -- 172.21.15.72:0/3803526116 wait complete. 2023-08-25T04:45:33.440 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 3 and data pool 4 2023-08-25T04:45:33.459 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-08-25T04:45:33.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-08-25T04:45:33.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.660+0000 7fd7a47ff700 1 Processor -- start 2023-08-25T04:45:33.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.660+0000 7fd7a47ff700 1 -- start start 2023-08-25T04:45:33.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.661+0000 7fd7a47ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd79c0adf70 0x7fd79c0cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.661+0000 7fd7a47ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c15a340 con 0x7fd79c0cdee0 2023-08-25T04:45:33.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.661+0000 7fd7a47ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c06a390 con 0x7fd79c159f60 2023-08-25T04:45:33.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.661+0000 7fd7a47ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c06a670 con 0x7fd79c0adf70 2023-08-25T04:45:33.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.661+0000 7fd7a1d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd79c0adf70 0x7fd79c0cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.661+0000 7fd7a2d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd79c0cdee0 0x7fd79c06c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35062/0 (socket says 172.21.15.72:35062) 2023-08-25T04:45:33.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.661+0000 7fd7a2d9c700 1 -- 172.21.15.72:0/315039985 learned_addr learned my addr 172.21.15.72:0/315039985 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.662+0000 7fd7a1d9a700 1 -- 172.21.15.72:0/315039985 >> v1:172.21.15.137:6789/0 conn(0x7fd79c159f60 legacy=0x7fd79c0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.662+0000 7fd7a1d9a700 1 -- 172.21.15.72:0/315039985 >> v1:172.21.15.72:6789/0 conn(0x7fd79c0cdee0 legacy=0x7fd79c06c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.662+0000 7fd7a1d9a700 1 -- 172.21.15.72:0/315039985 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c06a950 con 0x7fd79c0adf70 2023-08-25T04:45:33.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.662+0000 7fd7a1599700 1 -- 172.21.15.72:0/315039985 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24566489 0 0) 0x7fd79c15a340 con 0x7fd79c0cdee0 2023-08-25T04:45:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.662+0000 7fd7a1d9a700 1 --2- 172.21.15.72:0/315039985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 0x7fd79c0cac20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009840 tx=0x7fd78c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c711eb28b6870fe4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.662+0000 7fd7a1599700 1 -- 172.21.15.72:0/315039985 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c011830 con 0x7fd79c0adf70 2023-08-25T04:45:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.662+0000 7fd7a1599700 1 -- 172.21.15.72:0/315039985 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c011990 con 0x7fd79c0adf70 2023-08-25T04:45:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.662+0000 7fd7a1599700 1 -- 172.21.15.72:0/315039985 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c011d20 con 0x7fd79c0adf70 2023-08-25T04:45:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.663+0000 7fd7a47ff700 1 -- 172.21.15.72:0/315039985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 msgr2=0x7fd79c0cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.663+0000 7fd7a47ff700 1 --2- 172.21.15.72:0/315039985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 0x7fd79c0cac20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009840 tx=0x7fd78c009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.663+0000 7fd7a47ff700 1 -- 172.21.15.72:0/315039985 shutdown_connections 2023-08-25T04:45:33.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.663+0000 7fd7a47ff700 1 --2- 172.21.15.72:0/315039985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 0x7fd79c0cac20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.663+0000 7fd7a47ff700 1 -- 172.21.15.72:0/315039985 >> 172.21.15.72:0/315039985 conn(0x7fd79c0ceaa0 msgr2=0x7fd79c0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.663+0000 7fd7a47ff700 1 -- 172.21.15.72:0/315039985 shutdown_connections 2023-08-25T04:45:33.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.663+0000 7fd7a47ff700 1 -- 172.21.15.72:0/315039985 wait complete. 2023-08-25T04:45:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.664+0000 7fd7a47ff700 1 Processor -- start 2023-08-25T04:45:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.665+0000 7fd7a47ff700 1 -- start start 2023-08-25T04:45:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.665+0000 7fd7a47ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 0x7fd79c1e4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.665+0000 7fd7a47ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd79c0cdee0 0x7fd79c1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.665+0000 7fd7a47ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c159f60 0x7fd79c0c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.665+0000 7fd7a47ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0c3080 con 0x7fd79c0adf70 2023-08-25T04:45:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.665+0000 7fd7a47ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0c3360 con 0x7fd79c159f60 2023-08-25T04:45:33.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.665+0000 7fd7a47ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0c3640 con 0x7fd79c0cdee0 2023-08-25T04:45:33.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a259b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 0x7fd79c1e4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a259b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 0x7fd79c1e4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45094/0 (socket says 172.21.15.72:45094) 2023-08-25T04:45:33.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a259b700 1 -- 172.21.15.72:0/3467408957 learned_addr learned my addr 172.21.15.72:0/3467408957 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:33.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a1d9a700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd79c0cdee0 0x7fd79c1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a2d9c700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c159f60 0x7fd79c0c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a259b700 1 -- 172.21.15.72:0/3467408957 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd79c0cdee0 msgr2=0x7fd79c1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a259b700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd79c0cdee0 0x7fd79c1570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a259b700 1 -- 172.21.15.72:0/3467408957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c159f60 msgr2=0x7fd79c0c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:33.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a259b700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c159f60 0x7fd79c0c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:33.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a259b700 1 -- 172.21.15.72:0/3467408957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0094a0 con 0x7fd79c0adf70 2023-08-25T04:45:33.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a2d9c700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c159f60 0x7fd79c0c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:33.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.666+0000 7fd7a259b700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 0x7fd79c1e4360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd79800c700 tx=0x7fd79800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:33.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.667+0000 7fd792ffd700 1 -- 172.21.15.72:0/3467408957 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7980052d0 con 0x7fd79c0adf70 2023-08-25T04:45:33.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.667+0000 7fd792ffd700 1 -- 172.21.15.72:0/3467408957 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd798005430 con 0x7fd79c0adf70 2023-08-25T04:45:33.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.667+0000 7fd792ffd700 1 -- 172.21.15.72:0/3467408957 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798003880 con 0x7fd79c0adf70 2023-08-25T04:45:33.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.667+0000 7fd7a47ff700 1 -- 172.21.15.72:0/3467408957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79c0c3920 con 0x7fd79c0adf70 2023-08-25T04:45:33.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.667+0000 7fd7a47ff700 1 -- 172.21.15.72:0/3467408957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c157600 con 0x7fd79c0adf70 2023-08-25T04:45:33.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.668+0000 7fd7a47ff700 1 -- 172.21.15.72:0/3467408957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c04e690 con 0x7fd79c0adf70 2023-08-25T04:45:33.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.669+0000 7fd792ffd700 1 -- 172.21.15.72:0/3467408957 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd7980039e0 con 0x7fd79c0adf70 2023-08-25T04:45:33.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.669+0000 7fd792ffd700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd78006a110 0x7fd78006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:33.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.670+0000 7fd792ffd700 1 -- 172.21.15.72:0/3467408957 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7980879d0 con 0x7fd79c0adf70 2023-08-25T04:45:33.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.670+0000 7fd7a1d9a700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd78006a110 0x7fd78006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:33.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.670+0000 7fd7a1d9a700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd78006a110 0x7fd78006c5d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0090b0 tx=0x7fd78c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:33.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.674+0000 7fd792ffd700 1 -- 172.21.15.72:0/3467408957 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd798053040 con 0x7fd79c0adf70 2023-08-25T04:45:33.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:33.884+0000 7fd7a47ff700 1 -- 172.21.15.72:0/3467408957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fd79c0c5fc0 con 0x7fd79c0adf70 2023-08-25T04:45:34.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.168+0000 7fd792ffd700 1 -- 172.21.15.72:0/3467408957 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd798056660 con 0x7fd79c0adf70 2023-08-25T04:45:34.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 -- 172.21.15.72:0/3467408957 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd78006a110 msgr2=0x7fd78006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd78006a110 0x7fd78006c5d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0090b0 tx=0x7fd78c01c040 comp rx=0 tx=0).stop 2023-08-25T04:45:34.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 -- 172.21.15.72:0/3467408957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 msgr2=0x7fd79c1e4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 0x7fd79c1e4360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd79800c700 tx=0x7fd79800ca10 comp rx=0 tx=0).stop 2023-08-25T04:45:34.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 -- 172.21.15.72:0/3467408957 shutdown_connections 2023-08-25T04:45:34.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd78006a110 0x7fd78006c5d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c159f60 0x7fd79c0c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd79c0adf70 0x7fd79c1e4360 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 --2- 172.21.15.72:0/3467408957 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd79c0cdee0 0x7fd79c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 -- 172.21.15.72:0/3467408957 >> 172.21.15.72:0/3467408957 conn(0x7fd79c0ceaa0 msgr2=0x7fd79c0cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:34.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 -- 172.21.15.72:0/3467408957 shutdown_connections 2023-08-25T04:45:34.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.171+0000 7fd7a47ff700 1 -- 172.21.15.72:0/3467408957 wait complete. 2023-08-25T04:45:34.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:45:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.392+0000 7ff6ed3ff700 1 Processor -- start 2023-08-25T04:45:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.393+0000 7ff6ed3ff700 1 -- start start 2023-08-25T04:45:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6ed3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e815cd40 0x7ff6e80cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6ed3ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6e815d120 0x7ff6e8160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6ed3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6e8161000 0x7ff6e80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6ed3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e8161450 con 0x7ff6e8161000 2023-08-25T04:45:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6ed3ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e80b0260 con 0x7ff6e815d120 2023-08-25T04:45:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6ed3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e806bb60 con 0x7ff6e815cd40 2023-08-25T04:45:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6e77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6e8161000 0x7ff6e80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6e77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6e8161000 0x7ff6e80b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45104/0 (socket says 172.21.15.72:45104) 2023-08-25T04:45:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6e77fe700 1 -- 172.21.15.72:0/1028894947 learned_addr learned my addr 172.21.15.72:0/1028894947 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:34.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6dffff700 1 --2- 172.21.15.72:0/1028894947 >> v2:172.21.15.137:3300/0 conn(0x7ff6e815d120 0x7ff6e8160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6e6ffd700 1 --2- 172.21.15.72:0/1028894947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e815cd40 0x7ff6e80cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.394+0000 7ff6e77fe700 1 -- 172.21.15.72:0/1028894947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e815cd40 msgr2=0x7ff6e80cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.395+0000 7ff6e77fe700 1 --2- 172.21.15.72:0/1028894947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e815cd40 0x7ff6e80cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.395+0000 7ff6e77fe700 1 -- 172.21.15.72:0/1028894947 >> v2:172.21.15.137:3300/0 conn(0x7ff6e815d120 msgr2=0x7ff6e8160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.395+0000 7ff6e77fe700 1 --2- 172.21.15.72:0/1028894947 >> v2:172.21.15.137:3300/0 conn(0x7ff6e815d120 0x7ff6e8160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.395+0000 7ff6e77fe700 1 -- 172.21.15.72:0/1028894947 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8161630 con 0x7ff6e8161000 2023-08-25T04:45:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.395+0000 7ff6e77fe700 1 --2- 172.21.15.72:0/1028894947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e8161000 0x7ff6e80b2620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6e806b2b0 tx=0x7ff6e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b6bdedc2051ba0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.395+0000 7ff6e67fc700 1 -- 172.21.15.72:0/1028894947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e000e070 con 0x7ff6e8161000 2023-08-25T04:45:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.395+0000 7ff6e67fc700 1 -- 172.21.15.72:0/1028894947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e000b9c0 con 0x7ff6e8161000 2023-08-25T04:45:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.395+0000 7ff6e67fc700 1 -- 172.21.15.72:0/1028894947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e000bd70 con 0x7ff6e8161000 2023-08-25T04:45:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.396+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/1028894947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e8161000 msgr2=0x7ff6e80b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.396+0000 7ff6ed3ff700 1 --2- 172.21.15.72:0/1028894947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e8161000 0x7ff6e80b2620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6e806b2b0 tx=0x7ff6e000b330 comp rx=0 tx=0).stop 2023-08-25T04:45:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.396+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/1028894947 shutdown_connections 2023-08-25T04:45:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.396+0000 7ff6ed3ff700 1 --2- 172.21.15.72:0/1028894947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e815cd40 0x7ff6e80cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.396+0000 7ff6ed3ff700 1 --2- 172.21.15.72:0/1028894947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e8161000 0x7ff6e80b2620 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.396+0000 7ff6ed3ff700 1 --2- 172.21.15.72:0/1028894947 >> v2:172.21.15.137:3300/0 conn(0x7ff6e815d120 0x7ff6e8160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.396+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/1028894947 >> 172.21.15.72:0/1028894947 conn(0x7ff6e80cd620 msgr2=0x7ff6e80cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.396+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/1028894947 shutdown_connections 2023-08-25T04:45:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.396+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/1028894947 wait complete. 2023-08-25T04:45:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.397+0000 7ff6ed3ff700 1 Processor -- start 2023-08-25T04:45:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.398+0000 7ff6ed3ff700 1 -- start start 2023-08-25T04:45:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.398+0000 7ff6ed3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e815cd40 0x7ff6e80b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.398+0000 7ff6ed3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e815d120 0x7ff6e81f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6ed3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e8161000 0x7ff6e8152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6ed3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e8152740 con 0x7ff6e815d120 2023-08-25T04:45:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6ed3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e815d560 con 0x7ff6e815cd40 2023-08-25T04:45:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6ed3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80b5e10 con 0x7ff6e8161000 2023-08-25T04:45:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e815d120 0x7ff6e81f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e815d120 0x7ff6e81f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45118/0 (socket says 172.21.15.72:45118) 2023-08-25T04:45:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6dffff700 1 -- 172.21.15.72:0/3529473947 learned_addr learned my addr 172.21.15.72:0/3529473947 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6e6ffd700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e815cd40 0x7ff6e80b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6e77fe700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e8161000 0x7ff6e8152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6dffff700 1 -- 172.21.15.72:0/3529473947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e8161000 msgr2=0x7ff6e8152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6dffff700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e8161000 0x7ff6e8152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6dffff700 1 -- 172.21.15.72:0/3529473947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e815cd40 msgr2=0x7ff6e80b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6dffff700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e815cd40 0x7ff6e80b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6dffff700 1 -- 172.21.15.72:0/3529473947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0009b30 con 0x7ff6e815d120 2023-08-25T04:45:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6e77fe700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e8161000 0x7ff6e8152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.399+0000 7ff6dffff700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e815d120 0x7ff6e81f6650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000e810 tx=0x7ff6d000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.400+0000 7ff6df7fe700 1 -- 172.21.15.72:0/3529473947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0013610 con 0x7ff6e815d120 2023-08-25T04:45:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.400+0000 7ff6df7fe700 1 -- 172.21.15.72:0/3529473947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d0013770 con 0x7ff6e815d120 2023-08-25T04:45:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.400+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/3529473947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e815d7b0 con 0x7ff6e815d120 2023-08-25T04:45:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.400+0000 7ff6df7fe700 1 -- 172.21.15.72:0/3529473947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0013b20 con 0x7ff6e815d120 2023-08-25T04:45:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.400+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/3529473947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e815dd70 con 0x7ff6e815d120 2023-08-25T04:45:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.401+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/3529473947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e804e620 con 0x7ff6e815d120 2023-08-25T04:45:34.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.402+0000 7ff6df7fe700 1 -- 172.21.15.72:0/3529473947 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff6d0013c80 con 0x7ff6e815d120 2023-08-25T04:45:34.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.402+0000 7ff6df7fe700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6c806a0e0 0x7ff6c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:34.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.403+0000 7ff6df7fe700 1 -- 172.21.15.72:0/3529473947 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6288+0+0 (secure 0 0 0) 0x7ff6d0088260 con 0x7ff6e815d120 2023-08-25T04:45:34.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.403+0000 7ff6e6ffd700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6c806a0e0 0x7ff6c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:34.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.403+0000 7ff6e6ffd700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6c806a0e0 0x7ff6c806c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8006b20 tx=0x7ff6d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:34.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.407+0000 7ff6df7fe700 1 -- 172.21.15.72:0/3529473947 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff6d0057290 con 0x7ff6e815d120 2023-08-25T04:45:34.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:34.607+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/3529473947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff6e80b6b20 con 0x7ff6e815d120 2023-08-25T04:45:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.450+0000 7ff6df7fe700 1 -- 172.21.15.72:0/3529473947 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7ff6d0056e20 con 0x7ff6e815d120 2023-08-25T04:45:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.455+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/3529473947 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6c806a0e0 msgr2=0x7ff6c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.455+0000 7ff6ed3ff700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6c806a0e0 0x7ff6c806c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8006b20 tx=0x7ff6d8008040 comp rx=0 tx=0).stop 2023-08-25T04:45:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.455+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/3529473947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e815d120 msgr2=0x7ff6e81f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.455+0000 7ff6ed3ff700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e815d120 0x7ff6e81f6650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000e810 tx=0x7ff6d000eb20 comp rx=0 tx=0).stop 2023-08-25T04:45:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.455+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/3529473947 shutdown_connections 2023-08-25T04:45:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.455+0000 7ff6ed3ff700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6c806a0e0 0x7ff6c806c5a0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8006b20 tx=0x7ff6d8008040 comp rx=0 tx=0).stop 2023-08-25T04:45:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.455+0000 7ff6ed3ff700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6e8161000 0x7ff6e8152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.455+0000 7ff6ed3ff700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e815cd40 0x7ff6e80b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.455+0000 7ff6ed3ff700 1 --2- 172.21.15.72:0/3529473947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e815d120 0x7ff6e81f6650 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000e810 tx=0x7ff6d000eb20 comp rx=0 tx=0).stop 2023-08-25T04:45:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.455+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/3529473947 >> 172.21.15.72:0/3529473947 conn(0x7ff6e80cd620 msgr2=0x7ff6e80cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.465+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/3529473947 shutdown_connections 2023-08-25T04:45:36.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.466+0000 7ff6ed3ff700 1 -- 172.21.15.72:0/3529473947 wait complete. 2023-08-25T04:45:36.467 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' created 2023-08-25T04:45:36.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-08-25T04:45:36.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.688+0000 7f357dbff700 1 Processor -- start 2023-08-25T04:45:36.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.688+0000 7f357dbff700 1 -- start start 2023-08-25T04:45:36.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.689+0000 7f357dbff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f357815d000 0x7f35780d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.689+0000 7f357dbff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f35780b5e80 0x7f35780cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.689+0000 7f357dbff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35780d1fb0 con 0x7f35780d2890 2023-08-25T04:45:36.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.689+0000 7f357dbff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357815d3e0 con 0x7f35780b5e80 2023-08-25T04:45:36.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.689+0000 7f357dbff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3578160b80 con 0x7f357815d000 2023-08-25T04:45:36.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f3576ffd700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f35780b5e80 0x7f35780cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f35777fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f357815d000 0x7f35780d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f35777fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f357815d000 0x7f35780d2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:32776/0 (socket says 172.21.15.72:32776) 2023-08-25T04:45:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f35777fe700 1 -- 172.21.15.72:0/552294060 learned_addr learned my addr 172.21.15.72:0/552294060 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f3576ffd700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f35780b5e80 0x7f35780cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:55976/0 (socket says 172.21.15.72:55976) 2023-08-25T04:45:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f3577fff700 1 --1- 172.21.15.72:0/552294060 >> v1:172.21.15.137:6789/0 conn(0x7f35780d2890 0x7f35780b4900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:45004/0 (socket says 172.21.15.72:45004) 2023-08-25T04:45:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f35767fc700 1 -- 172.21.15.72:0/552294060 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424115708 0 0) 0x7f35780d1fb0 con 0x7f35780d2890 2023-08-25T04:45:36.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f35777fe700 1 -- 172.21.15.72:0/552294060 >> v2:172.21.15.137:3300/0 conn(0x7f35780b5e80 msgr2=0x7f35780cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:36.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f35777fe700 1 --2- 172.21.15.72:0/552294060 >> v2:172.21.15.137:3300/0 conn(0x7f35780b5e80 0x7f35780cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f35777fe700 1 -- 172.21.15.72:0/552294060 >> v1:172.21.15.137:6789/0 conn(0x7f35780d2890 legacy=0x7f35780b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f35777fe700 1 -- 172.21.15.72:0/552294060 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3578160e60 con 0x7f357815d000 2023-08-25T04:45:36.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.690+0000 7f3576ffd700 1 --2- 172.21.15.72:0/552294060 >> v2:172.21.15.137:3300/0 conn(0x7f35780b5e80 0x7f35780cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:36.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.691+0000 7f35777fe700 1 --2- 172.21.15.72:0/552294060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f357815d000 0x7f35780d2350 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f35680098f0 tx=0x7f3568009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb4d8e3d5441224 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:36.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.691+0000 7f35767fc700 1 -- 172.21.15.72:0/552294060 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568011830 con 0x7f357815d000 2023-08-25T04:45:36.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.691+0000 7f35767fc700 1 -- 172.21.15.72:0/552294060 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3568011990 con 0x7f357815d000 2023-08-25T04:45:36.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.691+0000 7f35767fc700 1 -- 172.21.15.72:0/552294060 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568011d20 con 0x7f357815d000 2023-08-25T04:45:36.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.692+0000 7f357dbff700 1 -- 172.21.15.72:0/552294060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f357815d000 msgr2=0x7f35780d2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.692+0000 7f357dbff700 1 --2- 172.21.15.72:0/552294060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f357815d000 0x7f35780d2350 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f35680098f0 tx=0x7f3568009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:36.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.692+0000 7f357dbff700 1 -- 172.21.15.72:0/552294060 shutdown_connections 2023-08-25T04:45:36.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.692+0000 7f357dbff700 1 --2- 172.21.15.72:0/552294060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f357815d000 0x7f35780d2350 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.692+0000 7f357dbff700 1 --2- 172.21.15.72:0/552294060 >> v2:172.21.15.137:3300/0 conn(0x7f35780b5e80 0x7f35780cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.692+0000 7f357dbff700 1 -- 172.21.15.72:0/552294060 >> 172.21.15.72:0/552294060 conn(0x7f357806ba80 msgr2=0x7f357806be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:36.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.692+0000 7f357dbff700 1 -- 172.21.15.72:0/552294060 shutdown_connections 2023-08-25T04:45:36.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.692+0000 7f357dbff700 1 -- 172.21.15.72:0/552294060 wait complete. 2023-08-25T04:45:36.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.694+0000 7f357dbff700 1 Processor -- start 2023-08-25T04:45:36.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.694+0000 7f357dbff700 1 -- start start 2023-08-25T04:45:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f357dbff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35780b5e80 0x7f357814a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f357dbff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35780d2890 0x7f35780c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f357dbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f357815d000 0x7f35781f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f357dbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780ca490 con 0x7f357815d000 2023-08-25T04:45:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f357dbff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780caf20 con 0x7f35780d2890 2023-08-25T04:45:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f357dbff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35780ca680 con 0x7f35780b5e80 2023-08-25T04:45:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f3577fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f357815d000 0x7f35781f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f3576ffd700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35780d2890 0x7f35780c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f35777fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35780b5e80 0x7f357814a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f3576ffd700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35780d2890 0x7f35780c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:55986/0 (socket says 172.21.15.72:55986) 2023-08-25T04:45:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f3576ffd700 1 -- 172.21.15.72:0/708312753 learned_addr learned my addr 172.21.15.72:0/708312753 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f35777fe700 1 -- 172.21.15.72:0/708312753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35780d2890 msgr2=0x7f35780c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f35777fe700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35780d2890 0x7f35780c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f35777fe700 1 -- 172.21.15.72:0/708312753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f357815d000 msgr2=0x7f35781f1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f35777fe700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f357815d000 0x7f35781f1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f35777fe700 1 -- 172.21.15.72:0/708312753 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c0094a0 con 0x7f35780b5e80 2023-08-25T04:45:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f3576ffd700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35780d2890 0x7f35780c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.695+0000 7f3577fff700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f357815d000 0x7f35781f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.696+0000 7f35777fe700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35780b5e80 0x7f357814a5d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3568016000 tx=0x7f3568004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.696+0000 7f355ffff700 1 -- 172.21.15.72:0/708312753 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568004300 con 0x7f35780b5e80 2023-08-25T04:45:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.696+0000 7f355ffff700 1 -- 172.21.15.72:0/708312753 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356801f070 con 0x7f35780b5e80 2023-08-25T04:45:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.696+0000 7f355ffff700 1 -- 172.21.15.72:0/708312753 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35680036a0 con 0x7f35780b5e80 2023-08-25T04:45:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.696+0000 7f357dbff700 1 -- 172.21.15.72:0/708312753 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3568009550 con 0x7f35780b5e80 2023-08-25T04:45:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.696+0000 7f357dbff700 1 -- 172.21.15.72:0/708312753 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35780cac40 con 0x7f35780b5e80 2023-08-25T04:45:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.697+0000 7f357dbff700 1 -- 172.21.15.72:0/708312753 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357804e690 con 0x7f35780b5e80 2023-08-25T04:45:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.698+0000 7f355ffff700 1 -- 172.21.15.72:0/708312753 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3568021030 con 0x7f35780b5e80 2023-08-25T04:45:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.699+0000 7f355ffff700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f356406a0e0 0x7f356406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.699+0000 7f355ffff700 1 -- 172.21.15.72:0/708312753 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f3568089cf0 con 0x7f35780b5e80 2023-08-25T04:45:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.699+0000 7f3576ffd700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f356406a0e0 0x7f356406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.700+0000 7f3576ffd700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f356406a0e0 0x7f356406c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f356c009fd0 tx=0x7f356c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.703+0000 7f355ffff700 1 -- 172.21.15.72:0/708312753 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3568055100 con 0x7f35780b5e80 2023-08-25T04:45:36.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:36.899+0000 7f357dbff700 1 -- 172.21.15.72:0/708312753 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f357815e200 con 0x7f35780b5e80 2023-08-25T04:45:37.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.463+0000 7f355ffff700 1 -- 172.21.15.72:0/708312753 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f35680150c0 con 0x7f35780b5e80 2023-08-25T04:45:37.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.470+0000 7f357dbff700 1 -- 172.21.15.72:0/708312753 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f356406a0e0 msgr2=0x7f356406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.470+0000 7f357dbff700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f356406a0e0 0x7f356406c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f356c009fd0 tx=0x7f356c009210 comp rx=0 tx=0).stop 2023-08-25T04:45:37.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.470+0000 7f357dbff700 1 -- 172.21.15.72:0/708312753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35780b5e80 msgr2=0x7f357814a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.470+0000 7f357dbff700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35780b5e80 0x7f357814a5d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3568016000 tx=0x7f3568004750 comp rx=0 tx=0).stop 2023-08-25T04:45:37.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.476+0000 7f357dbff700 1 -- 172.21.15.72:0/708312753 shutdown_connections 2023-08-25T04:45:37.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.476+0000 7f357dbff700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f356406a0e0 0x7f356406c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.476+0000 7f357dbff700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f357815d000 0x7f35781f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.476+0000 7f357dbff700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35780b5e80 0x7f357814a5d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.476+0000 7f357dbff700 1 --2- 172.21.15.72:0/708312753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35780d2890 0x7f35780c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.476+0000 7f357dbff700 1 -- 172.21.15.72:0/708312753 >> 172.21.15.72:0/708312753 conn(0x7f357806ba80 msgr2=0x7f357815d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:37.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.476+0000 7f357dbff700 1 -- 172.21.15.72:0/708312753 shutdown_connections 2023-08-25T04:45:37.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.476+0000 7f357dbff700 1 -- 172.21.15.72:0/708312753 wait complete. 2023-08-25T04:45:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 5 allow_ec_overwrites to true 2023-08-25T04:45:37.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-08-25T04:45:37.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.705+0000 7fdce95ff700 1 Processor -- start 2023-08-25T04:45:37.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.706+0000 7fdce95ff700 1 -- start start 2023-08-25T04:45:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce95ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce415d090 0x7fdce40d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce95ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdce40b8aa0 0x7fdce40cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce95ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 0x7fdce40b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce95ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40ce4d0 con 0x7fdce415d090 2023-08-25T04:45:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce95ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce415d470 con 0x7fdce40b8aa0 2023-08-25T04:45:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce95ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40d17e0 con 0x7fdce40ce090 2023-08-25T04:45:37.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce415d090 0x7fdce40d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce415d090 0x7fdce40d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45138/0 (socket says 172.21.15.72:45138) 2023-08-25T04:45:37.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce2ffd700 1 -- 172.21.15.72:0/10132212 learned_addr learned my addr 172.21.15.72:0/10132212 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce37fe700 1 --2- 172.21.15.72:0/10132212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 0x7fdce40b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdcdbfff700 1 --2- 172.21.15.72:0/10132212 >> v2:172.21.15.137:3300/0 conn(0x7fdce40b8aa0 0x7fdce40cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce2ffd700 1 -- 172.21.15.72:0/10132212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 msgr2=0x7fdce40b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce2ffd700 1 --2- 172.21.15.72:0/10132212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 0x7fdce40b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce2ffd700 1 -- 172.21.15.72:0/10132212 >> v2:172.21.15.137:3300/0 conn(0x7fdce40b8aa0 msgr2=0x7fdce40cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce2ffd700 1 --2- 172.21.15.72:0/10132212 >> v2:172.21.15.137:3300/0 conn(0x7fdce40b8aa0 0x7fdce40cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce2ffd700 1 -- 172.21.15.72:0/10132212 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40d1ac0 con 0x7fdce415d090 2023-08-25T04:45:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.707+0000 7fdce37fe700 1 --2- 172.21.15.72:0/10132212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 0x7fdce40b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.708+0000 7fdce2ffd700 1 --2- 172.21.15.72:0/10132212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 0x7fdce40d0e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdce40b5970 tx=0x7fdcd4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274e51bef07909d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.708+0000 7fdce27fc700 1 -- 172.21.15.72:0/10132212 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400b870 con 0x7fdce415d090 2023-08-25T04:45:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.708+0000 7fdce27fc700 1 -- 172.21.15.72:0/10132212 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd400b9d0 con 0x7fdce415d090 2023-08-25T04:45:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.708+0000 7fdce27fc700 1 -- 172.21.15.72:0/10132212 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400bd60 con 0x7fdce415d090 2023-08-25T04:45:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.708+0000 7fdce95ff700 1 -- 172.21.15.72:0/10132212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 msgr2=0x7fdce40d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.708+0000 7fdce95ff700 1 --2- 172.21.15.72:0/10132212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 0x7fdce40d0e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdce40b5970 tx=0x7fdcd4009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.709+0000 7fdce95ff700 1 -- 172.21.15.72:0/10132212 shutdown_connections 2023-08-25T04:45:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.709+0000 7fdce95ff700 1 --2- 172.21.15.72:0/10132212 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 0x7fdce40b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.709+0000 7fdce95ff700 1 --2- 172.21.15.72:0/10132212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 0x7fdce40d0e70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.709+0000 7fdce95ff700 1 --2- 172.21.15.72:0/10132212 >> v2:172.21.15.137:3300/0 conn(0x7fdce40b8aa0 0x7fdce40cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.709+0000 7fdce95ff700 1 -- 172.21.15.72:0/10132212 >> 172.21.15.72:0/10132212 conn(0x7fdce4071e10 msgr2=0x7fdce4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:37.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.709+0000 7fdce95ff700 1 -- 172.21.15.72:0/10132212 shutdown_connections 2023-08-25T04:45:37.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.709+0000 7fdce95ff700 1 -- 172.21.15.72:0/10132212 wait complete. 2023-08-25T04:45:37.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.711+0000 7fdce95ff700 1 Processor -- start 2023-08-25T04:45:37.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.711+0000 7fdce95ff700 1 -- start start 2023-08-25T04:45:37.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.712+0000 7fdce95ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdce40b8aa0 0x7fdce41f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.712+0000 7fdce95ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 0x7fdce41f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.712+0000 7fdce95ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 0x7fdce4157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.712+0000 7fdce95ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce41604b0 con 0x7fdce415d090 2023-08-25T04:45:37.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.712+0000 7fdce95ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce41f4800 con 0x7fdce40b8aa0 2023-08-25T04:45:37.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.712+0000 7fdce95ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce41f3bf0 con 0x7fdce40ce090 2023-08-25T04:45:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 0x7fdce4157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 0x7fdce4157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45144/0 (socket says 172.21.15.72:45144) 2023-08-25T04:45:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce37fe700 1 -- 172.21.15.72:0/3247769418 learned_addr learned my addr 172.21.15.72:0/3247769418 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce2ffd700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdce40b8aa0 0x7fdce41f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdcdbfff700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 0x7fdce41f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce37fe700 1 -- 172.21.15.72:0/3247769418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 msgr2=0x7fdce41f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce37fe700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 0x7fdce41f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce37fe700 1 -- 172.21.15.72:0/3247769418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdce40b8aa0 msgr2=0x7fdce41f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce37fe700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdce40b8aa0 0x7fdce41f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce37fe700 1 -- 172.21.15.72:0/3247769418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd4009550 con 0x7fdce415d090 2023-08-25T04:45:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce37fe700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 0x7fdce4157780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00cef0 tx=0x7fdcdc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdcdb7fe700 1 -- 172.21.15.72:0/3247769418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00adb0 con 0x7fdce415d090 2023-08-25T04:45:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdcdb7fe700 1 -- 172.21.15.72:0/3247769418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc015440 con 0x7fdce415d090 2023-08-25T04:45:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.713+0000 7fdce95ff700 1 -- 172.21.15.72:0/3247769418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce41f3ed0 con 0x7fdce415d090 2023-08-25T04:45:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.714+0000 7fdcdb7fe700 1 -- 172.21.15.72:0/3247769418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0157f0 con 0x7fdce415d090 2023-08-25T04:45:37.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.714+0000 7fdce95ff700 1 -- 172.21.15.72:0/3247769418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce41f4490 con 0x7fdce415d090 2023-08-25T04:45:37.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.715+0000 7fdce95ff700 1 -- 172.21.15.72:0/3247769418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce41f4990 con 0x7fdce415d090 2023-08-25T04:45:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.716+0000 7fdcdb7fe700 1 -- 172.21.15.72:0/3247769418 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdcdc00d430 con 0x7fdce415d090 2023-08-25T04:45:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.717+0000 7fdcdb7fe700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdcc406a0e0 0x7fdcc406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.717+0000 7fdcdb7fe700 1 -- 172.21.15.72:0/3247769418 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fdcdc088df0 con 0x7fdce415d090 2023-08-25T04:45:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.717+0000 7fdce2ffd700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdcc406a0e0 0x7fdcc406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.717+0000 7fdce2ffd700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdcc406a0e0 0x7fdcc406c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4014040 tx=0x7fdcd4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:37.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.722+0000 7fdcdb7fe700 1 -- 172.21.15.72:0/3247769418 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdcdc054170 con 0x7fdce415d090 2023-08-25T04:45:37.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:37.968+0000 7fdce95ff700 1 -- 172.21.15.72:0/3247769418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fdce406a2f0 con 0x7fdce415d090 2023-08-25T04:45:38.146 INFO:tasks.ceph.mds.b.smithi137.stderr:2023-08-25T04:45:38.146+0000 7f5a9a7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:45:38.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.463+0000 7fdcdb7fe700 1 -- 172.21.15.72:0/3247769418 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fdcdc01a0b0 con 0x7fdce415d090 2023-08-25T04:45:38.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 -- 172.21.15.72:0/3247769418 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdcc406a0e0 msgr2=0x7fdcc406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdcc406a0e0 0x7fdcc406c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4014040 tx=0x7fdcd4008030 comp rx=0 tx=0).stop 2023-08-25T04:45:38.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 -- 172.21.15.72:0/3247769418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 msgr2=0x7fdce4157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 0x7fdce4157780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00cef0 tx=0x7fdcdc00cf20 comp rx=0 tx=0).stop 2023-08-25T04:45:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 -- 172.21.15.72:0/3247769418 shutdown_connections 2023-08-25T04:45:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdcc406a0e0 0x7fdcc406c5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce415d090 0x7fdce4157780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdce40b8aa0 0x7fdce41f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 --2- 172.21.15.72:0/3247769418 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdce40ce090 0x7fdce41f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 -- 172.21.15.72:0/3247769418 >> 172.21.15.72:0/3247769418 conn(0x7fdce4071e10 msgr2=0x7fdce40d2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:38.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 -- 172.21.15.72:0/3247769418 shutdown_connections 2023-08-25T04:45:38.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.466+0000 7fdce95ff700 1 -- 172.21.15.72:0/3247769418 wait complete. 2023-08-25T04:45:38.469 INFO:teuthology.orchestra.run.smithi072.stderr:added data pool 5 to fsmap 2023-08-25T04:45:38.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:45:38.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.681+0000 7f7318dff700 1 Processor -- start 2023-08-25T04:45:38.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.681+0000 7f7318dff700 1 -- start start 2023-08-25T04:45:38.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.682+0000 7f7318dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f731415ac50 0x7f731406cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.682+0000 7f7318dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f731406e590 0x7f73140addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.682+0000 7f7318dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f73140c3f40 0x7f73140c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.682+0000 7f7318dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73140c4900 con 0x7f731406e590 2023-08-25T04:45:38.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.682+0000 7f7318dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731406d4f0 con 0x7f73140c3f40 2023-08-25T04:45:38.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.682+0000 7f7318dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731406d7d0 con 0x7f731415ac50 2023-08-25T04:45:38.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.682+0000 7f7311d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f731406e590 0x7f73140addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.682+0000 7f7311d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f731406e590 0x7f73140addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45152/0 (socket says 172.21.15.72:45152) 2023-08-25T04:45:38.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.682+0000 7f7311d9b700 1 -- 172.21.15.72:0/1592720848 learned_addr learned my addr 172.21.15.72:0/1592720848 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:38.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f731259c700 1 --2- 172.21.15.72:0/1592720848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f731415ac50 0x7f731406cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f7312d9d700 1 --2- 172.21.15.72:0/1592720848 >> v2:172.21.15.137:3300/0 conn(0x7f73140c3f40 0x7f73140c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f7311d9b700 1 -- 172.21.15.72:0/1592720848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f731415ac50 msgr2=0x7f731406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:38.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f7311d9b700 1 --2- 172.21.15.72:0/1592720848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f731415ac50 0x7f731406cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f7311d9b700 1 -- 172.21.15.72:0/1592720848 >> v2:172.21.15.137:3300/0 conn(0x7f73140c3f40 msgr2=0x7f73140c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:38.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f7311d9b700 1 --2- 172.21.15.72:0/1592720848 >> v2:172.21.15.137:3300/0 conn(0x7f73140c3f40 0x7f73140c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f7311d9b700 1 -- 172.21.15.72:0/1592720848 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731406dab0 con 0x7f731406e590 2023-08-25T04:45:38.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f7311d9b700 1 --2- 172.21.15.72:0/1592720848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731406e590 0x7f73140addd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7314071b90 tx=0x7f7308009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b015afcdff41113 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f731159a700 1 -- 172.21.15.72:0/1592720848 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800b870 con 0x7f731406e590 2023-08-25T04:45:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f731159a700 1 -- 172.21.15.72:0/1592720848 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730800b9d0 con 0x7f731406e590 2023-08-25T04:45:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.683+0000 7f731159a700 1 -- 172.21.15.72:0/1592720848 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800bd60 con 0x7f731406e590 2023-08-25T04:45:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.684+0000 7f7318dff700 1 -- 172.21.15.72:0/1592720848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731406e590 msgr2=0x7f73140addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.684+0000 7f7318dff700 1 --2- 172.21.15.72:0/1592720848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731406e590 0x7f73140addd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7314071b90 tx=0x7f7308009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.684+0000 7f7318dff700 1 -- 172.21.15.72:0/1592720848 shutdown_connections 2023-08-25T04:45:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.684+0000 7f7318dff700 1 --2- 172.21.15.72:0/1592720848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f731415ac50 0x7f731406cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.684+0000 7f7318dff700 1 --2- 172.21.15.72:0/1592720848 >> v2:172.21.15.137:3300/0 conn(0x7f73140c3f40 0x7f73140c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.684+0000 7f7318dff700 1 --2- 172.21.15.72:0/1592720848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731406e590 0x7f73140addd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.684+0000 7f7318dff700 1 -- 172.21.15.72:0/1592720848 >> 172.21.15.72:0/1592720848 conn(0x7f73140ce990 msgr2=0x7f73140ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.684+0000 7f7318dff700 1 -- 172.21.15.72:0/1592720848 shutdown_connections 2023-08-25T04:45:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.684+0000 7f7318dff700 1 -- 172.21.15.72:0/1592720848 wait complete. 2023-08-25T04:45:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.686+0000 7f7318dff700 1 Processor -- start 2023-08-25T04:45:38.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.686+0000 7f7318dff700 1 -- start start 2023-08-25T04:45:38.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f7318dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f731406e590 0x7f7314152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f7318dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73140c3f40 0x7f731415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f7318dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731415ac50 0x7f73141f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f7318dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7314152ad0 con 0x7f731415ac50 2023-08-25T04:45:38.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f7318dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7314154380 con 0x7f731406e590 2023-08-25T04:45:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f7318dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7314154660 con 0x7f73140c3f40 2023-08-25T04:45:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f7312d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731415ac50 0x7f73141f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f7312d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731415ac50 0x7f73141f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45160/0 (socket says 172.21.15.72:45160) 2023-08-25T04:45:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f7312d9d700 1 -- 172.21.15.72:0/2069601562 learned_addr learned my addr 172.21.15.72:0/2069601562 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f7311d9b700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73140c3f40 0x7f731415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.687+0000 7f731259c700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f731406e590 0x7f7314152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7312d9d700 1 -- 172.21.15.72:0/2069601562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73140c3f40 msgr2=0x7f731415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7312d9d700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73140c3f40 0x7f731415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7312d9d700 1 -- 172.21.15.72:0/2069601562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f731406e590 msgr2=0x7f7314152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7312d9d700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f731406e590 0x7f7314152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7312d9d700 1 -- 172.21.15.72:0/2069601562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308009550 con 0x7f731415ac50 2023-08-25T04:45:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7312d9d700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731415ac50 0x7f73141f3a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f730c007e60 tx=0x7f730c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7302ffd700 1 -- 172.21.15.72:0/2069601562 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c00ed30 con 0x7f731415ac50 2023-08-25T04:45:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7302ffd700 1 -- 172.21.15.72:0/2069601562 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c014420 con 0x7f731415ac50 2023-08-25T04:45:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7318dff700 1 -- 172.21.15.72:0/2069601562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7314154940 con 0x7f731415ac50 2023-08-25T04:45:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7302ffd700 1 -- 172.21.15.72:0/2069601562 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c0147d0 con 0x7f731415ac50 2023-08-25T04:45:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.688+0000 7f7318dff700 1 -- 172.21.15.72:0/2069601562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7314154f00 con 0x7f731415ac50 2023-08-25T04:45:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.689+0000 7f7318dff700 1 -- 172.21.15.72:0/2069601562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731404e620 con 0x7f731415ac50 2023-08-25T04:45:38.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.690+0000 7f7302ffd700 1 -- 172.21.15.72:0/2069601562 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f730c014930 con 0x7f731415ac50 2023-08-25T04:45:38.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.691+0000 7f7302ffd700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f72f406a0e0 0x7f72f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:38.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.691+0000 7f7302ffd700 1 -- 172.21.15.72:0/2069601562 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f730c088f50 con 0x7f731415ac50 2023-08-25T04:45:38.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.691+0000 7f731259c700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f72f406a0e0 0x7f72f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:38.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.692+0000 7f731259c700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f72f406a0e0 0x7f72f406c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7304006b20 tx=0x7f7304008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:38.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.695+0000 7f7302ffd700 1 -- 172.21.15.72:0/2069601562 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f730c054360 con 0x7f731415ac50 2023-08-25T04:45:38.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.937+0000 7f7318dff700 1 -- 172.21.15.72:0/2069601562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f731415e5b0 con 0x7f731415ac50 2023-08-25T04:45:38.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.938+0000 7f7302ffd700 1 -- 172.21.15.72:0/2069601562 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f730c057980 con 0x7f731415ac50 2023-08-25T04:45:38.939 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:38.940 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:45:32.715423+0000","modified":"2023-08-25T04:45:38.454980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-25T04:45:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 -- 172.21.15.72:0/2069601562 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f72f406a0e0 msgr2=0x7f72f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f72f406a0e0 0x7f72f406c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7304006b20 tx=0x7f7304008040 comp rx=0 tx=0).stop 2023-08-25T04:45:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 -- 172.21.15.72:0/2069601562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731415ac50 msgr2=0x7f73141f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731415ac50 0x7f73141f3a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f730c007e60 tx=0x7f730c00e3c0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 -- 172.21.15.72:0/2069601562 shutdown_connections 2023-08-25T04:45:38.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f72f406a0e0 0x7f72f406c5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731415ac50 0x7f73141f3a70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f731406e590 0x7f7314152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 --2- 172.21.15.72:0/2069601562 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f73140c3f40 0x7f731415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:38.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 -- 172.21.15.72:0/2069601562 >> 172.21.15.72:0/2069601562 conn(0x7f73140ce990 msgr2=0x7f73140ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:38.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 -- 172.21.15.72:0/2069601562 shutdown_connections 2023-08-25T04:45:38.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:38.941+0000 7f7318dff700 1 -- 172.21.15.72:0/2069601562 wait complete. 2023-08-25T04:45:38.944 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-08-25T04:45:38.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.155+0000 7f33151ff700 1 Processor -- start 2023-08-25T04:45:39.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.155+0000 7f33151ff700 1 -- start start 2023-08-25T04:45:39.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.156+0000 7f33151ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f331015ce60 0x7f33100d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.156+0000 7f33151ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33100d1fe0 con 0x7f33100cda40 2023-08-25T04:45:39.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.156+0000 7f33151ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33100d13d0 con 0x7f33100b8770 2023-08-25T04:45:39.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.156+0000 7f33151ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33100d2b80 con 0x7f331015ce60 2023-08-25T04:45:39.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.156+0000 7f330f59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f33100cda40 0x7f33100b5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35076/0 (socket says 172.21.15.72:35076) 2023-08-25T04:45:39.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.156+0000 7f330f59e700 1 -- 172.21.15.72:0/4053775108 learned_addr learned my addr 172.21.15.72:0/4053775108 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:39.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330ed9d700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f331015ce60 0x7f33100d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047465745 0 0) 0x7f33100d1fe0 con 0x7f33100cda40 2023-08-25T04:45:39.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32f80035b0 con 0x7f33100cda40 2023-08-25T04:45:39.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1699427893 0 0) 0x7f32f80035b0 con 0x7f33100cda40 2023-08-25T04:45:39.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f331015ce60 msgr2=0x7f33100d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:39.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f331015ce60 0x7f33100d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 >> v1:172.21.15.137:6789/0 conn(0x7f33100b8770 legacy=0x7f33100d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33100d16b0 con 0x7f33100cda40 2023-08-25T04:45:39.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f33080019f0 con 0x7f33100cda40 2023-08-25T04:45:39.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 >> v1:172.21.15.72:6789/0 conn(0x7f33100cda40 legacy=0x7f33100b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32f8003a30 0x7f32f8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f331015ce60 0x7f32f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32f8004d90 0x7f32f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f800bb10 con 0x7f32f8004d90 2023-08-25T04:45:39.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f800bc80 con 0x7f32f8003a30 2023-08-25T04:45:39.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f800be40 con 0x7f331015ce60 2023-08-25T04:45:39.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330f59e700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32f8004d90 0x7f32f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.157+0000 7f330ed9d700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32f8003a30 0x7f32f8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.158+0000 7f330e59c700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f331015ce60 0x7f32f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.158+0000 7f330f59e700 1 -- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f331015ce60 msgr2=0x7f32f8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:39.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.158+0000 7f330f59e700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f331015ce60 0x7f32f8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.158+0000 7f330f59e700 1 -- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32f8003a30 msgr2=0x7f32f8003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:39.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.158+0000 7f330f59e700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32f8003a30 0x7f32f8003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.158+0000 7f330f59e700 1 -- 172.21.15.72:0/4053775108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80035b0 con 0x7f32f8004d90 2023-08-25T04:45:39.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.158+0000 7f330f59e700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32f8004d90 0x7f32f8005210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f330800a820 tx=0x7f32f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3c2f5e29a691ad server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.158+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800a2f0 con 0x7f32f8004d90 2023-08-25T04:45:39.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.158+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3308012620 con 0x7f32f8004d90 2023-08-25T04:45:39.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.158+0000 7f330dd9b700 1 -- 172.21.15.72:0/4053775108 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33080129d0 con 0x7f32f8004d90 2023-08-25T04:45:39.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.159+0000 7f33151ff700 1 -- 172.21.15.72:0/4053775108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32f8004d90 msgr2=0x7f32f8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.159+0000 7f33151ff700 1 --2- 172.21.15.72:0/4053775108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32f8004d90 0x7f32f8005210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f330800a820 tx=0x7f32f8005880 comp rx=0 tx=0).stop 2023-08-25T04:45:39.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.159+0000 7f330f59e700 1 -- 172.21.15.72:0/4053775108 reap_dead start 2023-08-25T04:45:39.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.159+0000 7f33151ff700 1 -- 172.21.15.72:0/4053775108 shutdown_connections 2023-08-25T04:45:39.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.159+0000 7f33151ff700 1 -- 172.21.15.72:0/4053775108 >> 172.21.15.72:0/4053775108 conn(0x7f3310071e10 msgr2=0x7f3310072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:39.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.159+0000 7f33151ff700 1 -- 172.21.15.72:0/4053775108 shutdown_connections 2023-08-25T04:45:39.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.159+0000 7f33151ff700 1 -- 172.21.15.72:0/4053775108 wait complete. 2023-08-25T04:45:39.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.161+0000 7f33151ff700 1 Processor -- start 2023-08-25T04:45:39.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.161+0000 7f33151ff700 1 -- start start 2023-08-25T04:45:39.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f33151ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3310159690 0x7f33100c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f33151ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3310159a70 0x7f33100b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f33151ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33100b7510 0x7f33101f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f33151ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33100b79a0 con 0x7f33100b7510 2023-08-25T04:45:39.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f33151ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33100c90d0 con 0x7f3310159a70 2023-08-25T04:45:39.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f33151ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33100c8610 con 0x7f3310159690 2023-08-25T04:45:39.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f330f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33100b7510 0x7f33101f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f330ed9d700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3310159690 0x7f33100c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f330e59c700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3310159a70 0x7f33100b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f330f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33100b7510 0x7f33101f6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45184/0 (socket says 172.21.15.72:45184) 2023-08-25T04:45:39.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f330f59e700 1 -- 172.21.15.72:0/1211447782 learned_addr learned my addr 172.21.15.72:0/1211447782 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f330f59e700 1 -- 172.21.15.72:0/1211447782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3310159690 msgr2=0x7f33100c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f330f59e700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3310159690 0x7f33100c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f330f59e700 1 -- 172.21.15.72:0/1211447782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3310159a70 msgr2=0x7f33100b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f330f59e700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3310159a70 0x7f33100b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.162+0000 7f330f59e700 1 -- 172.21.15.72:0/1211447782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33100c88f0 con 0x7f33100b7510 2023-08-25T04:45:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.163+0000 7f330f59e700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33100b7510 0x7f33101f6010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3308012000 tx=0x7f33100d1f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.163+0000 7f32f77fe700 1 -- 172.21.15.72:0/1211447782 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308012990 con 0x7f33100b7510 2023-08-25T04:45:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.163+0000 7f32f77fe700 1 -- 172.21.15.72:0/1211447782 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3308012af0 con 0x7f33100b7510 2023-08-25T04:45:39.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.163+0000 7f32f77fe700 1 -- 172.21.15.72:0/1211447782 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308012ea0 con 0x7f33100b7510 2023-08-25T04:45:39.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.163+0000 7f33151ff700 1 -- 172.21.15.72:0/1211447782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33100c9e40 con 0x7f33100b7510 2023-08-25T04:45:39.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.163+0000 7f33151ff700 1 -- 172.21.15.72:0/1211447782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33100ca400 con 0x7f33100b7510 2023-08-25T04:45:39.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.164+0000 7f33151ff700 1 -- 172.21.15.72:0/1211447782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331004e620 con 0x7f33100b7510 2023-08-25T04:45:39.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.165+0000 7f32f77fe700 1 -- 172.21.15.72:0/1211447782 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f330802b460 con 0x7f33100b7510 2023-08-25T04:45:39.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.166+0000 7f32f77fe700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32fc06a0e0 0x7f32fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.166+0000 7f32f77fe700 1 -- 172.21.15.72:0/1211447782 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f330808a610 con 0x7f33100b7510 2023-08-25T04:45:39.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.166+0000 7f330ed9d700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32fc06a0e0 0x7f32fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.166+0000 7f330ed9d700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32fc06a0e0 0x7f32fc06c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3300009c60 tx=0x7f3300009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.170+0000 7f32f77fe700 1 -- 172.21.15.72:0/1211447782 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3308055a40 con 0x7f33100b7510 2023-08-25T04:45:39.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.369+0000 7f33151ff700 1 -- 172.21.15.72:0/1211447782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33100ca5c0 con 0x7f33100b7510 2023-08-25T04:45:39.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.371+0000 7f32f77fe700 1 -- 172.21.15.72:0/1211447782 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f3308059060 con 0x7f33100b7510 2023-08-25T04:45:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:39.372 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 -- 172.21.15.72:0/1211447782 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32fc06a0e0 msgr2=0x7f32fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32fc06a0e0 0x7f32fc06c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3300009c60 tx=0x7f3300009210 comp rx=0 tx=0).stop 2023-08-25T04:45:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 -- 172.21.15.72:0/1211447782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33100b7510 msgr2=0x7f33101f6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33100b7510 0x7f33101f6010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3308012000 tx=0x7f33100d1f50 comp rx=0 tx=0).stop 2023-08-25T04:45:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 -- 172.21.15.72:0/1211447782 shutdown_connections 2023-08-25T04:45:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32fc06a0e0 0x7f32fc06c5a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33100b7510 0x7f33101f6010 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3310159690 0x7f33100c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 --2- 172.21.15.72:0/1211447782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3310159a70 0x7f33100b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 -- 172.21.15.72:0/1211447782 >> 172.21.15.72:0/1211447782 conn(0x7f3310071e10 msgr2=0x7f33100b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 -- 172.21.15.72:0/1211447782 shutdown_connections 2023-08-25T04:45:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.373+0000 7f33151ff700 1 -- 172.21.15.72:0/1211447782 wait complete. 2023-08-25T04:45:39.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:39.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.588+0000 7fe8ed1ff700 1 Processor -- start 2023-08-25T04:45:39.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.588+0000 7fe8ed1ff700 1 -- start start 2023-08-25T04:45:39.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.589+0000 7fe8ed1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8e80b47c0 0x7fe8e80b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.589+0000 7fe8ed1ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe8e80b86b0 0x7fe8e80b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.589+0000 7fe8ed1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80b50e0 con 0x7fe8e815d130 2023-08-25T04:45:39.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.589+0000 7fe8ed1ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80d1590 con 0x7fe8e80b86b0 2023-08-25T04:45:39.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.589+0000 7fe8ed1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80d1780 con 0x7fe8e80b47c0 2023-08-25T04:45:39.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe8e815d130 0x7fe8e80d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35092/0 (socket says 172.21.15.72:35092) 2023-08-25T04:45:39.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e659c700 1 -- 172.21.15.72:0/3265513793 learned_addr learned my addr 172.21.15.72:0/3265513793 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:39.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e6d9d700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8e80b47c0 0x7fe8e80b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e759e700 1 --2- 172.21.15.72:0/3265513793 >> v2:172.21.15.137:3300/0 conn(0x7fe8e80b86b0 0x7fe8e80b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545084886 0 0) 0x7fe8e80b50e0 con 0x7fe8e815d130 2023-08-25T04:45:39.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d00035b0 con 0x7fe8e815d130 2023-08-25T04:45:39.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1251186822 0 0) 0x7fe8d00035b0 con 0x7fe8e815d130 2023-08-25T04:45:39.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8e80b47c0 msgr2=0x7fe8e80b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:39.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8e80b47c0 0x7fe8e80b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 >> v2:172.21.15.137:3300/0 conn(0x7fe8e80b86b0 msgr2=0x7fe8e80b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:39.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 --2- 172.21.15.72:0/3265513793 >> v2:172.21.15.137:3300/0 conn(0x7fe8e80b86b0 0x7fe8e80b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80d1a60 con 0x7fe8e815d130 2023-08-25T04:45:39.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fe8dc001670 con 0x7fe8e815d130 2023-08-25T04:45:39.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 >> v1:172.21.15.72:6789/0 conn(0x7fe8e815d130 legacy=0x7fe8e80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.590+0000 7fe8e5d9b700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d0003a00 0x7fe8d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e5d9b700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8e80b47c0 0x7fe8d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e5d9b700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8d0004d90 0x7fe8d0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80d1780 con 0x7fe8d0003a00 2023-08-25T04:45:39.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d000ba10 con 0x7fe8d0004d90 2023-08-25T04:45:39.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d000bb50 con 0x7fe8e80b47c0 2023-08-25T04:45:39.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e6d9d700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d0003a00 0x7fe8d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e659c700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8e80b47c0 0x7fe8d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e759e700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8d0004d90 0x7fe8d0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e6d9d700 1 -- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8e80b47c0 msgr2=0x7fe8d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:39.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e6d9d700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8e80b47c0 0x7fe8d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e6d9d700 1 -- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8d0004d90 msgr2=0x7fe8d0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:39.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e6d9d700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8d0004d90 0x7fe8d0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e6d9d700 1 -- 172.21.15.72:0/3265513793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00035b0 con 0x7fe8d0003a00 2023-08-25T04:45:39.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.591+0000 7fe8e6d9d700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d0003a00 0x7fe8d0003e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009b60 tx=0x7fe8d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bf33960aac5cff server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.592+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800e6c0 con 0x7fe8d0003a00 2023-08-25T04:45:39.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.592+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d800e820 con 0x7fe8d0003a00 2023-08-25T04:45:39.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.592+0000 7fe8e5d9b700 1 -- 172.21.15.72:0/3265513793 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800eb90 con 0x7fe8d0003a00 2023-08-25T04:45:39.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.592+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3265513793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d0003a00 msgr2=0x7fe8d0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.592+0000 7fe8ed1ff700 1 --2- 172.21.15.72:0/3265513793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d0003a00 0x7fe8d0003e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009b60 tx=0x7fe8d0005880 comp rx=0 tx=0).stop 2023-08-25T04:45:39.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.592+0000 7fe8e759e700 1 -- 172.21.15.72:0/3265513793 reap_dead start 2023-08-25T04:45:39.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.592+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3265513793 shutdown_connections 2023-08-25T04:45:39.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.592+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3265513793 >> 172.21.15.72:0/3265513793 conn(0x7fe8e8072050 msgr2=0x7fe8e80d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:39.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.592+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3265513793 shutdown_connections 2023-08-25T04:45:39.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.592+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3265513793 wait complete. 2023-08-25T04:45:39.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.594+0000 7fe8ed1ff700 1 Processor -- start 2023-08-25T04:45:39.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.594+0000 7fe8ed1ff700 1 -- start start 2023-08-25T04:45:39.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.595+0000 7fe8ed1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8d0003a00 0x7fe8e80c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.595+0000 7fe8ed1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8e815fd60 0x7fe8e80c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.595+0000 7fe8ed1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e814ec90 0x7fe8e814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.595+0000 7fe8ed1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e814e240 con 0x7fe8e814ec90 2023-08-25T04:45:39.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.595+0000 7fe8ed1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c9370 con 0x7fe8e815fd60 2023-08-25T04:45:39.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.595+0000 7fe8ed1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80ca2c0 con 0x7fe8d0003a00 2023-08-25T04:45:39.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.595+0000 7fe8e759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e814ec90 0x7fe8e814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8e759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e814ec90 0x7fe8e814f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45188/0 (socket says 172.21.15.72:45188) 2023-08-25T04:45:39.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8e759e700 1 -- 172.21.15.72:0/3489287639 learned_addr learned my addr 172.21.15.72:0/3489287639 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:39.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8e6d9d700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8d0003a00 0x7fe8e80c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8e659c700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8e815fd60 0x7fe8e80c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8e759e700 1 -- 172.21.15.72:0/3489287639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8d0003a00 msgr2=0x7fe8e80c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8e759e700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8d0003a00 0x7fe8e80c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8e759e700 1 -- 172.21.15.72:0/3489287639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8e815fd60 msgr2=0x7fe8e80c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8e759e700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8e815fd60 0x7fe8e80c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8e759e700 1 -- 172.21.15.72:0/3489287639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80ca560 con 0x7fe8e814ec90 2023-08-25T04:45:39.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8e759e700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e814ec90 0x7fe8e814f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8e806c9f0 tx=0x7fe8e0011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8cf7fe700 1 -- 172.21.15.72:0/3489287639 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e000e040 con 0x7fe8e814ec90 2023-08-25T04:45:39.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8cf7fe700 1 -- 172.21.15.72:0/3489287639 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e000f040 con 0x7fe8e814ec90 2023-08-25T04:45:39.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3489287639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e80ca840 con 0x7fe8e814ec90 2023-08-25T04:45:39.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8cf7fe700 1 -- 172.21.15.72:0/3489287639 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e000fd50 con 0x7fe8e814ec90 2023-08-25T04:45:39.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.596+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3489287639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e814e770 con 0x7fe8e814ec90 2023-08-25T04:45:39.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.597+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3489287639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e80caa80 con 0x7fe8e814ec90 2023-08-25T04:45:39.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.598+0000 7fe8cf7fe700 1 -- 172.21.15.72:0/3489287639 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe8e0022460 con 0x7fe8e814ec90 2023-08-25T04:45:39.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.599+0000 7fe8cf7fe700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe8d406a0e0 0x7fe8d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:39.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.599+0000 7fe8cf7fe700 1 -- 172.21.15.72:0/3489287639 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe8e0088df0 con 0x7fe8e814ec90 2023-08-25T04:45:39.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.600+0000 7fe8e6d9d700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe8d406a0e0 0x7fe8d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:39.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.600+0000 7fe8e6d9d700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe8d406a0e0 0x7fe8d406c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80090b0 tx=0x7fe8d8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:39.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.603+0000 7fe8cf7fe700 1 -- 172.21.15.72:0/3489287639 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe8e0054150 con 0x7fe8e814ec90 2023-08-25T04:45:39.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.800+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3489287639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8e804e620 con 0x7fe8e814ec90 2023-08-25T04:45:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.801+0000 7fe8cf7fe700 1 -- 172.21.15.72:0/3489287639 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fe8e0057770 con 0x7fe8e814ec90 2023-08-25T04:45:39.803 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:39.803 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:39.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.803+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3489287639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe8d406a0e0 msgr2=0x7fe8d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.803+0000 7fe8ed1ff700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe8d406a0e0 0x7fe8d406c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80090b0 tx=0x7fe8d8008030 comp rx=0 tx=0).stop 2023-08-25T04:45:39.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.803+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3489287639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e814ec90 msgr2=0x7fe8e814f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:39.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.803+0000 7fe8ed1ff700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e814ec90 0x7fe8e814f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8e806c9f0 tx=0x7fe8e0011f80 comp rx=0 tx=0).stop 2023-08-25T04:45:39.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.804+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3489287639 shutdown_connections 2023-08-25T04:45:39.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.804+0000 7fe8ed1ff700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe8d406a0e0 0x7fe8d406c5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.804+0000 7fe8ed1ff700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e814ec90 0x7fe8e814f110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.804+0000 7fe8ed1ff700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8d0003a00 0x7fe8e80c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.804+0000 7fe8ed1ff700 1 --2- 172.21.15.72:0/3489287639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8e815fd60 0x7fe8e80c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:39.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.804+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3489287639 >> 172.21.15.72:0/3489287639 conn(0x7fe8e8072050 msgr2=0x7fe8e80b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:39.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.804+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3489287639 shutdown_connections 2023-08-25T04:45:39.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:39.804+0000 7fe8ed1ff700 1 -- 172.21.15.72:0/3489287639 wait complete. 2023-08-25T04:45:39.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:45:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.035+0000 7fbf929ff700 1 Processor -- start 2023-08-25T04:45:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.035+0000 7fbf929ff700 1 -- start start 2023-08-25T04:45:40.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.036+0000 7fbf929ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf8c0b86b0 0x7fbf8c167a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.036+0000 7fbf929ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c0b6db0 con 0x7fbf8c15d130 2023-08-25T04:45:40.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.036+0000 7fbf929ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c0d1780 con 0x7fbf8c0b47c0 2023-08-25T04:45:40.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.036+0000 7fbf929ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c0d1590 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.036+0000 7fbf8b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbf8c15d130 0x7fbf8c0d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35096/0 (socket says 172.21.15.72:35096) 2023-08-25T04:45:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.036+0000 7fbf8b7fe700 1 -- 172.21.15.72:0/35023207 learned_addr learned my addr 172.21.15.72:0/35023207 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.037+0000 7fbf90f9c700 1 --2- 172.21.15.72:0/35023207 >> v2:172.21.15.72:3300/0 conn(0x7fbf8c0b86b0 0x7fbf8c167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.037+0000 7fbf8affd700 1 -- 172.21.15.72:0/35023207 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555788216 0 0) 0x7fbf8c0b6db0 con 0x7fbf8c15d130 2023-08-25T04:45:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.037+0000 7fbf90f9c700 1 -- 172.21.15.72:0/35023207 >> v1:172.21.15.137:6789/0 conn(0x7fbf8c0b47c0 legacy=0x7fbf8c0b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.037+0000 7fbf90f9c700 1 -- 172.21.15.72:0/35023207 >> v1:172.21.15.72:6789/0 conn(0x7fbf8c15d130 legacy=0x7fbf8c0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.037+0000 7fbf90f9c700 1 -- 172.21.15.72:0/35023207 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0d1a60 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.037+0000 7fbf90f9c700 1 --2- 172.21.15.72:0/35023207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 0x7fbf8c167a50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009d90 tx=0x7fbf8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1644b3cf9816e51 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.037+0000 7fbf8affd700 1 -- 172.21.15.72:0/35023207 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400e070 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.037+0000 7fbf8affd700 1 -- 172.21.15.72:0/35023207 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8400bbd0 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.037+0000 7fbf8affd700 1 -- 172.21.15.72:0/35023207 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84012430 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.038+0000 7fbf929ff700 1 -- 172.21.15.72:0/35023207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 msgr2=0x7fbf8c167a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.038+0000 7fbf929ff700 1 --2- 172.21.15.72:0/35023207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 0x7fbf8c167a50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009d90 tx=0x7fbf8400b330 comp rx=0 tx=0).stop 2023-08-25T04:45:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.038+0000 7fbf929ff700 1 -- 172.21.15.72:0/35023207 shutdown_connections 2023-08-25T04:45:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.038+0000 7fbf929ff700 1 --2- 172.21.15.72:0/35023207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 0x7fbf8c167a50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.038+0000 7fbf929ff700 1 -- 172.21.15.72:0/35023207 >> 172.21.15.72:0/35023207 conn(0x7fbf8c072050 msgr2=0x7fbf8c0d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.038+0000 7fbf929ff700 1 -- 172.21.15.72:0/35023207 shutdown_connections 2023-08-25T04:45:40.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.038+0000 7fbf929ff700 1 -- 172.21.15.72:0/35023207 wait complete. 2023-08-25T04:45:40.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.040+0000 7fbf929ff700 1 Processor -- start 2023-08-25T04:45:40.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.041+0000 7fbf929ff700 1 -- start start 2023-08-25T04:45:40.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf929ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf8c0b47c0 0x7fbf8c14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf929ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 0x7fbf8c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf929ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf8c15d130 0x7fbf8c0cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf929ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0c9d80 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf929ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0c9f90 con 0x7fbf8c15d130 2023-08-25T04:45:40.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf929ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0ca270 con 0x7fbf8c0b47c0 2023-08-25T04:45:40.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 0x7fbf8c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 0x7fbf8c0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45210/0 (socket says 172.21.15.72:45210) 2023-08-25T04:45:40.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf8b7fe700 1 -- 172.21.15.72:0/3382004060 learned_addr learned my addr 172.21.15.72:0/3382004060 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:40.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf8bfff700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf8c0b47c0 0x7fbf8c14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf90f9c700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf8c15d130 0x7fbf8c0cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf8b7fe700 1 -- 172.21.15.72:0/3382004060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf8c0b47c0 msgr2=0x7fbf8c14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf8b7fe700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf8c0b47c0 0x7fbf8c14df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf8b7fe700 1 -- 172.21.15.72:0/3382004060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf8c15d130 msgr2=0x7fbf8c0cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.042+0000 7fbf8b7fe700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf8c15d130 0x7fbf8c0cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.043+0000 7fbf8b7fe700 1 -- 172.21.15.72:0/3382004060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84009a70 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.043+0000 7fbf8bfff700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf8c0b47c0 0x7fbf8c14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:40.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.043+0000 7fbf90f9c700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf8c15d130 0x7fbf8c0cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:40.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.043+0000 7fbf8b7fe700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 0x7fbf8c0c70d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000c520 tx=0x7fbf8000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.043+0000 7fbf88ff9700 1 -- 172.21.15.72:0/3382004060 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80004c80 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.043+0000 7fbf88ff9700 1 -- 172.21.15.72:0/3382004060 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf80004e00 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.043+0000 7fbf88ff9700 1 -- 172.21.15.72:0/3382004060 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80007310 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.043+0000 7fbf929ff700 1 -- 172.21.15.72:0/3382004060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c0ca550 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.043+0000 7fbf929ff700 1 -- 172.21.15.72:0/3382004060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c0cab10 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.044+0000 7fbf929ff700 1 -- 172.21.15.72:0/3382004060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c04e620 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.045+0000 7fbf88ff9700 1 -- 172.21.15.72:0/3382004060 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbf80007470 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.046+0000 7fbf88ff9700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbf7806a0e0 0x7fbf7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.046+0000 7fbf88ff9700 1 -- 172.21.15.72:0/3382004060 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbf800885e0 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.046+0000 7fbf8bfff700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbf7806a0e0 0x7fbf7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.047+0000 7fbf8bfff700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbf7806a0e0 0x7fbf7806c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c001720 tx=0x7fbf7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.050+0000 7fbf88ff9700 1 -- 172.21.15.72:0/3382004060 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbf800539e0 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.291+0000 7fbf929ff700 1 -- 172.21.15.72:0/3382004060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf8c0cfff0 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.292+0000 7fbf88ff9700 1 -- 172.21.15.72:0/3382004060 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4877 (secure 0 0 0) 0x7fbf80057000 con 0x7fbf8c0b86b0 2023-08-25T04:45:40.293 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:40.293 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:45:32.715423+0000","modified":"2023-08-25T04:45:38.454980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-25T04:45:40.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 -- 172.21.15.72:0/3382004060 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbf7806a0e0 msgr2=0x7fbf7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbf7806a0e0 0x7fbf7806c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c001720 tx=0x7fbf7c009040 comp rx=0 tx=0).stop 2023-08-25T04:45:40.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 -- 172.21.15.72:0/3382004060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 msgr2=0x7fbf8c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 0x7fbf8c0c70d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000c520 tx=0x7fbf8000c8e0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 -- 172.21.15.72:0/3382004060 shutdown_connections 2023-08-25T04:45:40.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbf7806a0e0 0x7fbf7806c5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf8c15d130 0x7fbf8c0cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf8c0b47c0 0x7fbf8c14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 --2- 172.21.15.72:0/3382004060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8c0b86b0 0x7fbf8c0c70d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 -- 172.21.15.72:0/3382004060 >> 172.21.15.72:0/3382004060 conn(0x7fbf8c072050 msgr2=0x7fbf8c0b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:40.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.294+0000 7fbf929ff700 1 -- 172.21.15.72:0/3382004060 shutdown_connections 2023-08-25T04:45:40.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.295+0000 7fbf929ff700 1 -- 172.21.15.72:0/3382004060 wait complete. 2023-08-25T04:45:40.298 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-08-25T04:45:40.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:40.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.507+0000 7f6a0cfff700 1 Processor -- start 2023-08-25T04:45:40.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.508+0000 7f6a0cfff700 1 -- start start 2023-08-25T04:45:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.509+0000 7f6a0cfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a080b86b0 0x7f6a08167a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.509+0000 7f6a0cfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a080b6db0 con 0x7f6a0815d130 2023-08-25T04:45:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.509+0000 7f6a0cfff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a080d1780 con 0x7f6a080b47c0 2023-08-25T04:45:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.509+0000 7f6a0cfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080d1590 con 0x7f6a080b86b0 2023-08-25T04:45:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.509+0000 7f69fffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6a0815d130 0x7f6a080d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35104/0 (socket says 172.21.15.72:35104) 2023-08-25T04:45:40.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.509+0000 7f69fffff700 1 -- 172.21.15.72:0/2512374078 learned_addr learned my addr 172.21.15.72:0/2512374078 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.509+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638612711 0 0) 0x7f6a080b6db0 con 0x7f6a0815d130 2023-08-25T04:45:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.509+0000 7f6a06d9d700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a080b86b0 0x7f6a08167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.509+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69f40035b0 con 0x7f6a0815d130 2023-08-25T04:45:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784826489 0 0) 0x7f69f40035b0 con 0x7f6a0815d130 2023-08-25T04:45:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a080b86b0 msgr2=0x7f6a08167a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:40.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a080b86b0 0x7f6a08167a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 >> v1:172.21.15.137:6789/0 conn(0x7f6a080b47c0 legacy=0x7f6a080b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080d1a60 con 0x7f6a0815d130 2023-08-25T04:45:40.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f69f0001670 con 0x7f6a0815d130 2023-08-25T04:45:40.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 >> v1:172.21.15.72:6789/0 conn(0x7f6a0815d130 legacy=0x7f6a080d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a080b86b0 0x7f69f4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f4003fb0 0x7f69f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 0x7f69f4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f400bb50 con 0x7f69f4004d90 2023-08-25T04:45:40.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f400bcc0 con 0x7f69f4003fb0 2023-08-25T04:45:40.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f400be80 con 0x7f6a080b86b0 2023-08-25T04:45:40.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a06d9d700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 0x7f69f4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f69fffff700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f4003fb0 0x7f69f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a0659c700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a080b86b0 0x7f69f4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a06d9d700 1 -- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a080b86b0 msgr2=0x7f69f4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a06d9d700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a080b86b0 0x7f69f4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a06d9d700 1 -- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f4003fb0 msgr2=0x7f69f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:40.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a06d9d700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f4003fb0 0x7f69f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.510+0000 7f6a06d9d700 1 -- 172.21.15.72:0/2512374078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40035b0 con 0x7f69f4004d90 2023-08-25T04:45:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.511+0000 7f6a06d9d700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 0x7f69f4005210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a0806c9f0 tx=0x7f69f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f7b2092fb55ef1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.511+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000ebd0 con 0x7f69f4004d90 2023-08-25T04:45:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.511+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0000f040 con 0x7f69f4004d90 2023-08-25T04:45:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.511+0000 7f6a05d9b700 1 -- 172.21.15.72:0/2512374078 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00014480 con 0x7f69f4004d90 2023-08-25T04:45:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.511+0000 7f6a0cfff700 1 -- 172.21.15.72:0/2512374078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 msgr2=0x7f69f4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.511+0000 7f6a0cfff700 1 --2- 172.21.15.72:0/2512374078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 0x7f69f4005210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a0806c9f0 tx=0x7f69f4005880 comp rx=0 tx=0).stop 2023-08-25T04:45:40.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.511+0000 7f6a06d9d700 1 -- 172.21.15.72:0/2512374078 reap_dead start 2023-08-25T04:45:40.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.511+0000 7f6a0cfff700 1 -- 172.21.15.72:0/2512374078 shutdown_connections 2023-08-25T04:45:40.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.511+0000 7f6a0cfff700 1 -- 172.21.15.72:0/2512374078 >> 172.21.15.72:0/2512374078 conn(0x7f6a08072050 msgr2=0x7f6a080d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:40.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.511+0000 7f6a0cfff700 1 -- 172.21.15.72:0/2512374078 shutdown_connections 2023-08-25T04:45:40.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.512+0000 7f6a0cfff700 1 -- 172.21.15.72:0/2512374078 wait complete. 2023-08-25T04:45:40.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.513+0000 7f6a0cfff700 1 Processor -- start 2023-08-25T04:45:40.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.513+0000 7f6a0cfff700 1 -- start start 2023-08-25T04:45:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.514+0000 7f6a0cfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 0x7f6a08148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.514+0000 7f6a0cfff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a0814a800 0x7f6a081f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.514+0000 7f6a0cfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a081f6230 0x7f6a080d2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.514+0000 7f6a0cfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a081f21a0 con 0x7f69f4004d90 2023-08-25T04:45:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.514+0000 7f6a0cfff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080cc730 con 0x7f6a0814a800 2023-08-25T04:45:40.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.514+0000 7f6a0cfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c8140 con 0x7f6a081f6230 2023-08-25T04:45:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.514+0000 7f6a0659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 0x7f6a08148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.514+0000 7f6a0659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 0x7f6a08148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45224/0 (socket says 172.21.15.72:45224) 2023-08-25T04:45:40.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.514+0000 7f6a0659c700 1 -- 172.21.15.72:0/3038310500 learned_addr learned my addr 172.21.15.72:0/3038310500 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f6a06d9d700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a081f6230 0x7f6a080d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f6a0659c700 1 -- 172.21.15.72:0/3038310500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a081f6230 msgr2=0x7f6a080d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f69fffff700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a0814a800 0x7f6a081f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f6a0659c700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a081f6230 0x7f6a080d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f6a0659c700 1 -- 172.21.15.72:0/3038310500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a0814a800 msgr2=0x7f6a081f1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f6a0659c700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a0814a800 0x7f6a081f1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f6a0659c700 1 -- 172.21.15.72:0/3038310500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080ccc50 con 0x7f69f4004d90 2023-08-25T04:45:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f6a06d9d700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a081f6230 0x7f6a080d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f69fffff700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a0814a800 0x7f6a081f1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f6a0659c700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 0x7f6a08148140 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f69f800e7e0 tx=0x7f69f800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f69feffd700 1 -- 172.21.15.72:0/3038310500 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80052e0 con 0x7f69f4004d90 2023-08-25T04:45:40.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f69feffd700 1 -- 172.21.15.72:0/3038310500 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f8005440 con 0x7f69f4004d90 2023-08-25T04:45:40.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f6a0cfff700 1 -- 172.21.15.72:0/3038310500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a080cc970 con 0x7f69f4004d90 2023-08-25T04:45:40.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f69feffd700 1 -- 172.21.15.72:0/3038310500 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80038c0 con 0x7f69f4004d90 2023-08-25T04:45:40.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.515+0000 7f6a0cfff700 1 -- 172.21.15.72:0/3038310500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0814cbc0 con 0x7f69f4004d90 2023-08-25T04:45:40.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.517+0000 7f6a0cfff700 1 -- 172.21.15.72:0/3038310500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0814c740 con 0x7f69f4004d90 2023-08-25T04:45:40.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.517+0000 7f69feffd700 1 -- 172.21.15.72:0/3038310500 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f69f8003a20 con 0x7f69f4004d90 2023-08-25T04:45:40.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.518+0000 7f69feffd700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f69e806a0e0 0x7f69e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:40.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.518+0000 7f69feffd700 1 -- 172.21.15.72:0/3038310500 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f69f8087fe0 con 0x7f69f4004d90 2023-08-25T04:45:40.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.518+0000 7f69fffff700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f69e806a0e0 0x7f69e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:40.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.519+0000 7f69fffff700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f69e806a0e0 0x7f69e806c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a080b5fe0 tx=0x7f69f0001da0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:40.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.522+0000 7f69feffd700 1 -- 172.21.15.72:0/3038310500 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6a0814c740 con 0x7f69f4004d90 2023-08-25T04:45:40.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.720+0000 7f6a0cfff700 1 -- 172.21.15.72:0/3038310500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a0814c740 con 0x7f69f4004d90 2023-08-25T04:45:40.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.721+0000 7f69feffd700 1 -- 172.21.15.72:0/3038310500 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f6a0814c740 con 0x7f69f4004d90 2023-08-25T04:45:40.722 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:40.723 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.723+0000 7f6a0cfff700 1 -- 172.21.15.72:0/3038310500 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f69e806a0e0 msgr2=0x7f69e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.723+0000 7f6a0cfff700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f69e806a0e0 0x7f69e806c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a080b5fe0 tx=0x7f69f0001da0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.723+0000 7f6a0cfff700 1 -- 172.21.15.72:0/3038310500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 msgr2=0x7f6a08148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.723+0000 7f6a0cfff700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 0x7f6a08148140 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f69f800e7e0 tx=0x7f69f800eba0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.723+0000 7f6a0cfff700 1 -- 172.21.15.72:0/3038310500 shutdown_connections 2023-08-25T04:45:40.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.724+0000 7f6a0cfff700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f69e806a0e0 0x7f69e806c5a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.724+0000 7f6a0cfff700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a081f6230 0x7f6a080d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.724+0000 7f6a0cfff700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4004d90 0x7f6a08148140 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.724+0000 7f6a0cfff700 1 --2- 172.21.15.72:0/3038310500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a0814a800 0x7f6a081f1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:40.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.724+0000 7f6a0cfff700 1 -- 172.21.15.72:0/3038310500 >> 172.21.15.72:0/3038310500 conn(0x7f6a08072050 msgr2=0x7f6a080ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:40.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.724+0000 7f6a0cfff700 1 -- 172.21.15.72:0/3038310500 shutdown_connections 2023-08-25T04:45:40.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:40.724+0000 7f6a0cfff700 1 -- 172.21.15.72:0/3038310500 wait complete. 2023-08-25T04:45:41.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:45:32.715423+0000', 'modified': '2023-08-25T04:45:38.454980+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6834/1278273500', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6832', 'nonce': 1278273500}, {'type': 'v1', 'addr': '172.21.15.137:6834', 'nonce': 1278273500}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-08-25T04:45:41.146 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:45:41.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-25T04:45:41.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.347+0000 7ffa4d3ff700 1 Processor -- start 2023-08-25T04:45:41.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.347+0000 7ffa4d3ff700 1 -- start start 2023-08-25T04:45:41.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.348+0000 7ffa4d3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 0x7ffa480b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.348+0000 7ffa4d3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa480b51a0 con 0x7ffa48160710 2023-08-25T04:45:41.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.348+0000 7ffa4d3ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa480b7650 con 0x7ffa480b4d40 2023-08-25T04:45:41.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.348+0000 7ffa4d3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480b7930 con 0x7ffa480d20f0 2023-08-25T04:45:41.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.348+0000 7ffa46ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffa48160710 0x7ffa480b87f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35118/0 (socket says 172.21.15.72:35118) 2023-08-25T04:45:41.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.348+0000 7ffa46ffd700 1 -- 172.21.15.72:0/2489911856 learned_addr learned my addr 172.21.15.72:0/2489911856 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:41.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.349+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/2489911856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 0x7ffa480b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.349+0000 7ffa467fc700 1 -- 172.21.15.72:0/2489911856 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446466457 0 0) 0x7ffa480b51a0 con 0x7ffa48160710 2023-08-25T04:45:41.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.349+0000 7ffa467fc700 1 -- 172.21.15.72:0/2489911856 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa340035b0 con 0x7ffa48160710 2023-08-25T04:45:41.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.349+0000 7ffa467fc700 1 -- 172.21.15.72:0/2489911856 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880067837 0 0) 0x7ffa480b7650 con 0x7ffa480b4d40 2023-08-25T04:45:41.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.349+0000 7ffa3ffff700 1 -- 172.21.15.72:0/2489911856 >> v1:172.21.15.137:6789/0 conn(0x7ffa480b4d40 legacy=0x7ffa480b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.349+0000 7ffa3ffff700 1 -- 172.21.15.72:0/2489911856 >> v1:172.21.15.72:6789/0 conn(0x7ffa48160710 legacy=0x7ffa480b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.349+0000 7ffa3ffff700 1 -- 172.21.15.72:0/2489911856 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa480b7c10 con 0x7ffa480d20f0 2023-08-25T04:45:41.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.349+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/2489911856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 0x7ffa480b4800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009870 tx=0x7ffa30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e812e2fbbfa00f62 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.350+0000 7ffa467fc700 1 -- 172.21.15.72:0/2489911856 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38001670 con 0x7ffa480d20f0 2023-08-25T04:45:41.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.350+0000 7ffa467fc700 1 -- 172.21.15.72:0/2489911856 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa30004030 con 0x7ffa480d20f0 2023-08-25T04:45:41.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.350+0000 7ffa467fc700 1 -- 172.21.15.72:0/2489911856 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300043a0 con 0x7ffa480d20f0 2023-08-25T04:45:41.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.350+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/2489911856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 msgr2=0x7ffa480b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.350+0000 7ffa4d3ff700 1 --2- 172.21.15.72:0/2489911856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 0x7ffa480b4800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009870 tx=0x7ffa30009b80 comp rx=0 tx=0).stop 2023-08-25T04:45:41.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.350+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/2489911856 shutdown_connections 2023-08-25T04:45:41.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.350+0000 7ffa4d3ff700 1 --2- 172.21.15.72:0/2489911856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 0x7ffa480b4800 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.350+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/2489911856 >> 172.21.15.72:0/2489911856 conn(0x7ffa48071e40 msgr2=0x7ffa48072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.350+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/2489911856 shutdown_connections 2023-08-25T04:45:41.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.350+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/2489911856 wait complete. 2023-08-25T04:45:41.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.352+0000 7ffa4d3ff700 1 Processor -- start 2023-08-25T04:45:41.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.352+0000 7ffa4d3ff700 1 -- start start 2023-08-25T04:45:41.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.353+0000 7ffa4d3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa480b4d40 0x7ffa481f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.353+0000 7ffa4d3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 0x7ffa480c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.353+0000 7ffa4d3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa48160710 0x7ffa480c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.353+0000 7ffa4d3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4814f060 con 0x7ffa480b4d40 2023-08-25T04:45:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.353+0000 7ffa4d3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa481f6880 con 0x7ffa48160710 2023-08-25T04:45:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.353+0000 7ffa4d3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4814ed80 con 0x7ffa480d20f0 2023-08-25T04:45:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.353+0000 7ffa46ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa480b4d40 0x7ffa481f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.353+0000 7ffa46ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa480b4d40 0x7ffa481f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45234/0 (socket says 172.21.15.72:45234) 2023-08-25T04:45:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa46ffd700 1 -- 172.21.15.72:0/1409782745 learned_addr learned my addr 172.21.15.72:0/1409782745 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 0x7ffa480c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa477fe700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa48160710 0x7ffa480c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa46ffd700 1 -- 172.21.15.72:0/1409782745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 msgr2=0x7ffa480c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 0x7ffa480c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa46ffd700 1 -- 172.21.15.72:0/1409782745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa48160710 msgr2=0x7ffa480c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa48160710 0x7ffa480c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa46ffd700 1 -- 172.21.15.72:0/1409782745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300094a0 con 0x7ffa480b4d40 2023-08-25T04:45:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa480b4d40 0x7ffa481f6340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800c750 tx=0x7ffa3800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa3f7fe700 1 -- 172.21.15.72:0/1409782745 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38004c80 con 0x7ffa480b4d40 2023-08-25T04:45:41.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa3f7fe700 1 -- 172.21.15.72:0/1409782745 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa38004de0 con 0x7ffa480b4d40 2023-08-25T04:45:41.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa3f7fe700 1 -- 172.21.15.72:0/1409782745 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa380072f0 con 0x7ffa480b4d40 2023-08-25T04:45:41.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.354+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/1409782745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa48150490 con 0x7ffa480b4d40 2023-08-25T04:45:41.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.355+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/1409782745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa48150a50 con 0x7ffa480b4d40 2023-08-25T04:45:41.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.356+0000 7ffa3f7fe700 1 -- 172.21.15.72:0/1409782745 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffa38007450 con 0x7ffa480b4d40 2023-08-25T04:45:41.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.357+0000 7ffa3f7fe700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.357+0000 7ffa3f7fe700 1 -- 172.21.15.72:0/1409782745 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa380886d0 con 0x7ffa480b4d40 2023-08-25T04:45:41.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.358+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.358+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa30000c00 tx=0x7ffa30008000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.359+0000 7ffa60d2cb80 1 Processor -- start 2023-08-25T04:45:41.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.360+0000 7ffa60d2cb80 1 -- start start 2023-08-25T04:45:41.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc5a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc4fb5e0 con 0x55a8bc5de820 2023-08-25T04:45:41.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc4f8d40 con 0x55a8bc5ca760 2023-08-25T04:45:41.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc4f4630 con 0x55a8bc5cce00 2023-08-25T04:45:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5a2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45244/0 (socket says 172.21.15.72:45244) 2023-08-25T04:45:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa477fe700 1 -- 172.21.15.72:0/1358067964 learned_addr learned my addr 172.21.15.72:0/1358067964 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/1358067964 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc5a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/1358067964 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa477fe700 1 -- 172.21.15.72:0/1358067964 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 msgr2=0x55a8bc5cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa477fe700 1 --2- 172.21.15.72:0/1358067964 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa477fe700 1 -- 172.21.15.72:0/1358067964 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 msgr2=0x55a8bc5a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa477fe700 1 --2- 172.21.15.72:0/1358067964 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc5a28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa477fe700 1 -- 172.21.15.72:0/1358067964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8bc3d30a0 con 0x55a8bc5de820 2023-08-25T04:45:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.361+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/1358067964 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc5a28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.362+0000 7ffa477fe700 1 --2- 172.21.15.72:0/1358067964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5a2e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa40001f40 tx=0x7ffa4000f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2fe9f78093f7a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.362+0000 7ffa3cff9700 1 -- 172.21.15.72:0/1358067964 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40003c10 con 0x55a8bc5de820 2023-08-25T04:45:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.362+0000 7ffa3cff9700 1 -- 172.21.15.72:0/1358067964 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa40003d70 con 0x55a8bc5de820 2023-08-25T04:45:41.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.362+0000 7ffa3cff9700 1 -- 172.21.15.72:0/1358067964 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4000fb00 con 0x55a8bc5de820 2023-08-25T04:45:41.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.362+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1358067964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 msgr2=0x55a8bc5a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.362+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/1358067964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5a2e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa40001f40 tx=0x7ffa4000f1d0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.363+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1358067964 shutdown_connections 2023-08-25T04:45:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.363+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/1358067964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5a2e10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.363+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/1358067964 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.363+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/1358067964 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc5a28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.363+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1358067964 >> 172.21.15.72:0/1358067964 conn(0x55a8bc516b90 msgr2=0x55a8bc5a0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.363+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1358067964 shutdown_connections 2023-08-25T04:45:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.363+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1358067964 wait complete. 2023-08-25T04:45:41.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.364+0000 7ffa60d2cb80 1 -- start start 2023-08-25T04:45:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.364+0000 7ffa60d2cb80 1 Processor -- start 2023-08-25T04:45:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5ca760 0x55a8bc5f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5de820 0x55a8bc5c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc4b0750 con 0x55a8bc5ca760 2023-08-25T04:45:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc496ab0 con 0x55a8bc5de820 2023-08-25T04:45:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc2e7390 con 0x55a8bc5cce00 2023-08-25T04:45:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa60d2cb80 10 client.0 _ll_register_callbacks cb 0x55a8bc490400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:45:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa46ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5ca760 0x55a8bc5f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa46ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5ca760 0x55a8bc5f9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45256/0 (socket says 172.21.15.72:45256) 2023-08-25T04:45:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa46ffd700 1 -- 172.21.15.72:0/4272981672 learned_addr learned my addr 172.21.15.72:0/4272981672 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa477fe700 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5de820 0x55a8bc5c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa46ffd700 1 -- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 msgr2=0x55a8bc5c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa46ffd700 1 -- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5de820 msgr2=0x55a8bc5c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5de820 0x55a8bc5c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa46ffd700 1 -- 172.21.15.72:0/4272981672 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa40001c10 con 0x55a8bc5ca760 2023-08-25T04:45:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.366+0000 7ffa477fe700 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5de820 0x55a8bc5c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5ca760 0x55a8bc5f9c00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa380017a0 tx=0x7ffa3800e300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a89254a59bc5118 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa25ffb700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-25T04:45:41.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa25ffb700 1 -- 172.21.15.72:0/4272981672 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3805f400 con 0x55a8bc5ca760 2023-08-25T04:45:41.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa25ffb700 1 -- 172.21.15.72:0/4272981672 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa3805ef70 con 0x55a8bc5ca760 2023-08-25T04:45:41.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4272981672 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8bc3cbc00 con 0x55a8bc5ca760 2023-08-25T04:45:41.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa25ffb700 1 -- 172.21.15.72:0/4272981672 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa3805f130 con 0x55a8bc5ca760 2023-08-25T04:45:41.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa60d2cb80 10 client.4419 fetch_fsmap learned FSMap version 7 2023-08-25T04:45:41.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4272981672 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a8bc4b8b10 con 0x55a8bc5ca760 2023-08-25T04:45:41.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa25ffb700 1 -- 172.21.15.72:0/4272981672 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8bc3cbc00 con 0x55a8bc5ca760 2023-08-25T04:45:41.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa25ffb700 1 -- 172.21.15.72:0/4272981672 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7ffa3805d0c0 con 0x55a8bc5ca760 2023-08-25T04:45:41.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa60d2cb80 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2023-08-25T04:45:41.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa60d2cb80 10 client.4419 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-25T04:45:41.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa60d2cb80 20 client.4419 populate_metadata read hostname 'smithi072' 2023-08-25T04:45:41.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x55a8bc5ebc50 0x55a8bc5e6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa60d2cb80 4 client.4419 mds_command: new command op to 4297 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:45:41.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.367+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4272981672 --> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8bc571530 con 0x55a8bc5ebc50 2023-08-25T04:45:41.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.368+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x55a8bc5ebc50 0x55a8bc5e6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.368+0000 7ffa25ffb700 10 client.4419 ms_handle_connect on v2:172.21.15.137:6832/1278273500 2023-08-25T04:45:41.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.368+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x55a8bc5ebc50 0x55a8bc5e6230 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e237324d22b5ab6f server_cookie=72eb06b77c64a98 in_seq=0 out_seq=0 2023-08-25T04:45:41.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.369+0000 7ffa25ffb700 1 -- 172.21.15.72:0/4272981672 <== mds.0 v2:172.21.15.137:6832/1278273500 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a8bc571530 con 0x55a8bc5ebc50 2023-08-25T04:45:41.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.369+0000 7ffa25ffb700 10 client.4419 handle_command_reply: tid=0 2023-08-25T04:45:41.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.369+0000 7ffa60d2cb80 1 client.4419 shutdown 2023-08-25T04:45:41.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.369+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4272981672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5ca760 msgr2=0x55a8bc5f9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.369+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5ca760 0x55a8bc5f9c00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa380017a0 tx=0x7ffa3800e300 comp rx=0 tx=0).stop 2023-08-25T04:45:41.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.370+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4272981672 shutdown_connections 2023-08-25T04:45:41.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.370+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5de820 0x55a8bc5c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.370+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x55a8bc5ebc50 0x55a8bc5e6230 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.370+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5ca760 0x55a8bc5f9c00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.370+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/4272981672 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.370+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4272981672 >> 172.21.15.72:0/4272981672 conn(0x55a8bc516b90 msgr2=0x55a8bc597020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.370+0000 7ffa25ffb700 0 client.4419 ms_handle_reset on v2:172.21.15.137:6832/1278273500 2023-08-25T04:45:41.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.370+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4272981672 shutdown_connections 2023-08-25T04:45:41.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.370+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4272981672 wait complete. 2023-08-25T04:45:41.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.370+0000 7ffa60d2cb80 20 client.4419 trim_cache size 0 max 16384 2023-08-25T04:45:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.388+0000 7ffa60d2cb80 1 Processor -- start 2023-08-25T04:45:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.388+0000 7ffa60d2cb80 1 -- start start 2023-08-25T04:45:41.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.389+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc5cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.389+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5cce00 0x55a8bc5cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.389+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5de820 0x55a8bc5c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.389+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc5c3f10 con 0x55a8bc5cce00 2023-08-25T04:45:41.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.389+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc5a34c0 con 0x55a8bc5ca760 2023-08-25T04:45:41.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.389+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc5a0e10 con 0x55a8bc5de820 2023-08-25T04:45:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5cce00 0x55a8bc5cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5cce00 0x55a8bc5cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45262/0 (socket says 172.21.15.72:45262) 2023-08-25T04:45:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3ffff700 1 -- 172.21.15.72:0/4161324934 learned_addr learned my addr 172.21.15.72:0/4161324934 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3ffff700 1 -- 172.21.15.72:0/4161324934 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5de820 msgr2=0x55a8bc5c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/4161324934 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5de820 0x55a8bc5c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3ffff700 1 -- 172.21.15.72:0/4161324934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 msgr2=0x55a8bc5cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/4161324934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc5cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3ffff700 1 -- 172.21.15.72:0/4161324934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8bc3471d0 con 0x55a8bc5cce00 2023-08-25T04:45:41.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/4161324934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5cce00 0x55a8bc5cb080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa30004000 tx=0x7ffa30010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6170c1b15db73c5b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3d7fa700 1 -- 172.21.15.72:0/4161324934 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30003ce0 con 0x55a8bc5cce00 2023-08-25T04:45:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3d7fa700 1 -- 172.21.15.72:0/4161324934 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3002d040 con 0x55a8bc5cce00 2023-08-25T04:45:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.390+0000 7ffa3d7fa700 1 -- 172.21.15.72:0/4161324934 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30032b10 con 0x55a8bc5cce00 2023-08-25T04:45:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.391+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4161324934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5cce00 msgr2=0x55a8bc5cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.391+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/4161324934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5cce00 0x55a8bc5cb080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa30004000 tx=0x7ffa30010000 comp rx=0 tx=0).stop 2023-08-25T04:45:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.391+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4161324934 shutdown_connections 2023-08-25T04:45:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.391+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/4161324934 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5de820 0x55a8bc5c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.391+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/4161324934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc5cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.391+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/4161324934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5cce00 0x55a8bc5cb080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.391+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4161324934 >> 172.21.15.72:0/4161324934 conn(0x55a8bc516b90 msgr2=0x55a8bc600b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.391+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4161324934 shutdown_connections 2023-08-25T04:45:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.391+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/4161324934 wait complete. 2023-08-25T04:45:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.392+0000 7ffa60d2cb80 1 -- start start 2023-08-25T04:45:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.392+0000 7ffa60d2cb80 1 Processor -- start 2023-08-25T04:45:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc64e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5ffa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa60d2cb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5fff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc64ec20 con 0x55a8bc5de820 2023-08-25T04:45:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc5f93f0 con 0x55a8bc5ca760 2023-08-25T04:45:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa60d2cb80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8bc5c29a0 con 0x55a8bc5cce00 2023-08-25T04:45:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa60d2cb80 10 client.0 _ll_register_callbacks cb 0x55a8bc5e9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:45:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5fff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45268/0 (socket says 172.21.15.72:45268) 2023-08-25T04:45:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa477fe700 1 -- 172.21.15.72:0/1005994736 learned_addr learned my addr 172.21.15.72:0/1005994736 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5ffa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc64e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa477fe700 1 -- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 msgr2=0x55a8bc5ffa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa477fe700 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5ffa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa477fe700 1 -- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 msgr2=0x55a8bc64e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa477fe700 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc64e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa477fe700 1 -- 172.21.15.72:0/1005994736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa480b7c10 con 0x55a8bc5de820 2023-08-25T04:45:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa3ffff700 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.393+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc64e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.394+0000 7ffa477fe700 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5fff80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa40001ee0 tx=0x7ffa40001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df4325ede5ef5e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.394+0000 7ffa25ffb700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-25T04:45:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.394+0000 7ffa25ffb700 1 -- 172.21.15.72:0/1005994736 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400050d0 con 0x55a8bc5de820 2023-08-25T04:45:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.394+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1005994736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa40003d70 con 0x55a8bc5de820 2023-08-25T04:45:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.394+0000 7ffa25ffb700 1 -- 172.21.15.72:0/1005994736 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa40005230 con 0x55a8bc5de820 2023-08-25T04:45:41.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.394+0000 7ffa25ffb700 1 -- 172.21.15.72:0/1005994736 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa400053f0 con 0x55a8bc5de820 2023-08-25T04:45:41.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.394+0000 7ffa60d2cb80 10 client.4425 fetch_fsmap learned FSMap version 7 2023-08-25T04:45:41.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.394+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1005994736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a8bc320d60 con 0x55a8bc5de820 2023-08-25T04:45:41.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.394+0000 7ffa25ffb700 1 -- 172.21.15.72:0/1005994736 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa40003d70 con 0x55a8bc5de820 2023-08-25T04:45:41.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.394+0000 7ffa25ffb700 1 -- 172.21.15.72:0/1005994736 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7ffa40005550 con 0x55a8bc5de820 2023-08-25T04:45:41.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.395+0000 7ffa60d2cb80 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-08-25T04:45:41.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.395+0000 7ffa60d2cb80 10 client.4425 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-25T04:45:41.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.395+0000 7ffa60d2cb80 20 client.4425 populate_metadata read hostname 'smithi072' 2023-08-25T04:45:41.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.395+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x55a8bc5f8710 0x55a8bc5f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.395+0000 7ffa60d2cb80 4 client.4425 mds_command: new command op to 4297 tid=0[{"prefix": "status"}] 2023-08-25T04:45:41.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.395+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1005994736 --> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a8bc4ed770 con 0x55a8bc5f8710 2023-08-25T04:45:41.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.395+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x55a8bc5f8710 0x55a8bc5f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.395+0000 7ffa46ffd700 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x55a8bc5f8710 0x55a8bc5f8af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d7a3d4ab2e7146 server_cookie=57bd6e4d4c34eb80 in_seq=0 out_seq=0 2023-08-25T04:45:41.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.395+0000 7ffa25ffb700 10 client.4425 ms_handle_connect on v2:172.21.15.137:6832/1278273500 2023-08-25T04:45:41.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa25ffb700 1 -- 172.21.15.72:0/1005994736 <== mds.0 v2:172.21.15.137:6832/1278273500 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a8bc4ed770 con 0x55a8bc5f8710 2023-08-25T04:45:41.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa25ffb700 10 client.4425 handle_command_reply: tid=0 2023-08-25T04:45:41.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 client.4425 shutdown 2023-08-25T04:45:41.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1005994736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 msgr2=0x55a8bc5fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5fff80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa40001ee0 tx=0x7ffa40001250 comp rx=0 tx=0).stop 2023-08-25T04:45:41.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1005994736 shutdown_connections 2023-08-25T04:45:41.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x55a8bc5f8710 0x55a8bc5f8af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a8bc5de820 0x55a8bc5fff80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8bc5ca760 0x55a8bc64e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa25ffb700 0 client.4425 ms_handle_reset on v2:172.21.15.137:6832/1278273500 2023-08-25T04:45:41.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 --2- 172.21.15.72:0/1005994736 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8bc5cce00 0x55a8bc5ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1005994736 >> 172.21.15.72:0/1005994736 conn(0x55a8bc516b90 msgr2=0x55a8bc5cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1005994736 shutdown_connections 2023-08-25T04:45:41.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 1 -- 172.21.15.72:0/1005994736 wait complete. 2023-08-25T04:45:41.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.396+0000 7ffa60d2cb80 20 client.4425 trim_cache size 0 max 16384 2023-08-25T04:45:41.406 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-25T04:45:41.406 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "48882d5a-36fb-4a1e-9265-02d65750e322", 2023-08-25T04:45:41.406 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-25T04:45:41.406 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4297, 2023-08-25T04:45:41.406 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-25T04:45:41.406 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-25T04:45:41.407 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-25T04:45:41.407 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 7.9615879209999996, 2023-08-25T04:45:41.407 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 7, 2023-08-25T04:45:41.407 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 25, 2023-08-25T04:45:41.407 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 25, 2023-08-25T04:45:41.407 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 14.252434438 2023-08-25T04:45:41.407 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-25T04:45:41.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/1409782745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ffa2806a0e0 msgr2=0x7ffa2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa30000c00 tx=0x7ffa30008000 comp rx=0 tx=0).stop 2023-08-25T04:45:41.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/1409782745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa480b4d40 msgr2=0x7ffa481f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa480b4d40 0x7ffa481f6340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800c750 tx=0x7ffa3800ca60 comp rx=0 tx=0).stop 2023-08-25T04:45:41.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/1409782745 shutdown_connections 2023-08-25T04:45:41.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa48160710 0x7ffa480c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa480b4d40 0x7ffa481f6340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 --2- 172.21.15.72:0/1409782745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffa480d20f0 0x7ffa480c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/1409782745 >> 172.21.15.72:0/1409782745 conn(0x7ffa48071e40 msgr2=0x7ffa480d1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/1409782745 shutdown_connections 2023-08-25T04:45:41.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.397+0000 7ffa4d3ff700 1 -- 172.21.15.72:0/1409782745 wait complete. 2023-08-25T04:45:41.414 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:45:41.415 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-25T04:45:41.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:45:41.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.608+0000 7f9494dff700 1 Processor -- start 2023-08-25T04:45:41.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.609+0000 7f9494dff700 1 -- start start 2023-08-25T04:45:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.610+0000 7f9494dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94900d0df0 0x7f94900d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.610+0000 7f9494dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94900d1fe0 con 0x7f94900cda40 2023-08-25T04:45:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.610+0000 7f9494dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94900d13d0 con 0x7f949015ce60 2023-08-25T04:45:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.610+0000 7f9494dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900d16b0 con 0x7f94900d0df0 2023-08-25T04:45:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.610+0000 7f948ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f94900cda40 0x7f94900b5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35132/0 (socket says 172.21.15.72:35132) 2023-08-25T04:45:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.610+0000 7f948ed9d700 1 -- 172.21.15.72:0/4114585404 learned_addr learned my addr 172.21.15.72:0/4114585404 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.610+0000 7f948dd9b700 1 --2- 172.21.15.72:0/4114585404 >> v2:172.21.15.72:3300/0 conn(0x7f94900d0df0 0x7f94900d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.610+0000 7f948d59a700 1 -- 172.21.15.72:0/4114585404 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676084607 0 0) 0x7f94900d1fe0 con 0x7f94900cda40 2023-08-25T04:45:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.611+0000 7f948d59a700 1 -- 172.21.15.72:0/4114585404 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94780035b0 con 0x7f94900cda40 2023-08-25T04:45:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.611+0000 7f948dd9b700 1 -- 172.21.15.72:0/4114585404 >> v1:172.21.15.137:6789/0 conn(0x7f949015ce60 legacy=0x7f94900b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.611+0000 7f948dd9b700 1 -- 172.21.15.72:0/4114585404 >> v1:172.21.15.72:6789/0 conn(0x7f94900cda40 legacy=0x7f94900b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.611+0000 7f948dd9b700 1 -- 172.21.15.72:0/4114585404 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900d1990 con 0x7f94900d0df0 2023-08-25T04:45:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.611+0000 7f948dd9b700 1 --2- 172.21.15.72:0/4114585404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 0x7f94900d2470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9484009840 tx=0x7f9484009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56500ff3eb4fd7aa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.611+0000 7f948d59a700 1 -- 172.21.15.72:0/4114585404 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484011830 con 0x7f94900d0df0 2023-08-25T04:45:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.611+0000 7f948d59a700 1 -- 172.21.15.72:0/4114585404 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9484011990 con 0x7f94900d0df0 2023-08-25T04:45:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.611+0000 7f948d59a700 1 -- 172.21.15.72:0/4114585404 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484011d20 con 0x7f94900d0df0 2023-08-25T04:45:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.612+0000 7f9494dff700 1 -- 172.21.15.72:0/4114585404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 msgr2=0x7f94900d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.612+0000 7f9494dff700 1 --2- 172.21.15.72:0/4114585404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 0x7f94900d2470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9484009840 tx=0x7f9484009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.612+0000 7f9494dff700 1 -- 172.21.15.72:0/4114585404 shutdown_connections 2023-08-25T04:45:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.612+0000 7f9494dff700 1 --2- 172.21.15.72:0/4114585404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 0x7f94900d2470 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.612+0000 7f9494dff700 1 -- 172.21.15.72:0/4114585404 >> 172.21.15.72:0/4114585404 conn(0x7f9490071e10 msgr2=0x7f9490072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.612+0000 7f9494dff700 1 -- 172.21.15.72:0/4114585404 shutdown_connections 2023-08-25T04:45:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.612+0000 7f9494dff700 1 -- 172.21.15.72:0/4114585404 wait complete. 2023-08-25T04:45:41.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.614+0000 7f9494dff700 1 Processor -- start 2023-08-25T04:45:41.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.614+0000 7f9494dff700 1 -- start start 2023-08-25T04:45:41.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f9494dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94900cda40 0x7f94900cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f9494dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 0x7f94900c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f9494dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949015ce60 0x7f949015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f9494dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900cb4f0 con 0x7f94900d0df0 2023-08-25T04:45:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f9494dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900cac50 con 0x7f949015ce60 2023-08-25T04:45:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f9494dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900caf30 con 0x7f94900cda40 2023-08-25T04:45:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 0x7f94900c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 0x7f94900c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45278/0 (socket says 172.21.15.72:45278) 2023-08-25T04:45:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948dd9b700 1 -- 172.21.15.72:0/2989957294 learned_addr learned my addr 172.21.15.72:0/2989957294 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948e59c700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94900cda40 0x7f94900cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948ed9d700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949015ce60 0x7f949015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948dd9b700 1 -- 172.21.15.72:0/2989957294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94900cda40 msgr2=0x7f94900cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948dd9b700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94900cda40 0x7f94900cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948dd9b700 1 -- 172.21.15.72:0/2989957294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949015ce60 msgr2=0x7f949015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948dd9b700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949015ce60 0x7f949015dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948dd9b700 1 -- 172.21.15.72:0/2989957294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94840094a0 con 0x7f94900d0df0 2023-08-25T04:45:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948ed9d700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949015ce60 0x7f949015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.616+0000 7f948dd9b700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 0x7f94900c7f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9484009fd0 tx=0x7f9484004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.617+0000 7f947effd700 1 -- 172.21.15.72:0/2989957294 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94840036a0 con 0x7f94900d0df0 2023-08-25T04:45:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.617+0000 7f947effd700 1 -- 172.21.15.72:0/2989957294 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948401f070 con 0x7f94900d0df0 2023-08-25T04:45:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.617+0000 7f947effd700 1 -- 172.21.15.72:0/2989957294 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484003a20 con 0x7f94900d0df0 2023-08-25T04:45:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.617+0000 7f9494dff700 1 -- 172.21.15.72:0/2989957294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94900cb210 con 0x7f94900d0df0 2023-08-25T04:45:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.617+0000 7f9494dff700 1 -- 172.21.15.72:0/2989957294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9490160400 con 0x7f94900d0df0 2023-08-25T04:45:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.618+0000 7f9494dff700 1 -- 172.21.15.72:0/2989957294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949015d920 con 0x7f94900d0df0 2023-08-25T04:45:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.619+0000 7f947effd700 1 -- 172.21.15.72:0/2989957294 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9484003b80 con 0x7f94900d0df0 2023-08-25T04:45:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.619+0000 7f947effd700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f947006a0e0 0x7f947006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.620+0000 7f947effd700 1 -- 172.21.15.72:0/2989957294 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9484021070 con 0x7f94900d0df0 2023-08-25T04:45:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.620+0000 7f948e59c700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f947006a0e0 0x7f947006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.620+0000 7f948e59c700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f947006a0e0 0x7f947006c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9480007fd0 tx=0x7f9480009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.624+0000 7f947effd700 1 -- 172.21.15.72:0/2989957294 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f949015d920 con 0x7f94900d0df0 2023-08-25T04:45:41.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.865+0000 7f9494dff700 1 -- 172.21.15.72:0/2989957294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f949015d920 con 0x7f94900d0df0 2023-08-25T04:45:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.865+0000 7f947effd700 1 -- 172.21.15.72:0/2989957294 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f948402b070 con 0x7f94900d0df0 2023-08-25T04:45:41.867 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-25T04:45:41.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 -- 172.21.15.72:0/2989957294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f947006a0e0 msgr2=0x7f947006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f947006a0e0 0x7f947006c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9480007fd0 tx=0x7f9480009040 comp rx=0 tx=0).stop 2023-08-25T04:45:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 -- 172.21.15.72:0/2989957294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 msgr2=0x7f94900c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 0x7f94900c7f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9484009fd0 tx=0x7f9484004750 comp rx=0 tx=0).stop 2023-08-25T04:45:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 -- 172.21.15.72:0/2989957294 shutdown_connections 2023-08-25T04:45:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f947006a0e0 0x7f947006c5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f949015ce60 0x7f949015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f94900cda40 0x7f94900cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 --2- 172.21.15.72:0/2989957294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94900d0df0 0x7f94900c7f80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:41.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 -- 172.21.15.72:0/2989957294 >> 172.21.15.72:0/2989957294 conn(0x7f9490071e10 msgr2=0x7f94900b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:41.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 -- 172.21.15.72:0/2989957294 shutdown_connections 2023-08-25T04:45:41.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:41.868+0000 7f9494dff700 1 -- 172.21.15.72:0/2989957294 wait complete. 2023-08-25T04:45:41.888 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T04:45:41.888 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:45:41.889 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-25T04:45:41.889 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-08-25T04:45:41.889 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-25T04:45:41.889 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T04:45:41.890 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:45:41.890 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:45:41.890 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-08-25T04:45:41.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:41.891 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-25T04:45:41.937 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:45:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:45:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:45:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:45:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-25T04:45:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:45:41.939 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:45:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:45:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-25T04:45:41.939 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:45:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:45:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-25T04:45:41.939 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:45:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:45:41.940 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:45:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:45:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-25T04:45:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42226sec preferred_lft 42226sec 2023-08-25T04:45:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-25T04:45:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:45:41.941 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-25T04:45:41.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:41.942 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:45:41.942 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:45:41.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-08-25T04:45:41.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-08-25T04:45:41.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-08-25T04:45:41.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-25T04:45:41.944 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:45:45.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:45.122 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:45:45.228 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-25T04:45:45.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:45.232 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-25T04:45:45.311 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-25T04:45:45.311 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:45:45.312 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T04:45:45.312 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T04:45:45.312 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:45:45.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:45.314 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:45:45.315 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:45:45.315 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T04:45:45.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T04:45:45.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T04:45:45.317 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:45:46.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:46.271 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-25T04:45:46.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:46.319 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-08-25T04:45:46.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:46.367 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:45:46.367 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:45:46.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-25T04:45:46.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-08-25T04:45:46.368 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:45:46.512 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-08-25T04:45:46.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:46.514 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:45:46.514 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:45:46.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-08-25T04:45:46.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-25T04:45:46.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-08-25T04:45:46.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-08-25T04:45:46.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-08-25T04:45:46.518 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:45:46.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:47.218 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:45:47.218 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:45:47.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-25T04:45:47.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-08-25T04:45:47.220 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:45:47.392 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-08-25T04:45:47.393 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:45:47.393 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-08-25T04:45:47.440 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-08-25T04:45:47.440 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:45:47.441 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-08-25T04:45:47.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-08-25T04:45:47.598 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:45:47.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:45:47.668 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:45:47.669 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:45:47.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:47.671 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-08-25T04:45:47.717 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-25T04:45:47.717 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-08-25T04:45:47.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-08-25T04:45:47.792 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:45:47.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:45:47.864 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:45:47.866 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:45:47.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:47.868 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-08-25T04:45:47.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:2023-08-25T04:45:47.893+0000 7f4094e505c0 -1 init, newargv = 0x562f852dd7f0 newargc=15 2023-08-25T04:45:47.895 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[122680]: starting ceph client 2023-08-25T04:45:47.906 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[122680]: starting fuse 2023-08-25T04:45:47.919 INFO:teuthology.orchestra.run.smithi072.stdout:43 2023-08-25T04:45:47.919 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-08-25T04:45:47.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2023-08-25T04:45:47.920 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-08-25T04:45:47.921 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-08-25T04:45:47.921 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-08-25T04:45:47.921 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-08-25T04:45:47.921 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:45:47.922 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-08-25T04:45:47.922 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-08-25T04:45:47.923 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-08-25T04:45:47.923 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-08-25T04:45:47.923 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:45:47.923 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-08-25T04:45:47.924 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-08-25T04:45:47.924 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-08-25T04:45:47.924 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-08-25T04:45:47.925 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:45:47.925 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-08-25T04:45:47.925 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-25T04:45:47.925 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-25T04:45:47.926 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-25T04:45:47.926 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-08-25T04:45:47.926 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-08-25T04:45:47.926 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-08-25T04:45:47.927 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-25T04:45:47.927 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:45:47.927 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.admin")) 2023-08-25T04:45:47.928 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-08-25T04:45:48.102 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.admin.122680.asok 2023-08-25T04:45:48.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-25T04:45:48.115 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.122680.asok 2023-08-25T04:45:48.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:48.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.122680.asok status 2023-08-25T04:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-25T04:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-08-25T04:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "ba6b39e4f4f77fb95c747099b53db0467d435f56", 2023-08-25T04:45:48.341 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev)", 2023-08-25T04:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "admin", 2023-08-25T04:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-08-25T04:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-08-25T04:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "122680", 2023-08-25T04:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-08-25T04:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-08-25T04:45:48.342 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-08-25T04:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4443, 2023-08-25T04:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-08-25T04:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-08-25T04:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-08-25T04:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4443 2023-08-25T04:45:48.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-08-25T04:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-08-25T04:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-08-25T04:45:48.344 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1373200166 2023-08-25T04:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-08-25T04:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-08-25T04:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-08-25T04:45:48.345 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1373200166 2023-08-25T04:45:48.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:45:48.346 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4443 192.168.0.1:0/1373200166", 2023-08-25T04:45:48.346 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/1373200166", 2023-08-25T04:45:48.346 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-08-25T04:45:48.346 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 7, 2023-08-25T04:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 25, 2023-08-25T04:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-08-25T04:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-08-25T04:45:48.347 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-08-25T04:45:48.348 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-25T04:45:48.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:48.354 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-08-25T04:45:48.355 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-08-25T04:45:48.402 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-08-25T04:45:48.402 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-08-25T04:45:48.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:48.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-08-25T04:45:48.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:48.514 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-08-25T04:45:48.641 INFO:teuthology.orchestra.run.smithi072.stdout:# file: . 2023-08-25T04:45:48.641 INFO:teuthology.orchestra.run.smithi072.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-08-25T04:45:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:48.642 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:48.642 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:45:48.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:48.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.922+0000 7fb5d6bff700 1 Processor -- start 2023-08-25T04:45:48.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.922+0000 7fb5d6bff700 1 -- start start 2023-08-25T04:45:48.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.923+0000 7fb5d6bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5d00d0df0 0x7fb5d00d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.923+0000 7fb5d6bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 0x7fb5d00cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5d6bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d00d1fe0 con 0x7fb5d015ce60 2023-08-25T04:45:48.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5d6bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d00ce410 con 0x7fb5d00d0df0 2023-08-25T04:45:48.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5d6bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00d13d0 con 0x7fb5d00cda40 2023-08-25T04:45:48.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5cffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5d00d0df0 0x7fb5d00d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5cffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5d00d0df0 0x7fb5d00d2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46602/0 (socket says 172.21.15.72:46602) 2023-08-25T04:45:48.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5cffff700 1 -- 172.21.15.72:0/1692165972 learned_addr learned my addr 172.21.15.72:0/1692165972 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:48.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5d519c700 1 --2- 172.21.15.72:0/1692165972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 0x7fb5d00cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5cffff700 1 -- 172.21.15.72:0/1692165972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 msgr2=0x7fb5d00cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5cffff700 1 --2- 172.21.15.72:0/1692165972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 0x7fb5d00cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5cffff700 1 -- 172.21.15.72:0/1692165972 >> v1:172.21.15.72:6789/0 conn(0x7fb5d015ce60 legacy=0x7fb5d00b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5cffff700 1 -- 172.21.15.72:0/1692165972 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d00d16b0 con 0x7fb5d00d0df0 2023-08-25T04:45:48.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5d519c700 1 --2- 172.21.15.72:0/1692165972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 0x7fb5d00cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:48.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.924+0000 7fb5cf7fe700 1 -- 172.21.15.72:0/1692165972 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019750213 0 0) 0x7fb5d00d1fe0 con 0x7fb5d015ce60 2023-08-25T04:45:48.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5cffff700 1 --2- 172.21.15.72:0/1692165972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d00d0df0 0x7fb5d00d2470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0098f0 tx=0x7fb5bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9d92bf5da630e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5cf7fe700 1 -- 172.21.15.72:0/1692165972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc00b8a0 con 0x7fb5d00d0df0 2023-08-25T04:45:48.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5cf7fe700 1 -- 172.21.15.72:0/1692165972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc00ba00 con 0x7fb5d00d0df0 2023-08-25T04:45:48.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5cf7fe700 1 -- 172.21.15.72:0/1692165972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc00bd90 con 0x7fb5d00d0df0 2023-08-25T04:45:48.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5d6bff700 1 -- 172.21.15.72:0/1692165972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d00d0df0 msgr2=0x7fb5d00d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5d6bff700 1 --2- 172.21.15.72:0/1692165972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d00d0df0 0x7fb5d00d2470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0098f0 tx=0x7fb5bc009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:48.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5d6bff700 1 -- 172.21.15.72:0/1692165972 shutdown_connections 2023-08-25T04:45:48.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5d6bff700 1 --2- 172.21.15.72:0/1692165972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 0x7fb5d00cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5d6bff700 1 --2- 172.21.15.72:0/1692165972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d00d0df0 0x7fb5d00d2470 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5d6bff700 1 -- 172.21.15.72:0/1692165972 >> 172.21.15.72:0/1692165972 conn(0x7fb5d0071e10 msgr2=0x7fb5d0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.925+0000 7fb5d6bff700 1 -- 172.21.15.72:0/1692165972 shutdown_connections 2023-08-25T04:45:48.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.926+0000 7fb5d6bff700 1 -- 172.21.15.72:0/1692165972 wait complete. 2023-08-25T04:45:48.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.928+0000 7fb5d6bff700 1 Processor -- start 2023-08-25T04:45:48.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.928+0000 7fb5d6bff700 1 -- start start 2023-08-25T04:45:48.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.929+0000 7fb5d6bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 0x7fb5d01f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.929+0000 7fb5d6bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5d00d0df0 0x7fb5d015fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.929+0000 7fb5d6bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d015ce60 0x7fb5d01f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.929+0000 7fb5d6bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d01f5550 con 0x7fb5d015ce60 2023-08-25T04:45:48.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.929+0000 7fb5d6bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d01f5ad0 con 0x7fb5d00d0df0 2023-08-25T04:45:48.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.929+0000 7fb5d6bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d01f2a00 con 0x7fb5d00cda40 2023-08-25T04:45:48.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.929+0000 7fb5d519c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d015ce60 0x7fb5d01f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d519c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d015ce60 0x7fb5d01f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46608/0 (socket says 172.21.15.72:46608) 2023-08-25T04:45:48.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d519c700 1 -- 172.21.15.72:0/2461986382 learned_addr learned my addr 172.21.15.72:0/2461986382 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:48.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d499b700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 0x7fb5d01f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d519c700 1 -- 172.21.15.72:0/2461986382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 msgr2=0x7fb5d01f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5cffff700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5d00d0df0 0x7fb5d015fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d519c700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 0x7fb5d01f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d519c700 1 -- 172.21.15.72:0/2461986382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5d00d0df0 msgr2=0x7fb5d015fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:48.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d519c700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5d00d0df0 0x7fb5d015fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:48.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d519c700 1 -- 172.21.15.72:0/2461986382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009550 con 0x7fb5d015ce60 2023-08-25T04:45:48.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d499b700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 0x7fb5d01f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:48.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5cffff700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5d00d0df0 0x7fb5d015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:48.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d519c700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d015ce60 0x7fb5d01f1f10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800cd50 tx=0x7fb5c800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5cd7fa700 1 -- 172.21.15.72:0/2461986382 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800f480 con 0x7fb5d015ce60 2023-08-25T04:45:48.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5cd7fa700 1 -- 172.21.15.72:0/2461986382 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c800f600 con 0x7fb5d015ce60 2023-08-25T04:45:48.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5cd7fa700 1 -- 172.21.15.72:0/2461986382 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800f9b0 con 0x7fb5d015ce60 2023-08-25T04:45:48.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.930+0000 7fb5d6bff700 1 -- 172.21.15.72:0/2461986382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d01f2ce0 con 0x7fb5d015ce60 2023-08-25T04:45:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.931+0000 7fb5d6bff700 1 -- 172.21.15.72:0/2461986382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d0160400 con 0x7fb5d015ce60 2023-08-25T04:45:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.932+0000 7fb5d6bff700 1 -- 172.21.15.72:0/2461986382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d01f5c40 con 0x7fb5d015ce60 2023-08-25T04:45:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.933+0000 7fb5cd7fa700 1 -- 172.21.15.72:0/2461986382 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb5c800b040 con 0x7fb5d015ce60 2023-08-25T04:45:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.934+0000 7fb5cd7fa700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb5b406a110 0x7fb5b406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.934+0000 7fb5cd7fa700 1 -- 172.21.15.72:0/2461986382 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5c80890a0 con 0x7fb5d015ce60 2023-08-25T04:45:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.934+0000 7fb5d499b700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb5b406a110 0x7fb5b406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.935+0000 7fb5d499b700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb5b406a110 0x7fb5b406c5d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4000f60 tx=0x7fb5c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:48.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:48.938+0000 7fb5cd7fa700 1 -- 172.21.15.72:0/2461986382 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb5c8054490 con 0x7fb5d015ce60 2023-08-25T04:45:49.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.133+0000 7fb5d6bff700 1 -- 172.21.15.72:0/2461986382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5d00d1c40 con 0x7fb5d015ce60 2023-08-25T04:45:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.135+0000 7fb5cd7fa700 1 -- 172.21.15.72:0/2461986382 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fb5c801d090 con 0x7fb5d015ce60 2023-08-25T04:45:49.136 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:49.136 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:49.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 -- 172.21.15.72:0/2461986382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb5b406a110 msgr2=0x7fb5b406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb5b406a110 0x7fb5b406c5d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4000f60 tx=0x7fb5c4009040 comp rx=0 tx=0).stop 2023-08-25T04:45:49.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 -- 172.21.15.72:0/2461986382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d015ce60 msgr2=0x7fb5d01f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d015ce60 0x7fb5d01f1f10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800cd50 tx=0x7fb5c800a560 comp rx=0 tx=0).stop 2023-08-25T04:45:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 -- 172.21.15.72:0/2461986382 shutdown_connections 2023-08-25T04:45:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb5b406a110 0x7fb5b406c5d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d015ce60 0x7fb5d01f1f10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb5d00cda40 0x7fb5d01f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 --2- 172.21.15.72:0/2461986382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5d00d0df0 0x7fb5d015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 -- 172.21.15.72:0/2461986382 >> 172.21.15.72:0/2461986382 conn(0x7fb5d0071e10 msgr2=0x7fb5d00b7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 -- 172.21.15.72:0/2461986382 shutdown_connections 2023-08-25T04:45:49.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.137+0000 7fb5d6bff700 1 -- 172.21.15.72:0/2461986382 wait complete. 2023-08-25T04:45:49.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:45:49.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:45:49.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.356+0000 7f7841fff700 1 Processor -- start 2023-08-25T04:45:49.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.357+0000 7f7841fff700 1 -- start start 2023-08-25T04:45:49.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.358+0000 7f7841fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0b4f10 0x7f783c167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.358+0000 7f7841fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783c0b8d10 con 0x7f783c0d10c0 2023-08-25T04:45:49.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.358+0000 7f7841fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783c0b6e90 con 0x7f783c15d000 2023-08-25T04:45:49.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.358+0000 7f7841fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c0b56f0 con 0x7f783c0b4f10 2023-08-25T04:45:49.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.358+0000 7f783affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f783c0d10c0 0x7f783c0b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57374/0 (socket says 172.21.15.72:57374) 2023-08-25T04:45:49.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.358+0000 7f783affd700 1 -- 172.21.15.72:0/534522401 learned_addr learned my addr 172.21.15.72:0/534522401 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:49.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.358+0000 7f783bfff700 1 --2- 172.21.15.72:0/534522401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0b4f10 0x7f783c167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.358+0000 7f783a7fc700 1 -- 172.21.15.72:0/534522401 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913118621 0 0) 0x7f783c0b8d10 con 0x7f783c0d10c0 2023-08-25T04:45:49.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.358+0000 7f783a7fc700 1 -- 172.21.15.72:0/534522401 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78240035b0 con 0x7f783c0d10c0 2023-08-25T04:45:49.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.359+0000 7f783a7fc700 1 -- 172.21.15.72:0/534522401 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493509767 0 0) 0x7f783c0b6e90 con 0x7f783c15d000 2023-08-25T04:45:49.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.359+0000 7f783a7fc700 1 -- 172.21.15.72:0/534522401 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f783c0b8d10 con 0x7f783c15d000 2023-08-25T04:45:49.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.359+0000 7f783bfff700 1 -- 172.21.15.72:0/534522401 >> v1:172.21.15.137:6789/0 conn(0x7f783c15d000 legacy=0x7f783c0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.359+0000 7f783bfff700 1 -- 172.21.15.72:0/534522401 >> v1:172.21.15.72:6789/0 conn(0x7f783c0d10c0 legacy=0x7f783c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.359+0000 7f783bfff700 1 -- 172.21.15.72:0/534522401 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c15d3e0 con 0x7f783c0b4f10 2023-08-25T04:45:49.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.359+0000 7f783bfff700 1 --2- 172.21.15.72:0/534522401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0b4f10 0x7f783c167be0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7834009dc0 tx=0x7f783400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20652ecea433d7b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.359+0000 7f783a7fc700 1 -- 172.21.15.72:0/534522401 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783400e070 con 0x7f783c0b4f10 2023-08-25T04:45:49.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.359+0000 7f783a7fc700 1 -- 172.21.15.72:0/534522401 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783400bb20 con 0x7f783c0b4f10 2023-08-25T04:45:49.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.359+0000 7f783a7fc700 1 -- 172.21.15.72:0/534522401 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783400be90 con 0x7f783c0b4f10 2023-08-25T04:45:49.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.360+0000 7f7841fff700 1 -- 172.21.15.72:0/534522401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0b4f10 msgr2=0x7f783c167be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.360+0000 7f7841fff700 1 --2- 172.21.15.72:0/534522401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0b4f10 0x7f783c167be0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7834009dc0 tx=0x7f783400b330 comp rx=0 tx=0).stop 2023-08-25T04:45:49.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.360+0000 7f7841fff700 1 -- 172.21.15.72:0/534522401 shutdown_connections 2023-08-25T04:45:49.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.360+0000 7f7841fff700 1 --2- 172.21.15.72:0/534522401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0b4f10 0x7f783c167be0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.360+0000 7f7841fff700 1 -- 172.21.15.72:0/534522401 >> 172.21.15.72:0/534522401 conn(0x7f783c071e10 msgr2=0x7f783c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.360+0000 7f7841fff700 1 -- 172.21.15.72:0/534522401 shutdown_connections 2023-08-25T04:45:49.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.360+0000 7f7841fff700 1 -- 172.21.15.72:0/534522401 wait complete. 2023-08-25T04:45:49.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.362+0000 7f7841fff700 1 Processor -- start 2023-08-25T04:45:49.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.362+0000 7f7841fff700 1 -- start start 2023-08-25T04:45:49.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f7841fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f783c0b4f10 0x7f783c151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f7841fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0d10c0 0x7f783c15f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f7841fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f783c15d000 0x7f783c15fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f7841fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c0c7fc0 con 0x7f783c0b4f10 2023-08-25T04:45:49.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f7841fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c0c73d0 con 0x7f783c15d000 2023-08-25T04:45:49.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f7841fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c152390 con 0x7f783c0d10c0 2023-08-25T04:45:49.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f783b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f783c0b4f10 0x7f783c151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f783b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f783c0b4f10 0x7f783c151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46618/0 (socket says 172.21.15.72:46618) 2023-08-25T04:45:49.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f783b7fe700 1 -- 172.21.15.72:0/1109942195 learned_addr learned my addr 172.21.15.72:0/1109942195 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:49.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f783affd700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0d10c0 0x7f783c15f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.364+0000 7f783bfff700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f783c15d000 0x7f783c15fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f783b7fe700 1 -- 172.21.15.72:0/1109942195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0d10c0 msgr2=0x7f783c15f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f783b7fe700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0d10c0 0x7f783c15f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f783b7fe700 1 -- 172.21.15.72:0/1109942195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f783c15d000 msgr2=0x7f783c15fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f783b7fe700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f783c15d000 0x7f783c15fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f783b7fe700 1 -- 172.21.15.72:0/1109942195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834009a70 con 0x7f783c0b4f10 2023-08-25T04:45:49.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f783b7fe700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f783c0b4f10 0x7f783c151e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f782c00c500 tx=0x7f782c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f7823fff700 1 -- 172.21.15.72:0/1109942195 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c0052d0 con 0x7f783c0b4f10 2023-08-25T04:45:49.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f7823fff700 1 -- 172.21.15.72:0/1109942195 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c005450 con 0x7f783c0b4f10 2023-08-25T04:45:49.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f7841fff700 1 -- 172.21.15.72:0/1109942195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783c15e8d0 con 0x7f783c0b4f10 2023-08-25T04:45:49.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f7823fff700 1 -- 172.21.15.72:0/1109942195 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c0038c0 con 0x7f783c0b4f10 2023-08-25T04:45:49.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.365+0000 7f7841fff700 1 -- 172.21.15.72:0/1109942195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783c0c7900 con 0x7f783c0b4f10 2023-08-25T04:45:49.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.366+0000 7f7841fff700 1 -- 172.21.15.72:0/1109942195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783c06a2f0 con 0x7f783c0b4f10 2023-08-25T04:45:49.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.367+0000 7f7823fff700 1 -- 172.21.15.72:0/1109942195 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f782c003a20 con 0x7f783c0b4f10 2023-08-25T04:45:49.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.368+0000 7f7823fff700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f782806a0e0 0x7f782806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.368+0000 7f7823fff700 1 -- 172.21.15.72:0/1109942195 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f782c087be0 con 0x7f783c0b4f10 2023-08-25T04:45:49.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.368+0000 7f783affd700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f782806a0e0 0x7f782806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.369+0000 7f783affd700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f782806a0e0 0x7f782806c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f783c152a00 tx=0x7f7830007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.372+0000 7f7823fff700 1 -- 172.21.15.72:0/1109942195 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f782c052fd0 con 0x7f783c0b4f10 2023-08-25T04:45:49.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.568+0000 7f7841fff700 1 -- 172.21.15.72:0/1109942195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f783c08a000 con 0x7f783c0b4f10 2023-08-25T04:45:49.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.568+0000 7f7823fff700 1 -- 172.21.15.72:0/1109942195 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f782c017020 con 0x7f783c0b4f10 2023-08-25T04:45:49.570 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:45:49.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 -- 172.21.15.72:0/1109942195 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f782806a0e0 msgr2=0x7f782806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f782806a0e0 0x7f782806c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f783c152a00 tx=0x7f7830007dc0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 -- 172.21.15.72:0/1109942195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f783c0b4f10 msgr2=0x7f783c151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f783c0b4f10 0x7f783c151e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f782c00c500 tx=0x7f782c00c810 comp rx=0 tx=0).stop 2023-08-25T04:45:49.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 -- 172.21.15.72:0/1109942195 shutdown_connections 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f782806a0e0 0x7f782806c5a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f783c15d000 0x7f783c15fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f783c0b4f10 0x7f783c151e50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 --2- 172.21.15.72:0/1109942195 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f783c0d10c0 0x7f783c15f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 -- 172.21.15.72:0/1109942195 >> 172.21.15.72:0/1109942195 conn(0x7f783c071e10 msgr2=0x7f783c0b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 -- 172.21.15.72:0/1109942195 shutdown_connections 2023-08-25T04:45:49.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.571+0000 7f7841fff700 1 -- 172.21.15.72:0/1109942195 wait complete. 2023-08-25T04:45:49.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:45:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.787+0000 7fb09e5ff700 1 Processor -- start 2023-08-25T04:45:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.787+0000 7fb09e5ff700 1 -- start start 2023-08-25T04:45:49.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.788+0000 7fb09e5ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb09815d090 0x7fb0980d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.788+0000 7fb09e5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0980b8aa0 0x7fb0980cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.788+0000 7fb09e5ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0980ce4b0 con 0x7fb0980ce090 2023-08-25T04:45:49.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.788+0000 7fb09e5ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09815d470 con 0x7fb09815d090 2023-08-25T04:45:49.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.788+0000 7fb09e5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980b6ec0 con 0x7fb0980b8aa0 2023-08-25T04:45:49.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.789+0000 7fb097fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb09815d090 0x7fb0980d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.789+0000 7fb097fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb09815d090 0x7fb0980d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:37054/0 (socket says 172.21.15.72:37054) 2023-08-25T04:45:49.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.789+0000 7fb09cb9c700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb0980ce090 0x7fb0980b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:38292/0 (socket says 172.21.15.72:38292) 2023-08-25T04:45:49.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.789+0000 7fb097fff700 1 -- 172.21.15.72:0/881609520 learned_addr learned my addr 172.21.15.72:0/881609520 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:49.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.789+0000 7fb08ffff700 1 --2- 172.21.15.72:0/881609520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0980b8aa0 0x7fb0980cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.789+0000 7fb097fff700 1 -- 172.21.15.72:0/881609520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0980b8aa0 msgr2=0x7fb0980cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:49.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.789+0000 7fb097fff700 1 --2- 172.21.15.72:0/881609520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0980b8aa0 0x7fb0980cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.789+0000 7fb097fff700 1 -- 172.21.15.72:0/881609520 >> v1:172.21.15.137:6789/0 conn(0x7fb0980ce090 legacy=0x7fb0980b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.789+0000 7fb097fff700 1 -- 172.21.15.72:0/881609520 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0980d17e0 con 0x7fb09815d090 2023-08-25T04:45:49.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.790+0000 7fb097fff700 1 --2- 172.21.15.72:0/881609520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb09815d090 0x7fb0980d0e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0880098f0 tx=0x7fb088009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=228f0250ab868384 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.790+0000 7fb0977fe700 1 -- 172.21.15.72:0/881609520 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088011830 con 0x7fb09815d090 2023-08-25T04:45:49.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.790+0000 7fb0977fe700 1 -- 172.21.15.72:0/881609520 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb088011990 con 0x7fb09815d090 2023-08-25T04:45:49.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.790+0000 7fb0977fe700 1 -- 172.21.15.72:0/881609520 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088011d20 con 0x7fb09815d090 2023-08-25T04:45:49.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.790+0000 7fb09e5ff700 1 -- 172.21.15.72:0/881609520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb09815d090 msgr2=0x7fb0980d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.791+0000 7fb09e5ff700 1 --2- 172.21.15.72:0/881609520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb09815d090 0x7fb0980d0e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0880098f0 tx=0x7fb088009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:49.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.791+0000 7fb09e5ff700 1 -- 172.21.15.72:0/881609520 shutdown_connections 2023-08-25T04:45:49.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.791+0000 7fb09e5ff700 1 --2- 172.21.15.72:0/881609520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb09815d090 0x7fb0980d0e70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.791+0000 7fb09e5ff700 1 --2- 172.21.15.72:0/881609520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0980b8aa0 0x7fb0980cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.791+0000 7fb09e5ff700 1 -- 172.21.15.72:0/881609520 >> 172.21.15.72:0/881609520 conn(0x7fb098071e10 msgr2=0x7fb098072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:49.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.791+0000 7fb09e5ff700 1 -- 172.21.15.72:0/881609520 shutdown_connections 2023-08-25T04:45:49.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.791+0000 7fb09e5ff700 1 -- 172.21.15.72:0/881609520 wait complete. 2023-08-25T04:45:49.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.792+0000 7fb09e5ff700 1 Processor -- start 2023-08-25T04:45:49.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.793+0000 7fb09e5ff700 1 -- start start 2023-08-25T04:45:49.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.793+0000 7fb09e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0980b8aa0 0x7fb098152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.793+0000 7fb09e5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0980ce090 0x7fb098153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb09e5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb09815d090 0x7fb09815f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb09e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb098154b30 con 0x7fb0980b8aa0 2023-08-25T04:45:49.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb09e5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0981f2740 con 0x7fb0980ce090 2023-08-25T04:45:49.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb09e5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb098154850 con 0x7fb09815d090 2023-08-25T04:45:49.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb097fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0980b8aa0 0x7fb098152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb097fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0980b8aa0 0x7fb098152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46620/0 (socket says 172.21.15.72:46620) 2023-08-25T04:45:49.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb097fff700 1 -- 172.21.15.72:0/1540385485 learned_addr learned my addr 172.21.15.72:0/1540385485 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:49.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb08ffff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0980ce090 0x7fb098153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb09cb9c700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb09815d090 0x7fb09815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb097fff700 1 -- 172.21.15.72:0/1540385485 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb09815d090 msgr2=0x7fb09815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb097fff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb09815d090 0x7fb09815f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb097fff700 1 -- 172.21.15.72:0/1540385485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0980ce090 msgr2=0x7fb098153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:49.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb097fff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0980ce090 0x7fb098153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:49.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb097fff700 1 -- 172.21.15.72:0/1540385485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb088009550 con 0x7fb0980b8aa0 2023-08-25T04:45:49.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.794+0000 7fb097fff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0980b8aa0 0x7fb098152210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb088000c00 tx=0x7fb088004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.795+0000 7fb0957fa700 1 -- 172.21.15.72:0/1540385485 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088004400 con 0x7fb0980b8aa0 2023-08-25T04:45:49.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.795+0000 7fb0957fa700 1 -- 172.21.15.72:0/1540385485 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08801f070 con 0x7fb0980b8aa0 2023-08-25T04:45:49.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.795+0000 7fb09e5ff700 1 -- 172.21.15.72:0/1540385485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0981f29f0 con 0x7fb0980b8aa0 2023-08-25T04:45:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.795+0000 7fb0957fa700 1 -- 172.21.15.72:0/1540385485 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0880038e0 con 0x7fb0980b8aa0 2023-08-25T04:45:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.795+0000 7fb09e5ff700 1 -- 172.21.15.72:0/1540385485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0981f2fb0 con 0x7fb0980b8aa0 2023-08-25T04:45:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.796+0000 7fb09e5ff700 1 -- 172.21.15.72:0/1540385485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09806a2f0 con 0x7fb0980b8aa0 2023-08-25T04:45:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.797+0000 7fb0957fa700 1 -- 172.21.15.72:0/1540385485 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb088021030 con 0x7fb0980b8aa0 2023-08-25T04:45:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.798+0000 7fb0957fa700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb07806a0e0 0x7fb07806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.798+0000 7fb0957fa700 1 -- 172.21.15.72:0/1540385485 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb088089bd0 con 0x7fb0980b8aa0 2023-08-25T04:45:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.798+0000 7fb08ffff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb07806a0e0 0x7fb07806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.798+0000 7fb08ffff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb07806a0e0 0x7fb07806c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0981f3910 tx=0x7fb080009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:49.802+0000 7fb0957fa700 1 -- 172.21.15.72:0/1540385485 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb088054fe0 con 0x7fb0980b8aa0 2023-08-25T04:45:50.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.003+0000 7fb09e5ff700 1 -- 172.21.15.72:0/1540385485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb09808a000 con 0x7fb0980b8aa0 2023-08-25T04:45:50.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.003+0000 7fb0957fa700 1 -- 172.21.15.72:0/1540385485 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb088058600 con 0x7fb0980b8aa0 2023-08-25T04:45:50.005 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:45:50.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 -- 172.21.15.72:0/1540385485 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb07806a0e0 msgr2=0x7fb07806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb07806a0e0 0x7fb07806c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0981f3910 tx=0x7fb080009210 comp rx=0 tx=0).stop 2023-08-25T04:45:50.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 -- 172.21.15.72:0/1540385485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0980b8aa0 msgr2=0x7fb098152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0980b8aa0 0x7fb098152210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb088000c00 tx=0x7fb088004750 comp rx=0 tx=0).stop 2023-08-25T04:45:50.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 -- 172.21.15.72:0/1540385485 shutdown_connections 2023-08-25T04:45:50.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb07806a0e0 0x7fb07806c5a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb09815d090 0x7fb09815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0980b8aa0 0x7fb098152210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 --2- 172.21.15.72:0/1540385485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0980ce090 0x7fb098153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 -- 172.21.15.72:0/1540385485 >> 172.21.15.72:0/1540385485 conn(0x7fb098071e10 msgr2=0x7fb0980c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 -- 172.21.15.72:0/1540385485 shutdown_connections 2023-08-25T04:45:50.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.006+0000 7fb09e5ff700 1 -- 172.21.15.72:0/1540385485 wait complete. 2023-08-25T04:45:50.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:45:50.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.223+0000 7feeb6fff700 1 Processor -- start 2023-08-25T04:45:50.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.223+0000 7feeb6fff700 1 -- start start 2023-08-25T04:45:50.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.224+0000 7feeb6fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feeb0150ac0 0x7feeb015def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.224+0000 7feeb6fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb00aebf0 con 0x7feeb0150ea0 2023-08-25T04:45:50.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.224+0000 7feeb6fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb00aeed0 con 0x7feeb00cbd60 2023-08-25T04:45:50.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.224+0000 7feeb6fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00af490 con 0x7feeb0150ac0 2023-08-25T04:45:50.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.224+0000 7feeb4d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feeb0150ac0 0x7feeb015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.224+0000 7feeb4d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feeb0150ac0 0x7feeb015def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46632/0 (socket says 172.21.15.72:46632) 2023-08-25T04:45:50.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.224+0000 7feeb4d9b700 1 -- 172.21.15.72:0/3267942434 learned_addr learned my addr 172.21.15.72:0/3267942434 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:50.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.225+0000 7feeb4d9b700 1 -- 172.21.15.72:0/3267942434 >> v1:172.21.15.137:6789/0 conn(0x7feeb00cbd60 legacy=0x7feeb015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:50.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.225+0000 7feeb4d9b700 1 -- 172.21.15.72:0/3267942434 >> v1:172.21.15.72:6789/0 conn(0x7feeb0150ea0 legacy=0x7feeb00cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.225+0000 7feeb4d9b700 1 -- 172.21.15.72:0/3267942434 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00af1b0 con 0x7feeb0150ac0 2023-08-25T04:45:50.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.225+0000 7feeaf7fe700 1 -- 172.21.15.72:0/3267942434 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621301484 0 0) 0x7feeb00aebf0 con 0x7feeb0150ea0 2023-08-25T04:45:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.225+0000 7feeb4d9b700 1 --2- 172.21.15.72:0/3267942434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeb0150ac0 0x7feeb015def0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feea40098f0 tx=0x7feea4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c5ad2d74c467b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.225+0000 7feeaf7fe700 1 -- 172.21.15.72:0/3267942434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400b8a0 con 0x7feeb0150ac0 2023-08-25T04:45:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.225+0000 7feeaf7fe700 1 -- 172.21.15.72:0/3267942434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400ba00 con 0x7feeb0150ac0 2023-08-25T04:45:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.225+0000 7feeaf7fe700 1 -- 172.21.15.72:0/3267942434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400bd90 con 0x7feeb0150ac0 2023-08-25T04:45:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.226+0000 7feeb6fff700 1 -- 172.21.15.72:0/3267942434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeb0150ac0 msgr2=0x7feeb015def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.226+0000 7feeb6fff700 1 --2- 172.21.15.72:0/3267942434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeb0150ac0 0x7feeb015def0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feea40098f0 tx=0x7feea4009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.226+0000 7feeb6fff700 1 -- 172.21.15.72:0/3267942434 shutdown_connections 2023-08-25T04:45:50.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.226+0000 7feeb6fff700 1 --2- 172.21.15.72:0/3267942434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeb0150ac0 0x7feeb015def0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.226+0000 7feeb6fff700 1 -- 172.21.15.72:0/3267942434 >> 172.21.15.72:0/3267942434 conn(0x7feeb006a710 msgr2=0x7feeb006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.226+0000 7feeb6fff700 1 -- 172.21.15.72:0/3267942434 shutdown_connections 2023-08-25T04:45:50.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.226+0000 7feeb6fff700 1 -- 172.21.15.72:0/3267942434 wait complete. 2023-08-25T04:45:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.228+0000 7feeb6fff700 1 Processor -- start 2023-08-25T04:45:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.228+0000 7feeb6fff700 1 -- start start 2023-08-25T04:45:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeb6fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feeb00cbd60 0x7feeb01f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeb6fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb0150ac0 0x7feeb01f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeb6fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeb0150ea0 0x7feeb00c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeb6fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c3880 con 0x7feeb0150ea0 2023-08-25T04:45:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeb6fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c3b60 con 0x7feeb0150ac0 2023-08-25T04:45:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeb6fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c3e40 con 0x7feeb00cbd60 2023-08-25T04:45:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeb559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeb0150ea0 0x7feeb00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeb559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeb0150ea0 0x7feeb00c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46634/0 (socket says 172.21.15.72:46634) 2023-08-25T04:45:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeb559c700 1 -- 172.21.15.72:0/1005352744 learned_addr learned my addr 172.21.15.72:0/1005352744 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeb4d9b700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feeb00cbd60 0x7feeb01f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.229+0000 7feeaffff700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb0150ac0 0x7feeb01f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feeb4d9b700 1 -- 172.21.15.72:0/1005352744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb0150ac0 msgr2=0x7feeb01f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feeb4d9b700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb0150ac0 0x7feeb01f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feeb4d9b700 1 -- 172.21.15.72:0/1005352744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeb0150ea0 msgr2=0x7feeb00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feeb4d9b700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeb0150ea0 0x7feeb00c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feeb4d9b700 1 -- 172.21.15.72:0/1005352744 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4009550 con 0x7feeb00cbd60 2023-08-25T04:45:50.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feeaffff700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb0150ac0 0x7feeb01f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:50.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feeb4d9b700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feeb00cbd60 0x7feeb01f5110 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feea4016000 tx=0x7feea4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feead7fa700 1 -- 172.21.15.72:0/1005352744 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea401b900 con 0x7feeb00cbd60 2023-08-25T04:45:50.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feead7fa700 1 -- 172.21.15.72:0/1005352744 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea401f070 con 0x7feeb00cbd60 2023-08-25T04:45:50.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feeb6fff700 1 -- 172.21.15.72:0/1005352744 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb00c4120 con 0x7feeb00cbd60 2023-08-25T04:45:50.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feead7fa700 1 -- 172.21.15.72:0/1005352744 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea401bca0 con 0x7feeb00cbd60 2023-08-25T04:45:50.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.230+0000 7feeb6fff700 1 -- 172.21.15.72:0/1005352744 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb01f2700 con 0x7feeb00cbd60 2023-08-25T04:45:50.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.231+0000 7feeb6fff700 1 -- 172.21.15.72:0/1005352744 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb00c4640 con 0x7feeb00cbd60 2023-08-25T04:45:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.233+0000 7feead7fa700 1 -- 172.21.15.72:0/1005352744 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feea4026480 con 0x7feeb00cbd60 2023-08-25T04:45:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.234+0000 7feead7fa700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee9406a0e0 0x7fee9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.234+0000 7feead7fa700 1 -- 172.21.15.72:0/1005352744 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feea4021070 con 0x7feeb00cbd60 2023-08-25T04:45:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.234+0000 7feeaffff700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee9406a0e0 0x7fee9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.234+0000 7feeaffff700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee9406a0e0 0x7fee9406c5a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feeb014fff0 tx=0x7fee9c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.239+0000 7feead7fa700 1 -- 172.21.15.72:0/1005352744 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feeb00c4640 con 0x7feeb00cbd60 2023-08-25T04:45:50.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.433+0000 7feeb6fff700 1 -- 172.21.15.72:0/1005352744 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feeb00c4640 con 0x7feeb00cbd60 2023-08-25T04:45:50.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.435+0000 7feead7fa700 1 -- 172.21.15.72:0/1005352744 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7feea4015020 con 0x7feeb00cbd60 2023-08-25T04:45:50.435 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:45:50.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 -- 172.21.15.72:0/1005352744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee9406a0e0 msgr2=0x7fee9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee9406a0e0 0x7fee9406c5a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feeb014fff0 tx=0x7fee9c009040 comp rx=0 tx=0).stop 2023-08-25T04:45:50.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 -- 172.21.15.72:0/1005352744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feeb00cbd60 msgr2=0x7feeb01f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feeb00cbd60 0x7feeb01f5110 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feea4016000 tx=0x7feea4004750 comp rx=0 tx=0).stop 2023-08-25T04:45:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 -- 172.21.15.72:0/1005352744 shutdown_connections 2023-08-25T04:45:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fee9406a0e0 0x7fee9406c5a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feeb0150ea0 0x7feeb00c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feeb00cbd60 0x7feeb01f5110 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 --2- 172.21.15.72:0/1005352744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb0150ac0 0x7feeb01f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 -- 172.21.15.72:0/1005352744 >> 172.21.15.72:0/1005352744 conn(0x7feeb006a710 msgr2=0x7feeb00cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 -- 172.21.15.72:0/1005352744 shutdown_connections 2023-08-25T04:45:50.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.436+0000 7feeb6fff700 1 -- 172.21.15.72:0/1005352744 wait complete. 2023-08-25T04:45:50.456 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:45:50.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.655+0000 7f52047ff700 1 Processor -- start 2023-08-25T04:45:50.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.656+0000 7f52047ff700 1 -- start start 2023-08-25T04:45:50.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.657+0000 7f52047ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f51fc150ea0 0x7f51fc0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.657+0000 7f52047ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51fc0cbb90 0x7f51fc15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.657+0000 7f52047ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51fc0cbfd0 con 0x7f51fc150ac0 2023-08-25T04:45:50.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.657+0000 7f52047ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51fc0af490 con 0x7f51fc150ea0 2023-08-25T04:45:50.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.657+0000 7f52047ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc15d7c0 con 0x7f51fc0cbb90 2023-08-25T04:45:50.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.657+0000 7f520259b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f51fc150ac0 0x7f51fc15def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57394/0 (socket says 172.21.15.72:57394) 2023-08-25T04:45:50.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.657+0000 7f520259b700 1 -- 172.21.15.72:0/3497614377 learned_addr learned my addr 172.21.15.72:0/3497614377 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.657+0000 7f5201d9a700 1 --2- 172.21.15.72:0/3497614377 >> v2:172.21.15.137:3300/0 conn(0x7f51fc150ea0 0x7f51fc0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.657+0000 7f5202d9c700 1 --2- 172.21.15.72:0/3497614377 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51fc0cbb90 0x7f51fc15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.657+0000 7f5201599700 1 -- 172.21.15.72:0/3497614377 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079754847 0 0) 0x7f51fc0cbfd0 con 0x7f51fc150ac0 2023-08-25T04:45:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.658+0000 7f5201599700 1 -- 172.21.15.72:0/3497614377 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51e80035b0 con 0x7f51fc150ac0 2023-08-25T04:45:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.658+0000 7f5201d9a700 1 -- 172.21.15.72:0/3497614377 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51fc0cbb90 msgr2=0x7f51fc15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.658+0000 7f5201d9a700 1 --2- 172.21.15.72:0/3497614377 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51fc0cbb90 0x7f51fc15a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.658+0000 7f5201d9a700 1 -- 172.21.15.72:0/3497614377 >> v1:172.21.15.72:6789/0 conn(0x7f51fc150ac0 legacy=0x7f51fc15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.658+0000 7f5201d9a700 1 -- 172.21.15.72:0/3497614377 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc0aebf0 con 0x7f51fc150ea0 2023-08-25T04:45:50.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.658+0000 7f5201d9a700 1 --2- 172.21.15.72:0/3497614377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51fc150ea0 0x7f51fc0cb650 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009840 tx=0x7f51ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b77abdb7d892c895 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.658+0000 7f5201599700 1 -- 172.21.15.72:0/3497614377 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec011830 con 0x7f51fc150ea0 2023-08-25T04:45:50.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.658+0000 7f5201599700 1 -- 172.21.15.72:0/3497614377 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec011990 con 0x7f51fc150ea0 2023-08-25T04:45:50.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.658+0000 7f5201599700 1 -- 172.21.15.72:0/3497614377 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec011d20 con 0x7f51fc150ea0 2023-08-25T04:45:50.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.659+0000 7f52047ff700 1 -- 172.21.15.72:0/3497614377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51fc150ea0 msgr2=0x7f51fc0cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.659+0000 7f52047ff700 1 --2- 172.21.15.72:0/3497614377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51fc150ea0 0x7f51fc0cb650 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009840 tx=0x7f51ec009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.659+0000 7f52047ff700 1 -- 172.21.15.72:0/3497614377 shutdown_connections 2023-08-25T04:45:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.659+0000 7f52047ff700 1 --2- 172.21.15.72:0/3497614377 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51fc0cbb90 0x7f51fc15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.659+0000 7f52047ff700 1 --2- 172.21.15.72:0/3497614377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51fc150ea0 0x7f51fc0cb650 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.659+0000 7f52047ff700 1 -- 172.21.15.72:0/3497614377 >> 172.21.15.72:0/3497614377 conn(0x7f51fc06a710 msgr2=0x7f51fc06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.659+0000 7f52047ff700 1 -- 172.21.15.72:0/3497614377 shutdown_connections 2023-08-25T04:45:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.659+0000 7f52047ff700 1 -- 172.21.15.72:0/3497614377 wait complete. 2023-08-25T04:45:50.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.661+0000 7f52047ff700 1 Processor -- start 2023-08-25T04:45:50.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.661+0000 7f52047ff700 1 -- start start 2023-08-25T04:45:50.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f52047ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51fc0cbb90 0x7f51fc0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f52047ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc150ac0 0x7f51fc0a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f52047ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51fc150ea0 0x7f51fc0a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f52047ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc0b4830 con 0x7f51fc150ac0 2023-08-25T04:45:50.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f52047ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc0c4ef0 con 0x7f51fc0cbb90 2023-08-25T04:45:50.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f52047ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc0c4c10 con 0x7f51fc150ea0 2023-08-25T04:45:50.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f5201d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc150ac0 0x7f51fc0a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f5201d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc150ac0 0x7f51fc0a74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46642/0 (socket says 172.21.15.72:46642) 2023-08-25T04:45:50.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f5201d9a700 1 -- 172.21.15.72:0/2056920308 learned_addr learned my addr 172.21.15.72:0/2056920308 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:50.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f520259b700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51fc0cbb90 0x7f51fc0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f5202d9c700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51fc150ea0 0x7f51fc0a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f5201d9a700 1 -- 172.21.15.72:0/2056920308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51fc150ea0 msgr2=0x7f51fc0a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f5201d9a700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51fc150ea0 0x7f51fc0a7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f5201d9a700 1 -- 172.21.15.72:0/2056920308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51fc0cbb90 msgr2=0x7f51fc0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f5201d9a700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51fc0cbb90 0x7f51fc0b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.662+0000 7f5201d9a700 1 -- 172.21.15.72:0/2056920308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0094a0 con 0x7f51fc150ac0 2023-08-25T04:45:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.663+0000 7f5201d9a700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc150ac0 0x7f51fc0a74e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009fd0 tx=0x7f51ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.663+0000 7f51f2ffd700 1 -- 172.21.15.72:0/2056920308 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0044d0 con 0x7f51fc150ac0 2023-08-25T04:45:50.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.663+0000 7f51f2ffd700 1 -- 172.21.15.72:0/2056920308 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec01e070 con 0x7f51fc150ac0 2023-08-25T04:45:50.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.663+0000 7f52047ff700 1 -- 172.21.15.72:0/2056920308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51fc0b1f40 con 0x7f51fc150ac0 2023-08-25T04:45:50.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.663+0000 7f51f2ffd700 1 -- 172.21.15.72:0/2056920308 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0038e0 con 0x7f51fc150ac0 2023-08-25T04:45:50.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.663+0000 7f52047ff700 1 -- 172.21.15.72:0/2056920308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc0b2500 con 0x7f51fc150ac0 2023-08-25T04:45:50.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.664+0000 7f52047ff700 1 -- 172.21.15.72:0/2056920308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51fc072320 con 0x7f51fc150ac0 2023-08-25T04:45:50.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.665+0000 7f51f2ffd700 1 -- 172.21.15.72:0/2056920308 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f51ec003a40 con 0x7f51fc150ac0 2023-08-25T04:45:50.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.666+0000 7f51f2ffd700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f51e006a0e0 0x7f51e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.666+0000 7f51f2ffd700 1 -- 172.21.15.72:0/2056920308 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f51ec0896a0 con 0x7f51fc150ac0 2023-08-25T04:45:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.666+0000 7f520259b700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f51e006a0e0 0x7f51e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.666+0000 7f520259b700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f51e006a0e0 0x7f51e006c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51f8007fd0 tx=0x7f51f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.670+0000 7f51f2ffd700 1 -- 172.21.15.72:0/2056920308 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f51ec054a10 con 0x7f51fc150ac0 2023-08-25T04:45:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.870+0000 7f52047ff700 1 -- 172.21.15.72:0/2056920308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51fc0af180 con 0x7f51fc150ac0 2023-08-25T04:45:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.871+0000 7f51f2ffd700 1 -- 172.21.15.72:0/2056920308 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51ec058030 con 0x7f51fc150ac0 2023-08-25T04:45:50.877 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:45:50.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.873+0000 7f52047ff700 1 -- 172.21.15.72:0/2056920308 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f51e006a0e0 msgr2=0x7f51e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.873+0000 7f52047ff700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f51e006a0e0 0x7f51e006c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51f8007fd0 tx=0x7f51f8009040 comp rx=0 tx=0).stop 2023-08-25T04:45:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.873+0000 7f52047ff700 1 -- 172.21.15.72:0/2056920308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc150ac0 msgr2=0x7f51fc0a74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.873+0000 7f52047ff700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc150ac0 0x7f51fc0a74e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009fd0 tx=0x7f51ec004750 comp rx=0 tx=0).stop 2023-08-25T04:45:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.873+0000 7f52047ff700 1 -- 172.21.15.72:0/2056920308 shutdown_connections 2023-08-25T04:45:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.873+0000 7f52047ff700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f51e006a0e0 0x7f51e006c5a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.873+0000 7f52047ff700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51fc150ea0 0x7f51fc0a7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.873+0000 7f52047ff700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51fc0cbb90 0x7f51fc0b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.873+0000 7f52047ff700 1 --2- 172.21.15.72:0/2056920308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc150ac0 0x7f51fc0a74e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:50.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.873+0000 7f52047ff700 1 -- 172.21.15.72:0/2056920308 >> 172.21.15.72:0/2056920308 conn(0x7f51fc06a710 msgr2=0x7f51fc0c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:50.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.874+0000 7f52047ff700 1 -- 172.21.15.72:0/2056920308 shutdown_connections 2023-08-25T04:45:50.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:50.874+0000 7f52047ff700 1 -- 172.21.15.72:0/2056920308 wait complete. 2023-08-25T04:45:50.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:45:51.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.090+0000 7f4af25ff700 1 Processor -- start 2023-08-25T04:45:51.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.090+0000 7f4af25ff700 1 -- start start 2023-08-25T04:45:51.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.091+0000 7f4af25ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4aec15d090 0x7f4aec0d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.091+0000 7f4af25ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec0ce260 0x7f4aec0b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.091+0000 7f4af25ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec15d470 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.091+0000 7f4af25ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec0d17e0 con 0x7f4aec15d090 2023-08-25T04:45:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.091+0000 7f4af25ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0d1ac0 con 0x7f4aec0ce260 2023-08-25T04:45:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.091+0000 7f4aebfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4aec15d090 0x7f4aec0d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.091+0000 7f4aebfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4aec15d090 0x7f4aec0d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46648/0 (socket says 172.21.15.72:46648) 2023-08-25T04:45:51.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.091+0000 7f4aebfff700 1 -- 172.21.15.72:0/3315673999 learned_addr learned my addr 172.21.15.72:0/3315673999 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:51.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.091+0000 7f4af0b9c700 1 --2- 172.21.15.72:0/3315673999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec0ce260 0x7f4aec0b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.092+0000 7f4aebfff700 1 -- 172.21.15.72:0/3315673999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec0ce260 msgr2=0x7f4aec0b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:51.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.092+0000 7f4aebfff700 1 --2- 172.21.15.72:0/3315673999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec0ce260 0x7f4aec0b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.092+0000 7f4aebfff700 1 -- 172.21.15.72:0/3315673999 >> v1:172.21.15.137:6789/0 conn(0x7f4aec0b8aa0 legacy=0x7f4aec0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.092+0000 7f4aebfff700 1 -- 172.21.15.72:0/3315673999 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0d1da0 con 0x7f4aec15d090 2023-08-25T04:45:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.092+0000 7f4af0b9c700 1 --2- 172.21.15.72:0/3315673999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec0ce260 0x7f4aec0b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.092+0000 7f4aebfff700 1 --2- 172.21.15.72:0/3315673999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec15d090 0x7f4aec0d0e70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0098f0 tx=0x7f4adc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c782e161a8fa98 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.092+0000 7f4aeb7fe700 1 -- 172.21.15.72:0/3315673999 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00b8a0 con 0x7f4aec15d090 2023-08-25T04:45:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.092+0000 7f4aeb7fe700 1 -- 172.21.15.72:0/3315673999 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc00ba00 con 0x7f4aec15d090 2023-08-25T04:45:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.092+0000 7f4aeb7fe700 1 -- 172.21.15.72:0/3315673999 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00bd90 con 0x7f4aec15d090 2023-08-25T04:45:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.093+0000 7f4af25ff700 1 -- 172.21.15.72:0/3315673999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec15d090 msgr2=0x7f4aec0d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.093+0000 7f4af25ff700 1 --2- 172.21.15.72:0/3315673999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec15d090 0x7f4aec0d0e70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0098f0 tx=0x7f4adc009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:51.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.093+0000 7f4af25ff700 1 -- 172.21.15.72:0/3315673999 shutdown_connections 2023-08-25T04:45:51.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.093+0000 7f4af25ff700 1 --2- 172.21.15.72:0/3315673999 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec0ce260 0x7f4aec0b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.093+0000 7f4af25ff700 1 --2- 172.21.15.72:0/3315673999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec15d090 0x7f4aec0d0e70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.093+0000 7f4af25ff700 1 -- 172.21.15.72:0/3315673999 >> 172.21.15.72:0/3315673999 conn(0x7f4aec071e10 msgr2=0x7f4aec072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:51.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.093+0000 7f4af25ff700 1 -- 172.21.15.72:0/3315673999 shutdown_connections 2023-08-25T04:45:51.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.093+0000 7f4af25ff700 1 -- 172.21.15.72:0/3315673999 wait complete. 2023-08-25T04:45:51.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.094+0000 7f4af25ff700 1 Processor -- start 2023-08-25T04:45:51.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.095+0000 7f4af25ff700 1 -- start start 2023-08-25T04:45:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.095+0000 7f4af25ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec0b8aa0 0x7f4aec0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4af25ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4aec0ce260 0x7f4aec1f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4af25ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec15d090 0x7f4aec147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4af25ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0cb950 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4af25ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0cbc30 con 0x7f4aec0ce260 2023-08-25T04:45:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4af25ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0cbf10 con 0x7f4aec15d090 2023-08-25T04:45:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4aebfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec0b8aa0 0x7f4aec0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4aebfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec0b8aa0 0x7f4aec0b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46652/0 (socket says 172.21.15.72:46652) 2023-08-25T04:45:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4aebfff700 1 -- 172.21.15.72:0/3858767489 learned_addr learned my addr 172.21.15.72:0/3858767489 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4af0b9c700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec15d090 0x7f4aec147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4ae3fff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4aec0ce260 0x7f4aec1f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4aebfff700 1 -- 172.21.15.72:0/3858767489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec15d090 msgr2=0x7f4aec147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4aebfff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec15d090 0x7f4aec147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4aebfff700 1 -- 172.21.15.72:0/3858767489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4aec0ce260 msgr2=0x7f4aec1f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4aebfff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4aec0ce260 0x7f4aec1f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4aebfff700 1 -- 172.21.15.72:0/3858767489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc009550 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.096+0000 7f4aebfff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec0b8aa0 0x7f4aec0b26c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4adc000c00 tx=0x7f4adc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.097+0000 7f4ae97fa700 1 -- 172.21.15.72:0/3858767489 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc004480 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.097+0000 7f4ae97fa700 1 -- 172.21.15.72:0/3858767489 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc01f070 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.097+0000 7f4ae97fa700 1 -- 172.21.15.72:0/3858767489 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0038c0 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.097+0000 7f4af25ff700 1 -- 172.21.15.72:0/3858767489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec0cc1f0 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.097+0000 7f4af25ff700 1 -- 172.21.15.72:0/3858767489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec0b2de0 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.098+0000 7f4af25ff700 1 -- 172.21.15.72:0/3858767489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec06a2f0 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.099+0000 7f4ae97fa700 1 -- 172.21.15.72:0/3858767489 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4adc021030 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.099+0000 7f4ae97fa700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4acc06a0e0 0x7f4acc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.099+0000 7f4ae97fa700 1 -- 172.21.15.72:0/3858767489 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4adc089e30 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.100+0000 7f4ae3fff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4acc06a0e0 0x7f4acc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.100+0000 7f4ae3fff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4acc06a0e0 0x7f4acc06c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4aec1599d0 tx=0x7f4ad4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.104+0000 7f4ae97fa700 1 -- 172.21.15.72:0/3858767489 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4adc055220 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.300+0000 7f4af25ff700 1 -- 172.21.15.72:0/3858767489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4aec08a000 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.300+0000 7f4ae97fa700 1 -- 172.21.15.72:0/3858767489 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4adc058840 con 0x7f4aec0b8aa0 2023-08-25T04:45:51.302 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:45:51.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 -- 172.21.15.72:0/3858767489 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4acc06a0e0 msgr2=0x7f4acc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4acc06a0e0 0x7f4acc06c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4aec1599d0 tx=0x7f4ad4009040 comp rx=0 tx=0).stop 2023-08-25T04:45:51.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 -- 172.21.15.72:0/3858767489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec0b8aa0 msgr2=0x7f4aec0b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec0b8aa0 0x7f4aec0b26c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4adc000c00 tx=0x7f4adc004750 comp rx=0 tx=0).stop 2023-08-25T04:45:51.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 -- 172.21.15.72:0/3858767489 shutdown_connections 2023-08-25T04:45:51.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4acc06a0e0 0x7f4acc06c5a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4aec15d090 0x7f4aec147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4aec0b8aa0 0x7f4aec0b26c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 --2- 172.21.15.72:0/3858767489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4aec0ce260 0x7f4aec1f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 -- 172.21.15.72:0/3858767489 >> 172.21.15.72:0/3858767489 conn(0x7f4aec071e10 msgr2=0x7f4aec15d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:51.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 -- 172.21.15.72:0/3858767489 shutdown_connections 2023-08-25T04:45:51.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.303+0000 7f4af25ff700 1 -- 172.21.15.72:0/3858767489 wait complete. 2023-08-25T04:45:51.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:45:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.519+0000 7fd7c7dff700 1 Processor -- start 2023-08-25T04:45:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.519+0000 7fd7c7dff700 1 -- start start 2023-08-25T04:45:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.520+0000 7fd7c7dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd7c00b4f10 0x7fd7c00b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.520+0000 7fd7c7dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c00b7400 con 0x7fd7c0160710 2023-08-25T04:45:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.520+0000 7fd7c7dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c00b7650 con 0x7fd7c00d20f0 2023-08-25T04:45:51.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.520+0000 7fd7c7dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c00b7930 con 0x7fd7c00b4f10 2023-08-25T04:45:51.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c5b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd7c0160710 0x7fd7c00b87f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57400/0 (socket says 172.21.15.72:57400) 2023-08-25T04:45:51.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c5b9b700 1 -- 172.21.15.72:0/508838569 learned_addr learned my addr 172.21.15.72:0/508838569 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:51.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c639c700 1 --2- 172.21.15.72:0/508838569 >> v2:172.21.15.137:3300/0 conn(0x7fd7c00b4f10 0x7fd7c00b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c4b99700 1 -- 172.21.15.72:0/508838569 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715495079 0 0) 0x7fd7c00b7400 con 0x7fd7c0160710 2023-08-25T04:45:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c4b99700 1 -- 172.21.15.72:0/508838569 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ac0035b0 con 0x7fd7c0160710 2023-08-25T04:45:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c4b99700 1 -- 172.21.15.72:0/508838569 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645629760 0 0) 0x7fd7c00b7650 con 0x7fd7c00d20f0 2023-08-25T04:45:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c4b99700 1 -- 172.21.15.72:0/508838569 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c00b7400 con 0x7fd7c00d20f0 2023-08-25T04:45:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c4b99700 1 -- 172.21.15.72:0/508838569 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2648043843 0 0) 0x7fd7ac0035b0 con 0x7fd7c0160710 2023-08-25T04:45:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c639c700 1 -- 172.21.15.72:0/508838569 >> v1:172.21.15.137:6789/0 conn(0x7fd7c00d20f0 legacy=0x7fd7c00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c639c700 1 -- 172.21.15.72:0/508838569 >> v1:172.21.15.72:6789/0 conn(0x7fd7c0160710 legacy=0x7fd7c00b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.521+0000 7fd7c639c700 1 -- 172.21.15.72:0/508838569 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c00b7c10 con 0x7fd7c00b4f10 2023-08-25T04:45:51.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.522+0000 7fd7c639c700 1 --2- 172.21.15.72:0/508838569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c00b4f10 0x7fd7c00b6ec0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009d90 tx=0x7fd7b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a602641736048cb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.522+0000 7fd7c4b99700 1 -- 172.21.15.72:0/508838569 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800e070 con 0x7fd7c00b4f10 2023-08-25T04:45:51.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.522+0000 7fd7c4b99700 1 -- 172.21.15.72:0/508838569 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b8003a20 con 0x7fd7c00b4f10 2023-08-25T04:45:51.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.522+0000 7fd7c4b99700 1 -- 172.21.15.72:0/508838569 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc001670 con 0x7fd7c00b4f10 2023-08-25T04:45:51.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.522+0000 7fd7c7dff700 1 -- 172.21.15.72:0/508838569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c00b4f10 msgr2=0x7fd7c00b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.522+0000 7fd7c7dff700 1 --2- 172.21.15.72:0/508838569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c00b4f10 0x7fd7c00b6ec0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009d90 tx=0x7fd7b800b330 comp rx=0 tx=0).stop 2023-08-25T04:45:51.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.523+0000 7fd7c7dff700 1 -- 172.21.15.72:0/508838569 shutdown_connections 2023-08-25T04:45:51.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.523+0000 7fd7c7dff700 1 --2- 172.21.15.72:0/508838569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c00b4f10 0x7fd7c00b6ec0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.523+0000 7fd7c7dff700 1 -- 172.21.15.72:0/508838569 >> 172.21.15.72:0/508838569 conn(0x7fd7c0071e40 msgr2=0x7fd7c0072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:51.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.523+0000 7fd7c7dff700 1 -- 172.21.15.72:0/508838569 shutdown_connections 2023-08-25T04:45:51.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.523+0000 7fd7c7dff700 1 -- 172.21.15.72:0/508838569 wait complete. 2023-08-25T04:45:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.524+0000 7fd7c7dff700 1 Processor -- start 2023-08-25T04:45:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.524+0000 7fd7c7dff700 1 -- start start 2023-08-25T04:45:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.525+0000 7fd7c7dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7c00b4f10 0x7fd7c00cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.525+0000 7fd7c7dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c00d20f0 0x7fd7c0153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.525+0000 7fd7c7dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c0160710 0x7fd7c00d1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.525+0000 7fd7c7dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00cb930 con 0x7fd7c0160710 2023-08-25T04:45:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.525+0000 7fd7c7dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c0153740 con 0x7fd7c00d20f0 2023-08-25T04:45:51.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.525+0000 7fd7c7dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00cacb0 con 0x7fd7c00b4f10 2023-08-25T04:45:51.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.525+0000 7fd7c639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c0160710 0x7fd7c00d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c0160710 0x7fd7c00d1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46662/0 (socket says 172.21.15.72:46662) 2023-08-25T04:45:51.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c639c700 1 -- 172.21.15.72:0/159035657 learned_addr learned my addr 172.21.15.72:0/159035657 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:51.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c5b9b700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7c00b4f10 0x7fd7c00cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c539a700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c00d20f0 0x7fd7c0153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c639c700 1 -- 172.21.15.72:0/159035657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7c00b4f10 msgr2=0x7fd7c00cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c639c700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7c00b4f10 0x7fd7c00cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c639c700 1 -- 172.21.15.72:0/159035657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c00d20f0 msgr2=0x7fd7c0153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c639c700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c00d20f0 0x7fd7c0153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c639c700 1 -- 172.21.15.72:0/159035657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b8009a70 con 0x7fd7c0160710 2023-08-25T04:45:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c639c700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c0160710 0x7fd7c00d1730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8015040 tx=0x7fd7b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7b67fc700 1 -- 172.21.15.72:0/159035657 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8004240 con 0x7fd7c0160710 2023-08-25T04:45:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7b67fc700 1 -- 172.21.15.72:0/159035657 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b80043a0 con 0x7fd7c0160710 2023-08-25T04:45:51.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7b67fc700 1 -- 172.21.15.72:0/159035657 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8004790 con 0x7fd7c0160710 2023-08-25T04:45:51.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.526+0000 7fd7c7dff700 1 -- 172.21.15.72:0/159035657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c00caf90 con 0x7fd7c0160710 2023-08-25T04:45:51.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.527+0000 7fd7c7dff700 1 -- 172.21.15.72:0/159035657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c00cb550 con 0x7fd7c0160710 2023-08-25T04:45:51.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.528+0000 7fd7c7dff700 1 -- 172.21.15.72:0/159035657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c00cba70 con 0x7fd7c0160710 2023-08-25T04:45:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.529+0000 7fd7b67fc700 1 -- 172.21.15.72:0/159035657 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd7b801c460 con 0x7fd7c0160710 2023-08-25T04:45:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.529+0000 7fd7b67fc700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd7a406a0e0 0x7fd7a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.529+0000 7fd7b67fc700 1 -- 172.21.15.72:0/159035657 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd7b8089ea0 con 0x7fd7c0160710 2023-08-25T04:45:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.530+0000 7fd7c5b9b700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd7a406a0e0 0x7fd7a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.530+0000 7fd7c5b9b700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd7a406a0e0 0x7fd7a406c5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc000fd0 tx=0x7fd7bc000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:51.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.534+0000 7fd7b67fc700 1 -- 172.21.15.72:0/159035657 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd7c00cba70 con 0x7fd7c0160710 2023-08-25T04:45:51.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.747+0000 7fd7c7dff700 1 -- 172.21.15.72:0/159035657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd7c00cba70 con 0x7fd7c0160710 2023-08-25T04:45:51.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.747+0000 7fd7b67fc700 1 -- 172.21.15.72:0/159035657 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd7c00cba70 con 0x7fd7c0160710 2023-08-25T04:45:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.749+0000 7fd7c7dff700 1 -- 172.21.15.72:0/159035657 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd7a406a0e0 msgr2=0x7fd7a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.749+0000 7fd7c7dff700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd7a406a0e0 0x7fd7a406c5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc000fd0 tx=0x7fd7bc000ed0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.749+0000 7fd7c7dff700 1 -- 172.21.15.72:0/159035657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c0160710 msgr2=0x7fd7c00d1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.749+0000 7fd7c7dff700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c0160710 0x7fd7c00d1730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8015040 tx=0x7fd7b8004ad0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.750+0000 7fd7c7dff700 1 -- 172.21.15.72:0/159035657 shutdown_connections 2023-08-25T04:45:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.750+0000 7fd7c7dff700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd7a406a0e0 0x7fd7a406c5a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.750+0000 7fd7c7dff700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c0160710 0x7fd7c00d1730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.750+0000 7fd7c7dff700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7c00b4f10 0x7fd7c00cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.750+0000 7fd7c7dff700 1 --2- 172.21.15.72:0/159035657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7c00d20f0 0x7fd7c0153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:51.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.750+0000 7fd7c7dff700 1 -- 172.21.15.72:0/159035657 >> 172.21.15.72:0/159035657 conn(0x7fd7c0071e40 msgr2=0x7fd7c00b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:51.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.750+0000 7fd7c7dff700 1 -- 172.21.15.72:0/159035657 shutdown_connections 2023-08-25T04:45:51.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:51.750+0000 7fd7c7dff700 1 -- 172.21.15.72:0/159035657 wait complete. 2023-08-25T04:45:51.753 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-08-25T04:45:51.769 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:45:51.769 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:45:51.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:52.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.049+0000 7f8aabdff700 1 Processor -- start 2023-08-25T04:45:52.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.049+0000 7f8aabdff700 1 -- start start 2023-08-25T04:45:52.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.050+0000 7f8aabdff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa415d130 0x7f8aa40d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.050+0000 7f8aabdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8aa40b86b0 0x7f8aa40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.050+0000 7f8aabdff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa40d1780 con 0x7f8aa40b47c0 2023-08-25T04:45:52.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.050+0000 7f8aabdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa40d1a60 con 0x7f8aa40b86b0 2023-08-25T04:45:52.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.050+0000 7f8aabdff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40d1d40 con 0x7f8aa415d130 2023-08-25T04:45:52.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.050+0000 7f8aaa39c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8aa40b86b0 0x7f8aa40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.050+0000 7f8aaa39c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8aa40b86b0 0x7f8aa40b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46676/0 (socket says 172.21.15.72:46676) 2023-08-25T04:45:52.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.050+0000 7f8aaa39c700 1 -- 172.21.15.72:0/2893639783 learned_addr learned my addr 172.21.15.72:0/2893639783 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:52.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.051+0000 7f8aa939a700 1 --2- 172.21.15.72:0/2893639783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa415d130 0x7f8aa40d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.051+0000 7f8aaa39c700 1 -- 172.21.15.72:0/2893639783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa415d130 msgr2=0x7f8aa40d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:52.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.051+0000 7f8aaa39c700 1 --2- 172.21.15.72:0/2893639783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa415d130 0x7f8aa40d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.051+0000 7f8aaa39c700 1 -- 172.21.15.72:0/2893639783 >> v1:172.21.15.137:6789/0 conn(0x7f8aa40b47c0 legacy=0x7f8aa40b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.051+0000 7f8aaa39c700 1 -- 172.21.15.72:0/2893639783 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40d2020 con 0x7f8aa40b86b0 2023-08-25T04:45:52.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.051+0000 7f8aaa39c700 1 --2- 172.21.15.72:0/2893639783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa40b86b0 0x7f8aa40b5da0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009e50 tx=0x7f8a9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b57d82b3b06203 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:52.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aa8b99700 1 -- 172.21.15.72:0/2893639783 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00e070 con 0x7f8aa40b86b0 2023-08-25T04:45:52.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aa8b99700 1 -- 172.21.15.72:0/2893639783 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c00b910 con 0x7f8aa40b86b0 2023-08-25T04:45:52.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aa8b99700 1 -- 172.21.15.72:0/2893639783 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00bcc0 con 0x7f8aa40b86b0 2023-08-25T04:45:52.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aabdff700 1 -- 172.21.15.72:0/2893639783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa40b86b0 msgr2=0x7f8aa40b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aabdff700 1 --2- 172.21.15.72:0/2893639783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa40b86b0 0x7f8aa40b5da0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009e50 tx=0x7f8a9c00b330 comp rx=0 tx=0).stop 2023-08-25T04:45:52.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aabdff700 1 -- 172.21.15.72:0/2893639783 shutdown_connections 2023-08-25T04:45:52.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aabdff700 1 --2- 172.21.15.72:0/2893639783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa40b86b0 0x7f8aa40b5da0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aabdff700 1 --2- 172.21.15.72:0/2893639783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa415d130 0x7f8aa40d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aabdff700 1 -- 172.21.15.72:0/2893639783 >> 172.21.15.72:0/2893639783 conn(0x7f8aa4072050 msgr2=0x7f8aa40d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:52.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aabdff700 1 -- 172.21.15.72:0/2893639783 shutdown_connections 2023-08-25T04:45:52.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.052+0000 7f8aabdff700 1 -- 172.21.15.72:0/2893639783 wait complete. 2023-08-25T04:45:52.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.054+0000 7f8aabdff700 1 Processor -- start 2023-08-25T04:45:52.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.054+0000 7f8aabdff700 1 -- start start 2023-08-25T04:45:52.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.055+0000 7f8aabdff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa40b47c0 0x7f8aa414a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.055+0000 7f8aabdff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aa40b86b0 0x7f8aa414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.055+0000 7f8aabdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa415d130 0x7f8aa40d2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.055+0000 7f8aabdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa414d880 con 0x7f8aa415d130 2023-08-25T04:45:52.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.055+0000 7f8aabdff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa414a720 con 0x7f8aa40b86b0 2023-08-25T04:45:52.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.055+0000 7f8aabdff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa414c960 con 0x7f8aa40b47c0 2023-08-25T04:45:52.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.055+0000 7f8aaa39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa415d130 0x7f8aa40d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.055+0000 7f8aaa39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa415d130 0x7f8aa40d2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46692/0 (socket says 172.21.15.72:46692) 2023-08-25T04:45:52.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.055+0000 7f8aaa39c700 1 -- 172.21.15.72:0/2994492465 learned_addr learned my addr 172.21.15.72:0/2994492465 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:52.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aa9b9b700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa40b47c0 0x7f8aa414a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aaa39c700 1 -- 172.21.15.72:0/2994492465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa40b47c0 msgr2=0x7f8aa414a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aa939a700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aa40b86b0 0x7f8aa414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aaa39c700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa40b47c0 0x7f8aa414a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aaa39c700 1 -- 172.21.15.72:0/2994492465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aa40b86b0 msgr2=0x7f8aa414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aaa39c700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aa40b86b0 0x7f8aa414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aaa39c700 1 -- 172.21.15.72:0/2994492465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c009b30 con 0x7f8aa415d130 2023-08-25T04:45:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aa939a700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aa40b86b0 0x7f8aa414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aa9b9b700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa40b47c0 0x7f8aa414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aaa39c700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa415d130 0x7f8aa40d2820 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c012000 tx=0x7f8a9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:52.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8a9a7fc700 1 -- 172.21.15.72:0/2994492465 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0099b0 con 0x7f8aa415d130 2023-08-25T04:45:52.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8a9a7fc700 1 -- 172.21.15.72:0/2994492465 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0092e0 con 0x7f8aa415d130 2023-08-25T04:45:52.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8a9a7fc700 1 -- 172.21.15.72:0/2994492465 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c01c640 con 0x7f8aa415d130 2023-08-25T04:45:52.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.056+0000 7f8aabdff700 1 -- 172.21.15.72:0/2994492465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa414cc00 con 0x7f8aa415d130 2023-08-25T04:45:52.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.057+0000 7f8aabdff700 1 -- 172.21.15.72:0/2994492465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa414d1c0 con 0x7f8aa415d130 2023-08-25T04:45:52.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.057+0000 7f8aabdff700 1 -- 172.21.15.72:0/2994492465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa414d9c0 con 0x7f8aa415d130 2023-08-25T04:45:52.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.058+0000 7f8a9a7fc700 1 -- 172.21.15.72:0/2994492465 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8a9c01c7a0 con 0x7f8aa415d130 2023-08-25T04:45:52.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.059+0000 7f8a9a7fc700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a8806a0e0 0x7f8a8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.059+0000 7f8a9a7fc700 1 -- 172.21.15.72:0/2994492465 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8a9c08a610 con 0x7f8aa415d130 2023-08-25T04:45:52.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.059+0000 7f8aa9b9b700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a8806a0e0 0x7f8a8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.060+0000 7f8aa9b9b700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a8806a0e0 0x7f8a8806c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0000f60 tx=0x7f8aa0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:52.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.063+0000 7f8a9a7fc700 1 -- 172.21.15.72:0/2994492465 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8aa414d9c0 con 0x7f8aa415d130 2023-08-25T04:45:52.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.264+0000 7f8aabdff700 1 -- 172.21.15.72:0/2994492465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8aa414d9c0 con 0x7f8aa415d130 2023-08-25T04:45:52.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.265+0000 7f8a9a7fc700 1 -- 172.21.15.72:0/2994492465 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f8aa414d9c0 con 0x7f8aa415d130 2023-08-25T04:45:52.266 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:52.267 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 -- 172.21.15.72:0/2994492465 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a8806a0e0 msgr2=0x7f8a8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a8806a0e0 0x7f8a8806c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0000f60 tx=0x7f8aa0009040 comp rx=0 tx=0).stop 2023-08-25T04:45:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 -- 172.21.15.72:0/2994492465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa415d130 msgr2=0x7f8aa40d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa415d130 0x7f8aa40d2820 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c012000 tx=0x7f8a9c004ad0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 -- 172.21.15.72:0/2994492465 shutdown_connections 2023-08-25T04:45:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a8806a0e0 0x7f8a8806c5a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aa415d130 0x7f8aa40d2820 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8aa40b47c0 0x7f8aa414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 --2- 172.21.15.72:0/2994492465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8aa40b86b0 0x7f8aa414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 -- 172.21.15.72:0/2994492465 >> 172.21.15.72:0/2994492465 conn(0x7f8aa4072050 msgr2=0x7f8aa40b63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 -- 172.21.15.72:0/2994492465 shutdown_connections 2023-08-25T04:45:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.268+0000 7f8aabdff700 1 -- 172.21.15.72:0/2994492465 wait complete. 2023-08-25T04:45:52.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:45:52.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:45:52.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.488+0000 7f22e2dff700 1 Processor -- start 2023-08-25T04:45:52.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.488+0000 7f22e2dff700 1 -- start start 2023-08-25T04:45:52.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.489+0000 7f22e2dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22dc0d10c0 0x7f22dc0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.489+0000 7f22e2dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22dc0b8d10 con 0x7f22dc0b4d40 2023-08-25T04:45:52.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.489+0000 7f22e2dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22dc0b6e90 con 0x7f22dc15d000 2023-08-25T04:45:52.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.489+0000 7f22e2dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc0b56f0 con 0x7f22dc0d10c0 2023-08-25T04:45:52.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.489+0000 7f22dbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22dc0d10c0 0x7f22dc0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.489+0000 7f22e139c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f22dc0b4d40 0x7f22dc0b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57410/0 (socket says 172.21.15.72:57410) 2023-08-25T04:45:52.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.489+0000 7f22e139c700 1 -- 172.21.15.72:0/958358204 learned_addr learned my addr 172.21.15.72:0/958358204 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:52.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.490+0000 7f22dbfff700 1 -- 172.21.15.72:0/958358204 >> v1:172.21.15.137:6789/0 conn(0x7f22dc15d000 legacy=0x7f22dc0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.490+0000 7f22dbfff700 1 -- 172.21.15.72:0/958358204 >> v1:172.21.15.72:6789/0 conn(0x7f22dc0b4d40 legacy=0x7f22dc0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.490+0000 7f22dbfff700 1 -- 172.21.15.72:0/958358204 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0b5170 con 0x7f22dc0d10c0 2023-08-25T04:45:52.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.490+0000 7f22dbfff700 1 --2- 172.21.15.72:0/958358204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0d10c0 0x7f22dc0b4800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009840 tx=0x7f22c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9da28e6dc01da32 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:52.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.490+0000 7f22db7fe700 1 -- 172.21.15.72:0/958358204 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8011830 con 0x7f22dc0d10c0 2023-08-25T04:45:52.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.490+0000 7f22db7fe700 1 -- 172.21.15.72:0/958358204 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8011990 con 0x7f22dc0d10c0 2023-08-25T04:45:52.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.490+0000 7f22db7fe700 1 -- 172.21.15.72:0/958358204 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8011d20 con 0x7f22dc0d10c0 2023-08-25T04:45:52.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.491+0000 7f22e2dff700 1 -- 172.21.15.72:0/958358204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0d10c0 msgr2=0x7f22dc0b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.491+0000 7f22e2dff700 1 --2- 172.21.15.72:0/958358204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0d10c0 0x7f22dc0b4800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009840 tx=0x7f22c8009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:52.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.491+0000 7f22e2dff700 1 -- 172.21.15.72:0/958358204 shutdown_connections 2023-08-25T04:45:52.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.491+0000 7f22e2dff700 1 --2- 172.21.15.72:0/958358204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0d10c0 0x7f22dc0b4800 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.491+0000 7f22e2dff700 1 -- 172.21.15.72:0/958358204 >> 172.21.15.72:0/958358204 conn(0x7f22dc071e10 msgr2=0x7f22dc072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:52.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.491+0000 7f22e2dff700 1 -- 172.21.15.72:0/958358204 shutdown_connections 2023-08-25T04:45:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.491+0000 7f22e2dff700 1 -- 172.21.15.72:0/958358204 wait complete. 2023-08-25T04:45:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.493+0000 7f22e2dff700 1 Processor -- start 2023-08-25T04:45:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.493+0000 7f22e2dff700 1 -- start start 2023-08-25T04:45:52.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e2dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0b4d40 0x7f22dc15c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e2dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22dc0d10c0 0x7f22dc0a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e2dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22dc15d000 0x7f22dc0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e2dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0c7f60 con 0x7f22dc0b4d40 2023-08-25T04:45:52.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e2dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0c8200 con 0x7f22dc15d000 2023-08-25T04:45:52.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e2dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0c84e0 con 0x7f22dc0d10c0 2023-08-25T04:45:52.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e0b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0b4d40 0x7f22dc15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e0b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0b4d40 0x7f22dc15c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46720/0 (socket says 172.21.15.72:46720) 2023-08-25T04:45:52.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e0b9b700 1 -- 172.21.15.72:0/2004029325 learned_addr learned my addr 172.21.15.72:0/2004029325 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:52.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22dbfff700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22dc0d10c0 0x7f22dc0a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e139c700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22dc15d000 0x7f22dc0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e0b9b700 1 -- 172.21.15.72:0/2004029325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22dc0d10c0 msgr2=0x7f22dc0a9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e0b9b700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22dc0d10c0 0x7f22dc0a9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e0b9b700 1 -- 172.21.15.72:0/2004029325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22dc15d000 msgr2=0x7f22dc0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e0b9b700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22dc15d000 0x7f22dc0cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e0b9b700 1 -- 172.21.15.72:0/2004029325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c80094a0 con 0x7f22dc0b4d40 2023-08-25T04:45:52.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.494+0000 7f22e0b9b700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0b4d40 0x7f22dc15c420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f22d000c450 tx=0x7f22d000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:52.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.495+0000 7f22d97fa700 1 -- 172.21.15.72:0/2004029325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d00052d0 con 0x7f22dc0b4d40 2023-08-25T04:45:52.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.495+0000 7f22d97fa700 1 -- 172.21.15.72:0/2004029325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0005430 con 0x7f22dc0b4d40 2023-08-25T04:45:52.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.495+0000 7f22e2dff700 1 -- 172.21.15.72:0/2004029325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc0c87c0 con 0x7f22dc0b4d40 2023-08-25T04:45:52.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.495+0000 7f22d97fa700 1 -- 172.21.15.72:0/2004029325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d00038c0 con 0x7f22dc0b4d40 2023-08-25T04:45:52.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.495+0000 7f22e2dff700 1 -- 172.21.15.72:0/2004029325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc0c8d80 con 0x7f22dc0b4d40 2023-08-25T04:45:52.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.496+0000 7f22e2dff700 1 -- 172.21.15.72:0/2004029325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc06a2f0 con 0x7f22dc0b4d40 2023-08-25T04:45:52.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.497+0000 7f22d97fa700 1 -- 172.21.15.72:0/2004029325 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f22d0003a20 con 0x7f22dc0b4d40 2023-08-25T04:45:52.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.499+0000 7f22d97fa700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f22c006a0e0 0x7f22c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.499+0000 7f22d97fa700 1 -- 172.21.15.72:0/2004029325 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f22d0087ba0 con 0x7f22dc0b4d40 2023-08-25T04:45:52.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.499+0000 7f22dbfff700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f22c006a0e0 0x7f22c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.499+0000 7f22dbfff700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f22c006a0e0 0x7f22c006c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22c80090b0 tx=0x7f22c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:52.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.503+0000 7f22d97fa700 1 -- 172.21.15.72:0/2004029325 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f22d0053030 con 0x7f22dc0b4d40 2023-08-25T04:45:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.702+0000 7f22e2dff700 1 -- 172.21.15.72:0/2004029325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f22dc08a000 con 0x7f22dc0b4d40 2023-08-25T04:45:52.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.702+0000 7f22d97fa700 1 -- 172.21.15.72:0/2004029325 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f22d0017020 con 0x7f22dc0b4d40 2023-08-25T04:45:52.705 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:45:52.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.704+0000 7f22e2dff700 1 -- 172.21.15.72:0/2004029325 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f22c006a0e0 msgr2=0x7f22c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.704+0000 7f22e2dff700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f22c006a0e0 0x7f22c006c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22c80090b0 tx=0x7f22c8008030 comp rx=0 tx=0).stop 2023-08-25T04:45:52.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.705+0000 7f22e2dff700 1 -- 172.21.15.72:0/2004029325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0b4d40 msgr2=0x7f22dc15c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.705+0000 7f22e2dff700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0b4d40 0x7f22dc15c420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f22d000c450 tx=0x7f22d000c760 comp rx=0 tx=0).stop 2023-08-25T04:45:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.705+0000 7f22e2dff700 1 -- 172.21.15.72:0/2004029325 shutdown_connections 2023-08-25T04:45:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.705+0000 7f22e2dff700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f22c006a0e0 0x7f22c006c5a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.705+0000 7f22e2dff700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22dc15d000 0x7f22dc0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.705+0000 7f22e2dff700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22dc0b4d40 0x7f22dc15c420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.705+0000 7f22e2dff700 1 --2- 172.21.15.72:0/2004029325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22dc0d10c0 0x7f22dc0a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.705+0000 7f22e2dff700 1 -- 172.21.15.72:0/2004029325 >> 172.21.15.72:0/2004029325 conn(0x7f22dc071e10 msgr2=0x7f22dc0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.705+0000 7f22e2dff700 1 -- 172.21.15.72:0/2004029325 shutdown_connections 2023-08-25T04:45:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.705+0000 7f22e2dff700 1 -- 172.21.15.72:0/2004029325 wait complete. 2023-08-25T04:45:52.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:45:52.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.924+0000 7f720c5ff700 1 Processor -- start 2023-08-25T04:45:52.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.924+0000 7f720c5ff700 1 -- start start 2023-08-25T04:45:52.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.925+0000 7f720c5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f72040cb650 0x7f72040cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.925+0000 7f720c5ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f72040b2c70 0x7f72040710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.925+0000 7f720c5ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72040b4300 con 0x7f72040b2810 2023-08-25T04:45:52.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.925+0000 7f720c5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72040cbf70 con 0x7f72040cb650 2023-08-25T04:45:52.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.925+0000 7f720c5ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72040b3260 con 0x7f72040b2c70 2023-08-25T04:45:52.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.925+0000 7f720a39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f72040cb650 0x7f72040cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.926+0000 7f720a39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f72040cb650 0x7f72040cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55846/0 (socket says 172.21.15.72:55846) 2023-08-25T04:45:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.926+0000 7f720a39b700 1 -- 172.21.15.72:0/2629913044 learned_addr learned my addr 172.21.15.72:0/2629913044 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.926+0000 7f720ab9c700 1 --2- 172.21.15.72:0/2629913044 >> v2:172.21.15.137:3300/0 conn(0x7f72040b2c70 0x7f72040710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.926+0000 7f720a39b700 1 -- 172.21.15.72:0/2629913044 >> v2:172.21.15.137:3300/0 conn(0x7f72040b2c70 msgr2=0x7f72040710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.926+0000 7f720a39b700 1 --2- 172.21.15.72:0/2629913044 >> v2:172.21.15.137:3300/0 conn(0x7f72040b2c70 0x7f72040710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.926+0000 7f720a39b700 1 -- 172.21.15.72:0/2629913044 >> v1:172.21.15.137:6789/0 conn(0x7f72040b2810 legacy=0x7f7204070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.926+0000 7f720a39b700 1 -- 172.21.15.72:0/2629913044 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72040b3540 con 0x7f72040cb650 2023-08-25T04:45:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.926+0000 7f720ab9c700 1 --2- 172.21.15.72:0/2629913044 >> v2:172.21.15.137:3300/0 conn(0x7f72040b2c70 0x7f72040710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:52.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.926+0000 7f720a39b700 1 --2- 172.21.15.72:0/2629913044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 0x7f72040cba30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f720406ee80 tx=0x7f7200009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71d924110675967 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:52.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.926+0000 7f7209399700 1 -- 172.21.15.72:0/2629913044 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000b870 con 0x7f72040cb650 2023-08-25T04:45:52.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.927+0000 7f7209399700 1 -- 172.21.15.72:0/2629913044 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720000b9d0 con 0x7f72040cb650 2023-08-25T04:45:52.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.927+0000 7f7209399700 1 -- 172.21.15.72:0/2629913044 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000bd60 con 0x7f72040cb650 2023-08-25T04:45:52.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.927+0000 7f720c5ff700 1 -- 172.21.15.72:0/2629913044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 msgr2=0x7f72040cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.927+0000 7f720c5ff700 1 --2- 172.21.15.72:0/2629913044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 0x7f72040cba30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f720406ee80 tx=0x7f7200009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.927+0000 7f720c5ff700 1 -- 172.21.15.72:0/2629913044 shutdown_connections 2023-08-25T04:45:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.927+0000 7f720c5ff700 1 --2- 172.21.15.72:0/2629913044 >> v2:172.21.15.137:3300/0 conn(0x7f72040b2c70 0x7f72040710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.927+0000 7f720c5ff700 1 --2- 172.21.15.72:0/2629913044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 0x7f72040cba30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.927+0000 7f720c5ff700 1 -- 172.21.15.72:0/2629913044 >> 172.21.15.72:0/2629913044 conn(0x7f720406a710 msgr2=0x7f720406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.927+0000 7f720c5ff700 1 -- 172.21.15.72:0/2629913044 shutdown_connections 2023-08-25T04:45:52.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.927+0000 7f720c5ff700 1 -- 172.21.15.72:0/2629913044 wait complete. 2023-08-25T04:45:52.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.929+0000 7f720c5ff700 1 Processor -- start 2023-08-25T04:45:52.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.929+0000 7f720c5ff700 1 -- start start 2023-08-25T04:45:52.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f720c5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72040b2810 0x7f72041f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f720c5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72040b2c70 0x7f720415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f720c5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 0x7f72040acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f720c5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72040c24b0 con 0x7f72040cb650 2023-08-25T04:45:52.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f720c5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72041f31d0 con 0x7f72040b2c70 2023-08-25T04:45:52.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f720c5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72040c6e10 con 0x7f72040b2810 2023-08-25T04:45:52.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f720ab9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 0x7f72040acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f720ab9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 0x7f72040acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55862/0 (socket says 172.21.15.72:55862) 2023-08-25T04:45:52.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f720ab9c700 1 -- 172.21.15.72:0/3532357312 learned_addr learned my addr 172.21.15.72:0/3532357312 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:52.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f720a39b700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72040b2810 0x7f72041f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.930+0000 7f7209b9a700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72040b2c70 0x7f720415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f720ab9c700 1 -- 172.21.15.72:0/3532357312 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72040b2810 msgr2=0x7f72041f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f720ab9c700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72040b2810 0x7f72041f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f720ab9c700 1 -- 172.21.15.72:0/3532357312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72040b2c70 msgr2=0x7f720415aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:52.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f720ab9c700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72040b2c70 0x7f720415aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:52.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f720ab9c700 1 -- 172.21.15.72:0/3532357312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200009550 con 0x7f72040cb650 2023-08-25T04:45:52.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f720ab9c700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 0x7f72040acb70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009fa0 tx=0x7f71fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:52.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f71faffd700 1 -- 172.21.15.72:0/3532357312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00ddb0 con 0x7f72040cb650 2023-08-25T04:45:52.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f71faffd700 1 -- 172.21.15.72:0/3532357312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00f040 con 0x7f72040cb650 2023-08-25T04:45:52.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f71faffd700 1 -- 172.21.15.72:0/3532357312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc003c60 con 0x7f72040cb650 2023-08-25T04:45:52.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f720c5ff700 1 -- 172.21.15.72:0/3532357312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72040c70f0 con 0x7f72040cb650 2023-08-25T04:45:52.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.931+0000 7f720c5ff700 1 -- 172.21.15.72:0/3532357312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72040c7480 con 0x7f72040cb650 2023-08-25T04:45:52.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.932+0000 7f720c5ff700 1 -- 172.21.15.72:0/3532357312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7204072320 con 0x7f72040cb650 2023-08-25T04:45:52.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.933+0000 7f71faffd700 1 -- 172.21.15.72:0/3532357312 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f71fc004030 con 0x7f72040cb650 2023-08-25T04:45:52.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.934+0000 7f71faffd700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71e806a0e0 0x7f71e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:52.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.934+0000 7f71faffd700 1 -- 172.21.15.72:0/3532357312 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f71fc088a70 con 0x7f72040cb650 2023-08-25T04:45:52.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.934+0000 7f720a39b700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71e806a0e0 0x7f71e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:52.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.935+0000 7f720a39b700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71e806a0e0 0x7f71e806c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7200014040 tx=0x7f7200008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:52.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:52.939+0000 7f71faffd700 1 -- 172.21.15.72:0/3532357312 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f71fc053d40 con 0x7f72040cb650 2023-08-25T04:45:53.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.136+0000 7f720c5ff700 1 -- 172.21.15.72:0/3532357312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72040744f0 con 0x7f72040cb650 2023-08-25T04:45:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.137+0000 7f71faffd700 1 -- 172.21.15.72:0/3532357312 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71fc057360 con 0x7f72040cb650 2023-08-25T04:45:53.139 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:45:53.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 -- 172.21.15.72:0/3532357312 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71e806a0e0 msgr2=0x7f71e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71e806a0e0 0x7f71e806c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7200014040 tx=0x7f7200008030 comp rx=0 tx=0).stop 2023-08-25T04:45:53.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 -- 172.21.15.72:0/3532357312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 msgr2=0x7f72040acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 0x7f72040acb70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009fa0 tx=0x7f71fc00d3b0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 -- 172.21.15.72:0/3532357312 shutdown_connections 2023-08-25T04:45:53.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71e806a0e0 0x7f71e806c5a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72040cb650 0x7f72040acb70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72040b2810 0x7f72041f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 --2- 172.21.15.72:0/3532357312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72040b2c70 0x7f720415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 -- 172.21.15.72:0/3532357312 >> 172.21.15.72:0/3532357312 conn(0x7f720406a710 msgr2=0x7f720406db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 -- 172.21.15.72:0/3532357312 shutdown_connections 2023-08-25T04:45:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.139+0000 7f720c5ff700 1 -- 172.21.15.72:0/3532357312 wait complete. 2023-08-25T04:45:53.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:45:53.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.358+0000 7fe4a8fff700 1 Processor -- start 2023-08-25T04:45:53.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.358+0000 7fe4a8fff700 1 -- start start 2023-08-25T04:45:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.359+0000 7fe4a8fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe4a415d180 0x7fe4a40cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.359+0000 7fe4a8fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4a406ee50 0x7fe4a40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.359+0000 7fe4a8fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a406b030 con 0x7fe4a406f950 2023-08-25T04:45:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.359+0000 7fe4a8fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a415d560 con 0x7fe4a406ee50 2023-08-25T04:45:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.359+0000 7fe4a8fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a406a420 con 0x7fe4a415d180 2023-08-25T04:45:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.359+0000 7fe49bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe4a406f950 0x7fe4a406e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53128/0 (socket says 172.21.15.72:53128) 2023-08-25T04:45:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.359+0000 7fe49bfff700 1 -- 172.21.15.72:0/1337895775 learned_addr learned my addr 172.21.15.72:0/1337895775 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.359+0000 7fe4a2d9d700 1 --2- 172.21.15.72:0/1337895775 >> v2:172.21.15.72:3300/0 conn(0x7fe4a406ee50 0x7fe4a40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.360+0000 7fe4a259c700 1 --2- 172.21.15.72:0/1337895775 >> v2:172.21.15.137:3300/0 conn(0x7fe4a415d180 0x7fe4a40cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.360+0000 7fe4a1d9b700 1 -- 172.21.15.72:0/1337895775 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143130634 0 0) 0x7fe4a406b030 con 0x7fe4a406f950 2023-08-25T04:45:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.360+0000 7fe4a2d9d700 1 -- 172.21.15.72:0/1337895775 >> v2:172.21.15.137:3300/0 conn(0x7fe4a415d180 msgr2=0x7fe4a40cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.360+0000 7fe4a2d9d700 1 --2- 172.21.15.72:0/1337895775 >> v2:172.21.15.137:3300/0 conn(0x7fe4a415d180 0x7fe4a40cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.360+0000 7fe4a2d9d700 1 -- 172.21.15.72:0/1337895775 >> v1:172.21.15.72:6789/0 conn(0x7fe4a406f950 legacy=0x7fe4a406e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.360+0000 7fe4a2d9d700 1 -- 172.21.15.72:0/1337895775 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a406a700 con 0x7fe4a406ee50 2023-08-25T04:45:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.360+0000 7fe4a2d9d700 1 --2- 172.21.15.72:0/1337895775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 0x7fe4a40c9c80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe4a406deb0 tx=0x7fe49c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0003f73e08e29ca server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.360+0000 7fe4a1d9b700 1 -- 172.21.15.72:0/1337895775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00e070 con 0x7fe4a406ee50 2023-08-25T04:45:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.360+0000 7fe4a1d9b700 1 -- 172.21.15.72:0/1337895775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c00bbd0 con 0x7fe4a406ee50 2023-08-25T04:45:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.360+0000 7fe4a1d9b700 1 -- 172.21.15.72:0/1337895775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c012430 con 0x7fe4a406ee50 2023-08-25T04:45:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.361+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1337895775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 msgr2=0x7fe4a40c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.361+0000 7fe4a8fff700 1 --2- 172.21.15.72:0/1337895775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 0x7fe4a40c9c80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe4a406deb0 tx=0x7fe49c00b330 comp rx=0 tx=0).stop 2023-08-25T04:45:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.361+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1337895775 shutdown_connections 2023-08-25T04:45:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.361+0000 7fe4a8fff700 1 --2- 172.21.15.72:0/1337895775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 0x7fe4a40c9c80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.361+0000 7fe4a8fff700 1 --2- 172.21.15.72:0/1337895775 >> v2:172.21.15.137:3300/0 conn(0x7fe4a415d180 0x7fe4a40cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.361+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1337895775 >> 172.21.15.72:0/1337895775 conn(0x7fe4a406d200 msgr2=0x7fe4a406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.361+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1337895775 shutdown_connections 2023-08-25T04:45:53.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.361+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1337895775 wait complete. 2023-08-25T04:45:53.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.363+0000 7fe4a8fff700 1 Processor -- start 2023-08-25T04:45:53.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.363+0000 7fe4a8fff700 1 -- start start 2023-08-25T04:45:53.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a8fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 0x7fe4a4153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a8fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4a406f950 0x7fe4a40c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a8fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4a415d180 0x7fe4a40c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a8fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40c47b0 con 0x7fe4a406ee50 2023-08-25T04:45:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a8fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40c4a90 con 0x7fe4a406f950 2023-08-25T04:45:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a8fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40c4d70 con 0x7fe4a415d180 2023-08-25T04:45:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 0x7fe4a4153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 0x7fe4a4153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55872/0 (socket says 172.21.15.72:55872) 2023-08-25T04:45:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a259c700 1 -- 172.21.15.72:0/1762203902 learned_addr learned my addr 172.21.15.72:0/1762203902 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe49bfff700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4a406f950 0x7fe4a40c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a259c700 1 -- 172.21.15.72:0/1762203902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4a415d180 msgr2=0x7fe4a40c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a2d9d700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4a415d180 0x7fe4a40c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a259c700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4a415d180 0x7fe4a40c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a259c700 1 -- 172.21.15.72:0/1762203902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4a406f950 msgr2=0x7fe4a40c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a259c700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4a406f950 0x7fe4a40c2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.364+0000 7fe4a259c700 1 -- 172.21.15.72:0/1762203902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009a70 con 0x7fe4a406ee50 2023-08-25T04:45:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.365+0000 7fe4a259c700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 0x7fe4a4153050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe49400e810 tx=0x7fe49400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.365+0000 7fe49affd700 1 -- 172.21.15.72:0/1762203902 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494013610 con 0x7fe4a406ee50 2023-08-25T04:45:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.365+0000 7fe49affd700 1 -- 172.21.15.72:0/1762203902 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494013770 con 0x7fe4a406ee50 2023-08-25T04:45:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.365+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1762203902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a40c5050 con 0x7fe4a406ee50 2023-08-25T04:45:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.365+0000 7fe49affd700 1 -- 172.21.15.72:0/1762203902 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494013b20 con 0x7fe4a406ee50 2023-08-25T04:45:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.365+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1762203902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a40c5610 con 0x7fe4a406ee50 2023-08-25T04:45:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.366+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1762203902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a406e530 con 0x7fe4a406ee50 2023-08-25T04:45:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.367+0000 7fe49affd700 1 -- 172.21.15.72:0/1762203902 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe494013c80 con 0x7fe4a406ee50 2023-08-25T04:45:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.368+0000 7fe49affd700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe48406a0e0 0x7fe48406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.368+0000 7fe49affd700 1 -- 172.21.15.72:0/1762203902 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe494088620 con 0x7fe4a406ee50 2023-08-25T04:45:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.368+0000 7fe49bfff700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe48406a0e0 0x7fe48406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.369+0000 7fe49bfff700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe48406a0e0 0x7fe48406c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe48c000f60 tx=0x7fe48c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:53.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.372+0000 7fe49affd700 1 -- 172.21.15.72:0/1762203902 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe494053990 con 0x7fe4a406ee50 2023-08-25T04:45:53.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.577+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1762203902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4a40cdf80 con 0x7fe4a406ee50 2023-08-25T04:45:53.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.578+0000 7fe49affd700 1 -- 172.21.15.72:0/1762203902 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe494056fb0 con 0x7fe4a406ee50 2023-08-25T04:45:53.580 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:45:53.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1762203902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe48406a0e0 msgr2=0x7fe48406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe48406a0e0 0x7fe48406c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe48c000f60 tx=0x7fe48c009040 comp rx=0 tx=0).stop 2023-08-25T04:45:53.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1762203902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 msgr2=0x7fe4a4153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 0x7fe4a4153050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe49400e810 tx=0x7fe49400ebd0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1762203902 shutdown_connections 2023-08-25T04:45:53.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe48406a0e0 0x7fe48406c5a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4a415d180 0x7fe4a40c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4a406ee50 0x7fe4a4153050 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 --2- 172.21.15.72:0/1762203902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4a406f950 0x7fe4a40c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1762203902 >> 172.21.15.72:0/1762203902 conn(0x7fe4a406d200 msgr2=0x7fe4a40c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:53.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1762203902 shutdown_connections 2023-08-25T04:45:53.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.580+0000 7fe4a8fff700 1 -- 172.21.15.72:0/1762203902 wait complete. 2023-08-25T04:45:53.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:45:53.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.797+0000 7f68e95ff700 1 Processor -- start 2023-08-25T04:45:53.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.797+0000 7f68e95ff700 1 -- start start 2023-08-25T04:45:53.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.798+0000 7f68e95ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68e415d000 0x7f68e40b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.798+0000 7f68e95ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e40b4f10 0x7f68e40b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e95ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e40b6e90 con 0x7f68e40d10c0 2023-08-25T04:45:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e95ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e40b56f0 con 0x7f68e415d000 2023-08-25T04:45:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e95ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e415d3e0 con 0x7f68e40b4f10 2023-08-25T04:45:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68e415d000 0x7f68e40b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68e415d000 0x7f68e40b8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55876/0 (socket says 172.21.15.72:55876) 2023-08-25T04:45:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e2ffd700 1 -- 172.21.15.72:0/3391860044 learned_addr learned my addr 172.21.15.72:0/3391860044 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e37fe700 1 --2- 172.21.15.72:0/3391860044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e40b4f10 0x7f68e40b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e2ffd700 1 -- 172.21.15.72:0/3391860044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e40b4f10 msgr2=0x7f68e40b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e2ffd700 1 --2- 172.21.15.72:0/3391860044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e40b4f10 0x7f68e40b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e2ffd700 1 -- 172.21.15.72:0/3391860044 >> v1:172.21.15.137:6789/0 conn(0x7f68e40d10c0 legacy=0x7f68e40b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.799+0000 7f68e2ffd700 1 -- 172.21.15.72:0/3391860044 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e40b6280 con 0x7f68e415d000 2023-08-25T04:45:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.800+0000 7f68e2ffd700 1 --2- 172.21.15.72:0/3391860044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e415d000 0x7f68e40b8600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68d40098f0 tx=0x7f68d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b04e3da902dbc8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.800+0000 7f68e1ffb700 1 -- 172.21.15.72:0/3391860044 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d400b8a0 con 0x7f68e415d000 2023-08-25T04:45:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.800+0000 7f68e1ffb700 1 -- 172.21.15.72:0/3391860044 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d400ba00 con 0x7f68e415d000 2023-08-25T04:45:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.800+0000 7f68e1ffb700 1 -- 172.21.15.72:0/3391860044 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d400bd90 con 0x7f68e415d000 2023-08-25T04:45:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.800+0000 7f68e95ff700 1 -- 172.21.15.72:0/3391860044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e415d000 msgr2=0x7f68e40b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.800+0000 7f68e95ff700 1 --2- 172.21.15.72:0/3391860044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e415d000 0x7f68e40b8600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68d40098f0 tx=0x7f68d4009c00 comp rx=0 tx=0).stop 2023-08-25T04:45:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.800+0000 7f68e95ff700 1 -- 172.21.15.72:0/3391860044 shutdown_connections 2023-08-25T04:45:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.800+0000 7f68e95ff700 1 --2- 172.21.15.72:0/3391860044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e40b4f10 0x7f68e40b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.800+0000 7f68e95ff700 1 --2- 172.21.15.72:0/3391860044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e415d000 0x7f68e40b8600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.800+0000 7f68e95ff700 1 -- 172.21.15.72:0/3391860044 >> 172.21.15.72:0/3391860044 conn(0x7f68e4071e10 msgr2=0x7f68e4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.801+0000 7f68e95ff700 1 -- 172.21.15.72:0/3391860044 shutdown_connections 2023-08-25T04:45:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.801+0000 7f68e95ff700 1 -- 172.21.15.72:0/3391860044 wait complete. 2023-08-25T04:45:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.802+0000 7f68e95ff700 1 Processor -- start 2023-08-25T04:45:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.802+0000 7f68e95ff700 1 -- start start 2023-08-25T04:45:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.803+0000 7f68e95ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e40b4f10 0x7f68e4152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.803+0000 7f68e95ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68e40d10c0 0x7f68e40c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.803+0000 7f68e95ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e415d000 0x7f68e40d2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.803+0000 7f68e95ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40c7eb0 con 0x7f68e40b4f10 2023-08-25T04:45:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.803+0000 7f68e95ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40c96d0 con 0x7f68e40d10c0 2023-08-25T04:45:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.803+0000 7f68e95ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40c83b0 con 0x7f68e415d000 2023-08-25T04:45:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.803+0000 7f68e2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e40b4f10 0x7f68e4152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e40b4f10 0x7f68e4152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55890/0 (socket says 172.21.15.72:55890) 2023-08-25T04:45:53.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e2ffd700 1 -- 172.21.15.72:0/2013033768 learned_addr learned my addr 172.21.15.72:0/2013033768 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:53.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e2ffd700 1 -- 172.21.15.72:0/2013033768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e415d000 msgr2=0x7f68e40d2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e37fe700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e415d000 0x7f68e40d2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e27fc700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68e40d10c0 0x7f68e40c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e2ffd700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e415d000 0x7f68e40d2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e2ffd700 1 -- 172.21.15.72:0/2013033768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68e40d10c0 msgr2=0x7f68e40c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:53.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e2ffd700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68e40d10c0 0x7f68e40c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:53.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e2ffd700 1 -- 172.21.15.72:0/2013033768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d4009550 con 0x7f68e40b4f10 2023-08-25T04:45:53.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e37fe700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e415d000 0x7f68e40d2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:53.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e27fc700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68e40d10c0 0x7f68e40c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:53.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e2ffd700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e40b4f10 0x7f68e4152510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f68e40d3ae0 tx=0x7f68d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:53.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68cb7fe700 1 -- 172.21.15.72:0/2013033768 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d40036a0 con 0x7f68e40b4f10 2023-08-25T04:45:53.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68cb7fe700 1 -- 172.21.15.72:0/2013033768 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d401e070 con 0x7f68e40b4f10 2023-08-25T04:45:53.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68cb7fe700 1 -- 172.21.15.72:0/2013033768 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4003a60 con 0x7f68e40b4f10 2023-08-25T04:45:53.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.804+0000 7f68e95ff700 1 -- 172.21.15.72:0/2013033768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e40c8630 con 0x7f68e40b4f10 2023-08-25T04:45:53.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.805+0000 7f68e95ff700 1 -- 172.21.15.72:0/2013033768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e40c8bf0 con 0x7f68e40b4f10 2023-08-25T04:45:53.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.806+0000 7f68e95ff700 1 -- 172.21.15.72:0/2013033768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e406a2f0 con 0x7f68e40b4f10 2023-08-25T04:45:53.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.806+0000 7f68cb7fe700 1 -- 172.21.15.72:0/2013033768 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f68d4003bc0 con 0x7f68e40b4f10 2023-08-25T04:45:53.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.807+0000 7f68cb7fe700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f68d006a0e0 0x7f68d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:53.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.807+0000 7f68cb7fe700 1 -- 172.21.15.72:0/2013033768 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f68d4020070 con 0x7f68e40b4f10 2023-08-25T04:45:53.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.808+0000 7f68e27fc700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f68d006a0e0 0x7f68d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:53.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.808+0000 7f68e27fc700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f68d006a0e0 0x7f68d006c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68e40b4eb0 tx=0x7f68d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:53.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:53.812+0000 7f68cb7fe700 1 -- 172.21.15.72:0/2013033768 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f68d4055180 con 0x7f68e40b4f10 2023-08-25T04:45:54.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.009+0000 7f68e95ff700 1 -- 172.21.15.72:0/2013033768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68e40b6810 con 0x7f68e40b4f10 2023-08-25T04:45:54.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.009+0000 7f68cb7fe700 1 -- 172.21.15.72:0/2013033768 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f68d40150a0 con 0x7f68e40b4f10 2023-08-25T04:45:54.010 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:45:54.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 -- 172.21.15.72:0/2013033768 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f68d006a0e0 msgr2=0x7f68d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f68d006a0e0 0x7f68d006c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68e40b4eb0 tx=0x7f68d8009040 comp rx=0 tx=0).stop 2023-08-25T04:45:54.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 -- 172.21.15.72:0/2013033768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e40b4f10 msgr2=0x7f68e4152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e40b4f10 0x7f68e4152510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f68e40d3ae0 tx=0x7f68d4004750 comp rx=0 tx=0).stop 2023-08-25T04:45:54.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 -- 172.21.15.72:0/2013033768 shutdown_connections 2023-08-25T04:45:54.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f68d006a0e0 0x7f68d006c5a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68e415d000 0x7f68e40d2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e40b4f10 0x7f68e4152510 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 --2- 172.21.15.72:0/2013033768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68e40d10c0 0x7f68e40c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 -- 172.21.15.72:0/2013033768 >> 172.21.15.72:0/2013033768 conn(0x7f68e4071e10 msgr2=0x7f68e40d14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:54.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 -- 172.21.15.72:0/2013033768 shutdown_connections 2023-08-25T04:45:54.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.012+0000 7f68e95ff700 1 -- 172.21.15.72:0/2013033768 wait complete. 2023-08-25T04:45:54.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:45:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.229+0000 7f4c003ff700 1 Processor -- start 2023-08-25T04:45:54.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.229+0000 7f4c003ff700 1 -- start start 2023-08-25T04:45:54.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.230+0000 7f4c003ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4bf815d090 0x7f4bf80d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4c003ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf815d470 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4c003ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf80d17e0 con 0x7f4bf80ce260 2023-08-25T04:45:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4c003ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf80d1ac0 con 0x7f4bf815d090 2023-08-25T04:45:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4bfe19b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4bf815d090 0x7f4bf80d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4bfd99a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4bf80b8aa0 0x7f4bf80cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53130/0 (socket says 172.21.15.72:53130) 2023-08-25T04:45:54.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4bfe19b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4bf815d090 0x7f4bf80d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55892/0 (socket says 172.21.15.72:55892) 2023-08-25T04:45:54.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4bfd99a700 1 -- 172.21.15.72:0/3849280229 learned_addr learned my addr 172.21.15.72:0/3849280229 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:54.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4bfe19b700 1 -- 172.21.15.72:0/3849280229 >> v1:172.21.15.137:6789/0 conn(0x7f4bf80ce260 legacy=0x7f4bf80b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4bfe19b700 1 -- 172.21.15.72:0/3849280229 >> v1:172.21.15.72:6789/0 conn(0x7f4bf80b8aa0 legacy=0x7f4bf80cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4bfe19b700 1 -- 172.21.15.72:0/3849280229 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80d1da0 con 0x7f4bf815d090 2023-08-25T04:45:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.231+0000 7f4bfd199700 1 -- 172.21.15.72:0/3849280229 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904115254 0 0) 0x7f4bf815d470 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4bfe19b700 1 --2- 172.21.15.72:0/3849280229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf815d090 0x7f4bf80d0e70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009840 tx=0x7f4bf4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255a30c5f30814d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4bfd199700 1 -- 172.21.15.72:0/3849280229 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4011830 con 0x7f4bf815d090 2023-08-25T04:45:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4bfd199700 1 -- 172.21.15.72:0/3849280229 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf4011990 con 0x7f4bf815d090 2023-08-25T04:45:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4bfd199700 1 -- 172.21.15.72:0/3849280229 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4011d20 con 0x7f4bf815d090 2023-08-25T04:45:54.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4c003ff700 1 -- 172.21.15.72:0/3849280229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf815d090 msgr2=0x7f4bf80d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4c003ff700 1 --2- 172.21.15.72:0/3849280229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf815d090 0x7f4bf80d0e70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009840 tx=0x7f4bf4009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:54.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4c003ff700 1 -- 172.21.15.72:0/3849280229 shutdown_connections 2023-08-25T04:45:54.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4c003ff700 1 --2- 172.21.15.72:0/3849280229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf815d090 0x7f4bf80d0e70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4c003ff700 1 -- 172.21.15.72:0/3849280229 >> 172.21.15.72:0/3849280229 conn(0x7f4bf8071e10 msgr2=0x7f4bf8072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:54.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4c003ff700 1 -- 172.21.15.72:0/3849280229 shutdown_connections 2023-08-25T04:45:54.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.232+0000 7f4c003ff700 1 -- 172.21.15.72:0/3849280229 wait complete. 2023-08-25T04:45:54.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.235+0000 7f4c003ff700 1 Processor -- start 2023-08-25T04:45:54.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.235+0000 7f4c003ff700 1 -- start start 2023-08-25T04:45:54.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.236+0000 7f4c003ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf80b8aa0 0x7f4bf81510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.236+0000 7f4c003ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf80ce260 0x7f4bf8153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.236+0000 7f4c003ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf815d090 0x7f4bf80c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.236+0000 7f4c003ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf8155e70 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.236+0000 7f4c003ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf8159190 con 0x7f4bf80ce260 2023-08-25T04:45:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.236+0000 7f4c003ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf8159710 con 0x7f4bf815d090 2023-08-25T04:45:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.236+0000 7f4bfe19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf80b8aa0 0x7f4bf81510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.236+0000 7f4bfe19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf80b8aa0 0x7f4bf81510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55894/0 (socket says 172.21.15.72:55894) 2023-08-25T04:45:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.236+0000 7f4bfe19b700 1 -- 172.21.15.72:0/3356154306 learned_addr learned my addr 172.21.15.72:0/3356154306 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4bfd99a700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf80ce260 0x7f4bf8153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4bfe99c700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf815d090 0x7f4bf80c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4bfe19b700 1 -- 172.21.15.72:0/3356154306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf815d090 msgr2=0x7f4bf80c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4bfe19b700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf815d090 0x7f4bf80c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4bfe19b700 1 -- 172.21.15.72:0/3356154306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf80ce260 msgr2=0x7f4bf8153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4bfe19b700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf80ce260 0x7f4bf8153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4bfe19b700 1 -- 172.21.15.72:0/3356154306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf40094a0 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4bfe19b700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf80b8aa0 0x7f4bf81510b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009b90 tx=0x7f4bf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4beeffd700 1 -- 172.21.15.72:0/3356154306 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40036a0 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4beeffd700 1 -- 172.21.15.72:0/3356154306 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf401e070 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4beeffd700 1 -- 172.21.15.72:0/3356154306 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4003a00 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.237+0000 7f4c003ff700 1 -- 172.21.15.72:0/3356154306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf81560c0 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.238+0000 7f4c003ff700 1 -- 172.21.15.72:0/3356154306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf8152f20 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.239+0000 7f4c003ff700 1 -- 172.21.15.72:0/3356154306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf806a2f0 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.239+0000 7f4beeffd700 1 -- 172.21.15.72:0/3356154306 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4bf4003b60 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.241+0000 7f4beeffd700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4bdc06a0e0 0x7f4bdc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.241+0000 7f4beeffd700 1 -- 172.21.15.72:0/3356154306 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4bf4089990 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.241+0000 7f4bfd99a700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4bdc06a0e0 0x7f4bdc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.242+0000 7f4bfd99a700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4bdc06a0e0 0x7f4bdc06c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8158e80 tx=0x7f4be8007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:54.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.245+0000 7f4beeffd700 1 -- 172.21.15.72:0/3356154306 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4bf4054e20 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.442+0000 7f4c003ff700 1 -- 172.21.15.72:0/3356154306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4bf808a000 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.442+0000 7f4beeffd700 1 -- 172.21.15.72:0/3356154306 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4bf4015020 con 0x7f4bf80b8aa0 2023-08-25T04:45:54.445 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:45:54.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.444+0000 7f4c003ff700 1 -- 172.21.15.72:0/3356154306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4bdc06a0e0 msgr2=0x7f4bdc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.444+0000 7f4c003ff700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4bdc06a0e0 0x7f4bdc06c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8158e80 tx=0x7f4be8007c20 comp rx=0 tx=0).stop 2023-08-25T04:45:54.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.444+0000 7f4c003ff700 1 -- 172.21.15.72:0/3356154306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf80b8aa0 msgr2=0x7f4bf81510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.444+0000 7f4c003ff700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf80b8aa0 0x7f4bf81510b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009b90 tx=0x7f4bf4004750 comp rx=0 tx=0).stop 2023-08-25T04:45:54.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.444+0000 7f4c003ff700 1 -- 172.21.15.72:0/3356154306 shutdown_connections 2023-08-25T04:45:54.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.444+0000 7f4c003ff700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4bdc06a0e0 0x7f4bdc06c5a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.444+0000 7f4c003ff700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bf815d090 0x7f4bf80c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.444+0000 7f4c003ff700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bf80b8aa0 0x7f4bf81510b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.444+0000 7f4c003ff700 1 --2- 172.21.15.72:0/3356154306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf80ce260 0x7f4bf8153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.444+0000 7f4c003ff700 1 -- 172.21.15.72:0/3356154306 >> 172.21.15.72:0/3356154306 conn(0x7f4bf8071e10 msgr2=0x7f4bf80b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.445+0000 7f4c003ff700 1 -- 172.21.15.72:0/3356154306 shutdown_connections 2023-08-25T04:45:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.445+0000 7f4c003ff700 1 -- 172.21.15.72:0/3356154306 wait complete. 2023-08-25T04:45:54.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:45:54.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.662+0000 7fcccbbff700 1 Processor -- start 2023-08-25T04:45:54.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.662+0000 7fcccbbff700 1 -- start start 2023-08-25T04:45:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.664+0000 7fcccbbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fccc4160710 0x7fccc40b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.664+0000 7fcccbbff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fccc40b4800 0x7fccc40b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.664+0000 7fcccbbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc40b8d30 con 0x7fccc40d10e0 2023-08-25T04:45:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.664+0000 7fcccbbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc40b51c0 con 0x7fccc4160710 2023-08-25T04:45:54.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.664+0000 7fcccbbff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc40b7650 con 0x7fccc40b4800 2023-08-25T04:45:54.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.664+0000 7fccc999b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fccc4160710 0x7fccc40b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.664+0000 7fccc999b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fccc4160710 0x7fccc40b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55896/0 (socket says 172.21.15.72:55896) 2023-08-25T04:45:54.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.664+0000 7fccc999b700 1 -- 172.21.15.72:0/4198468989 learned_addr learned my addr 172.21.15.72:0/4198468989 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:54.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.664+0000 7fccc999b700 1 -- 172.21.15.72:0/4198468989 >> v2:172.21.15.137:3300/0 conn(0x7fccc40b4800 msgr2=0x7fccc40b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:54.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.665+0000 7fccc919a700 1 --2- 172.21.15.72:0/4198468989 >> v2:172.21.15.137:3300/0 conn(0x7fccc40b4800 0x7fccc40b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.665+0000 7fccc999b700 1 --2- 172.21.15.72:0/4198468989 >> v2:172.21.15.137:3300/0 conn(0x7fccc40b4800 0x7fccc40b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.665+0000 7fccc999b700 1 -- 172.21.15.72:0/4198468989 >> v1:172.21.15.72:6789/0 conn(0x7fccc40d10e0 legacy=0x7fccc40d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.665+0000 7fccc999b700 1 -- 172.21.15.72:0/4198468989 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40b7930 con 0x7fccc4160710 2023-08-25T04:45:54.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.665+0000 7fccc919a700 1 --2- 172.21.15.72:0/4198468989 >> v2:172.21.15.137:3300/0 conn(0x7fccc40b4800 0x7fccc40b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:54.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.665+0000 7fccc999b700 1 --2- 172.21.15.72:0/4198468989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc4160710 0x7fccc40b87f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fccc40cf760 tx=0x7fccc0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a33e271800aea6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:54.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.665+0000 7fccc8999700 1 -- 172.21.15.72:0/4198468989 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc000b870 con 0x7fccc4160710 2023-08-25T04:45:54.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.665+0000 7fccc8999700 1 -- 172.21.15.72:0/4198468989 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc000b9d0 con 0x7fccc4160710 2023-08-25T04:45:54.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.665+0000 7fccc8999700 1 -- 172.21.15.72:0/4198468989 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc000bd60 con 0x7fccc4160710 2023-08-25T04:45:54.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.666+0000 7fcccbbff700 1 -- 172.21.15.72:0/4198468989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc4160710 msgr2=0x7fccc40b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.666+0000 7fcccbbff700 1 --2- 172.21.15.72:0/4198468989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc4160710 0x7fccc40b87f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fccc40cf760 tx=0x7fccc0009bd0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.666+0000 7fcccbbff700 1 -- 172.21.15.72:0/4198468989 shutdown_connections 2023-08-25T04:45:54.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.666+0000 7fcccbbff700 1 --2- 172.21.15.72:0/4198468989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc4160710 0x7fccc40b87f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.666+0000 7fcccbbff700 1 --2- 172.21.15.72:0/4198468989 >> v2:172.21.15.137:3300/0 conn(0x7fccc40b4800 0x7fccc40b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.666+0000 7fcccbbff700 1 -- 172.21.15.72:0/4198468989 >> 172.21.15.72:0/4198468989 conn(0x7fccc4071e40 msgr2=0x7fccc4072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:54.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.666+0000 7fcccbbff700 1 -- 172.21.15.72:0/4198468989 shutdown_connections 2023-08-25T04:45:54.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.666+0000 7fcccbbff700 1 -- 172.21.15.72:0/4198468989 wait complete. 2023-08-25T04:45:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.667+0000 7fcccbbff700 1 Processor -- start 2023-08-25T04:45:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.668+0000 7fcccbbff700 1 -- start start 2023-08-25T04:45:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.668+0000 7fcccbbff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccc40b4800 0x7fccc415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.668+0000 7fcccbbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40d10e0 0x7fccc40cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.668+0000 7fcccbbff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fccc4160710 0x7fccc41f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.668+0000 7fcccbbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc415a960 con 0x7fccc40d10e0 2023-08-25T04:45:54.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.668+0000 7fcccbbff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc41f2ac0 con 0x7fccc40b4800 2023-08-25T04:45:54.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.668+0000 7fcccbbff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40d36a0 con 0x7fccc4160710 2023-08-25T04:45:54.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc919a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40d10e0 0x7fccc40cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc919a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40d10e0 0x7fccc40cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55910/0 (socket says 172.21.15.72:55910) 2023-08-25T04:45:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc919a700 1 -- 172.21.15.72:0/2441214593 learned_addr learned my addr 172.21.15.72:0/2441214593 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc999b700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccc40b4800 0x7fccc415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccca19c700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fccc4160710 0x7fccc41f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc919a700 1 -- 172.21.15.72:0/2441214593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fccc4160710 msgr2=0x7fccc41f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc919a700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fccc4160710 0x7fccc41f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc919a700 1 -- 172.21.15.72:0/2441214593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccc40b4800 msgr2=0x7fccc415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc919a700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccc40b4800 0x7fccc415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc919a700 1 -- 172.21.15.72:0/2441214593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc0009550 con 0x7fccc40d10e0 2023-08-25T04:45:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc999b700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccc40b4800 0x7fccc415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.669+0000 7fccc919a700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40d10e0 0x7fccc40cc660 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c7f0 tx=0x7fccb400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.670+0000 7fccba7fc700 1 -- 172.21.15.72:0/2441214593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4011800 con 0x7fccc40d10e0 2023-08-25T04:45:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.670+0000 7fccba7fc700 1 -- 172.21.15.72:0/2441214593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb4011960 con 0x7fccc40d10e0 2023-08-25T04:45:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.670+0000 7fccba7fc700 1 -- 172.21.15.72:0/2441214593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4011d10 con 0x7fccc40d10e0 2023-08-25T04:45:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.670+0000 7fcccbbff700 1 -- 172.21.15.72:0/2441214593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc40d2e00 con 0x7fccc40d10e0 2023-08-25T04:45:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.670+0000 7fcccbbff700 1 -- 172.21.15.72:0/2441214593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc40d33c0 con 0x7fccc40d10e0 2023-08-25T04:45:54.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.671+0000 7fcccbbff700 1 -- 172.21.15.72:0/2441214593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc408a000 con 0x7fccc40d10e0 2023-08-25T04:45:54.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.672+0000 7fccba7fc700 1 -- 172.21.15.72:0/2441214593 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fccb4018360 con 0x7fccc40d10e0 2023-08-25T04:45:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.673+0000 7fccba7fc700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcca806a0e0 0x7fcca806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.673+0000 7fccba7fc700 1 -- 172.21.15.72:0/2441214593 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fccb4088780 con 0x7fccc40d10e0 2023-08-25T04:45:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.673+0000 7fccc999b700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcca806a0e0 0x7fcca806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.673+0000 7fccc999b700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcca806a0e0 0x7fcca806c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009840 tx=0x7fccc0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.677+0000 7fccba7fc700 1 -- 172.21.15.72:0/2441214593 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fccb40576a0 con 0x7fccc40d10e0 2023-08-25T04:45:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.890+0000 7fcccbbff700 1 -- 172.21.15.72:0/2441214593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fccc40744f0 con 0x7fccc40d10e0 2023-08-25T04:45:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.891+0000 7fccba7fc700 1 -- 172.21.15.72:0/2441214593 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fccb4057230 con 0x7fccc40d10e0 2023-08-25T04:45:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 -- 172.21.15.72:0/2441214593 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcca806a0e0 msgr2=0x7fcca806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcca806a0e0 0x7fcca806c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009840 tx=0x7fccc0008030 comp rx=0 tx=0).stop 2023-08-25T04:45:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 -- 172.21.15.72:0/2441214593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40d10e0 msgr2=0x7fccc40cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40d10e0 0x7fccc40cc660 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c7f0 tx=0x7fccb400cbb0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 -- 172.21.15.72:0/2441214593 shutdown_connections 2023-08-25T04:45:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcca806a0e0 0x7fcca806c5a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fccc4160710 0x7fccc41f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccc40b4800 0x7fccc415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 --2- 172.21.15.72:0/2441214593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccc40d10e0 0x7fccc40cc660 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 -- 172.21.15.72:0/2441214593 >> 172.21.15.72:0/2441214593 conn(0x7fccc4071e40 msgr2=0x7fccc40d14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 -- 172.21.15.72:0/2441214593 shutdown_connections 2023-08-25T04:45:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:54.893+0000 7fcccbbff700 1 -- 172.21.15.72:0/2441214593 wait complete. 2023-08-25T04:45:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-08-25T04:45:54.913 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-08-25T04:45:54.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:54.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-08-25T04:45:54.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[122680]: fuse finished with error 0 and tester_r 0 2023-08-25T04:45:54.992 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:45:55.082 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-25T04:45:55.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:45:55.083 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-08-25T04:45:55.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:55.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.338+0000 7fdc7c5ff700 1 Processor -- start 2023-08-25T04:45:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.339+0000 7fdc7c5ff700 1 -- start start 2023-08-25T04:45:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.340+0000 7fdc7c5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc740d0df0 0x7fdc740d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.340+0000 7fdc7c5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc740d1fe0 con 0x7fdc7415ce60 2023-08-25T04:45:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.340+0000 7fdc7c5ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc740d13d0 con 0x7fdc740cda40 2023-08-25T04:45:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.340+0000 7fdc7c5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc740d16b0 con 0x7fdc740d0df0 2023-08-25T04:45:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.340+0000 7fdc7a39b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdc7415ce60 0x7fdc740b8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53144/0 (socket says 172.21.15.72:53144) 2023-08-25T04:45:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.340+0000 7fdc7a39b700 1 -- 172.21.15.72:0/909027853 learned_addr learned my addr 172.21.15.72:0/909027853 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:55.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.340+0000 7fdc79b9a700 1 --2- 172.21.15.72:0/909027853 >> v2:172.21.15.72:3300/0 conn(0x7fdc740d0df0 0x7fdc740d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.340+0000 7fdc79399700 1 -- 172.21.15.72:0/909027853 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742290196 0 0) 0x7fdc740d1fe0 con 0x7fdc7415ce60 2023-08-25T04:45:55.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.341+0000 7fdc79399700 1 -- 172.21.15.72:0/909027853 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc600035b0 con 0x7fdc7415ce60 2023-08-25T04:45:55.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.341+0000 7fdc79b9a700 1 -- 172.21.15.72:0/909027853 >> v1:172.21.15.137:6789/0 conn(0x7fdc740cda40 legacy=0x7fdc740b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.341+0000 7fdc79b9a700 1 -- 172.21.15.72:0/909027853 >> v1:172.21.15.72:6789/0 conn(0x7fdc7415ce60 legacy=0x7fdc740b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.341+0000 7fdc79b9a700 1 -- 172.21.15.72:0/909027853 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc740d1990 con 0x7fdc740d0df0 2023-08-25T04:45:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.341+0000 7fdc79b9a700 1 --2- 172.21.15.72:0/909027853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740d0df0 0x7fdc740d2470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009840 tx=0x7fdc64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be77df9a662cd8c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.341+0000 7fdc79399700 1 -- 172.21.15.72:0/909027853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64011830 con 0x7fdc740d0df0 2023-08-25T04:45:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.341+0000 7fdc79399700 1 -- 172.21.15.72:0/909027853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc64011990 con 0x7fdc740d0df0 2023-08-25T04:45:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.341+0000 7fdc79399700 1 -- 172.21.15.72:0/909027853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64011d00 con 0x7fdc740d0df0 2023-08-25T04:45:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.342+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/909027853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740d0df0 msgr2=0x7fdc740d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.342+0000 7fdc7c5ff700 1 --2- 172.21.15.72:0/909027853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740d0df0 0x7fdc740d2470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009840 tx=0x7fdc64009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.342+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/909027853 shutdown_connections 2023-08-25T04:45:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.342+0000 7fdc7c5ff700 1 --2- 172.21.15.72:0/909027853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740d0df0 0x7fdc740d2470 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.342+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/909027853 >> 172.21.15.72:0/909027853 conn(0x7fdc74071e10 msgr2=0x7fdc74072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.342+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/909027853 shutdown_connections 2023-08-25T04:45:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.342+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/909027853 wait complete. 2023-08-25T04:45:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.343+0000 7fdc7c5ff700 1 Processor -- start 2023-08-25T04:45:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.344+0000 7fdc7c5ff700 1 -- start start 2023-08-25T04:45:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7c5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740cda40 0x7fdc740b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7c5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc740d0df0 0x7fdc740c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7c5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc7415ce60 0x7fdc74152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7c5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc741f6300 con 0x7fdc740cda40 2023-08-25T04:45:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7c5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc741f6830 con 0x7fdc740d0df0 2023-08-25T04:45:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7c5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc740ca980 con 0x7fdc7415ce60 2023-08-25T04:45:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7a39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740cda40 0x7fdc740b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7a39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740cda40 0x7fdc740b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55930/0 (socket says 172.21.15.72:55930) 2023-08-25T04:45:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7a39b700 1 -- 172.21.15.72:0/2660976328 learned_addr learned my addr 172.21.15.72:0/2660976328 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc79b9a700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc740d0df0 0x7fdc740c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7ab9c700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc7415ce60 0x7fdc74152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7a39b700 1 -- 172.21.15.72:0/2660976328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc7415ce60 msgr2=0x7fdc74152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7a39b700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc7415ce60 0x7fdc74152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7a39b700 1 -- 172.21.15.72:0/2660976328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc740d0df0 msgr2=0x7fdc740c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7a39b700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc740d0df0 0x7fdc740c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7a39b700 1 -- 172.21.15.72:0/2660976328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640094a0 con 0x7fdc740cda40 2023-08-25T04:45:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.345+0000 7fdc7a39b700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740cda40 0x7fdc740b1d30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000c700 tx=0x7fdc7000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.346+0000 7fdc6affd700 1 -- 172.21.15.72:0/2660976328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70005d70 con 0x7fdc740cda40 2023-08-25T04:45:55.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.346+0000 7fdc6affd700 1 -- 172.21.15.72:0/2660976328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc700070d0 con 0x7fdc740cda40 2023-08-25T04:45:55.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.346+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/2660976328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc741f6550 con 0x7fdc740cda40 2023-08-25T04:45:55.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.346+0000 7fdc6affd700 1 -- 172.21.15.72:0/2660976328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70007460 con 0x7fdc740cda40 2023-08-25T04:45:55.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.346+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/2660976328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc740caf00 con 0x7fdc740cda40 2023-08-25T04:45:55.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.347+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/2660976328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7404e620 con 0x7fdc740cda40 2023-08-25T04:45:55.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.348+0000 7fdc6affd700 1 -- 172.21.15.72:0/2660976328 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdc700075c0 con 0x7fdc740cda40 2023-08-25T04:45:55.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.348+0000 7fdc6affd700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc5806a0e0 0x7fdc5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.349+0000 7fdc6affd700 1 -- 172.21.15.72:0/2660976328 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc70087e50 con 0x7fdc740cda40 2023-08-25T04:45:55.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.349+0000 7fdc79b9a700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc5806a0e0 0x7fdc5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.349+0000 7fdc79b9a700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc5806a0e0 0x7fdc5806c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc64000c00 tx=0x7fdc64008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:55.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.353+0000 7fdc6affd700 1 -- 172.21.15.72:0/2660976328 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdc70053260 con 0x7fdc740cda40 2023-08-25T04:45:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.550+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/2660976328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc740b3020 con 0x7fdc740cda40 2023-08-25T04:45:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.552+0000 7fdc6affd700 1 -- 172.21.15.72:0/2660976328 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fdc70056880 con 0x7fdc740cda40 2023-08-25T04:45:55.554 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:55.554 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/2660976328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc5806a0e0 msgr2=0x7fdc5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc5806a0e0 0x7fdc5806c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc64000c00 tx=0x7fdc64008030 comp rx=0 tx=0).stop 2023-08-25T04:45:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/2660976328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740cda40 msgr2=0x7fdc740b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740cda40 0x7fdc740b1d30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000c700 tx=0x7fdc7000cac0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/2660976328 shutdown_connections 2023-08-25T04:45:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc5806a0e0 0x7fdc5806c5a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc7415ce60 0x7fdc74152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc740cda40 0x7fdc740b1d30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 --2- 172.21.15.72:0/2660976328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc740d0df0 0x7fdc740c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/2660976328 >> 172.21.15.72:0/2660976328 conn(0x7fdc74071e10 msgr2=0x7fdc740b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:55.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/2660976328 shutdown_connections 2023-08-25T04:45:55.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.554+0000 7fdc7c5ff700 1 -- 172.21.15.72:0/2660976328 wait complete. 2023-08-25T04:45:55.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:55.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.769+0000 7f5a7dfff700 1 Processor -- start 2023-08-25T04:45:55.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.769+0000 7f5a7dfff700 1 -- start start 2023-08-25T04:45:55.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.770+0000 7f5a7dfff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5a780b47c0 0x7f5a780b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.770+0000 7f5a7dfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b86b0 0x7f5a780b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.770+0000 7f5a7dfff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a780b50e0 con 0x7f5a7815d130 2023-08-25T04:45:55.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.770+0000 7f5a7dfff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a780d1590 con 0x7f5a780b47c0 2023-08-25T04:45:55.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.770+0000 7f5a7dfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780d1780 con 0x7f5a780b86b0 2023-08-25T04:45:55.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a777fe700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5a780b47c0 0x7f5a780b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a77fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b86b0 0x7f5a780b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a77fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b86b0 0x7f5a780b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:50994/0 (socket says 172.21.15.72:50994) 2023-08-25T04:45:55.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a777fe700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5a780b47c0 0x7f5a780b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:59724/0 (socket says 172.21.15.72:59724) 2023-08-25T04:45:55.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a77fff700 1 -- 172.21.15.72:0/1121012374 learned_addr learned my addr 172.21.15.72:0/1121012374 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:55.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a777fe700 1 -- 172.21.15.72:0/1121012374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b86b0 msgr2=0x7f5a780b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:55.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a777fe700 1 --2- 172.21.15.72:0/1121012374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b86b0 0x7f5a780b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a777fe700 1 -- 172.21.15.72:0/1121012374 >> v1:172.21.15.137:6789/0 conn(0x7f5a7815d130 legacy=0x7f5a780d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a777fe700 1 -- 172.21.15.72:0/1121012374 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780d1a60 con 0x7f5a780b47c0 2023-08-25T04:45:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a767fc700 1 -- 172.21.15.72:0/1121012374 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100900468 0 0) 0x7f5a780b50e0 con 0x7f5a7815d130 2023-08-25T04:45:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.771+0000 7f5a77fff700 1 --2- 172.21.15.72:0/1121012374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b86b0 0x7f5a780b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a777fe700 1 --2- 172.21.15.72:0/1121012374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a780b47c0 0x7f5a780b4ba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009840 tx=0x7f5a68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19e3e9639c4fff1e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a767fc700 1 -- 172.21.15.72:0/1121012374 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68011830 con 0x7f5a780b47c0 2023-08-25T04:45:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a767fc700 1 -- 172.21.15.72:0/1121012374 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a68011990 con 0x7f5a780b47c0 2023-08-25T04:45:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a767fc700 1 -- 172.21.15.72:0/1121012374 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68011d20 con 0x7f5a780b47c0 2023-08-25T04:45:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a7dfff700 1 -- 172.21.15.72:0/1121012374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a780b47c0 msgr2=0x7f5a780b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a7dfff700 1 --2- 172.21.15.72:0/1121012374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a780b47c0 0x7f5a780b4ba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009840 tx=0x7f5a68009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a7dfff700 1 -- 172.21.15.72:0/1121012374 shutdown_connections 2023-08-25T04:45:55.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a7dfff700 1 --2- 172.21.15.72:0/1121012374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b86b0 0x7f5a780b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a7dfff700 1 --2- 172.21.15.72:0/1121012374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a780b47c0 0x7f5a780b4ba0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a7dfff700 1 -- 172.21.15.72:0/1121012374 >> 172.21.15.72:0/1121012374 conn(0x7f5a78072050 msgr2=0x7f5a780d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:55.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a7dfff700 1 -- 172.21.15.72:0/1121012374 shutdown_connections 2023-08-25T04:45:55.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.772+0000 7f5a7dfff700 1 -- 172.21.15.72:0/1121012374 wait complete. 2023-08-25T04:45:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.774+0000 7f5a7dfff700 1 Processor -- start 2023-08-25T04:45:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.774+0000 7f5a7dfff700 1 -- start start 2023-08-25T04:45:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.775+0000 7f5a7dfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b47c0 0x7f5a780c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.775+0000 7f5a7dfff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a780b86b0 0x7f5a780cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.775+0000 7f5a7dfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7815d130 0x7f5a780c3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.775+0000 7f5a7dfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780c3ea0 con 0x7f5a7815d130 2023-08-25T04:45:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.775+0000 7f5a7dfff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780c4cc0 con 0x7f5a780b86b0 2023-08-25T04:45:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.775+0000 7f5a7dfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780c40b0 con 0x7f5a780b47c0 2023-08-25T04:45:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.775+0000 7f5a77fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7815d130 0x7f5a780c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a77fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7815d130 0x7f5a780c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55932/0 (socket says 172.21.15.72:55932) 2023-08-25T04:45:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a77fff700 1 -- 172.21.15.72:0/3236810097 learned_addr learned my addr 172.21.15.72:0/3236810097 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a777fe700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b47c0 0x7f5a780c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a76ffd700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a780b86b0 0x7f5a780cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a77fff700 1 -- 172.21.15.72:0/3236810097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b47c0 msgr2=0x7f5a780c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a77fff700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b47c0 0x7f5a780c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a77fff700 1 -- 172.21.15.72:0/3236810097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a780b86b0 msgr2=0x7f5a780cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a77fff700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a780b86b0 0x7f5a780cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a77fff700 1 -- 172.21.15.72:0/3236810097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70009b30 con 0x7f5a7815d130 2023-08-25T04:45:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a76ffd700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a780b86b0 0x7f5a780cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a77fff700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7815d130 0x7f5a780c3960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000ef90 tx=0x7f5a7000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a5ffff700 1 -- 172.21.15.72:0/3236810097 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70018070 con 0x7f5a7815d130 2023-08-25T04:45:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a5ffff700 1 -- 172.21.15.72:0/3236810097 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7000f040 con 0x7f5a7815d130 2023-08-25T04:45:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a5ffff700 1 -- 172.21.15.72:0/3236810097 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70003c60 con 0x7f5a7815d130 2023-08-25T04:45:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.776+0000 7f5a7dfff700 1 -- 172.21.15.72:0/3236810097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a680094a0 con 0x7f5a7815d130 2023-08-25T04:45:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.777+0000 7f5a7dfff700 1 -- 172.21.15.72:0/3236810097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a780c4670 con 0x7f5a7815d130 2023-08-25T04:45:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.778+0000 7f5a7dfff700 1 -- 172.21.15.72:0/3236810097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a780c4e70 con 0x7f5a7815d130 2023-08-25T04:45:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.779+0000 7f5a5ffff700 1 -- 172.21.15.72:0/3236810097 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5a7000c930 con 0x7f5a7815d130 2023-08-25T04:45:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.779+0000 7f5a5ffff700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5a6406a0e0 0x7f5a6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.780+0000 7f5a5ffff700 1 -- 172.21.15.72:0/3236810097 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5a70088a80 con 0x7f5a7815d130 2023-08-25T04:45:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.780+0000 7f5a777fe700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5a6406a0e0 0x7f5a6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.780+0000 7f5a777fe700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5a6406a0e0 0x7f5a6406c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a680090b0 tx=0x7f5a6801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.784+0000 7f5a5ffff700 1 -- 172.21.15.72:0/3236810097 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5a780c4e70 con 0x7f5a7815d130 2023-08-25T04:45:55.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.981+0000 7f5a7dfff700 1 -- 172.21.15.72:0/3236810097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a780c4e70 con 0x7f5a7815d130 2023-08-25T04:45:55.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.982+0000 7f5a5ffff700 1 -- 172.21.15.72:0/3236810097 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f5a780c4e70 con 0x7f5a7815d130 2023-08-25T04:45:55.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:55.985 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:55.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 -- 172.21.15.72:0/3236810097 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5a6406a0e0 msgr2=0x7f5a6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5a6406a0e0 0x7f5a6406c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a680090b0 tx=0x7f5a6801c040 comp rx=0 tx=0).stop 2023-08-25T04:45:55.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 -- 172.21.15.72:0/3236810097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7815d130 msgr2=0x7f5a780c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:55.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7815d130 0x7f5a780c3960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000ef90 tx=0x7f5a7000c3a0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 -- 172.21.15.72:0/3236810097 shutdown_connections 2023-08-25T04:45:55.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5a6406a0e0 0x7f5a6406c5a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7815d130 0x7f5a780c3960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a780b47c0 0x7f5a780c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 --2- 172.21.15.72:0/3236810097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a780b86b0 0x7f5a780cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:55.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 -- 172.21.15.72:0/3236810097 >> 172.21.15.72:0/3236810097 conn(0x7f5a78072050 msgr2=0x7f5a7815a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:55.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 -- 172.21.15.72:0/3236810097 shutdown_connections 2023-08-25T04:45:55.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:55.985+0000 7f5a7dfff700 1 -- 172.21.15.72:0/3236810097 wait complete. 2023-08-25T04:45:56.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:45:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.206+0000 7fa85cfff700 1 Processor -- start 2023-08-25T04:45:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.206+0000 7fa85cfff700 1 -- start start 2023-08-25T04:45:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.207+0000 7fa85cfff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa858150ac0 0x7fa85815def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.207+0000 7fa85cfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa858150ea0 0x7fa8580cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.207+0000 7fa85cfff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580aebf0 con 0x7fa85815e430 2023-08-25T04:45:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.207+0000 7fa85cfff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8580af490 con 0x7fa858150ac0 2023-08-25T04:45:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.207+0000 7fa85cfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85815d7c0 con 0x7fa858150ea0 2023-08-25T04:45:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa85659c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa858150ac0 0x7fa85815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa855d9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa858150ea0 0x7fa8580cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa855d9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa858150ea0 0x7fa8580cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51026/0 (socket says 172.21.15.72:51026) 2023-08-25T04:45:56.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa85659c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa858150ac0 0x7fa85815def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:59750/0 (socket says 172.21.15.72:59750) 2023-08-25T04:45:56.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa855d9b700 1 -- 172.21.15.72:0/3038246125 learned_addr learned my addr 172.21.15.72:0/3038246125 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:56.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa85559a700 1 -- 172.21.15.72:0/3038246125 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054082600 0 0) 0x7fa8580aebf0 con 0x7fa85815e430 2023-08-25T04:45:56.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa85559a700 1 -- 172.21.15.72:0/3038246125 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8400035b0 con 0x7fa85815e430 2023-08-25T04:45:56.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa85659c700 1 -- 172.21.15.72:0/3038246125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa858150ea0 msgr2=0x7fa8580cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:56.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa85659c700 1 --2- 172.21.15.72:0/3038246125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa858150ea0 0x7fa8580cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa85659c700 1 -- 172.21.15.72:0/3038246125 >> v1:172.21.15.137:6789/0 conn(0x7fa85815e430 legacy=0x7fa85815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:56.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa85659c700 1 -- 172.21.15.72:0/3038246125 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8580aeed0 con 0x7fa858150ac0 2023-08-25T04:45:56.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.208+0000 7fa855d9b700 1 --2- 172.21.15.72:0/3038246125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa858150ea0 0x7fa8580cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:45:56.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.209+0000 7fa85659c700 1 --2- 172.21.15.72:0/3038246125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa858150ac0 0x7fa85815def0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa848009840 tx=0x7fa848009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cfc60e8068c210a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:56.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.209+0000 7fa85559a700 1 -- 172.21.15.72:0/3038246125 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84800f8a0 con 0x7fa858150ac0 2023-08-25T04:45:56.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.209+0000 7fa85559a700 1 -- 172.21.15.72:0/3038246125 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84800fa00 con 0x7fa858150ac0 2023-08-25T04:45:56.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.209+0000 7fa85559a700 1 -- 172.21.15.72:0/3038246125 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84800fd90 con 0x7fa858150ac0 2023-08-25T04:45:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.209+0000 7fa85cfff700 1 -- 172.21.15.72:0/3038246125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa858150ac0 msgr2=0x7fa85815def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.209+0000 7fa85cfff700 1 --2- 172.21.15.72:0/3038246125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa858150ac0 0x7fa85815def0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa848009840 tx=0x7fa848009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.210+0000 7fa85cfff700 1 -- 172.21.15.72:0/3038246125 shutdown_connections 2023-08-25T04:45:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.210+0000 7fa85cfff700 1 --2- 172.21.15.72:0/3038246125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa858150ac0 0x7fa85815def0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.210+0000 7fa85cfff700 1 --2- 172.21.15.72:0/3038246125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa858150ea0 0x7fa8580cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.210+0000 7fa85cfff700 1 -- 172.21.15.72:0/3038246125 >> 172.21.15.72:0/3038246125 conn(0x7fa85806a710 msgr2=0x7fa85806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.210+0000 7fa85cfff700 1 -- 172.21.15.72:0/3038246125 shutdown_connections 2023-08-25T04:45:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.210+0000 7fa85cfff700 1 -- 172.21.15.72:0/3038246125 wait complete. 2023-08-25T04:45:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.211+0000 7fa85cfff700 1 Processor -- start 2023-08-25T04:45:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.211+0000 7fa85cfff700 1 -- start start 2023-08-25T04:45:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.212+0000 7fa85cfff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa858150ac0 0x7fa8580c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.212+0000 7fa85cfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa858150ea0 0x7fa8581f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.212+0000 7fa85cfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa85815e430 0x7fa85814e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.212+0000 7fa85cfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8581f3ac0 con 0x7fa858150ea0 2023-08-25T04:45:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.212+0000 7fa85cfff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85814ed20 con 0x7fa858150ac0 2023-08-25T04:45:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.212+0000 7fa85cfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580c2ad0 con 0x7fa85815e430 2023-08-25T04:45:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa855d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa858150ea0 0x7fa8581f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa855d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa858150ea0 0x7fa8581f2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55942/0 (socket says 172.21.15.72:55942) 2023-08-25T04:45:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa855d9b700 1 -- 172.21.15.72:0/4030349320 learned_addr learned my addr 172.21.15.72:0/4030349320 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa85659c700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa858150ac0 0x7fa8580c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa856d9d700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa85815e430 0x7fa85814e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa855d9b700 1 -- 172.21.15.72:0/4030349320 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa85815e430 msgr2=0x7fa85814e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa855d9b700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa85815e430 0x7fa85814e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa855d9b700 1 -- 172.21.15.72:0/4030349320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa858150ac0 msgr2=0x7fa8580c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa855d9b700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa858150ac0 0x7fa8580c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa855d9b700 1 -- 172.21.15.72:0/4030349320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c009550 con 0x7fa858150ea0 2023-08-25T04:45:56.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.213+0000 7fa855d9b700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa858150ea0 0x7fa8581f2ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00ebe0 tx=0x7fa84c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:56.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.214+0000 7fa846ffd700 1 -- 172.21.15.72:0/4030349320 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c00c850 con 0x7fa858150ea0 2023-08-25T04:45:56.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.214+0000 7fa846ffd700 1 -- 172.21.15.72:0/4030349320 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c00c9b0 con 0x7fa858150ea0 2023-08-25T04:45:56.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.214+0000 7fa846ffd700 1 -- 172.21.15.72:0/4030349320 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c00cd40 con 0x7fa858150ea0 2023-08-25T04:45:56.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.214+0000 7fa85cfff700 1 -- 172.21.15.72:0/4030349320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8480094a0 con 0x7fa858150ea0 2023-08-25T04:45:56.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.214+0000 7fa85cfff700 1 -- 172.21.15.72:0/4030349320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8580c3090 con 0x7fa858150ea0 2023-08-25T04:45:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.215+0000 7fa85cfff700 1 -- 172.21.15.72:0/4030349320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85806d560 con 0x7fa858150ea0 2023-08-25T04:45:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.216+0000 7fa846ffd700 1 -- 172.21.15.72:0/4030349320 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa84c013470 con 0x7fa858150ea0 2023-08-25T04:45:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.217+0000 7fa846ffd700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa83806a0e0 0x7fa83806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.217+0000 7fa846ffd700 1 -- 172.21.15.72:0/4030349320 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa84c088960 con 0x7fa858150ea0 2023-08-25T04:45:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.217+0000 7fa85659c700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa83806a0e0 0x7fa83806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.218+0000 7fa85659c700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa83806a0e0 0x7fa83806c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa848000c00 tx=0x7fa84801b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:56.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.221+0000 7fa846ffd700 1 -- 172.21.15.72:0/4030349320 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa84c053d50 con 0x7fa858150ea0 2023-08-25T04:45:56.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.463+0000 7fa85cfff700 1 -- 172.21.15.72:0/4030349320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa858072320 con 0x7fa858150ea0 2023-08-25T04:45:56.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.526+0000 7fa846ffd700 1 -- 172.21.15.72:0/4030349320 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa84c00cea0 con 0x7fa858150ea0 2023-08-25T04:45:56.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 -- 172.21.15.72:0/4030349320 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa83806a0e0 msgr2=0x7fa83806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:56.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa83806a0e0 0x7fa83806c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa848000c00 tx=0x7fa84801b040 comp rx=0 tx=0).stop 2023-08-25T04:45:56.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 -- 172.21.15.72:0/4030349320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa858150ea0 msgr2=0x7fa8581f2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:56.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa858150ea0 0x7fa8581f2ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00ebe0 tx=0x7fa84c00eef0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 -- 172.21.15.72:0/4030349320 shutdown_connections 2023-08-25T04:45:56.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa83806a0e0 0x7fa83806c5a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa85815e430 0x7fa85814e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa858150ac0 0x7fa8580c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 --2- 172.21.15.72:0/4030349320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa858150ea0 0x7fa8581f2ad0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 -- 172.21.15.72:0/4030349320 >> 172.21.15.72:0/4030349320 conn(0x7fa85806a710 msgr2=0x7fa8580ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:56.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 -- 172.21.15.72:0/4030349320 shutdown_connections 2023-08-25T04:45:56.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.528+0000 7fa85cfff700 1 -- 172.21.15.72:0/4030349320 wait complete. 2023-08-25T04:45:56.550 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-08-25T04:45:56.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:45:56.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.749+0000 7ff6cd3ff700 1 Processor -- start 2023-08-25T04:45:56.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.749+0000 7ff6cd3ff700 1 -- start start 2023-08-25T04:45:56.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.750+0000 7ff6cd3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6c80cb650 0x7ff6c80cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.750+0000 7ff6cd3ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff6c80b2c70 0x7ff6c80710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.750+0000 7ff6cd3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c80b4300 con 0x7ff6c80b2810 2023-08-25T04:45:56.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6cd3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c80cbf70 con 0x7ff6c80cb650 2023-08-25T04:45:56.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6cd3ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c80b3260 con 0x7ff6c80b2c70 2023-08-25T04:45:56.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6c6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6c80cb650 0x7ff6c80cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:56.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6c67fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff6c80b2810 0x7ff6c8070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53160/0 (socket says 172.21.15.72:53160) 2023-08-25T04:45:56.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6c67fc700 1 -- 172.21.15.72:0/3579019684 learned_addr learned my addr 172.21.15.72:0/3579019684 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:56.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6c77fe700 1 --2- 172.21.15.72:0/3579019684 >> v2:172.21.15.137:3300/0 conn(0x7ff6c80b2c70 0x7ff6c80710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:56.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6c6ffd700 1 -- 172.21.15.72:0/3579019684 >> v2:172.21.15.137:3300/0 conn(0x7ff6c80b2c70 msgr2=0x7ff6c80710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:56.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6c6ffd700 1 --2- 172.21.15.72:0/3579019684 >> v2:172.21.15.137:3300/0 conn(0x7ff6c80b2c70 0x7ff6c80710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6c6ffd700 1 -- 172.21.15.72:0/3579019684 >> v1:172.21.15.72:6789/0 conn(0x7ff6c80b2810 legacy=0x7ff6c8070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:56.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6c6ffd700 1 -- 172.21.15.72:0/3579019684 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c80b3540 con 0x7ff6c80cb650 2023-08-25T04:45:56.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.751+0000 7ff6c5ffb700 1 -- 172.21.15.72:0/3579019684 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976912630 0 0) 0x7ff6c80b4300 con 0x7ff6c80b2810 2023-08-25T04:45:56.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6c6ffd700 1 --2- 172.21.15.72:0/3579019684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80cb650 0x7ff6c80cba30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6c806ee80 tx=0x7ff6b8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9053015f31b4620b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:56.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6c5ffb700 1 -- 172.21.15.72:0/3579019684 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8011830 con 0x7ff6c80cb650 2023-08-25T04:45:56.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6c5ffb700 1 -- 172.21.15.72:0/3579019684 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8011990 con 0x7ff6c80cb650 2023-08-25T04:45:56.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6c5ffb700 1 -- 172.21.15.72:0/3579019684 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8011d20 con 0x7ff6c80cb650 2023-08-25T04:45:56.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/3579019684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80cb650 msgr2=0x7ff6c80cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:56.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6cd3ff700 1 --2- 172.21.15.72:0/3579019684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80cb650 0x7ff6c80cba30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6c806ee80 tx=0x7ff6b8009b20 comp rx=0 tx=0).stop 2023-08-25T04:45:56.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/3579019684 shutdown_connections 2023-08-25T04:45:56.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6cd3ff700 1 --2- 172.21.15.72:0/3579019684 >> v2:172.21.15.137:3300/0 conn(0x7ff6c80b2c70 0x7ff6c80710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6cd3ff700 1 --2- 172.21.15.72:0/3579019684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80cb650 0x7ff6c80cba30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/3579019684 >> 172.21.15.72:0/3579019684 conn(0x7ff6c806a710 msgr2=0x7ff6c806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:56.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/3579019684 shutdown_connections 2023-08-25T04:45:56.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.752+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/3579019684 wait complete. 2023-08-25T04:45:56.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.754+0000 7ff6cd3ff700 1 Processor -- start 2023-08-25T04:45:56.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.754+0000 7ff6cd3ff700 1 -- start start 2023-08-25T04:45:56.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.755+0000 7ff6cd3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80b2810 0x7ff6c8150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.755+0000 7ff6cd3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6c80b2c70 0x7ff6c8070890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.755+0000 7ff6cd3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6c80cb650 0x7ff6c8070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.755+0000 7ff6cd3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c81f33c0 con 0x7ff6c80b2810 2023-08-25T04:45:56.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.755+0000 7ff6cd3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80c6bb0 con 0x7ff6c80b2c70 2023-08-25T04:45:56.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.755+0000 7ff6cd3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80c6e90 con 0x7ff6c80cb650 2023-08-25T04:45:56.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.755+0000 7ff6c6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80b2810 0x7ff6c8150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:56.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.755+0000 7ff6c6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80b2810 0x7ff6c8150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55962/0 (socket says 172.21.15.72:55962) 2023-08-25T04:45:56.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6c6ffd700 1 -- 172.21.15.72:0/294433277 learned_addr learned my addr 172.21.15.72:0/294433277 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:56.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6c6ffd700 1 -- 172.21.15.72:0/294433277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6c80cb650 msgr2=0x7ff6c8070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:56.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6c6ffd700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6c80cb650 0x7ff6c8070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6c6ffd700 1 -- 172.21.15.72:0/294433277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6c80b2c70 msgr2=0x7ff6c8070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:56.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6c6ffd700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6c80b2c70 0x7ff6c8070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:56.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6c6ffd700 1 -- 172.21.15.72:0/294433277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b80094a0 con 0x7ff6c80b2810 2023-08-25T04:45:56.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6c6ffd700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80b2810 0x7ff6c8150e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8000c00 tx=0x7ff6b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:56.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6af7fe700 1 -- 172.21.15.72:0/294433277 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80036a0 con 0x7ff6c80b2810 2023-08-25T04:45:56.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6af7fe700 1 -- 172.21.15.72:0/294433277 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b801e070 con 0x7ff6c80b2810 2023-08-25T04:45:56.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6af7fe700 1 -- 172.21.15.72:0/294433277 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8003a60 con 0x7ff6c80b2810 2023-08-25T04:45:56.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.756+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/294433277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c80c7170 con 0x7ff6c80b2810 2023-08-25T04:45:56.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.757+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/294433277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c81f25d0 con 0x7ff6c80b2810 2023-08-25T04:45:56.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.758+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/294433277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c80c6a10 con 0x7ff6c80b2810 2023-08-25T04:45:56.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.758+0000 7ff6af7fe700 1 -- 172.21.15.72:0/294433277 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff6b8003bc0 con 0x7ff6c80b2810 2023-08-25T04:45:56.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.759+0000 7ff6af7fe700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6b406a0e0 0x7ff6b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:56.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.759+0000 7ff6af7fe700 1 -- 172.21.15.72:0/294433277 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff6b8089880 con 0x7ff6c80b2810 2023-08-25T04:45:56.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.760+0000 7ff6c67fc700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6b406a0e0 0x7ff6b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:56.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.760+0000 7ff6c67fc700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6b406a0e0 0x7ff6b406c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0011e0 tx=0x7ff6bc0079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:56.764+0000 7ff6af7fe700 1 -- 172.21.15.72:0/294433277 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff6c80c6a10 con 0x7ff6c80b2810 2023-08-25T04:45:57.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.004+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/294433277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff6c80c73b0 con 0x7ff6c80b2810 2023-08-25T04:45:57.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.530+0000 7ff6af7fe700 1 -- 172.21.15.72:0/294433277 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff6c80c73b0 con 0x7ff6c80b2810 2023-08-25T04:45:57.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.533+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/294433277 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6b406a0e0 msgr2=0x7ff6b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:57.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.533+0000 7ff6cd3ff700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6b406a0e0 0x7ff6b406c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0011e0 tx=0x7ff6bc0079b0 comp rx=0 tx=0).stop 2023-08-25T04:45:57.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.533+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/294433277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80b2810 msgr2=0x7ff6c8150e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:57.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.533+0000 7ff6cd3ff700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80b2810 0x7ff6c8150e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8000c00 tx=0x7ff6b8004750 comp rx=0 tx=0).stop 2023-08-25T04:45:57.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.534+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/294433277 shutdown_connections 2023-08-25T04:45:57.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.534+0000 7ff6cd3ff700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff6b406a0e0 0x7ff6b406c5a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:57.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.534+0000 7ff6cd3ff700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff6c80cb650 0x7ff6c8070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:57.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.534+0000 7ff6cd3ff700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c80b2810 0x7ff6c8150e10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:57.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.534+0000 7ff6cd3ff700 1 --2- 172.21.15.72:0/294433277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6c80b2c70 0x7ff6c8070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:57.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.534+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/294433277 >> 172.21.15.72:0/294433277 conn(0x7ff6c806a710 msgr2=0x7ff6c806aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:57.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.534+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/294433277 shutdown_connections 2023-08-25T04:45:57.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.534+0000 7ff6cd3ff700 1 -- 172.21.15.72:0/294433277 wait complete. 2023-08-25T04:45:57.555 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:45:57.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:45:57.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.753+0000 7f125b3ff700 1 Processor -- start 2023-08-25T04:45:57.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.754+0000 7f125b3ff700 1 -- start start 2023-08-25T04:45:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f125b3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12540b47c0 0x7f12540b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f125b3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f125415d130 0x7f12540d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f125b3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12540b50e0 con 0x7f12540b86b0 2023-08-25T04:45:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f125b3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540b6db0 con 0x7f12540b47c0 2023-08-25T04:45:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f125b3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540d1780 con 0x7f125415d130 2023-08-25T04:45:57.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f125919b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12540b47c0 0x7f12540b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:57.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f125999c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f12540b86b0 0x7f125406b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53176/0 (socket says 172.21.15.72:53176) 2023-08-25T04:45:57.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f125999c700 1 -- 172.21.15.72:0/1978322649 learned_addr learned my addr 172.21.15.72:0/1978322649 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:57.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f125899a700 1 --2- 172.21.15.72:0/1978322649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f125415d130 0x7f12540d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:57.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f125919b700 1 -- 172.21.15.72:0/1978322649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f125415d130 msgr2=0x7f12540d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:57.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.756+0000 7f125919b700 1 --2- 172.21.15.72:0/1978322649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f125415d130 0x7f12540d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:57.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.756+0000 7f125919b700 1 -- 172.21.15.72:0/1978322649 >> v1:172.21.15.72:6789/0 conn(0x7f12540b86b0 legacy=0x7f125406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:57.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.756+0000 7f125919b700 1 -- 172.21.15.72:0/1978322649 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540d1a60 con 0x7f12540b47c0 2023-08-25T04:45:57.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.755+0000 7f124bfff700 1 -- 172.21.15.72:0/1978322649 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162814486 0 0) 0x7f12540b50e0 con 0x7f12540b86b0 2023-08-25T04:45:57.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.756+0000 7f125919b700 1 --2- 172.21.15.72:0/1978322649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b47c0 0x7f12540b4ba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1250009840 tx=0x7f1250009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f4656f3c92798 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:57.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.756+0000 7f124bfff700 1 -- 172.21.15.72:0/1978322649 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250011830 con 0x7f12540b47c0 2023-08-25T04:45:57.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.756+0000 7f124bfff700 1 -- 172.21.15.72:0/1978322649 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1250011990 con 0x7f12540b47c0 2023-08-25T04:45:57.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.756+0000 7f124bfff700 1 -- 172.21.15.72:0/1978322649 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250011d20 con 0x7f12540b47c0 2023-08-25T04:45:57.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.756+0000 7f125b3ff700 1 -- 172.21.15.72:0/1978322649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b47c0 msgr2=0x7f12540b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:57.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.756+0000 7f125b3ff700 1 --2- 172.21.15.72:0/1978322649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b47c0 0x7f12540b4ba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1250009840 tx=0x7f1250009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:57.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.757+0000 7f125b3ff700 1 -- 172.21.15.72:0/1978322649 shutdown_connections 2023-08-25T04:45:57.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.757+0000 7f125b3ff700 1 --2- 172.21.15.72:0/1978322649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b47c0 0x7f12540b4ba0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:57.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.757+0000 7f125b3ff700 1 --2- 172.21.15.72:0/1978322649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f125415d130 0x7f12540d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.757+0000 7f125b3ff700 1 -- 172.21.15.72:0/1978322649 >> 172.21.15.72:0/1978322649 conn(0x7f1254072050 msgr2=0x7f12540d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.757+0000 7f125b3ff700 1 -- 172.21.15.72:0/1978322649 shutdown_connections 2023-08-25T04:45:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.757+0000 7f125b3ff700 1 -- 172.21.15.72:0/1978322649 wait complete. 2023-08-25T04:45:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.758+0000 7f125b3ff700 1 Processor -- start 2023-08-25T04:45:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.758+0000 7f125b3ff700 1 -- start start 2023-08-25T04:45:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.759+0000 7f125b3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12540b47c0 0x7f125414a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.759+0000 7f125b3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b86b0 0x7f12540cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.759+0000 7f125b3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f125415d130 0x7f12540cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.759+0000 7f125b3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125415f6e0 con 0x7f12540b86b0 2023-08-25T04:45:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.759+0000 7f125b3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540c9d80 con 0x7f12540b47c0 2023-08-25T04:45:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.759+0000 7f125b3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125415f980 con 0x7f125415d130 2023-08-25T04:45:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125899a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b86b0 0x7f12540cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125899a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b86b0 0x7f12540cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55972/0 (socket says 172.21.15.72:55972) 2023-08-25T04:45:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125899a700 1 -- 172.21.15.72:0/2773943478 learned_addr learned my addr 172.21.15.72:0/2773943478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:57.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125999c700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f125415d130 0x7f12540cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:57.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125919b700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12540b47c0 0x7f125414a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:57.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125899a700 1 -- 172.21.15.72:0/2773943478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f125415d130 msgr2=0x7f12540cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:57.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125899a700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f125415d130 0x7f12540cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:57.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125899a700 1 -- 172.21.15.72:0/2773943478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12540b47c0 msgr2=0x7f125414a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:57.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125899a700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12540b47c0 0x7f125414a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:57.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125899a700 1 -- 172.21.15.72:0/2773943478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12500094a0 con 0x7f12540b86b0 2023-08-25T04:45:57.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.760+0000 7f125899a700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b86b0 0x7f12540cc600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f124400e9b0 tx=0x7f124400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:57.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.761+0000 7f1249ffb700 1 -- 172.21.15.72:0/2773943478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244009710 con 0x7f12540b86b0 2023-08-25T04:45:57.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.761+0000 7f1249ffb700 1 -- 172.21.15.72:0/2773943478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124400ee50 con 0x7f12540b86b0 2023-08-25T04:45:57.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.761+0000 7f125b3ff700 1 -- 172.21.15.72:0/2773943478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125415fc60 con 0x7f12540b86b0 2023-08-25T04:45:57.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.761+0000 7f1249ffb700 1 -- 172.21.15.72:0/2773943478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400ca50 con 0x7f12540b86b0 2023-08-25T04:45:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.761+0000 7f125b3ff700 1 -- 172.21.15.72:0/2773943478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12540ca300 con 0x7f12540b86b0 2023-08-25T04:45:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.762+0000 7f125b3ff700 1 -- 172.21.15.72:0/2773943478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125404e620 con 0x7f12540b86b0 2023-08-25T04:45:57.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.763+0000 7f1249ffb700 1 -- 172.21.15.72:0/2773943478 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f124400cbb0 con 0x7f12540b86b0 2023-08-25T04:45:57.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.764+0000 7f1249ffb700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f123806a0e0 0x7f123806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:57.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.764+0000 7f1249ffb700 1 -- 172.21.15.72:0/2773943478 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1244088780 con 0x7f12540b86b0 2023-08-25T04:45:57.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.764+0000 7f125919b700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f123806a0e0 0x7f123806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:57.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.765+0000 7f125919b700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f123806a0e0 0x7f123806c5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f12500090b0 tx=0x7f125001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:57.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:57.769+0000 7f1249ffb700 1 -- 172.21.15.72:0/2773943478 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f12440576a0 con 0x7f12540b86b0 2023-08-25T04:45:58.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.010+0000 7f125b3ff700 1 -- 172.21.15.72:0/2773943478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1254154820 con 0x7f12540b86b0 2023-08-25T04:45:58.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.011+0000 7f1249ffb700 1 -- 172.21.15.72:0/2773943478 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f124400ce60 con 0x7f12540b86b0 2023-08-25T04:45:58.012 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:58.012 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:45:32.715423+0000","modified":"2023-08-25T04:45:57.525662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:45:58.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.013+0000 7f125b3ff700 1 -- 172.21.15.72:0/2773943478 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f123806a0e0 msgr2=0x7f123806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.013+0000 7f125b3ff700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f123806a0e0 0x7f123806c5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f12500090b0 tx=0x7f125001c040 comp rx=0 tx=0).stop 2023-08-25T04:45:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.013+0000 7f125b3ff700 1 -- 172.21.15.72:0/2773943478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b86b0 msgr2=0x7f12540cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.013+0000 7f125b3ff700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b86b0 0x7f12540cc600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f124400e9b0 tx=0x7f124400ecc0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.013+0000 7f125b3ff700 1 -- 172.21.15.72:0/2773943478 shutdown_connections 2023-08-25T04:45:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.013+0000 7f125b3ff700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f123806a0e0 0x7f123806c5a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.013+0000 7f125b3ff700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f125415d130 0x7f12540cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.013+0000 7f125b3ff700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12540b47c0 0x7f125414a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.013+0000 7f125b3ff700 1 --2- 172.21.15.72:0/2773943478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12540b86b0 0x7f12540cc600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.013+0000 7f125b3ff700 1 -- 172.21.15.72:0/2773943478 >> 172.21.15.72:0/2773943478 conn(0x7f1254072050 msgr2=0x7f125415a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:58.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.014+0000 7f125b3ff700 1 -- 172.21.15.72:0/2773943478 shutdown_connections 2023-08-25T04:45:58.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.014+0000 7f125b3ff700 1 -- 172.21.15.72:0/2773943478 wait complete. 2023-08-25T04:45:58.017 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-08-25T04:45:58.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:45:58.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.227+0000 7f03557ff700 1 Processor -- start 2023-08-25T04:45:58.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.228+0000 7f03557ff700 1 -- start start 2023-08-25T04:45:58.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f03557ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f03500b4890 0x7f03500b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f03557ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f03500b6020 0x7f03500b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f03557ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03500d19f0 con 0x7f035015cec0 2023-08-25T04:45:58.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f03557ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03500b5280 con 0x7f03500b4890 2023-08-25T04:45:58.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f03557ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03500ce580 con 0x7f03500b6020 2023-08-25T04:45:58.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f0347fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f03500b4890 0x7f03500b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f034effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f035015cec0 0x7f03500cde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53182/0 (socket says 172.21.15.72:53182) 2023-08-25T04:45:58.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f034effd700 1 -- 172.21.15.72:0/3767315856 learned_addr learned my addr 172.21.15.72:0/3767315856 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:58.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f034f7fe700 1 --2- 172.21.15.72:0/3767315856 >> v2:172.21.15.137:3300/0 conn(0x7f03500b6020 0x7f03500b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f0347fff700 1 -- 172.21.15.72:0/3767315856 >> v2:172.21.15.137:3300/0 conn(0x7f03500b6020 msgr2=0x7f03500b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:58.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f0347fff700 1 --2- 172.21.15.72:0/3767315856 >> v2:172.21.15.137:3300/0 conn(0x7f03500b6020 0x7f03500b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.229+0000 7f0347fff700 1 -- 172.21.15.72:0/3767315856 >> v1:172.21.15.72:6789/0 conn(0x7f035015cec0 legacy=0x7f03500cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.230+0000 7f0347fff700 1 -- 172.21.15.72:0/3767315856 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500d1c40 con 0x7f03500b4890 2023-08-25T04:45:58.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.230+0000 7f034e7fc700 1 -- 172.21.15.72:0/3767315856 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564771230 0 0) 0x7f03500d19f0 con 0x7f035015cec0 2023-08-25T04:45:58.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.230+0000 7f0347fff700 1 --2- 172.21.15.72:0/3767315856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 0x7f03500b4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03500cd3f0 tx=0x7f0338009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810ce722680385be server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:58.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.230+0000 7f034e7fc700 1 -- 172.21.15.72:0/3767315856 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338011830 con 0x7f03500b4890 2023-08-25T04:45:58.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.230+0000 7f034e7fc700 1 -- 172.21.15.72:0/3767315856 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338011990 con 0x7f03500b4890 2023-08-25T04:45:58.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.230+0000 7f034e7fc700 1 -- 172.21.15.72:0/3767315856 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338011d20 con 0x7f03500b4890 2023-08-25T04:45:58.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.230+0000 7f03557ff700 1 -- 172.21.15.72:0/3767315856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 msgr2=0x7f03500b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.230+0000 7f03557ff700 1 --2- 172.21.15.72:0/3767315856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 0x7f03500b4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03500cd3f0 tx=0x7f0338009b20 comp rx=0 tx=0).stop 2023-08-25T04:45:58.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.231+0000 7f03557ff700 1 -- 172.21.15.72:0/3767315856 shutdown_connections 2023-08-25T04:45:58.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.231+0000 7f03557ff700 1 --2- 172.21.15.72:0/3767315856 >> v2:172.21.15.137:3300/0 conn(0x7f03500b6020 0x7f03500b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.231+0000 7f03557ff700 1 --2- 172.21.15.72:0/3767315856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 0x7f03500b4d40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.231+0000 7f03557ff700 1 -- 172.21.15.72:0/3767315856 >> 172.21.15.72:0/3767315856 conn(0x7f0350072050 msgr2=0x7f03500cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:58.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.231+0000 7f03557ff700 1 -- 172.21.15.72:0/3767315856 shutdown_connections 2023-08-25T04:45:58.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.231+0000 7f03557ff700 1 -- 172.21.15.72:0/3767315856 wait complete. 2023-08-25T04:45:58.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.233+0000 7f03557ff700 1 Processor -- start 2023-08-25T04:45:58.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.233+0000 7f03557ff700 1 -- start start 2023-08-25T04:45:58.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.234+0000 7f03557ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 0x7f03501559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.234+0000 7f03557ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03500b6020 0x7f035015dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.234+0000 7f03557ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f035015cec0 0x7f03500c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.234+0000 7f03557ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0350155f30 con 0x7f03500b4890 2023-08-25T04:45:58.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.234+0000 7f03557ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0350160920 con 0x7f035015cec0 2023-08-25T04:45:58.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.234+0000 7f03557ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0350160490 con 0x7f03500b6020 2023-08-25T04:45:58.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f034effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 0x7f03501559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f034effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 0x7f03501559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55990/0 (socket says 172.21.15.72:55990) 2023-08-25T04:45:58.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f034effd700 1 -- 172.21.15.72:0/297415379 learned_addr learned my addr 172.21.15.72:0/297415379 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:58.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f034f7fe700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f035015cec0 0x7f03500c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f0347fff700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03500b6020 0x7f035015dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f034effd700 1 -- 172.21.15.72:0/297415379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03500b6020 msgr2=0x7f035015dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f034effd700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03500b6020 0x7f035015dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f034effd700 1 -- 172.21.15.72:0/297415379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f035015cec0 msgr2=0x7f03500c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f034effd700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f035015cec0 0x7f03500c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f034effd700 1 -- 172.21.15.72:0/297415379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380094a0 con 0x7f03500b4890 2023-08-25T04:45:58.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f0347fff700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03500b6020 0x7f035015dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:58.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.235+0000 7f034effd700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 0x7f03501559f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f034000c4d0 tx=0x7f034000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:58.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.236+0000 7f03477fe700 1 -- 172.21.15.72:0/297415379 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03400074e0 con 0x7f03500b4890 2023-08-25T04:45:58.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.236+0000 7f03477fe700 1 -- 172.21.15.72:0/297415379 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0340007640 con 0x7f03500b4890 2023-08-25T04:45:58.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.236+0000 7f03557ff700 1 -- 172.21.15.72:0/297415379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035015e180 con 0x7f03500b4890 2023-08-25T04:45:58.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.236+0000 7f03477fe700 1 -- 172.21.15.72:0/297415379 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340005a70 con 0x7f03500b4890 2023-08-25T04:45:58.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.236+0000 7f03557ff700 1 -- 172.21.15.72:0/297415379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035015fe40 con 0x7f03500b4890 2023-08-25T04:45:58.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.237+0000 7f03557ff700 1 -- 172.21.15.72:0/297415379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035004e620 con 0x7f03500b4890 2023-08-25T04:45:58.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.238+0000 7f03477fe700 1 -- 172.21.15.72:0/297415379 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0340005bd0 con 0x7f03500b4890 2023-08-25T04:45:58.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.238+0000 7f03477fe700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f033006a0e0 0x7f033006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.238+0000 7f03477fe700 1 -- 172.21.15.72:0/297415379 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0340087d20 con 0x7f03500b4890 2023-08-25T04:45:58.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.239+0000 7f0347fff700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f033006a0e0 0x7f033006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.239+0000 7f0347fff700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f033006a0e0 0x7f033006c5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03380090b0 tx=0x7f0338008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:58.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.243+0000 7f03477fe700 1 -- 172.21.15.72:0/297415379 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0340053080 con 0x7f03500b4890 2023-08-25T04:45:58.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.441+0000 7f03557ff700 1 -- 172.21.15.72:0/297415379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03500cf3e0 con 0x7f03500b4890 2023-08-25T04:45:58.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.443+0000 7f03477fe700 1 -- 172.21.15.72:0/297415379 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f0340017090 con 0x7f03500b4890 2023-08-25T04:45:58.444 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:58.444 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:45:58.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 -- 172.21.15.72:0/297415379 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f033006a0e0 msgr2=0x7f033006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f033006a0e0 0x7f033006c5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03380090b0 tx=0x7f0338008030 comp rx=0 tx=0).stop 2023-08-25T04:45:58.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 -- 172.21.15.72:0/297415379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 msgr2=0x7f03501559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 0x7f03501559f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f034000c4d0 tx=0x7f034000c7e0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 -- 172.21.15.72:0/297415379 shutdown_connections 2023-08-25T04:45:58.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f033006a0e0 0x7f033006c5a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f035015cec0 0x7f03500c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03500b4890 0x7f03501559f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 --2- 172.21.15.72:0/297415379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03500b6020 0x7f035015dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 -- 172.21.15.72:0/297415379 >> 172.21.15.72:0/297415379 conn(0x7f0350072050 msgr2=0x7f0350157750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:58.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 -- 172.21.15.72:0/297415379 shutdown_connections 2023-08-25T04:45:58.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.445+0000 7f03557ff700 1 -- 172.21.15.72:0/297415379 wait complete. 2023-08-25T04:45:58.464 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:45:58.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:45:58.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.661+0000 7effa21ff700 1 Processor -- start 2023-08-25T04:45:58.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.661+0000 7effa21ff700 1 -- start start 2023-08-25T04:45:58.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.662+0000 7effa21ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff9c15d130 0x7eff9c0d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.662+0000 7effa21ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0d1780 con 0x7eff9c0b86b0 2023-08-25T04:45:58.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.662+0000 7effa21ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0d1a60 con 0x7eff9c0b47c0 2023-08-25T04:45:58.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.662+0000 7effa21ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c0d1d40 con 0x7eff9c15d130 2023-08-25T04:45:58.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9b7fe700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7eff9c0b47c0 0x7eff9c0b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:58000/0 (socket says 172.21.15.72:58000) 2023-08-25T04:45:58.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9b7fe700 1 -- 172.21.15.72:0/354429498 learned_addr learned my addr 172.21.15.72:0/354429498 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:58.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9affd700 1 --2- 172.21.15.72:0/354429498 >> v2:172.21.15.72:3300/0 conn(0x7eff9c15d130 0x7eff9c0d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9bfff700 1 --1- 172.21.15.72:0/354429498 >> v1:172.21.15.72:6789/0 conn(0x7eff9c0b86b0 0x7eff9c0b5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53184/0 (socket says 172.21.15.72:53184) 2023-08-25T04:45:58.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9a7fc700 1 -- 172.21.15.72:0/354429498 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125346954 0 0) 0x7eff9c0d1a60 con 0x7eff9c0b47c0 2023-08-25T04:45:58.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9a7fc700 1 -- 172.21.15.72:0/354429498 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff840035b0 con 0x7eff9c0b47c0 2023-08-25T04:45:58.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9affd700 1 -- 172.21.15.72:0/354429498 >> v1:172.21.15.137:6789/0 conn(0x7eff9c0b47c0 legacy=0x7eff9c0b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9affd700 1 -- 172.21.15.72:0/354429498 >> v1:172.21.15.72:6789/0 conn(0x7eff9c0b86b0 legacy=0x7eff9c0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9a7fc700 1 -- 172.21.15.72:0/354429498 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729339122 0 0) 0x7eff9c0d1780 con 0x7eff9c0b86b0 2023-08-25T04:45:58.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9affd700 1 -- 172.21.15.72:0/354429498 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c0d2020 con 0x7eff9c15d130 2023-08-25T04:45:58.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.663+0000 7eff9affd700 1 --2- 172.21.15.72:0/354429498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c15d130 0x7eff9c0d0e80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff90009840 tx=0x7eff90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dfe547bd0d7965 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:58.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.664+0000 7eff9a7fc700 1 -- 172.21.15.72:0/354429498 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90011830 con 0x7eff9c15d130 2023-08-25T04:45:58.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.664+0000 7eff9a7fc700 1 -- 172.21.15.72:0/354429498 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff90011990 con 0x7eff9c15d130 2023-08-25T04:45:58.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.664+0000 7eff9a7fc700 1 -- 172.21.15.72:0/354429498 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90011d20 con 0x7eff9c15d130 2023-08-25T04:45:58.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.664+0000 7effa21ff700 1 -- 172.21.15.72:0/354429498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c15d130 msgr2=0x7eff9c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.664+0000 7effa21ff700 1 --2- 172.21.15.72:0/354429498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c15d130 0x7eff9c0d0e80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff90009840 tx=0x7eff90009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:58.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.664+0000 7effa21ff700 1 -- 172.21.15.72:0/354429498 shutdown_connections 2023-08-25T04:45:58.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.664+0000 7effa21ff700 1 --2- 172.21.15.72:0/354429498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c15d130 0x7eff9c0d0e80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.664+0000 7effa21ff700 1 -- 172.21.15.72:0/354429498 >> 172.21.15.72:0/354429498 conn(0x7eff9c072050 msgr2=0x7eff9c0d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:58.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.664+0000 7effa21ff700 1 -- 172.21.15.72:0/354429498 shutdown_connections 2023-08-25T04:45:58.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.664+0000 7effa21ff700 1 -- 172.21.15.72:0/354429498 wait complete. 2023-08-25T04:45:58.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.667+0000 7effa21ff700 1 Processor -- start 2023-08-25T04:45:58.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.667+0000 7effa21ff700 1 -- start start 2023-08-25T04:45:58.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.668+0000 7effa21ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff9c0b47c0 0x7eff9c155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.668+0000 7effa21ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c0b86b0 0x7eff9c0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.668+0000 7effa21ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7eff9c15d130 0x7eff9c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.668+0000 7effa21ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c155b20 con 0x7eff9c0b86b0 2023-08-25T04:45:58.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.668+0000 7effa21ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c154c30 con 0x7eff9c0b47c0 2023-08-25T04:45:58.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.668+0000 7effa21ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c154f10 con 0x7eff9c15d130 2023-08-25T04:45:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.668+0000 7eff9affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c0b86b0 0x7eff9c0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff9affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c0b86b0 0x7eff9c0c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56016/0 (socket says 172.21.15.72:56016) 2023-08-25T04:45:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff9affd700 1 -- 172.21.15.72:0/2595974220 learned_addr learned my addr 172.21.15.72:0/2595974220 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff9bfff700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7eff9c15d130 0x7eff9c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff9b7fe700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff9c0b47c0 0x7eff9c155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff9affd700 1 -- 172.21.15.72:0/2595974220 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7eff9c15d130 msgr2=0x7eff9c156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff9affd700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7eff9c15d130 0x7eff9c156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff9affd700 1 -- 172.21.15.72:0/2595974220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff9c0b47c0 msgr2=0x7eff9c155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff9affd700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff9c0b47c0 0x7eff9c155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff9affd700 1 -- 172.21.15.72:0/2595974220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff900094a0 con 0x7eff9c0b86b0 2023-08-25T04:45:58.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff9affd700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c0b86b0 0x7eff9c0c8930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff90014040 tx=0x7eff90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:58.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff83fff700 1 -- 172.21.15.72:0/2595974220 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9001a910 con 0x7eff9c0b86b0 2023-08-25T04:45:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7eff83fff700 1 -- 172.21.15.72:0/2595974220 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9001aa70 con 0x7eff9c0b86b0 2023-08-25T04:45:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.669+0000 7effa21ff700 1 -- 172.21.15.72:0/2595974220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c1551f0 con 0x7eff9c0b86b0 2023-08-25T04:45:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.670+0000 7eff83fff700 1 -- 172.21.15.72:0/2595974220 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9001ade0 con 0x7eff9c0b86b0 2023-08-25T04:45:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.670+0000 7effa21ff700 1 -- 172.21.15.72:0/2595974220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c1557b0 con 0x7eff9c0b86b0 2023-08-25T04:45:58.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.671+0000 7effa21ff700 1 -- 172.21.15.72:0/2595974220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c04e620 con 0x7eff9c0b86b0 2023-08-25T04:45:58.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.672+0000 7eff83fff700 1 -- 172.21.15.72:0/2595974220 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7eff90022070 con 0x7eff9c0b86b0 2023-08-25T04:45:58.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.672+0000 7eff83fff700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7eff8806a0e0 0x7eff8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:58.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.673+0000 7eff83fff700 1 -- 172.21.15.72:0/2595974220 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7eff90089930 con 0x7eff9c0b86b0 2023-08-25T04:45:58.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.673+0000 7eff9b7fe700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7eff8806a0e0 0x7eff8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:58.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.673+0000 7eff9b7fe700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7eff8806a0e0 0x7eff8806c5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff8c001220 tx=0x7eff8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:58.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.677+0000 7eff83fff700 1 -- 172.21.15.72:0/2595974220 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7eff90054ee0 con 0x7eff9c0b86b0 2023-08-25T04:45:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.868+0000 7effa21ff700 1 -- 172.21.15.72:0/2595974220 --> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff9c0d2300 con 0x7eff8806a0e0 2023-08-25T04:45:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.880+0000 7eff83fff700 1 -- 172.21.15.72:0/2595974220 <== mgr.4101 v2:172.21.15.72:6832/1377484023 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367582 (secure 0 0 0) 0x7eff8c0058e0 con 0x7eff8806a0e0 2023-08-25T04:45:58.884 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 -- 172.21.15.72:0/2595974220 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7eff8806a0e0 msgr2=0x7eff8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7eff8806a0e0 0x7eff8806c5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff8c001220 tx=0x7eff8c009040 comp rx=0 tx=0).stop 2023-08-25T04:45:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 -- 172.21.15.72:0/2595974220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c0b86b0 msgr2=0x7eff9c0c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c0b86b0 0x7eff9c0c8930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff90014040 tx=0x7eff90004750 comp rx=0 tx=0).stop 2023-08-25T04:45:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 -- 172.21.15.72:0/2595974220 shutdown_connections 2023-08-25T04:45:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7eff8806a0e0 0x7eff8806c5a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7eff9c15d130 0x7eff9c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff9c0b47c0 0x7eff9c155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 --2- 172.21.15.72:0/2595974220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c0b86b0 0x7eff9c0c8930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 -- 172.21.15.72:0/2595974220 >> 172.21.15.72:0/2595974220 conn(0x7eff9c072050 msgr2=0x7eff9c15b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 -- 172.21.15.72:0/2595974220 shutdown_connections 2023-08-25T04:45:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:58.885+0000 7effa21ff700 1 -- 172.21.15.72:0/2595974220 wait complete. 2023-08-25T04:45:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-25T04:45:58.903 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-08-25T04:45:57.858882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219456,"kb_used_data":3300,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755264,"statfs":{"total":773094113280,"available":772869390336,"internally_reserved":0,"allocated":3379200,"data_stored":2066894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003003"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460126+0000","last_change":"2023-08-25T04:45:33.185383+0000","last_active":"2023-08-25T04:45:38.460126+0000","last_peered":"2023-08-25T04:45:38.460126+0000","last_clean":"2023-08-25T04:45:38.460126+0000","last_became_active":"2023-08-25T04:45:33.184169+0000","last_became_peered":"2023-08-25T04:45:33.184169+0000","last_unstale":"2023-08-25T04:45:38.460126+0000","last_undegraded":"2023-08-25T04:45:38.460126+0000","last_fullsized":"2023-08-25T04:45:38.460126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:42:04.862278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460260+0000","last_change":"2023-08-25T04:45:33.187575+0000","last_active":"2023-08-25T04:45:38.460260+0000","last_peered":"2023-08-25T04:45:38.460260+0000","last_clean":"2023-08-25T04:45:38.460260+0000","last_became_active":"2023-08-25T04:45:33.187289+0000","last_became_peered":"2023-08-25T04:45:33.187289+0000","last_unstale":"2023-08-25T04:45:38.460260+0000","last_undegraded":"2023-08-25T04:45:38.460260+0000","last_fullsized":"2023-08-25T04:45:38.460260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:14.806194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461583+0000","last_change":"2023-08-25T04:45:33.179277+0000","last_active":"2023-08-25T04:45:38.461583+0000","last_peered":"2023-08-25T04:45:38.461583+0000","last_clean":"2023-08-25T04:45:38.461583+0000","last_became_active":"2023-08-25T04:45:33.178903+0000","last_became_peered":"2023-08-25T04:45:33.178903+0000","last_unstale":"2023-08-25T04:45:38.461583+0000","last_undegraded":"2023-08-25T04:45:38.461583+0000","last_fullsized":"2023-08-25T04:45:38.461583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:22:43.697767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652749+0000","last_change":"2023-08-25T04:45:33.187260+0000","last_active":"2023-08-25T04:45:38.652749+0000","last_peered":"2023-08-25T04:45:38.652749+0000","last_clean":"2023-08-25T04:45:38.652749+0000","last_became_active":"2023-08-25T04:45:33.186900+0000","last_became_peered":"2023-08-25T04:45:33.186900+0000","last_unstale":"2023-08-25T04:45:38.652749+0000","last_undegraded":"2023-08-25T04:45:38.652749+0000","last_fullsized":"2023-08-25T04:45:38.652749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:30.486107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845968+0000","last_change":"2023-08-25T04:45:33.184990+0000","last_active":"2023-08-25T04:45:38.845968+0000","last_peered":"2023-08-25T04:45:38.845968+0000","last_clean":"2023-08-25T04:45:38.845968+0000","last_became_active":"2023-08-25T04:45:33.184741+0000","last_became_peered":"2023-08-25T04:45:33.184741+0000","last_unstale":"2023-08-25T04:45:38.845968+0000","last_undegraded":"2023-08-25T04:45:38.845968+0000","last_fullsized":"2023-08-25T04:45:38.845968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:15.434939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461899+0000","last_change":"2023-08-25T04:45:33.182357+0000","last_active":"2023-08-25T04:45:38.461899+0000","last_peered":"2023-08-25T04:45:38.461899+0000","last_clean":"2023-08-25T04:45:38.461899+0000","last_became_active":"2023-08-25T04:45:33.182046+0000","last_became_peered":"2023-08-25T04:45:33.182046+0000","last_unstale":"2023-08-25T04:45:38.461899+0000","last_undegraded":"2023-08-25T04:45:38.461899+0000","last_fullsized":"2023-08-25T04:45:38.461899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:23.439531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475830+0000","last_change":"2023-08-25T04:45:33.188333+0000","last_active":"2023-08-25T04:45:39.475830+0000","last_peered":"2023-08-25T04:45:39.475830+0000","last_clean":"2023-08-25T04:45:39.475830+0000","last_became_active":"2023-08-25T04:45:33.187968+0000","last_became_peered":"2023-08-25T04:45:33.187968+0000","last_unstale":"2023-08-25T04:45:39.475830+0000","last_undegraded":"2023-08-25T04:45:39.475830+0000","last_fullsized":"2023-08-25T04:45:39.475830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:22:29.864512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459977+0000","last_change":"2023-08-25T04:45:33.186253+0000","last_active":"2023-08-25T04:45:38.459977+0000","last_peered":"2023-08-25T04:45:38.459977+0000","last_clean":"2023-08-25T04:45:38.459977+0000","last_became_active":"2023-08-25T04:45:33.185966+0000","last_became_peered":"2023-08-25T04:45:33.185966+0000","last_unstale":"2023-08-25T04:45:38.459977+0000","last_undegraded":"2023-08-25T04:45:38.459977+0000","last_fullsized":"2023-08-25T04:45:38.459977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:10.645818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845570+0000","last_change":"2023-08-25T04:45:33.186028+0000","last_active":"2023-08-25T04:45:38.845570+0000","last_peered":"2023-08-25T04:45:38.845570+0000","last_clean":"2023-08-25T04:45:38.845570+0000","last_became_active":"2023-08-25T04:45:33.185568+0000","last_became_peered":"2023-08-25T04:45:33.185568+0000","last_unstale":"2023-08-25T04:45:38.845570+0000","last_undegraded":"2023-08-25T04:45:38.845570+0000","last_fullsized":"2023-08-25T04:45:38.845570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:05.092316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460526+0000","last_change":"2023-08-25T04:45:33.178499+0000","last_active":"2023-08-25T04:45:38.460526+0000","last_peered":"2023-08-25T04:45:38.460526+0000","last_clean":"2023-08-25T04:45:38.460526+0000","last_became_active":"2023-08-25T04:45:33.178145+0000","last_became_peered":"2023-08-25T04:45:33.178145+0000","last_unstale":"2023-08-25T04:45:38.460526+0000","last_undegraded":"2023-08-25T04:45:38.460526+0000","last_fullsized":"2023-08-25T04:45:38.460526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:50.758247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461421+0000","last_change":"2023-08-25T04:45:33.173857+0000","last_active":"2023-08-25T04:45:38.461421+0000","last_peered":"2023-08-25T04:45:38.461421+0000","last_clean":"2023-08-25T04:45:38.461421+0000","last_became_active":"2023-08-25T04:45:33.173577+0000","last_became_peered":"2023-08-25T04:45:33.173577+0000","last_unstale":"2023-08-25T04:45:38.461421+0000","last_undegraded":"2023-08-25T04:45:38.461421+0000","last_fullsized":"2023-08-25T04:45:38.461421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:45:23.452085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459669+0000","last_change":"2023-08-25T04:45:33.186989+0000","last_active":"2023-08-25T04:45:38.459669+0000","last_peered":"2023-08-25T04:45:38.459669+0000","last_clean":"2023-08-25T04:45:38.459669+0000","last_became_active":"2023-08-25T04:45:33.186701+0000","last_became_peered":"2023-08-25T04:45:33.186701+0000","last_unstale":"2023-08-25T04:45:38.459669+0000","last_undegraded":"2023-08-25T04:45:38.459669+0000","last_fullsized":"2023-08-25T04:45:38.459669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:19.431020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459722+0000","last_change":"2023-08-25T04:45:33.183696+0000","last_active":"2023-08-25T04:45:38.459722+0000","last_peered":"2023-08-25T04:45:38.459722+0000","last_clean":"2023-08-25T04:45:38.459722+0000","last_became_active":"2023-08-25T04:45:33.183381+0000","last_became_peered":"2023-08-25T04:45:33.183381+0000","last_unstale":"2023-08-25T04:45:38.459722+0000","last_undegraded":"2023-08-25T04:45:38.459722+0000","last_fullsized":"2023-08-25T04:45:38.459722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:36.669250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459977+0000","last_change":"2023-08-25T04:45:33.183979+0000","last_active":"2023-08-25T04:45:38.459977+0000","last_peered":"2023-08-25T04:45:38.459977+0000","last_clean":"2023-08-25T04:45:38.459977+0000","last_became_active":"2023-08-25T04:45:33.183700+0000","last_became_peered":"2023-08-25T04:45:33.183700+0000","last_unstale":"2023-08-25T04:45:38.459977+0000","last_undegraded":"2023-08-25T04:45:38.459977+0000","last_fullsized":"2023-08-25T04:45:38.459977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475604+0000","last_change":"2023-08-25T04:45:33.188668+0000","last_active":"2023-08-25T04:45:39.475604+0000","last_peered":"2023-08-25T04:45:39.475604+0000","last_clean":"2023-08-25T04:45:39.475604+0000","last_became_active":"2023-08-25T04:45:33.188447+0000","last_became_peered":"2023-08-25T04:45:33.188447+0000","last_unstale":"2023-08-25T04:45:39.475604+0000","last_undegraded":"2023-08-25T04:45:39.475604+0000","last_fullsized":"2023-08-25T04:45:39.475604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461770+0000","last_change":"2023-08-25T04:45:33.175887+0000","last_active":"2023-08-25T04:45:38.461770+0000","last_peered":"2023-08-25T04:45:38.461770+0000","last_clean":"2023-08-25T04:45:38.461770+0000","last_became_active":"2023-08-25T04:45:33.175585+0000","last_became_peered":"2023-08-25T04:45:33.175585+0000","last_unstale":"2023-08-25T04:45:38.461770+0000","last_undegraded":"2023-08-25T04:45:38.461770+0000","last_fullsized":"2023-08-25T04:45:38.461770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:37.935438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845602+0000","last_change":"2023-08-25T04:45:33.185875+0000","last_active":"2023-08-25T04:45:38.845602+0000","last_peered":"2023-08-25T04:45:38.845602+0000","last_clean":"2023-08-25T04:45:38.845602+0000","last_became_active":"2023-08-25T04:45:33.185200+0000","last_became_peered":"2023-08-25T04:45:33.185200+0000","last_unstale":"2023-08-25T04:45:38.845602+0000","last_undegraded":"2023-08-25T04:45:38.845602+0000","last_fullsized":"2023-08-25T04:45:38.845602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:30.597928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461261+0000","last_change":"2023-08-25T04:45:33.170738+0000","last_active":"2023-08-25T04:45:38.461261+0000","last_peered":"2023-08-25T04:45:38.461261+0000","last_clean":"2023-08-25T04:45:38.461261+0000","last_became_active":"2023-08-25T04:45:33.170445+0000","last_became_peered":"2023-08-25T04:45:33.170445+0000","last_unstale":"2023-08-25T04:45:38.461261+0000","last_undegraded":"2023-08-25T04:45:38.461261+0000","last_fullsized":"2023-08-25T04:45:38.461261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:42:18.697261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459973+0000","last_change":"2023-08-25T04:45:33.189985+0000","last_active":"2023-08-25T04:45:38.459973+0000","last_peered":"2023-08-25T04:45:38.459973+0000","last_clean":"2023-08-25T04:45:38.459973+0000","last_became_active":"2023-08-25T04:45:33.189741+0000","last_became_peered":"2023-08-25T04:45:33.189741+0000","last_unstale":"2023-08-25T04:45:38.459973+0000","last_undegraded":"2023-08-25T04:45:38.459973+0000","last_fullsized":"2023-08-25T04:45:38.459973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:54:14.813343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.462063+0000","last_change":"2023-08-25T04:45:33.190893+0000","last_active":"2023-08-25T04:45:38.462063+0000","last_peered":"2023-08-25T04:45:38.462063+0000","last_clean":"2023-08-25T04:45:38.462063+0000","last_became_active":"2023-08-25T04:45:33.190613+0000","last_became_peered":"2023-08-25T04:45:33.190613+0000","last_unstale":"2023-08-25T04:45:38.462063+0000","last_undegraded":"2023-08-25T04:45:38.462063+0000","last_fullsized":"2023-08-25T04:45:38.462063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:30:18.502488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476050+0000","last_change":"2023-08-25T04:45:33.184588+0000","last_active":"2023-08-25T04:45:39.476050+0000","last_peered":"2023-08-25T04:45:39.476050+0000","last_clean":"2023-08-25T04:45:39.476050+0000","last_became_active":"2023-08-25T04:45:33.184240+0000","last_became_peered":"2023-08-25T04:45:33.184240+0000","last_unstale":"2023-08-25T04:45:39.476050+0000","last_undegraded":"2023-08-25T04:45:39.476050+0000","last_fullsized":"2023-08-25T04:45:39.476050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:00.135600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845427+0000","last_change":"2023-08-25T04:45:33.187776+0000","last_active":"2023-08-25T04:45:38.845427+0000","last_peered":"2023-08-25T04:45:38.845427+0000","last_clean":"2023-08-25T04:45:38.845427+0000","last_became_active":"2023-08-25T04:45:33.187529+0000","last_became_peered":"2023-08-25T04:45:33.187529+0000","last_unstale":"2023-08-25T04:45:38.845427+0000","last_undegraded":"2023-08-25T04:45:38.845427+0000","last_fullsized":"2023-08-25T04:45:38.845427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475970+0000","last_change":"2023-08-25T04:45:33.182244+0000","last_active":"2023-08-25T04:45:39.475970+0000","last_peered":"2023-08-25T04:45:39.475970+0000","last_clean":"2023-08-25T04:45:39.475970+0000","last_became_active":"2023-08-25T04:45:33.181940+0000","last_became_peered":"2023-08-25T04:45:33.181940+0000","last_unstale":"2023-08-25T04:45:39.475970+0000","last_undegraded":"2023-08-25T04:45:39.475970+0000","last_fullsized":"2023-08-25T04:45:39.475970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:02.627838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475607+0000","last_change":"2023-08-25T04:45:33.184900+0000","last_active":"2023-08-25T04:45:39.475607+0000","last_peered":"2023-08-25T04:45:39.475607+0000","last_clean":"2023-08-25T04:45:39.475607+0000","last_became_active":"2023-08-25T04:45:33.184589+0000","last_became_peered":"2023-08-25T04:45:33.184589+0000","last_unstale":"2023-08-25T04:45:39.475607+0000","last_undegraded":"2023-08-25T04:45:39.475607+0000","last_fullsized":"2023-08-25T04:45:39.475607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:17:10.410580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122553+0000","last_change":"2023-08-25T04:45:33.191724+0000","last_active":"2023-08-25T04:45:39.122553+0000","last_peered":"2023-08-25T04:45:39.122553+0000","last_clean":"2023-08-25T04:45:39.122553+0000","last_became_active":"2023-08-25T04:45:33.191388+0000","last_became_peered":"2023-08-25T04:45:33.191388+0000","last_unstale":"2023-08-25T04:45:39.122553+0000","last_undegraded":"2023-08-25T04:45:39.122553+0000","last_fullsized":"2023-08-25T04:45:39.122553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122544+0000","last_change":"2023-08-25T04:45:33.168956+0000","last_active":"2023-08-25T04:45:39.122544+0000","last_peered":"2023-08-25T04:45:39.122544+0000","last_clean":"2023-08-25T04:45:39.122544+0000","last_became_active":"2023-08-25T04:45:33.168694+0000","last_became_peered":"2023-08-25T04:45:33.168694+0000","last_unstale":"2023-08-25T04:45:39.122544+0000","last_undegraded":"2023-08-25T04:45:39.122544+0000","last_fullsized":"2023-08-25T04:45:39.122544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:50.406447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460744+0000","last_change":"2023-08-25T04:45:33.185807+0000","last_active":"2023-08-25T04:45:38.460744+0000","last_peered":"2023-08-25T04:45:38.460744+0000","last_clean":"2023-08-25T04:45:38.460744+0000","last_became_active":"2023-08-25T04:45:33.185511+0000","last_became_peered":"2023-08-25T04:45:33.185511+0000","last_unstale":"2023-08-25T04:45:38.460744+0000","last_undegraded":"2023-08-25T04:45:38.460744+0000","last_fullsized":"2023-08-25T04:45:38.460744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.462370+0000","last_change":"2023-08-25T04:45:37.484174+0000","last_active":"2023-08-25T04:45:38.462370+0000","last_peered":"2023-08-25T04:45:38.462370+0000","last_clean":"2023-08-25T04:45:38.462370+0000","last_became_active":"2023-08-25T04:45:37.483785+0000","last_became_peered":"2023-08-25T04:45:37.483785+0000","last_unstale":"2023-08-25T04:45:38.462370+0000","last_undegraded":"2023-08-25T04:45:38.462370+0000","last_fullsized":"2023-08-25T04:45:38.462370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:09.116862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461690+0000","last_change":"2023-08-25T04:45:32.241316+0000","last_active":"2023-08-25T04:45:38.461690+0000","last_peered":"2023-08-25T04:45:38.461690+0000","last_clean":"2023-08-25T04:45:38.461690+0000","last_became_active":"2023-08-25T04:45:32.235835+0000","last_became_peered":"2023-08-25T04:45:32.235835+0000","last_unstale":"2023-08-25T04:45:38.461690+0000","last_undegraded":"2023-08-25T04:45:38.461690+0000","last_fullsized":"2023-08-25T04:45:38.461690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:23:28.852339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475699+0000","last_change":"2023-08-25T04:45:33.191163+0000","last_active":"2023-08-25T04:45:39.475699+0000","last_peered":"2023-08-25T04:45:39.475699+0000","last_clean":"2023-08-25T04:45:39.475699+0000","last_became_active":"2023-08-25T04:45:33.190820+0000","last_became_peered":"2023-08-25T04:45:33.190820+0000","last_unstale":"2023-08-25T04:45:39.475699+0000","last_undegraded":"2023-08-25T04:45:39.475699+0000","last_fullsized":"2023-08-25T04:45:39.475699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:47:58.777265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653134+0000","last_change":"2023-08-25T04:45:37.480700+0000","last_active":"2023-08-25T04:45:38.653134+0000","last_peered":"2023-08-25T04:45:38.653134+0000","last_clean":"2023-08-25T04:45:38.653134+0000","last_became_active":"2023-08-25T04:45:37.480204+0000","last_became_peered":"2023-08-25T04:45:37.480204+0000","last_unstale":"2023-08-25T04:45:38.653134+0000","last_undegraded":"2023-08-25T04:45:38.653134+0000","last_fullsized":"2023-08-25T04:45:38.653134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:59.030524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121571+0000","last_change":"2023-08-25T04:45:32.228380+0000","last_active":"2023-08-25T04:45:39.121571+0000","last_peered":"2023-08-25T04:45:39.121571+0000","last_clean":"2023-08-25T04:45:39.121571+0000","last_became_active":"2023-08-25T04:45:32.228067+0000","last_became_peered":"2023-08-25T04:45:32.228067+0000","last_unstale":"2023-08-25T04:45:39.121571+0000","last_undegraded":"2023-08-25T04:45:39.121571+0000","last_fullsized":"2023-08-25T04:45:39.121571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:52.789398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845784+0000","last_change":"2023-08-25T04:45:33.194235+0000","last_active":"2023-08-25T04:45:38.845784+0000","last_peered":"2023-08-25T04:45:38.845784+0000","last_clean":"2023-08-25T04:45:38.845784+0000","last_became_active":"2023-08-25T04:45:33.193947+0000","last_became_peered":"2023-08-25T04:45:33.193947+0000","last_unstale":"2023-08-25T04:45:38.845784+0000","last_undegraded":"2023-08-25T04:45:38.845784+0000","last_fullsized":"2023-08-25T04:45:38.845784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845934+0000","last_change":"2023-08-25T04:45:37.488780+0000","last_active":"2023-08-25T04:45:38.845934+0000","last_peered":"2023-08-25T04:45:38.845934+0000","last_clean":"2023-08-25T04:45:38.845934+0000","last_became_active":"2023-08-25T04:45:37.488413+0000","last_became_peered":"2023-08-25T04:45:37.488413+0000","last_unstale":"2023-08-25T04:45:38.845934+0000","last_undegraded":"2023-08-25T04:45:38.845934+0000","last_fullsized":"2023-08-25T04:45:38.845934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:38.928881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475447+0000","last_change":"2023-08-25T04:45:32.235379+0000","last_active":"2023-08-25T04:45:39.475447+0000","last_peered":"2023-08-25T04:45:39.475447+0000","last_clean":"2023-08-25T04:45:39.475447+0000","last_became_active":"2023-08-25T04:45:32.235070+0000","last_became_peered":"2023-08-25T04:45:32.235070+0000","last_unstale":"2023-08-25T04:45:39.475447+0000","last_undegraded":"2023-08-25T04:45:39.475447+0000","last_fullsized":"2023-08-25T04:45:39.475447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:34:26.267011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653235+0000","last_change":"2023-08-25T04:45:33.181190+0000","last_active":"2023-08-25T04:45:38.653235+0000","last_peered":"2023-08-25T04:45:38.653235+0000","last_clean":"2023-08-25T04:45:38.653235+0000","last_became_active":"2023-08-25T04:45:33.180891+0000","last_became_peered":"2023-08-25T04:45:33.180891+0000","last_unstale":"2023-08-25T04:45:38.653235+0000","last_undegraded":"2023-08-25T04:45:38.653235+0000","last_fullsized":"2023-08-25T04:45:38.653235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:16.907159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652536+0000","last_change":"2023-08-25T04:45:37.480980+0000","last_active":"2023-08-25T04:45:38.652536+0000","last_peered":"2023-08-25T04:45:38.652536+0000","last_clean":"2023-08-25T04:45:38.652536+0000","last_became_active":"2023-08-25T04:45:37.480357+0000","last_became_peered":"2023-08-25T04:45:37.480357+0000","last_unstale":"2023-08-25T04:45:38.652536+0000","last_undegraded":"2023-08-25T04:45:38.652536+0000","last_fullsized":"2023-08-25T04:45:38.652536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:01.442164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845694+0000","last_change":"2023-08-25T04:45:32.242639+0000","last_active":"2023-08-25T04:45:38.845694+0000","last_peered":"2023-08-25T04:45:38.845694+0000","last_clean":"2023-08-25T04:45:38.845694+0000","last_became_active":"2023-08-25T04:45:32.242393+0000","last_became_peered":"2023-08-25T04:45:32.242393+0000","last_unstale":"2023-08-25T04:45:38.845694+0000","last_undegraded":"2023-08-25T04:45:38.845694+0000","last_fullsized":"2023-08-25T04:45:38.845694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:29.089180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475389+0000","last_change":"2023-08-25T04:45:33.190455+0000","last_active":"2023-08-25T04:45:39.475389+0000","last_peered":"2023-08-25T04:45:39.475389+0000","last_clean":"2023-08-25T04:45:39.475389+0000","last_became_active":"2023-08-25T04:45:33.190204+0000","last_became_peered":"2023-08-25T04:45:33.190204+0000","last_unstale":"2023-08-25T04:45:39.475389+0000","last_undegraded":"2023-08-25T04:45:39.475389+0000","last_fullsized":"2023-08-25T04:45:39.475389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:41.739700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475477+0000","last_change":"2023-08-25T04:45:37.495023+0000","last_active":"2023-08-25T04:45:39.475477+0000","last_peered":"2023-08-25T04:45:39.475477+0000","last_clean":"2023-08-25T04:45:39.475477+0000","last_became_active":"2023-08-25T04:45:37.494694+0000","last_became_peered":"2023-08-25T04:45:37.494694+0000","last_unstale":"2023-08-25T04:45:39.475477+0000","last_undegraded":"2023-08-25T04:45:39.475477+0000","last_fullsized":"2023-08-25T04:45:39.475477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:34.327962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460645+0000","last_change":"2023-08-25T04:45:32.239824+0000","last_active":"2023-08-25T04:45:38.460645+0000","last_peered":"2023-08-25T04:45:38.460645+0000","last_clean":"2023-08-25T04:45:38.460645+0000","last_became_active":"2023-08-25T04:45:32.239533+0000","last_became_peered":"2023-08-25T04:45:32.239533+0000","last_unstale":"2023-08-25T04:45:38.460645+0000","last_undegraded":"2023-08-25T04:45:38.460645+0000","last_fullsized":"2023-08-25T04:45:38.460645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:50.517646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475245+0000","last_change":"2023-08-25T04:45:33.178438+0000","last_active":"2023-08-25T04:45:39.475245+0000","last_peered":"2023-08-25T04:45:39.475245+0000","last_clean":"2023-08-25T04:45:39.475245+0000","last_became_active":"2023-08-25T04:45:33.178111+0000","last_became_peered":"2023-08-25T04:45:33.178111+0000","last_unstale":"2023-08-25T04:45:39.475245+0000","last_undegraded":"2023-08-25T04:45:39.475245+0000","last_fullsized":"2023-08-25T04:45:39.475245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:18.567030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476115+0000","last_change":"2023-08-25T04:45:37.491477+0000","last_active":"2023-08-25T04:45:39.476115+0000","last_peered":"2023-08-25T04:45:39.476115+0000","last_clean":"2023-08-25T04:45:39.476115+0000","last_became_active":"2023-08-25T04:45:37.491133+0000","last_became_peered":"2023-08-25T04:45:37.491133+0000","last_unstale":"2023-08-25T04:45:39.476115+0000","last_undegraded":"2023-08-25T04:45:39.476115+0000","last_fullsized":"2023-08-25T04:45:39.476115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:43.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476334+0000","last_change":"2023-08-25T04:45:32.236418+0000","last_active":"2023-08-25T04:45:39.476334+0000","last_peered":"2023-08-25T04:45:39.476334+0000","last_clean":"2023-08-25T04:45:39.476334+0000","last_became_active":"2023-08-25T04:45:32.236098+0000","last_became_peered":"2023-08-25T04:45:32.236098+0000","last_unstale":"2023-08-25T04:45:39.476334+0000","last_undegraded":"2023-08-25T04:45:39.476334+0000","last_fullsized":"2023-08-25T04:45:39.476334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:20.718480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121637+0000","last_change":"2023-08-25T04:45:33.189838+0000","last_active":"2023-08-25T04:45:39.121637+0000","last_peered":"2023-08-25T04:45:39.121637+0000","last_clean":"2023-08-25T04:45:39.121637+0000","last_became_active":"2023-08-25T04:45:33.189477+0000","last_became_peered":"2023-08-25T04:45:33.189477+0000","last_unstale":"2023-08-25T04:45:39.121637+0000","last_undegraded":"2023-08-25T04:45:39.121637+0000","last_fullsized":"2023-08-25T04:45:39.121637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:55.379189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121928+0000","last_change":"2023-08-25T04:45:37.481651+0000","last_active":"2023-08-25T04:45:39.121928+0000","last_peered":"2023-08-25T04:45:39.121928+0000","last_clean":"2023-08-25T04:45:39.121928+0000","last_became_active":"2023-08-25T04:45:37.481302+0000","last_became_peered":"2023-08-25T04:45:37.481302+0000","last_unstale":"2023-08-25T04:45:39.121928+0000","last_undegraded":"2023-08-25T04:45:39.121928+0000","last_fullsized":"2023-08-25T04:45:39.121928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:35.137823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.635942+0000","last_change":"2023-08-25T04:45:32.239434+0000","last_active":"2023-08-25T04:45:48.635942+0000","last_peered":"2023-08-25T04:45:48.635942+0000","last_clean":"2023-08-25T04:45:48.635942+0000","last_became_active":"2023-08-25T04:45:32.239151+0000","last_became_peered":"2023-08-25T04:45:32.239151+0000","last_unstale":"2023-08-25T04:45:48.635942+0000","last_undegraded":"2023-08-25T04:45:48.635942+0000","last_fullsized":"2023-08-25T04:45:48.635942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:58.197133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461057+0000","last_change":"2023-08-25T04:45:33.180869+0000","last_active":"2023-08-25T04:45:38.461057+0000","last_peered":"2023-08-25T04:45:38.461057+0000","last_clean":"2023-08-25T04:45:38.461057+0000","last_became_active":"2023-08-25T04:45:33.180505+0000","last_became_peered":"2023-08-25T04:45:33.180505+0000","last_unstale":"2023-08-25T04:45:38.461057+0000","last_undegraded":"2023-08-25T04:45:38.461057+0000","last_fullsized":"2023-08-25T04:45:38.461057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:35:18.068007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461020+0000","last_change":"2023-08-25T04:45:37.486816+0000","last_active":"2023-08-25T04:45:38.461020+0000","last_peered":"2023-08-25T04:45:38.461020+0000","last_clean":"2023-08-25T04:45:38.461020+0000","last_became_active":"2023-08-25T04:45:37.486420+0000","last_became_peered":"2023-08-25T04:45:37.486420+0000","last_unstale":"2023-08-25T04:45:38.461020+0000","last_undegraded":"2023-08-25T04:45:38.461020+0000","last_fullsized":"2023-08-25T04:45:38.461020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:44.168940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475889+0000","last_change":"2023-08-25T04:45:32.238252+0000","last_active":"2023-08-25T04:45:39.475889+0000","last_peered":"2023-08-25T04:45:39.475889+0000","last_clean":"2023-08-25T04:45:39.475889+0000","last_became_active":"2023-08-25T04:45:32.237891+0000","last_became_peered":"2023-08-25T04:45:32.237891+0000","last_unstale":"2023-08-25T04:45:39.475889+0000","last_undegraded":"2023-08-25T04:45:39.475889+0000","last_fullsized":"2023-08-25T04:45:39.475889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:14.432494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475538+0000","last_change":"2023-08-25T04:45:33.191207+0000","last_active":"2023-08-25T04:45:39.475538+0000","last_peered":"2023-08-25T04:45:39.475538+0000","last_clean":"2023-08-25T04:45:39.475538+0000","last_became_active":"2023-08-25T04:45:33.190881+0000","last_became_peered":"2023-08-25T04:45:33.190881+0000","last_unstale":"2023-08-25T04:45:39.475538+0000","last_undegraded":"2023-08-25T04:45:39.475538+0000","last_fullsized":"2023-08-25T04:45:39.475538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:34.898702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475931+0000","last_change":"2023-08-25T04:45:37.481672+0000","last_active":"2023-08-25T04:45:39.475931+0000","last_peered":"2023-08-25T04:45:39.475931+0000","last_clean":"2023-08-25T04:45:39.475931+0000","last_became_active":"2023-08-25T04:45:37.481257+0000","last_became_peered":"2023-08-25T04:45:37.481257+0000","last_unstale":"2023-08-25T04:45:39.475931+0000","last_undegraded":"2023-08-25T04:45:39.475931+0000","last_fullsized":"2023-08-25T04:45:39.475931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:54:14.466417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845469+0000","last_change":"2023-08-25T04:45:32.239060+0000","last_active":"2023-08-25T04:45:38.845469+0000","last_peered":"2023-08-25T04:45:38.845469+0000","last_clean":"2023-08-25T04:45:38.845469+0000","last_became_active":"2023-08-25T04:45:32.237855+0000","last_became_peered":"2023-08-25T04:45:32.237855+0000","last_unstale":"2023-08-25T04:45:38.845469+0000","last_undegraded":"2023-08-25T04:45:38.845469+0000","last_fullsized":"2023-08-25T04:45:38.845469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:22.321053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460613+0000","last_change":"2023-08-25T04:45:33.179488+0000","last_active":"2023-08-25T04:45:38.460613+0000","last_peered":"2023-08-25T04:45:38.460613+0000","last_clean":"2023-08-25T04:45:38.460613+0000","last_became_active":"2023-08-25T04:45:33.179179+0000","last_became_peered":"2023-08-25T04:45:33.179179+0000","last_unstale":"2023-08-25T04:45:38.460613+0000","last_undegraded":"2023-08-25T04:45:38.460613+0000","last_fullsized":"2023-08-25T04:45:38.460613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:30.091625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476139+0000","last_change":"2023-08-25T04:45:37.490744+0000","last_active":"2023-08-25T04:45:39.476139+0000","last_peered":"2023-08-25T04:45:39.476139+0000","last_clean":"2023-08-25T04:45:39.476139+0000","last_became_active":"2023-08-25T04:45:37.490339+0000","last_became_peered":"2023-08-25T04:45:37.490339+0000","last_unstale":"2023-08-25T04:45:39.476139+0000","last_undegraded":"2023-08-25T04:45:39.476139+0000","last_fullsized":"2023-08-25T04:45:39.476139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:12.857847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475618+0000","last_change":"2023-08-25T04:45:32.237744+0000","last_active":"2023-08-25T04:45:39.475618+0000","last_peered":"2023-08-25T04:45:39.475618+0000","last_clean":"2023-08-25T04:45:39.475618+0000","last_became_active":"2023-08-25T04:45:32.237386+0000","last_became_peered":"2023-08-25T04:45:32.237386+0000","last_unstale":"2023-08-25T04:45:39.475618+0000","last_undegraded":"2023-08-25T04:45:39.475618+0000","last_fullsized":"2023-08-25T04:45:39.475618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:50.517646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.846029+0000","last_change":"2023-08-25T04:45:33.184947+0000","last_active":"2023-08-25T04:45:38.846029+0000","last_peered":"2023-08-25T04:45:38.846029+0000","last_clean":"2023-08-25T04:45:38.846029+0000","last_became_active":"2023-08-25T04:45:33.184665+0000","last_became_peered":"2023-08-25T04:45:33.184665+0000","last_unstale":"2023-08-25T04:45:38.846029+0000","last_undegraded":"2023-08-25T04:45:38.846029+0000","last_fullsized":"2023-08-25T04:45:38.846029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:00.135600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460244+0000","last_change":"2023-08-25T04:45:37.478006+0000","last_active":"2023-08-25T04:45:38.460244+0000","last_peered":"2023-08-25T04:45:38.460244+0000","last_clean":"2023-08-25T04:45:38.460244+0000","last_became_active":"2023-08-25T04:45:37.477688+0000","last_became_peered":"2023-08-25T04:45:37.477688+0000","last_unstale":"2023-08-25T04:45:38.460244+0000","last_undegraded":"2023-08-25T04:45:38.460244+0000","last_fullsized":"2023-08-25T04:45:38.460244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:50.054137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652522+0000","last_change":"2023-08-25T04:45:32.239091+0000","last_active":"2023-08-25T04:45:38.652522+0000","last_peered":"2023-08-25T04:45:38.652522+0000","last_clean":"2023-08-25T04:45:38.652522+0000","last_became_active":"2023-08-25T04:45:32.238782+0000","last_became_peered":"2023-08-25T04:45:32.238782+0000","last_unstale":"2023-08-25T04:45:38.652522+0000","last_undegraded":"2023-08-25T04:45:38.652522+0000","last_fullsized":"2023-08-25T04:45:38.652522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:42.259140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476306+0000","last_change":"2023-08-25T04:45:33.181564+0000","last_active":"2023-08-25T04:45:39.476306+0000","last_peered":"2023-08-25T04:45:39.476306+0000","last_clean":"2023-08-25T04:45:39.476306+0000","last_became_active":"2023-08-25T04:45:33.181312+0000","last_became_peered":"2023-08-25T04:45:33.181312+0000","last_unstale":"2023-08-25T04:45:39.476306+0000","last_undegraded":"2023-08-25T04:45:39.476306+0000","last_fullsized":"2023-08-25T04:45:39.476306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:37.480877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476370+0000","last_change":"2023-08-25T04:45:37.488909+0000","last_active":"2023-08-25T04:45:39.476370+0000","last_peered":"2023-08-25T04:45:39.476370+0000","last_clean":"2023-08-25T04:45:39.476370+0000","last_became_active":"2023-08-25T04:45:37.488338+0000","last_became_peered":"2023-08-25T04:45:37.488338+0000","last_unstale":"2023-08-25T04:45:39.476370+0000","last_undegraded":"2023-08-25T04:45:39.476370+0000","last_fullsized":"2023-08-25T04:45:39.476370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:30.680527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476509+0000","last_change":"2023-08-25T04:45:32.237964+0000","last_active":"2023-08-25T04:45:39.476509+0000","last_peered":"2023-08-25T04:45:39.476509+0000","last_clean":"2023-08-25T04:45:39.476509+0000","last_became_active":"2023-08-25T04:45:32.237542+0000","last_became_peered":"2023-08-25T04:45:32.237542+0000","last_unstale":"2023-08-25T04:45:39.476509+0000","last_undegraded":"2023-08-25T04:45:39.476509+0000","last_fullsized":"2023-08-25T04:45:39.476509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:31:55.456937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459530+0000","last_change":"2023-08-25T04:45:33.192515+0000","last_active":"2023-08-25T04:45:38.459530+0000","last_peered":"2023-08-25T04:45:38.459530+0000","last_clean":"2023-08-25T04:45:38.459530+0000","last_became_active":"2023-08-25T04:45:33.192143+0000","last_became_peered":"2023-08-25T04:45:33.192143+0000","last_unstale":"2023-08-25T04:45:38.459530+0000","last_undegraded":"2023-08-25T04:45:38.459530+0000","last_fullsized":"2023-08-25T04:45:38.459530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:30.901486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459477+0000","last_change":"2023-08-25T04:45:37.488063+0000","last_active":"2023-08-25T04:45:38.459477+0000","last_peered":"2023-08-25T04:45:38.459477+0000","last_clean":"2023-08-25T04:45:38.459477+0000","last_became_active":"2023-08-25T04:45:37.487757+0000","last_became_peered":"2023-08-25T04:45:37.487757+0000","last_unstale":"2023-08-25T04:45:38.459477+0000","last_undegraded":"2023-08-25T04:45:38.459477+0000","last_fullsized":"2023-08-25T04:45:38.459477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:09.769950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476402+0000","last_change":"2023-08-25T04:45:32.237033+0000","last_active":"2023-08-25T04:45:39.476402+0000","last_peered":"2023-08-25T04:45:39.476402+0000","last_clean":"2023-08-25T04:45:39.476402+0000","last_became_active":"2023-08-25T04:45:32.236722+0000","last_became_peered":"2023-08-25T04:45:32.236722+0000","last_unstale":"2023-08-25T04:45:39.476402+0000","last_undegraded":"2023-08-25T04:45:39.476402+0000","last_fullsized":"2023-08-25T04:45:39.476402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:40.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461087+0000","last_change":"2023-08-25T04:45:33.173339+0000","last_active":"2023-08-25T04:45:38.461087+0000","last_peered":"2023-08-25T04:45:38.461087+0000","last_clean":"2023-08-25T04:45:38.461087+0000","last_became_active":"2023-08-25T04:45:33.173001+0000","last_became_peered":"2023-08-25T04:45:33.173001+0000","last_unstale":"2023-08-25T04:45:38.461087+0000","last_undegraded":"2023-08-25T04:45:38.461087+0000","last_fullsized":"2023-08-25T04:45:38.461087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:40.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459839+0000","last_change":"2023-08-25T04:45:37.492765+0000","last_active":"2023-08-25T04:45:38.459839+0000","last_peered":"2023-08-25T04:45:38.459839+0000","last_clean":"2023-08-25T04:45:38.459839+0000","last_became_active":"2023-08-25T04:45:37.492429+0000","last_became_peered":"2023-08-25T04:45:37.492429+0000","last_unstale":"2023-08-25T04:45:38.459839+0000","last_undegraded":"2023-08-25T04:45:38.459839+0000","last_fullsized":"2023-08-25T04:45:38.459839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:19:28.095175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476148+0000","last_change":"2023-08-25T04:45:32.240462+0000","last_active":"2023-08-25T04:45:39.476148+0000","last_peered":"2023-08-25T04:45:39.476148+0000","last_clean":"2023-08-25T04:45:39.476148+0000","last_became_active":"2023-08-25T04:45:32.240196+0000","last_became_peered":"2023-08-25T04:45:32.240196+0000","last_unstale":"2023-08-25T04:45:39.476148+0000","last_undegraded":"2023-08-25T04:45:39.476148+0000","last_fullsized":"2023-08-25T04:45:39.476148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:17.564585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652550+0000","last_change":"2023-08-25T04:45:33.193608+0000","last_active":"2023-08-25T04:45:38.652550+0000","last_peered":"2023-08-25T04:45:38.652550+0000","last_clean":"2023-08-25T04:45:38.652550+0000","last_became_active":"2023-08-25T04:45:33.193118+0000","last_became_peered":"2023-08-25T04:45:33.193118+0000","last_unstale":"2023-08-25T04:45:38.652550+0000","last_undegraded":"2023-08-25T04:45:38.652550+0000","last_fullsized":"2023-08-25T04:45:38.652550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:32.968362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459765+0000","last_change":"2023-08-25T04:45:37.476345+0000","last_active":"2023-08-25T04:45:38.459765+0000","last_peered":"2023-08-25T04:45:38.459765+0000","last_clean":"2023-08-25T04:45:38.459765+0000","last_became_active":"2023-08-25T04:45:37.475874+0000","last_became_peered":"2023-08-25T04:45:37.475874+0000","last_unstale":"2023-08-25T04:45:38.459765+0000","last_undegraded":"2023-08-25T04:45:38.459765+0000","last_fullsized":"2023-08-25T04:45:38.459765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:00:54.571481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460487+0000","last_change":"2023-08-25T04:45:32.233694+0000","last_active":"2023-08-25T04:45:38.460487+0000","last_peered":"2023-08-25T04:45:38.460487+0000","last_clean":"2023-08-25T04:45:38.460487+0000","last_became_active":"2023-08-25T04:45:32.233412+0000","last_became_peered":"2023-08-25T04:45:32.233412+0000","last_unstale":"2023-08-25T04:45:38.460487+0000","last_undegraded":"2023-08-25T04:45:38.460487+0000","last_fullsized":"2023-08-25T04:45:38.460487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:29.595483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845836+0000","last_change":"2023-08-25T04:45:33.186227+0000","last_active":"2023-08-25T04:45:38.845836+0000","last_peered":"2023-08-25T04:45:38.845836+0000","last_clean":"2023-08-25T04:45:38.845836+0000","last_became_active":"2023-08-25T04:45:33.185317+0000","last_became_peered":"2023-08-25T04:45:33.185317+0000","last_unstale":"2023-08-25T04:45:38.845836+0000","last_undegraded":"2023-08-25T04:45:38.845836+0000","last_fullsized":"2023-08-25T04:45:38.845836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:39.932603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459653+0000","last_change":"2023-08-25T04:45:37.481516+0000","last_active":"2023-08-25T04:45:38.459653+0000","last_peered":"2023-08-25T04:45:38.459653+0000","last_clean":"2023-08-25T04:45:38.459653+0000","last_became_active":"2023-08-25T04:45:37.481121+0000","last_became_peered":"2023-08-25T04:45:37.481121+0000","last_unstale":"2023-08-25T04:45:38.459653+0000","last_undegraded":"2023-08-25T04:45:38.459653+0000","last_fullsized":"2023-08-25T04:45:38.459653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:26:41.512610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475607+0000","last_change":"2023-08-25T04:45:32.238750+0000","last_active":"2023-08-25T04:45:39.475607+0000","last_peered":"2023-08-25T04:45:39.475607+0000","last_clean":"2023-08-25T04:45:39.475607+0000","last_became_active":"2023-08-25T04:45:32.238446+0000","last_became_peered":"2023-08-25T04:45:32.238446+0000","last_unstale":"2023-08-25T04:45:39.475607+0000","last_undegraded":"2023-08-25T04:45:39.475607+0000","last_fullsized":"2023-08-25T04:45:39.475607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:09.729389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461964+0000","last_change":"2023-08-25T04:45:33.181796+0000","last_active":"2023-08-25T04:45:38.461964+0000","last_peered":"2023-08-25T04:45:38.461964+0000","last_clean":"2023-08-25T04:45:38.461964+0000","last_became_active":"2023-08-25T04:45:33.180064+0000","last_became_peered":"2023-08-25T04:45:33.180064+0000","last_unstale":"2023-08-25T04:45:38.461964+0000","last_undegraded":"2023-08-25T04:45:38.461964+0000","last_fullsized":"2023-08-25T04:45:38.461964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:00:02.188322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122491+0000","last_change":"2023-08-25T04:45:37.483736+0000","last_active":"2023-08-25T04:45:39.122491+0000","last_peered":"2023-08-25T04:45:39.122491+0000","last_clean":"2023-08-25T04:45:39.122491+0000","last_became_active":"2023-08-25T04:45:37.483361+0000","last_became_peered":"2023-08-25T04:45:37.483361+0000","last_unstale":"2023-08-25T04:45:39.122491+0000","last_undegraded":"2023-08-25T04:45:39.122491+0000","last_fullsized":"2023-08-25T04:45:39.122491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:19.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652579+0000","last_change":"2023-08-25T04:45:32.238540+0000","last_active":"2023-08-25T04:45:38.652579+0000","last_peered":"2023-08-25T04:45:38.652579+0000","last_clean":"2023-08-25T04:45:38.652579+0000","last_became_active":"2023-08-25T04:45:32.238265+0000","last_became_peered":"2023-08-25T04:45:32.238265+0000","last_unstale":"2023-08-25T04:45:38.652579+0000","last_undegraded":"2023-08-25T04:45:38.652579+0000","last_fullsized":"2023-08-25T04:45:38.652579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:29:01.273137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460742+0000","last_change":"2023-08-25T04:45:33.184042+0000","last_active":"2023-08-25T04:45:38.460742+0000","last_peered":"2023-08-25T04:45:38.460742+0000","last_clean":"2023-08-25T04:45:38.460742+0000","last_became_active":"2023-08-25T04:45:33.183680+0000","last_became_peered":"2023-08-25T04:45:33.183680+0000","last_unstale":"2023-08-25T04:45:38.460742+0000","last_undegraded":"2023-08-25T04:45:38.460742+0000","last_fullsized":"2023-08-25T04:45:38.460742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:39.595770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460726+0000","last_change":"2023-08-25T04:45:37.476840+0000","last_active":"2023-08-25T04:45:38.460726+0000","last_peered":"2023-08-25T04:45:38.460726+0000","last_clean":"2023-08-25T04:45:38.460726+0000","last_became_active":"2023-08-25T04:45:37.476291+0000","last_became_peered":"2023-08-25T04:45:37.476291+0000","last_unstale":"2023-08-25T04:45:38.460726+0000","last_undegraded":"2023-08-25T04:45:38.460726+0000","last_fullsized":"2023-08-25T04:45:38.460726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:45.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460720+0000","last_change":"2023-08-25T04:45:32.235065+0000","last_active":"2023-08-25T04:45:38.460720+0000","last_peered":"2023-08-25T04:45:38.460720+0000","last_clean":"2023-08-25T04:45:38.460720+0000","last_became_active":"2023-08-25T04:45:32.234777+0000","last_became_peered":"2023-08-25T04:45:32.234777+0000","last_unstale":"2023-08-25T04:45:38.460720+0000","last_undegraded":"2023-08-25T04:45:38.460720+0000","last_fullsized":"2023-08-25T04:45:38.460720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:01.625394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461475+0000","last_change":"2023-08-25T04:45:33.179314+0000","last_active":"2023-08-25T04:45:38.461475+0000","last_peered":"2023-08-25T04:45:38.461475+0000","last_clean":"2023-08-25T04:45:38.461475+0000","last_became_active":"2023-08-25T04:45:33.178995+0000","last_became_peered":"2023-08-25T04:45:33.178995+0000","last_unstale":"2023-08-25T04:45:38.461475+0000","last_undegraded":"2023-08-25T04:45:38.461475+0000","last_fullsized":"2023-08-25T04:45:38.461475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:48:01.925682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461005+0000","last_change":"2023-08-25T04:45:37.490254+0000","last_active":"2023-08-25T04:45:38.461005+0000","last_peered":"2023-08-25T04:45:38.461005+0000","last_clean":"2023-08-25T04:45:38.461005+0000","last_became_active":"2023-08-25T04:45:37.489836+0000","last_became_peered":"2023-08-25T04:45:37.489836+0000","last_unstale":"2023-08-25T04:45:38.461005+0000","last_undegraded":"2023-08-25T04:45:38.461005+0000","last_fullsized":"2023-08-25T04:45:38.461005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:41.717214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475327+0000","last_change":"2023-08-25T04:45:32.230980+0000","last_active":"2023-08-25T04:45:39.475327+0000","last_peered":"2023-08-25T04:45:39.475327+0000","last_clean":"2023-08-25T04:45:39.475327+0000","last_became_active":"2023-08-25T04:45:32.230712+0000","last_became_peered":"2023-08-25T04:45:32.230712+0000","last_unstale":"2023-08-25T04:45:39.475327+0000","last_undegraded":"2023-08-25T04:45:39.475327+0000","last_fullsized":"2023-08-25T04:45:39.475327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:20.718480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122672+0000","last_change":"2023-08-25T04:45:33.182453+0000","last_active":"2023-08-25T04:45:39.122672+0000","last_peered":"2023-08-25T04:45:39.122672+0000","last_clean":"2023-08-25T04:45:39.122672+0000","last_became_active":"2023-08-25T04:45:33.182169+0000","last_became_peered":"2023-08-25T04:45:33.182169+0000","last_unstale":"2023-08-25T04:45:39.122672+0000","last_undegraded":"2023-08-25T04:45:39.122672+0000","last_fullsized":"2023-08-25T04:45:39.122672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:30.597928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461232+0000","last_change":"2023-08-25T04:45:37.483595+0000","last_active":"2023-08-25T04:45:38.461232+0000","last_peered":"2023-08-25T04:45:38.461232+0000","last_clean":"2023-08-25T04:45:38.461232+0000","last_became_active":"2023-08-25T04:45:37.483087+0000","last_became_peered":"2023-08-25T04:45:37.483087+0000","last_unstale":"2023-08-25T04:45:38.461232+0000","last_undegraded":"2023-08-25T04:45:38.461232+0000","last_fullsized":"2023-08-25T04:45:38.461232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:11:09.671424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476157+0000","last_change":"2023-08-25T04:45:32.237401+0000","last_active":"2023-08-25T04:45:39.476157+0000","last_peered":"2023-08-25T04:45:39.476157+0000","last_clean":"2023-08-25T04:45:39.476157+0000","last_became_active":"2023-08-25T04:45:32.237147+0000","last_became_peered":"2023-08-25T04:45:32.237147+0000","last_unstale":"2023-08-25T04:45:39.476157+0000","last_undegraded":"2023-08-25T04:45:39.476157+0000","last_fullsized":"2023-08-25T04:45:39.476157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:20.177142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460896+0000","last_change":"2023-08-25T04:45:26.770775+0000","last_active":"2023-08-25T04:45:38.460896+0000","last_peered":"2023-08-25T04:45:38.460896+0000","last_clean":"2023-08-25T04:45:38.460896+0000","last_became_active":"2023-08-25T04:45:26.770447+0000","last_became_peered":"2023-08-25T04:45:26.770447+0000","last_unstale":"2023-08-25T04:45:38.460896+0000","last_undegraded":"2023-08-25T04:45:38.460896+0000","last_fullsized":"2023-08-25T04:45:38.460896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:02.164906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475251+0000","last_change":"2023-08-25T04:45:33.180113+0000","last_active":"2023-08-25T04:45:39.475251+0000","last_peered":"2023-08-25T04:45:39.475251+0000","last_clean":"2023-08-25T04:45:39.475251+0000","last_became_active":"2023-08-25T04:45:33.179859+0000","last_became_peered":"2023-08-25T04:45:33.179859+0000","last_unstale":"2023-08-25T04:45:39.475251+0000","last_undegraded":"2023-08-25T04:45:39.475251+0000","last_fullsized":"2023-08-25T04:45:39.475251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:26.444190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475239+0000","last_change":"2023-08-25T04:45:37.483731+0000","last_active":"2023-08-25T04:45:39.475239+0000","last_peered":"2023-08-25T04:45:39.475239+0000","last_clean":"2023-08-25T04:45:39.475239+0000","last_became_active":"2023-08-25T04:45:37.483367+0000","last_became_peered":"2023-08-25T04:45:37.483367+0000","last_unstale":"2023-08-25T04:45:39.475239+0000","last_undegraded":"2023-08-25T04:45:39.475239+0000","last_fullsized":"2023-08-25T04:45:39.475239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:04.371937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475657+0000","last_change":"2023-08-25T04:45:26.768222+0000","last_active":"2023-08-25T04:45:39.475657+0000","last_peered":"2023-08-25T04:45:39.475657+0000","last_clean":"2023-08-25T04:45:39.475657+0000","last_became_active":"2023-08-25T04:45:26.767875+0000","last_became_peered":"2023-08-25T04:45:26.767875+0000","last_unstale":"2023-08-25T04:45:39.475657+0000","last_undegraded":"2023-08-25T04:45:39.475657+0000","last_fullsized":"2023-08-25T04:45:39.475657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:31:22.454559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845648+0000","last_change":"2023-08-25T04:45:32.238276+0000","last_active":"2023-08-25T04:45:38.845648+0000","last_peered":"2023-08-25T04:45:38.845648+0000","last_clean":"2023-08-25T04:45:38.845648+0000","last_became_active":"2023-08-25T04:45:32.237881+0000","last_became_peered":"2023-08-25T04:45:32.237881+0000","last_unstale":"2023-08-25T04:45:38.845648+0000","last_undegraded":"2023-08-25T04:45:38.845648+0000","last_fullsized":"2023-08-25T04:45:38.845648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:49.755802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460946+0000","last_change":"2023-08-25T04:45:33.175073+0000","last_active":"2023-08-25T04:45:38.460946+0000","last_peered":"2023-08-25T04:45:38.460946+0000","last_clean":"2023-08-25T04:45:38.460946+0000","last_became_active":"2023-08-25T04:45:33.174739+0000","last_became_peered":"2023-08-25T04:45:33.174739+0000","last_unstale":"2023-08-25T04:45:38.460946+0000","last_undegraded":"2023-08-25T04:45:38.460946+0000","last_fullsized":"2023-08-25T04:45:38.460946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:21.179587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460451+0000","last_change":"2023-08-25T04:45:37.491239+0000","last_active":"2023-08-25T04:45:38.460451+0000","last_peered":"2023-08-25T04:45:38.460451+0000","last_clean":"2023-08-25T04:45:38.460451+0000","last_became_active":"2023-08-25T04:45:37.490902+0000","last_became_peered":"2023-08-25T04:45:37.490902+0000","last_unstale":"2023-08-25T04:45:38.460451+0000","last_undegraded":"2023-08-25T04:45:38.460451+0000","last_fullsized":"2023-08-25T04:45:38.460451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:27.559835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122041+0000","last_change":"2023-08-25T04:45:26.767948+0000","last_active":"2023-08-25T04:45:39.122041+0000","last_peered":"2023-08-25T04:45:39.122041+0000","last_clean":"2023-08-25T04:45:39.122041+0000","last_became_active":"2023-08-25T04:45:26.767496+0000","last_became_peered":"2023-08-25T04:45:26.767496+0000","last_unstale":"2023-08-25T04:45:39.122041+0000","last_undegraded":"2023-08-25T04:45:39.122041+0000","last_fullsized":"2023-08-25T04:45:39.122041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:13.795305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475898+0000","last_change":"2023-08-25T04:45:27.771979+0000","last_active":"2023-08-25T04:45:39.475898+0000","last_peered":"2023-08-25T04:45:39.475898+0000","last_clean":"2023-08-25T04:45:39.475898+0000","last_became_active":"2023-08-25T04:45:27.770968+0000","last_became_peered":"2023-08-25T04:45:27.770968+0000","last_unstale":"2023-08-25T04:45:39.475898+0000","last_undegraded":"2023-08-25T04:45:39.475898+0000","last_fullsized":"2023-08-25T04:45:39.475898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_clean_scrub_stamp":"2023-08-25T04:45:26.752521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:46.377207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845326+0000","last_change":"2023-08-25T04:45:32.242202+0000","last_active":"2023-08-25T04:45:38.845326+0000","last_peered":"2023-08-25T04:45:38.845326+0000","last_clean":"2023-08-25T04:45:38.845326+0000","last_became_active":"2023-08-25T04:45:32.241904+0000","last_became_peered":"2023-08-25T04:45:32.241904+0000","last_unstale":"2023-08-25T04:45:38.845326+0000","last_undegraded":"2023-08-25T04:45:38.845326+0000","last_fullsized":"2023-08-25T04:45:38.845326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:49.404002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845976+0000","last_change":"2023-08-25T04:45:33.187739+0000","last_active":"2023-08-25T04:45:38.845976+0000","last_peered":"2023-08-25T04:45:38.845976+0000","last_clean":"2023-08-25T04:45:38.845976+0000","last_became_active":"2023-08-25T04:45:33.186521+0000","last_became_peered":"2023-08-25T04:45:33.186521+0000","last_unstale":"2023-08-25T04:45:38.845976+0000","last_undegraded":"2023-08-25T04:45:38.845976+0000","last_fullsized":"2023-08-25T04:45:38.845976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:51.831184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460199+0000","last_change":"2023-08-25T04:45:37.488145+0000","last_active":"2023-08-25T04:45:38.460199+0000","last_peered":"2023-08-25T04:45:38.460199+0000","last_clean":"2023-08-25T04:45:38.460199+0000","last_became_active":"2023-08-25T04:45:37.487669+0000","last_became_peered":"2023-08-25T04:45:37.487669+0000","last_unstale":"2023-08-25T04:45:38.460199+0000","last_undegraded":"2023-08-25T04:45:38.460199+0000","last_fullsized":"2023-08-25T04:45:38.460199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:16.119177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475782+0000","last_change":"2023-08-25T04:45:26.807286+0000","last_active":"2023-08-25T04:45:39.475782+0000","last_peered":"2023-08-25T04:45:39.475782+0000","last_clean":"2023-08-25T04:45:39.475782+0000","last_became_active":"2023-08-25T04:45:26.806698+0000","last_became_peered":"2023-08-25T04:45:26.806698+0000","last_unstale":"2023-08-25T04:45:39.475782+0000","last_undegraded":"2023-08-25T04:45:39.475782+0000","last_fullsized":"2023-08-25T04:45:39.475782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:28.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121731+0000","last_change":"2023-08-25T04:45:32.233634+0000","last_active":"2023-08-25T04:45:39.121731+0000","last_peered":"2023-08-25T04:45:39.121731+0000","last_clean":"2023-08-25T04:45:39.121731+0000","last_became_active":"2023-08-25T04:45:32.233114+0000","last_became_peered":"2023-08-25T04:45:32.233114+0000","last_unstale":"2023-08-25T04:45:39.121731+0000","last_undegraded":"2023-08-25T04:45:39.121731+0000","last_fullsized":"2023-08-25T04:45:39.121731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:41:01.219246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122577+0000","last_change":"2023-08-25T04:45:33.176186+0000","last_active":"2023-08-25T04:45:39.122577+0000","last_peered":"2023-08-25T04:45:39.122577+0000","last_clean":"2023-08-25T04:45:39.122577+0000","last_became_active":"2023-08-25T04:45:33.175948+0000","last_became_peered":"2023-08-25T04:45:33.175948+0000","last_unstale":"2023-08-25T04:45:39.122577+0000","last_undegraded":"2023-08-25T04:45:39.122577+0000","last_fullsized":"2023-08-25T04:45:39.122577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:23.323498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476087+0000","last_change":"2023-08-25T04:45:37.488913+0000","last_active":"2023-08-25T04:45:39.476087+0000","last_peered":"2023-08-25T04:45:39.476087+0000","last_clean":"2023-08-25T04:45:39.476087+0000","last_became_active":"2023-08-25T04:45:37.488517+0000","last_became_peered":"2023-08-25T04:45:37.488517+0000","last_unstale":"2023-08-25T04:45:39.476087+0000","last_undegraded":"2023-08-25T04:45:39.476087+0000","last_fullsized":"2023-08-25T04:45:39.476087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:56.688517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475596+0000","last_change":"2023-08-25T04:45:26.807096+0000","last_active":"2023-08-25T04:45:39.475596+0000","last_peered":"2023-08-25T04:45:39.475596+0000","last_clean":"2023-08-25T04:45:39.475596+0000","last_became_active":"2023-08-25T04:45:26.806713+0000","last_became_peered":"2023-08-25T04:45:26.806713+0000","last_unstale":"2023-08-25T04:45:39.475596+0000","last_undegraded":"2023-08-25T04:45:39.475596+0000","last_fullsized":"2023-08-25T04:45:39.475596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:35.196391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475423+0000","last_change":"2023-08-25T04:45:32.228181+0000","last_active":"2023-08-25T04:45:39.475423+0000","last_peered":"2023-08-25T04:45:39.475423+0000","last_clean":"2023-08-25T04:45:39.475423+0000","last_became_active":"2023-08-25T04:45:32.227866+0000","last_became_peered":"2023-08-25T04:45:32.227866+0000","last_unstale":"2023-08-25T04:45:39.475423+0000","last_undegraded":"2023-08-25T04:45:39.475423+0000","last_fullsized":"2023-08-25T04:45:39.475423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:11.034422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653005+0000","last_change":"2023-08-25T04:45:33.189112+0000","last_active":"2023-08-25T04:45:38.653005+0000","last_peered":"2023-08-25T04:45:38.653005+0000","last_clean":"2023-08-25T04:45:38.653005+0000","last_became_active":"2023-08-25T04:45:33.188826+0000","last_became_peered":"2023-08-25T04:45:33.188826+0000","last_unstale":"2023-08-25T04:45:38.653005+0000","last_undegraded":"2023-08-25T04:45:38.653005+0000","last_fullsized":"2023-08-25T04:45:38.653005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:37.230837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845808+0000","last_change":"2023-08-25T04:45:37.484004+0000","last_active":"2023-08-25T04:45:38.845808+0000","last_peered":"2023-08-25T04:45:38.845808+0000","last_clean":"2023-08-25T04:45:38.845808+0000","last_became_active":"2023-08-25T04:45:37.483640+0000","last_became_peered":"2023-08-25T04:45:37.483640+0000","last_unstale":"2023-08-25T04:45:38.845808+0000","last_undegraded":"2023-08-25T04:45:38.845808+0000","last_fullsized":"2023-08-25T04:45:38.845808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:55.756428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459530+0000","last_change":"2023-08-25T04:45:26.807065+0000","last_active":"2023-08-25T04:45:38.459530+0000","last_peered":"2023-08-25T04:45:38.459530+0000","last_clean":"2023-08-25T04:45:38.459530+0000","last_became_active":"2023-08-25T04:45:26.806737+0000","last_became_peered":"2023-08-25T04:45:26.806737+0000","last_unstale":"2023-08-25T04:45:38.459530+0000","last_undegraded":"2023-08-25T04:45:38.459530+0000","last_fullsized":"2023-08-25T04:45:38.459530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:11.279650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461215+0000","last_change":"2023-08-25T04:45:32.243699+0000","last_active":"2023-08-25T04:45:38.461215+0000","last_peered":"2023-08-25T04:45:38.461215+0000","last_clean":"2023-08-25T04:45:38.461215+0000","last_became_active":"2023-08-25T04:45:32.243274+0000","last_became_peered":"2023-08-25T04:45:32.243274+0000","last_unstale":"2023-08-25T04:45:38.461215+0000","last_undegraded":"2023-08-25T04:45:38.461215+0000","last_fullsized":"2023-08-25T04:45:38.461215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:24.791647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121774+0000","last_change":"2023-08-25T04:45:33.168891+0000","last_active":"2023-08-25T04:45:39.121774+0000","last_peered":"2023-08-25T04:45:39.121774+0000","last_clean":"2023-08-25T04:45:39.121774+0000","last_became_active":"2023-08-25T04:45:33.168678+0000","last_became_peered":"2023-08-25T04:45:33.168678+0000","last_unstale":"2023-08-25T04:45:39.121774+0000","last_undegraded":"2023-08-25T04:45:39.121774+0000","last_fullsized":"2023-08-25T04:45:39.121774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:33:22.522440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653080+0000","last_change":"2023-08-25T04:45:37.485021+0000","last_active":"2023-08-25T04:45:38.653080+0000","last_peered":"2023-08-25T04:45:38.653080+0000","last_clean":"2023-08-25T04:45:38.653080+0000","last_became_active":"2023-08-25T04:45:37.484610+0000","last_became_peered":"2023-08-25T04:45:37.484610+0000","last_unstale":"2023-08-25T04:45:38.653080+0000","last_undegraded":"2023-08-25T04:45:38.653080+0000","last_fullsized":"2023-08-25T04:45:38.653080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:10.974671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653028+0000","last_change":"2023-08-25T04:45:26.807090+0000","last_active":"2023-08-25T04:45:38.653028+0000","last_peered":"2023-08-25T04:45:38.653028+0000","last_clean":"2023-08-25T04:45:38.653028+0000","last_became_active":"2023-08-25T04:45:26.806685+0000","last_became_peered":"2023-08-25T04:45:26.806685+0000","last_unstale":"2023-08-25T04:45:38.653028+0000","last_undegraded":"2023-08-25T04:45:38.653028+0000","last_fullsized":"2023-08-25T04:45:38.653028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:15.681823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121905+0000","last_change":"2023-08-25T04:45:32.233460+0000","last_active":"2023-08-25T04:45:39.121905+0000","last_peered":"2023-08-25T04:45:39.121905+0000","last_clean":"2023-08-25T04:45:39.121905+0000","last_became_active":"2023-08-25T04:45:32.233102+0000","last_became_peered":"2023-08-25T04:45:32.233102+0000","last_unstale":"2023-08-25T04:45:39.121905+0000","last_undegraded":"2023-08-25T04:45:39.121905+0000","last_fullsized":"2023-08-25T04:45:39.121905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:32.845760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845981+0000","last_change":"2023-08-25T04:45:33.177772+0000","last_active":"2023-08-25T04:45:38.845981+0000","last_peered":"2023-08-25T04:45:38.845981+0000","last_clean":"2023-08-25T04:45:38.845981+0000","last_became_active":"2023-08-25T04:45:33.177547+0000","last_became_peered":"2023-08-25T04:45:33.177547+0000","last_unstale":"2023-08-25T04:45:38.845981+0000","last_undegraded":"2023-08-25T04:45:38.845981+0000","last_fullsized":"2023-08-25T04:45:38.845981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:52.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845774+0000","last_change":"2023-08-25T04:45:37.490313+0000","last_active":"2023-08-25T04:45:38.845774+0000","last_peered":"2023-08-25T04:45:38.845774+0000","last_clean":"2023-08-25T04:45:38.845774+0000","last_became_active":"2023-08-25T04:45:37.489828+0000","last_became_peered":"2023-08-25T04:45:37.489828+0000","last_unstale":"2023-08-25T04:45:38.845774+0000","last_undegraded":"2023-08-25T04:45:38.845774+0000","last_fullsized":"2023-08-25T04:45:38.845774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:45.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653039+0000","last_change":"2023-08-25T04:45:26.768150+0000","last_active":"2023-08-25T04:45:38.653039+0000","last_peered":"2023-08-25T04:45:38.653039+0000","last_clean":"2023-08-25T04:45:38.653039+0000","last_became_active":"2023-08-25T04:45:26.767845+0000","last_became_peered":"2023-08-25T04:45:26.767845+0000","last_unstale":"2023-08-25T04:45:38.653039+0000","last_undegraded":"2023-08-25T04:45:38.653039+0000","last_fullsized":"2023-08-25T04:45:38.653039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:42.888555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460497+0000","last_change":"2023-08-25T04:45:32.235113+0000","last_active":"2023-08-25T04:45:38.460497+0000","last_peered":"2023-08-25T04:45:38.460497+0000","last_clean":"2023-08-25T04:45:38.460497+0000","last_became_active":"2023-08-25T04:45:32.234769+0000","last_became_peered":"2023-08-25T04:45:32.234769+0000","last_unstale":"2023-08-25T04:45:38.460497+0000","last_undegraded":"2023-08-25T04:45:38.460497+0000","last_fullsized":"2023-08-25T04:45:38.460497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:04.089871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121833+0000","last_change":"2023-08-25T04:45:33.176251+0000","last_active":"2023-08-25T04:45:39.121833+0000","last_peered":"2023-08-25T04:45:39.121833+0000","last_clean":"2023-08-25T04:45:39.121833+0000","last_became_active":"2023-08-25T04:45:33.175905+0000","last_became_peered":"2023-08-25T04:45:33.175905+0000","last_unstale":"2023-08-25T04:45:39.121833+0000","last_undegraded":"2023-08-25T04:45:39.121833+0000","last_fullsized":"2023-08-25T04:45:39.121833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:17.736254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122068+0000","last_change":"2023-08-25T04:45:37.490783+0000","last_active":"2023-08-25T04:45:39.122068+0000","last_peered":"2023-08-25T04:45:39.122068+0000","last_clean":"2023-08-25T04:45:39.122068+0000","last_became_active":"2023-08-25T04:45:37.490007+0000","last_became_peered":"2023-08-25T04:45:37.490007+0000","last_unstale":"2023-08-25T04:45:39.122068+0000","last_undegraded":"2023-08-25T04:45:39.122068+0000","last_fullsized":"2023-08-25T04:45:39.122068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:50.054137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845866+0000","last_change":"2023-08-25T04:45:32.242734+0000","last_active":"2023-08-25T04:45:38.845866+0000","last_peered":"2023-08-25T04:45:38.845866+0000","last_clean":"2023-08-25T04:45:38.845866+0000","last_became_active":"2023-08-25T04:45:32.241971+0000","last_became_peered":"2023-08-25T04:45:32.241971+0000","last_unstale":"2023-08-25T04:45:38.845866+0000","last_undegraded":"2023-08-25T04:45:38.845866+0000","last_fullsized":"2023-08-25T04:45:38.845866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:17:09.408135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459937+0000","last_change":"2023-08-25T04:45:33.173345+0000","last_active":"2023-08-25T04:45:38.459937+0000","last_peered":"2023-08-25T04:45:38.459937+0000","last_clean":"2023-08-25T04:45:38.459937+0000","last_became_active":"2023-08-25T04:45:33.173020+0000","last_became_peered":"2023-08-25T04:45:33.173020+0000","last_unstale":"2023-08-25T04:45:38.459937+0000","last_undegraded":"2023-08-25T04:45:38.459937+0000","last_fullsized":"2023-08-25T04:45:38.459937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:25:18.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475713+0000","last_change":"2023-08-25T04:45:37.489214+0000","last_active":"2023-08-25T04:45:39.475713+0000","last_peered":"2023-08-25T04:45:39.475713+0000","last_clean":"2023-08-25T04:45:39.475713+0000","last_became_active":"2023-08-25T04:45:37.488142+0000","last_became_peered":"2023-08-25T04:45:37.488142+0000","last_unstale":"2023-08-25T04:45:39.475713+0000","last_undegraded":"2023-08-25T04:45:39.475713+0000","last_fullsized":"2023-08-25T04:45:39.475713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:44.168940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460273+0000","last_change":"2023-08-25T04:45:32.237652+0000","last_active":"2023-08-25T04:45:38.460273+0000","last_peered":"2023-08-25T04:45:38.460273+0000","last_clean":"2023-08-25T04:45:38.460273+0000","last_became_active":"2023-08-25T04:45:32.237377+0000","last_became_peered":"2023-08-25T04:45:32.237377+0000","last_unstale":"2023-08-25T04:45:38.460273+0000","last_undegraded":"2023-08-25T04:45:38.460273+0000","last_fullsized":"2023-08-25T04:45:38.460273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:49.404002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461705+0000","last_change":"2023-08-25T04:45:33.186012+0000","last_active":"2023-08-25T04:45:38.461705+0000","last_peered":"2023-08-25T04:45:38.461705+0000","last_clean":"2023-08-25T04:45:38.461705+0000","last_became_active":"2023-08-25T04:45:33.185728+0000","last_became_peered":"2023-08-25T04:45:33.185728+0000","last_unstale":"2023-08-25T04:45:38.461705+0000","last_undegraded":"2023-08-25T04:45:38.461705+0000","last_fullsized":"2023-08-25T04:45:38.461705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:13.906330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460189+0000","last_change":"2023-08-25T04:45:37.491674+0000","last_active":"2023-08-25T04:45:38.460189+0000","last_peered":"2023-08-25T04:45:38.460189+0000","last_clean":"2023-08-25T04:45:38.460189+0000","last_became_active":"2023-08-25T04:45:37.491231+0000","last_became_peered":"2023-08-25T04:45:37.491231+0000","last_unstale":"2023-08-25T04:45:38.460189+0000","last_undegraded":"2023-08-25T04:45:38.460189+0000","last_fullsized":"2023-08-25T04:45:38.460189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:38.084542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460262+0000","last_change":"2023-08-25T04:45:32.237694+0000","last_active":"2023-08-25T04:45:38.460262+0000","last_peered":"2023-08-25T04:45:38.460262+0000","last_clean":"2023-08-25T04:45:38.460262+0000","last_became_active":"2023-08-25T04:45:32.237349+0000","last_became_peered":"2023-08-25T04:45:32.237349+0000","last_unstale":"2023-08-25T04:45:38.460262+0000","last_undegraded":"2023-08-25T04:45:38.460262+0000","last_fullsized":"2023-08-25T04:45:38.460262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:19.249464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461404+0000","last_change":"2023-08-25T04:45:33.182578+0000","last_active":"2023-08-25T04:45:38.461404+0000","last_peered":"2023-08-25T04:45:38.461404+0000","last_clean":"2023-08-25T04:45:38.461404+0000","last_became_active":"2023-08-25T04:45:33.182247+0000","last_became_peered":"2023-08-25T04:45:33.182247+0000","last_unstale":"2023-08-25T04:45:38.461404+0000","last_undegraded":"2023-08-25T04:45:38.461404+0000","last_fullsized":"2023-08-25T04:45:38.461404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:07.921112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460509+0000","last_change":"2023-08-25T04:45:37.474385+0000","last_active":"2023-08-25T04:45:38.460509+0000","last_peered":"2023-08-25T04:45:38.460509+0000","last_clean":"2023-08-25T04:45:38.460509+0000","last_became_active":"2023-08-25T04:45:37.473906+0000","last_became_peered":"2023-08-25T04:45:37.473906+0000","last_unstale":"2023-08-25T04:45:38.460509+0000","last_undegraded":"2023-08-25T04:45:38.460509+0000","last_fullsized":"2023-08-25T04:45:38.460509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:54:14.466417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475836+0000","last_change":"2023-08-25T04:45:32.230006+0000","last_active":"2023-08-25T04:45:39.475836+0000","last_peered":"2023-08-25T04:45:39.475836+0000","last_clean":"2023-08-25T04:45:39.475836+0000","last_became_active":"2023-08-25T04:45:32.229669+0000","last_became_peered":"2023-08-25T04:45:32.229669+0000","last_unstale":"2023-08-25T04:45:39.475836+0000","last_undegraded":"2023-08-25T04:45:39.475836+0000","last_fullsized":"2023-08-25T04:45:39.475836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:05.707508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475400+0000","last_change":"2023-08-25T04:45:33.191243+0000","last_active":"2023-08-25T04:45:39.475400+0000","last_peered":"2023-08-25T04:45:39.475400+0000","last_clean":"2023-08-25T04:45:39.475400+0000","last_became_active":"2023-08-25T04:45:33.190978+0000","last_became_peered":"2023-08-25T04:45:33.190978+0000","last_unstale":"2023-08-25T04:45:39.475400+0000","last_undegraded":"2023-08-25T04:45:39.475400+0000","last_fullsized":"2023-08-25T04:45:39.475400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:31:56.459382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122653+0000","last_change":"2023-08-25T04:45:37.480208+0000","last_active":"2023-08-25T04:45:39.122653+0000","last_peered":"2023-08-25T04:45:39.122653+0000","last_clean":"2023-08-25T04:45:39.122653+0000","last_became_active":"2023-08-25T04:45:37.479756+0000","last_became_peered":"2023-08-25T04:45:37.479756+0000","last_unstale":"2023-08-25T04:45:39.122653+0000","last_undegraded":"2023-08-25T04:45:39.122653+0000","last_fullsized":"2023-08-25T04:45:39.122653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:09.328653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845931+0000","last_change":"2023-08-25T04:45:32.242698+0000","last_active":"2023-08-25T04:45:38.845931+0000","last_peered":"2023-08-25T04:45:38.845931+0000","last_clean":"2023-08-25T04:45:38.845931+0000","last_became_active":"2023-08-25T04:45:32.242434+0000","last_became_peered":"2023-08-25T04:45:32.242434+0000","last_unstale":"2023-08-25T04:45:38.845931+0000","last_undegraded":"2023-08-25T04:45:38.845931+0000","last_fullsized":"2023-08-25T04:45:38.845931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:22:28.862067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460720+0000","last_change":"2023-08-25T04:45:33.178625+0000","last_active":"2023-08-25T04:45:38.460720+0000","last_peered":"2023-08-25T04:45:38.460720+0000","last_clean":"2023-08-25T04:45:38.460720+0000","last_became_active":"2023-08-25T04:45:33.178339+0000","last_became_peered":"2023-08-25T04:45:33.178339+0000","last_unstale":"2023-08-25T04:45:38.460720+0000","last_undegraded":"2023-08-25T04:45:38.460720+0000","last_fullsized":"2023-08-25T04:45:38.460720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:27.545798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652789+0000","last_change":"2023-08-25T04:45:33.184848+0000","last_active":"2023-08-25T04:45:38.652789+0000","last_peered":"2023-08-25T04:45:38.652789+0000","last_clean":"2023-08-25T04:45:38.652789+0000","last_became_active":"2023-08-25T04:45:33.184561+0000","last_became_peered":"2023-08-25T04:45:33.184561+0000","last_unstale":"2023-08-25T04:45:38.652789+0000","last_undegraded":"2023-08-25T04:45:38.652789+0000","last_fullsized":"2023-08-25T04:45:38.652789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:51.096987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475832+0000","last_change":"2023-08-25T04:45:33.191054+0000","last_active":"2023-08-25T04:45:39.475832+0000","last_peered":"2023-08-25T04:45:39.475832+0000","last_clean":"2023-08-25T04:45:39.475832+0000","last_became_active":"2023-08-25T04:45:33.190791+0000","last_became_peered":"2023-08-25T04:45:33.190791+0000","last_unstale":"2023-08-25T04:45:39.475832+0000","last_undegraded":"2023-08-25T04:45:39.475832+0000","last_fullsized":"2023-08-25T04:45:39.475832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:11.510859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461862+0000","last_change":"2023-08-25T04:45:33.189475+0000","last_active":"2023-08-25T04:45:38.461862+0000","last_peered":"2023-08-25T04:45:38.461862+0000","last_clean":"2023-08-25T04:45:38.461862+0000","last_became_active":"2023-08-25T04:45:33.189067+0000","last_became_peered":"2023-08-25T04:45:33.189067+0000","last_unstale":"2023-08-25T04:45:38.461862+0000","last_undegraded":"2023-08-25T04:45:38.461862+0000","last_fullsized":"2023-08-25T04:45:38.461862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:19.369230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475668+0000","last_change":"2023-08-25T04:45:33.193380+0000","last_active":"2023-08-25T04:45:39.475668+0000","last_peered":"2023-08-25T04:45:39.475668+0000","last_clean":"2023-08-25T04:45:39.475668+0000","last_became_active":"2023-08-25T04:45:33.193083+0000","last_became_peered":"2023-08-25T04:45:33.193083+0000","last_unstale":"2023-08-25T04:45:39.475668+0000","last_undegraded":"2023-08-25T04:45:39.475668+0000","last_fullsized":"2023-08-25T04:45:39.475668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:19:48.510004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121877+0000","last_change":"2023-08-25T04:45:33.180446+0000","last_active":"2023-08-25T04:45:39.121877+0000","last_peered":"2023-08-25T04:45:39.121877+0000","last_clean":"2023-08-25T04:45:39.121877+0000","last_became_active":"2023-08-25T04:45:33.179711+0000","last_became_peered":"2023-08-25T04:45:33.179711+0000","last_unstale":"2023-08-25T04:45:39.121877+0000","last_undegraded":"2023-08-25T04:45:39.121877+0000","last_fullsized":"2023-08-25T04:45:39.121877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:10.645818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":704047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":700130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":109852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:45:58.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:45:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.138+0000 7f7ee1bff700 1 Processor -- start 2023-08-25T04:45:59.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.139+0000 7f7ee1bff700 1 -- start start 2023-08-25T04:45:59.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.140+0000 7f7ee1bff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7edc15ce60 0x7f7edc0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.140+0000 7f7ee1bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 0x7f7edc0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.140+0000 7f7ee1bff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc0d1fe0 con 0x7f7edc0b8770 2023-08-25T04:45:59.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.140+0000 7f7ee1bff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc0d2b80 con 0x7f7edc15ce60 2023-08-25T04:45:59.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.140+0000 7f7ee1bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0ce410 con 0x7f7edc0cda40 2023-08-25T04:45:59.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.140+0000 7f7edb7fe700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7edc15ce60 0x7f7edc0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.140+0000 7f7edaffd700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7edc0b8770 0x7f7edc0d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:58008/0 (socket says 172.21.15.72:58008) 2023-08-25T04:45:59.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.140+0000 7f7edbfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 0x7f7edc0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.140+0000 7f7edaffd700 1 -- 172.21.15.72:0/3268231364 learned_addr learned my addr 172.21.15.72:0/3268231364 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:59.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.141+0000 7f7edbfff700 1 -- 172.21.15.72:0/3268231364 >> v2:172.21.15.137:3300/0 conn(0x7f7edc15ce60 msgr2=0x7f7edc0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:59.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.141+0000 7f7edbfff700 1 --2- 172.21.15.72:0/3268231364 >> v2:172.21.15.137:3300/0 conn(0x7f7edc15ce60 0x7f7edc0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.141+0000 7f7edbfff700 1 -- 172.21.15.72:0/3268231364 >> v1:172.21.15.137:6789/0 conn(0x7f7edc0b8770 legacy=0x7f7edc0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.141+0000 7f7edbfff700 1 -- 172.21.15.72:0/3268231364 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0d13d0 con 0x7f7edc0cda40 2023-08-25T04:45:59.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.141+0000 7f7edbfff700 1 --2- 172.21.15.72:0/3268231364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 0x7f7edc0cded0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ddc149a405e39 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:59.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.141+0000 7f7eda7fc700 1 -- 172.21.15.72:0/3268231364 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400e070 con 0x7f7edc0cda40 2023-08-25T04:45:59.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.141+0000 7f7eda7fc700 1 -- 172.21.15.72:0/3268231364 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed400bb20 con 0x7f7edc0cda40 2023-08-25T04:45:59.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.141+0000 7f7eda7fc700 1 -- 172.21.15.72:0/3268231364 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4012430 con 0x7f7edc0cda40 2023-08-25T04:45:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.142+0000 7f7ee1bff700 1 -- 172.21.15.72:0/3268231364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 msgr2=0x7f7edc0cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.142+0000 7f7ee1bff700 1 --2- 172.21.15.72:0/3268231364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 0x7f7edc0cded0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed400b330 comp rx=0 tx=0).stop 2023-08-25T04:45:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.142+0000 7f7ee1bff700 1 -- 172.21.15.72:0/3268231364 shutdown_connections 2023-08-25T04:45:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.142+0000 7f7ee1bff700 1 --2- 172.21.15.72:0/3268231364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 0x7f7edc0cded0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.142+0000 7f7ee1bff700 1 --2- 172.21.15.72:0/3268231364 >> v2:172.21.15.137:3300/0 conn(0x7f7edc15ce60 0x7f7edc0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.142+0000 7f7ee1bff700 1 -- 172.21.15.72:0/3268231364 >> 172.21.15.72:0/3268231364 conn(0x7f7edc071e10 msgr2=0x7f7edc072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.142+0000 7f7ee1bff700 1 -- 172.21.15.72:0/3268231364 shutdown_connections 2023-08-25T04:45:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.142+0000 7f7ee1bff700 1 -- 172.21.15.72:0/3268231364 wait complete. 2023-08-25T04:45:59.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.144+0000 7f7ee1bff700 1 Processor -- start 2023-08-25T04:45:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.144+0000 7f7ee1bff700 1 -- start start 2023-08-25T04:45:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7ee1bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0b8770 0x7f7edc15e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7ee1bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 0x7f7edc0c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7ee1bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7edc15ce60 0x7f7edc0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7ee1bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc1f2830 con 0x7f7edc0b8770 2023-08-25T04:45:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7ee1bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc15eb50 con 0x7f7edc15ce60 2023-08-25T04:45:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7ee1bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc15ee30 con 0x7f7edc0cda40 2023-08-25T04:45:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0b8770 0x7f7edc15e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0b8770 0x7f7edc15e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56026/0 (socket says 172.21.15.72:56026) 2023-08-25T04:45:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edb7fe700 1 -- 172.21.15.72:0/1676565462 learned_addr learned my addr 172.21.15.72:0/1676565462 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edbfff700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7edc15ce60 0x7f7edc0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edaffd700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 0x7f7edc0c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edb7fe700 1 -- 172.21.15.72:0/1676565462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 msgr2=0x7f7edc0c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edb7fe700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 0x7f7edc0c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edb7fe700 1 -- 172.21.15.72:0/1676565462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7edc15ce60 msgr2=0x7f7edc0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edb7fe700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7edc15ce60 0x7f7edc0ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edb7fe700 1 -- 172.21.15.72:0/1676565462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009a70 con 0x7f7edc0b8770 2023-08-25T04:45:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.145+0000 7f7edaffd700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 0x7f7edc0c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:45:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.146+0000 7f7edb7fe700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0b8770 0x7f7edc15e320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00e9b0 tx=0x7f7ecc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.146+0000 7f7ec3fff700 1 -- 172.21.15.72:0/1676565462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc009710 con 0x7f7edc0b8770 2023-08-25T04:45:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.146+0000 7f7ec3fff700 1 -- 172.21.15.72:0/1676565462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc00c850 con 0x7f7edc0b8770 2023-08-25T04:45:59.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.146+0000 7f7ee1bff700 1 -- 172.21.15.72:0/1676565462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc15f110 con 0x7f7edc0b8770 2023-08-25T04:45:59.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.146+0000 7f7ec3fff700 1 -- 172.21.15.72:0/1676565462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc00cbc0 con 0x7f7edc0b8770 2023-08-25T04:45:59.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.146+0000 7f7ee1bff700 1 -- 172.21.15.72:0/1676565462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc15f6d0 con 0x7f7edc0b8770 2023-08-25T04:45:59.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.147+0000 7f7ee1bff700 1 -- 172.21.15.72:0/1676565462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc15f890 con 0x7f7edc0b8770 2023-08-25T04:45:59.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.148+0000 7f7ec3fff700 1 -- 172.21.15.72:0/1676565462 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7ecc00cd20 con 0x7f7edc0b8770 2023-08-25T04:45:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.149+0000 7f7ec3fff700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ec806a0e0 0x7f7ec806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.149+0000 7f7ec3fff700 1 -- 172.21.15.72:0/1676565462 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ecc088960 con 0x7f7edc0b8770 2023-08-25T04:45:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.150+0000 7f7edaffd700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ec806a0e0 0x7f7ec806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.150+0000 7f7edaffd700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ec806a0e0 0x7f7ec806c5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0007fd0 tx=0x7f7ed0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.154+0000 7f7ec3fff700 1 -- 172.21.15.72:0/1676565462 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7ecc053cc0 con 0x7f7edc0b8770 2023-08-25T04:45:59.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.343+0000 7f7ee1bff700 1 -- 172.21.15.72:0/1676565462 --> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7edc15efa0 con 0x7f7ec806a0e0 2023-08-25T04:45:59.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.353+0000 7f7ec3fff700 1 -- 172.21.15.72:0/1676565462 <== mgr.4101 v2:172.21.15.72:6832/1377484023 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367582 (secure 0 0 0) 0x7f7edc15efa0 con 0x7f7ec806a0e0 2023-08-25T04:45:59.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:59.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 -- 172.21.15.72:0/1676565462 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ec806a0e0 msgr2=0x7f7ec806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ec806a0e0 0x7f7ec806c5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0007fd0 tx=0x7f7ed0009040 comp rx=0 tx=0).stop 2023-08-25T04:45:59.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 -- 172.21.15.72:0/1676565462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0b8770 msgr2=0x7f7edc15e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0b8770 0x7f7edc15e320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00e9b0 tx=0x7f7ecc00ecc0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 -- 172.21.15.72:0/1676565462 shutdown_connections 2023-08-25T04:45:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ec806a0e0 0x7f7ec806c5a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7edc15ce60 0x7f7edc0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7edc0b8770 0x7f7edc15e320 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 --2- 172.21.15.72:0/1676565462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7edc0cda40 0x7f7edc0c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 -- 172.21.15.72:0/1676565462 >> 172.21.15.72:0/1676565462 conn(0x7f7edc071e10 msgr2=0x7f7edc0b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 -- 172.21.15.72:0/1676565462 shutdown_connections 2023-08-25T04:45:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.358+0000 7f7ee1bff700 1 -- 172.21.15.72:0/1676565462 wait complete. 2023-08-25T04:45:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-25T04:45:59.376 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-08-25T04:45:57.858882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219456,"kb_used_data":3300,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755264,"statfs":{"total":773094113280,"available":772869390336,"internally_reserved":0,"allocated":3379200,"data_stored":2066894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003003"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460126+0000","last_change":"2023-08-25T04:45:33.185383+0000","last_active":"2023-08-25T04:45:38.460126+0000","last_peered":"2023-08-25T04:45:38.460126+0000","last_clean":"2023-08-25T04:45:38.460126+0000","last_became_active":"2023-08-25T04:45:33.184169+0000","last_became_peered":"2023-08-25T04:45:33.184169+0000","last_unstale":"2023-08-25T04:45:38.460126+0000","last_undegraded":"2023-08-25T04:45:38.460126+0000","last_fullsized":"2023-08-25T04:45:38.460126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:42:04.862278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460260+0000","last_change":"2023-08-25T04:45:33.187575+0000","last_active":"2023-08-25T04:45:38.460260+0000","last_peered":"2023-08-25T04:45:38.460260+0000","last_clean":"2023-08-25T04:45:38.460260+0000","last_became_active":"2023-08-25T04:45:33.187289+0000","last_became_peered":"2023-08-25T04:45:33.187289+0000","last_unstale":"2023-08-25T04:45:38.460260+0000","last_undegraded":"2023-08-25T04:45:38.460260+0000","last_fullsized":"2023-08-25T04:45:38.460260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:14.806194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461583+0000","last_change":"2023-08-25T04:45:33.179277+0000","last_active":"2023-08-25T04:45:38.461583+0000","last_peered":"2023-08-25T04:45:38.461583+0000","last_clean":"2023-08-25T04:45:38.461583+0000","last_became_active":"2023-08-25T04:45:33.178903+0000","last_became_peered":"2023-08-25T04:45:33.178903+0000","last_unstale":"2023-08-25T04:45:38.461583+0000","last_undegraded":"2023-08-25T04:45:38.461583+0000","last_fullsized":"2023-08-25T04:45:38.461583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:22:43.697767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652749+0000","last_change":"2023-08-25T04:45:33.187260+0000","last_active":"2023-08-25T04:45:38.652749+0000","last_peered":"2023-08-25T04:45:38.652749+0000","last_clean":"2023-08-25T04:45:38.652749+0000","last_became_active":"2023-08-25T04:45:33.186900+0000","last_became_peered":"2023-08-25T04:45:33.186900+0000","last_unstale":"2023-08-25T04:45:38.652749+0000","last_undegraded":"2023-08-25T04:45:38.652749+0000","last_fullsized":"2023-08-25T04:45:38.652749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:30.486107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845968+0000","last_change":"2023-08-25T04:45:33.184990+0000","last_active":"2023-08-25T04:45:38.845968+0000","last_peered":"2023-08-25T04:45:38.845968+0000","last_clean":"2023-08-25T04:45:38.845968+0000","last_became_active":"2023-08-25T04:45:33.184741+0000","last_became_peered":"2023-08-25T04:45:33.184741+0000","last_unstale":"2023-08-25T04:45:38.845968+0000","last_undegraded":"2023-08-25T04:45:38.845968+0000","last_fullsized":"2023-08-25T04:45:38.845968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:15.434939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461899+0000","last_change":"2023-08-25T04:45:33.182357+0000","last_active":"2023-08-25T04:45:38.461899+0000","last_peered":"2023-08-25T04:45:38.461899+0000","last_clean":"2023-08-25T04:45:38.461899+0000","last_became_active":"2023-08-25T04:45:33.182046+0000","last_became_peered":"2023-08-25T04:45:33.182046+0000","last_unstale":"2023-08-25T04:45:38.461899+0000","last_undegraded":"2023-08-25T04:45:38.461899+0000","last_fullsized":"2023-08-25T04:45:38.461899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:23.439531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475830+0000","last_change":"2023-08-25T04:45:33.188333+0000","last_active":"2023-08-25T04:45:39.475830+0000","last_peered":"2023-08-25T04:45:39.475830+0000","last_clean":"2023-08-25T04:45:39.475830+0000","last_became_active":"2023-08-25T04:45:33.187968+0000","last_became_peered":"2023-08-25T04:45:33.187968+0000","last_unstale":"2023-08-25T04:45:39.475830+0000","last_undegraded":"2023-08-25T04:45:39.475830+0000","last_fullsized":"2023-08-25T04:45:39.475830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:22:29.864512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459977+0000","last_change":"2023-08-25T04:45:33.186253+0000","last_active":"2023-08-25T04:45:38.459977+0000","last_peered":"2023-08-25T04:45:38.459977+0000","last_clean":"2023-08-25T04:45:38.459977+0000","last_became_active":"2023-08-25T04:45:33.185966+0000","last_became_peered":"2023-08-25T04:45:33.185966+0000","last_unstale":"2023-08-25T04:45:38.459977+0000","last_undegraded":"2023-08-25T04:45:38.459977+0000","last_fullsized":"2023-08-25T04:45:38.459977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:10.645818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845570+0000","last_change":"2023-08-25T04:45:33.186028+0000","last_active":"2023-08-25T04:45:38.845570+0000","last_peered":"2023-08-25T04:45:38.845570+0000","last_clean":"2023-08-25T04:45:38.845570+0000","last_became_active":"2023-08-25T04:45:33.185568+0000","last_became_peered":"2023-08-25T04:45:33.185568+0000","last_unstale":"2023-08-25T04:45:38.845570+0000","last_undegraded":"2023-08-25T04:45:38.845570+0000","last_fullsized":"2023-08-25T04:45:38.845570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:05.092316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460526+0000","last_change":"2023-08-25T04:45:33.178499+0000","last_active":"2023-08-25T04:45:38.460526+0000","last_peered":"2023-08-25T04:45:38.460526+0000","last_clean":"2023-08-25T04:45:38.460526+0000","last_became_active":"2023-08-25T04:45:33.178145+0000","last_became_peered":"2023-08-25T04:45:33.178145+0000","last_unstale":"2023-08-25T04:45:38.460526+0000","last_undegraded":"2023-08-25T04:45:38.460526+0000","last_fullsized":"2023-08-25T04:45:38.460526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:50.758247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461421+0000","last_change":"2023-08-25T04:45:33.173857+0000","last_active":"2023-08-25T04:45:38.461421+0000","last_peered":"2023-08-25T04:45:38.461421+0000","last_clean":"2023-08-25T04:45:38.461421+0000","last_became_active":"2023-08-25T04:45:33.173577+0000","last_became_peered":"2023-08-25T04:45:33.173577+0000","last_unstale":"2023-08-25T04:45:38.461421+0000","last_undegraded":"2023-08-25T04:45:38.461421+0000","last_fullsized":"2023-08-25T04:45:38.461421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:45:23.452085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459669+0000","last_change":"2023-08-25T04:45:33.186989+0000","last_active":"2023-08-25T04:45:38.459669+0000","last_peered":"2023-08-25T04:45:38.459669+0000","last_clean":"2023-08-25T04:45:38.459669+0000","last_became_active":"2023-08-25T04:45:33.186701+0000","last_became_peered":"2023-08-25T04:45:33.186701+0000","last_unstale":"2023-08-25T04:45:38.459669+0000","last_undegraded":"2023-08-25T04:45:38.459669+0000","last_fullsized":"2023-08-25T04:45:38.459669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:19.431020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459722+0000","last_change":"2023-08-25T04:45:33.183696+0000","last_active":"2023-08-25T04:45:38.459722+0000","last_peered":"2023-08-25T04:45:38.459722+0000","last_clean":"2023-08-25T04:45:38.459722+0000","last_became_active":"2023-08-25T04:45:33.183381+0000","last_became_peered":"2023-08-25T04:45:33.183381+0000","last_unstale":"2023-08-25T04:45:38.459722+0000","last_undegraded":"2023-08-25T04:45:38.459722+0000","last_fullsized":"2023-08-25T04:45:38.459722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:36.669250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459977+0000","last_change":"2023-08-25T04:45:33.183979+0000","last_active":"2023-08-25T04:45:38.459977+0000","last_peered":"2023-08-25T04:45:38.459977+0000","last_clean":"2023-08-25T04:45:38.459977+0000","last_became_active":"2023-08-25T04:45:33.183700+0000","last_became_peered":"2023-08-25T04:45:33.183700+0000","last_unstale":"2023-08-25T04:45:38.459977+0000","last_undegraded":"2023-08-25T04:45:38.459977+0000","last_fullsized":"2023-08-25T04:45:38.459977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475604+0000","last_change":"2023-08-25T04:45:33.188668+0000","last_active":"2023-08-25T04:45:39.475604+0000","last_peered":"2023-08-25T04:45:39.475604+0000","last_clean":"2023-08-25T04:45:39.475604+0000","last_became_active":"2023-08-25T04:45:33.188447+0000","last_became_peered":"2023-08-25T04:45:33.188447+0000","last_unstale":"2023-08-25T04:45:39.475604+0000","last_undegraded":"2023-08-25T04:45:39.475604+0000","last_fullsized":"2023-08-25T04:45:39.475604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461770+0000","last_change":"2023-08-25T04:45:33.175887+0000","last_active":"2023-08-25T04:45:38.461770+0000","last_peered":"2023-08-25T04:45:38.461770+0000","last_clean":"2023-08-25T04:45:38.461770+0000","last_became_active":"2023-08-25T04:45:33.175585+0000","last_became_peered":"2023-08-25T04:45:33.175585+0000","last_unstale":"2023-08-25T04:45:38.461770+0000","last_undegraded":"2023-08-25T04:45:38.461770+0000","last_fullsized":"2023-08-25T04:45:38.461770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:37.935438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845602+0000","last_change":"2023-08-25T04:45:33.185875+0000","last_active":"2023-08-25T04:45:38.845602+0000","last_peered":"2023-08-25T04:45:38.845602+0000","last_clean":"2023-08-25T04:45:38.845602+0000","last_became_active":"2023-08-25T04:45:33.185200+0000","last_became_peered":"2023-08-25T04:45:33.185200+0000","last_unstale":"2023-08-25T04:45:38.845602+0000","last_undegraded":"2023-08-25T04:45:38.845602+0000","last_fullsized":"2023-08-25T04:45:38.845602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:30.597928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461261+0000","last_change":"2023-08-25T04:45:33.170738+0000","last_active":"2023-08-25T04:45:38.461261+0000","last_peered":"2023-08-25T04:45:38.461261+0000","last_clean":"2023-08-25T04:45:38.461261+0000","last_became_active":"2023-08-25T04:45:33.170445+0000","last_became_peered":"2023-08-25T04:45:33.170445+0000","last_unstale":"2023-08-25T04:45:38.461261+0000","last_undegraded":"2023-08-25T04:45:38.461261+0000","last_fullsized":"2023-08-25T04:45:38.461261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:42:18.697261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459973+0000","last_change":"2023-08-25T04:45:33.189985+0000","last_active":"2023-08-25T04:45:38.459973+0000","last_peered":"2023-08-25T04:45:38.459973+0000","last_clean":"2023-08-25T04:45:38.459973+0000","last_became_active":"2023-08-25T04:45:33.189741+0000","last_became_peered":"2023-08-25T04:45:33.189741+0000","last_unstale":"2023-08-25T04:45:38.459973+0000","last_undegraded":"2023-08-25T04:45:38.459973+0000","last_fullsized":"2023-08-25T04:45:38.459973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:54:14.813343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.462063+0000","last_change":"2023-08-25T04:45:33.190893+0000","last_active":"2023-08-25T04:45:38.462063+0000","last_peered":"2023-08-25T04:45:38.462063+0000","last_clean":"2023-08-25T04:45:38.462063+0000","last_became_active":"2023-08-25T04:45:33.190613+0000","last_became_peered":"2023-08-25T04:45:33.190613+0000","last_unstale":"2023-08-25T04:45:38.462063+0000","last_undegraded":"2023-08-25T04:45:38.462063+0000","last_fullsized":"2023-08-25T04:45:38.462063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:30:18.502488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476050+0000","last_change":"2023-08-25T04:45:33.184588+0000","last_active":"2023-08-25T04:45:39.476050+0000","last_peered":"2023-08-25T04:45:39.476050+0000","last_clean":"2023-08-25T04:45:39.476050+0000","last_became_active":"2023-08-25T04:45:33.184240+0000","last_became_peered":"2023-08-25T04:45:33.184240+0000","last_unstale":"2023-08-25T04:45:39.476050+0000","last_undegraded":"2023-08-25T04:45:39.476050+0000","last_fullsized":"2023-08-25T04:45:39.476050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:00.135600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845427+0000","last_change":"2023-08-25T04:45:33.187776+0000","last_active":"2023-08-25T04:45:38.845427+0000","last_peered":"2023-08-25T04:45:38.845427+0000","last_clean":"2023-08-25T04:45:38.845427+0000","last_became_active":"2023-08-25T04:45:33.187529+0000","last_became_peered":"2023-08-25T04:45:33.187529+0000","last_unstale":"2023-08-25T04:45:38.845427+0000","last_undegraded":"2023-08-25T04:45:38.845427+0000","last_fullsized":"2023-08-25T04:45:38.845427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475970+0000","last_change":"2023-08-25T04:45:33.182244+0000","last_active":"2023-08-25T04:45:39.475970+0000","last_peered":"2023-08-25T04:45:39.475970+0000","last_clean":"2023-08-25T04:45:39.475970+0000","last_became_active":"2023-08-25T04:45:33.181940+0000","last_became_peered":"2023-08-25T04:45:33.181940+0000","last_unstale":"2023-08-25T04:45:39.475970+0000","last_undegraded":"2023-08-25T04:45:39.475970+0000","last_fullsized":"2023-08-25T04:45:39.475970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:02.627838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475607+0000","last_change":"2023-08-25T04:45:33.184900+0000","last_active":"2023-08-25T04:45:39.475607+0000","last_peered":"2023-08-25T04:45:39.475607+0000","last_clean":"2023-08-25T04:45:39.475607+0000","last_became_active":"2023-08-25T04:45:33.184589+0000","last_became_peered":"2023-08-25T04:45:33.184589+0000","last_unstale":"2023-08-25T04:45:39.475607+0000","last_undegraded":"2023-08-25T04:45:39.475607+0000","last_fullsized":"2023-08-25T04:45:39.475607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:17:10.410580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122553+0000","last_change":"2023-08-25T04:45:33.191724+0000","last_active":"2023-08-25T04:45:39.122553+0000","last_peered":"2023-08-25T04:45:39.122553+0000","last_clean":"2023-08-25T04:45:39.122553+0000","last_became_active":"2023-08-25T04:45:33.191388+0000","last_became_peered":"2023-08-25T04:45:33.191388+0000","last_unstale":"2023-08-25T04:45:39.122553+0000","last_undegraded":"2023-08-25T04:45:39.122553+0000","last_fullsized":"2023-08-25T04:45:39.122553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122544+0000","last_change":"2023-08-25T04:45:33.168956+0000","last_active":"2023-08-25T04:45:39.122544+0000","last_peered":"2023-08-25T04:45:39.122544+0000","last_clean":"2023-08-25T04:45:39.122544+0000","last_became_active":"2023-08-25T04:45:33.168694+0000","last_became_peered":"2023-08-25T04:45:33.168694+0000","last_unstale":"2023-08-25T04:45:39.122544+0000","last_undegraded":"2023-08-25T04:45:39.122544+0000","last_fullsized":"2023-08-25T04:45:39.122544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:50.406447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460744+0000","last_change":"2023-08-25T04:45:33.185807+0000","last_active":"2023-08-25T04:45:38.460744+0000","last_peered":"2023-08-25T04:45:38.460744+0000","last_clean":"2023-08-25T04:45:38.460744+0000","last_became_active":"2023-08-25T04:45:33.185511+0000","last_became_peered":"2023-08-25T04:45:33.185511+0000","last_unstale":"2023-08-25T04:45:38.460744+0000","last_undegraded":"2023-08-25T04:45:38.460744+0000","last_fullsized":"2023-08-25T04:45:38.460744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.462370+0000","last_change":"2023-08-25T04:45:37.484174+0000","last_active":"2023-08-25T04:45:38.462370+0000","last_peered":"2023-08-25T04:45:38.462370+0000","last_clean":"2023-08-25T04:45:38.462370+0000","last_became_active":"2023-08-25T04:45:37.483785+0000","last_became_peered":"2023-08-25T04:45:37.483785+0000","last_unstale":"2023-08-25T04:45:38.462370+0000","last_undegraded":"2023-08-25T04:45:38.462370+0000","last_fullsized":"2023-08-25T04:45:38.462370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:09.116862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461690+0000","last_change":"2023-08-25T04:45:32.241316+0000","last_active":"2023-08-25T04:45:38.461690+0000","last_peered":"2023-08-25T04:45:38.461690+0000","last_clean":"2023-08-25T04:45:38.461690+0000","last_became_active":"2023-08-25T04:45:32.235835+0000","last_became_peered":"2023-08-25T04:45:32.235835+0000","last_unstale":"2023-08-25T04:45:38.461690+0000","last_undegraded":"2023-08-25T04:45:38.461690+0000","last_fullsized":"2023-08-25T04:45:38.461690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:23:28.852339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475699+0000","last_change":"2023-08-25T04:45:33.191163+0000","last_active":"2023-08-25T04:45:39.475699+0000","last_peered":"2023-08-25T04:45:39.475699+0000","last_clean":"2023-08-25T04:45:39.475699+0000","last_became_active":"2023-08-25T04:45:33.190820+0000","last_became_peered":"2023-08-25T04:45:33.190820+0000","last_unstale":"2023-08-25T04:45:39.475699+0000","last_undegraded":"2023-08-25T04:45:39.475699+0000","last_fullsized":"2023-08-25T04:45:39.475699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:47:58.777265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653134+0000","last_change":"2023-08-25T04:45:37.480700+0000","last_active":"2023-08-25T04:45:38.653134+0000","last_peered":"2023-08-25T04:45:38.653134+0000","last_clean":"2023-08-25T04:45:38.653134+0000","last_became_active":"2023-08-25T04:45:37.480204+0000","last_became_peered":"2023-08-25T04:45:37.480204+0000","last_unstale":"2023-08-25T04:45:38.653134+0000","last_undegraded":"2023-08-25T04:45:38.653134+0000","last_fullsized":"2023-08-25T04:45:38.653134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:59.030524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121571+0000","last_change":"2023-08-25T04:45:32.228380+0000","last_active":"2023-08-25T04:45:39.121571+0000","last_peered":"2023-08-25T04:45:39.121571+0000","last_clean":"2023-08-25T04:45:39.121571+0000","last_became_active":"2023-08-25T04:45:32.228067+0000","last_became_peered":"2023-08-25T04:45:32.228067+0000","last_unstale":"2023-08-25T04:45:39.121571+0000","last_undegraded":"2023-08-25T04:45:39.121571+0000","last_fullsized":"2023-08-25T04:45:39.121571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:52.789398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845784+0000","last_change":"2023-08-25T04:45:33.194235+0000","last_active":"2023-08-25T04:45:38.845784+0000","last_peered":"2023-08-25T04:45:38.845784+0000","last_clean":"2023-08-25T04:45:38.845784+0000","last_became_active":"2023-08-25T04:45:33.193947+0000","last_became_peered":"2023-08-25T04:45:33.193947+0000","last_unstale":"2023-08-25T04:45:38.845784+0000","last_undegraded":"2023-08-25T04:45:38.845784+0000","last_fullsized":"2023-08-25T04:45:38.845784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845934+0000","last_change":"2023-08-25T04:45:37.488780+0000","last_active":"2023-08-25T04:45:38.845934+0000","last_peered":"2023-08-25T04:45:38.845934+0000","last_clean":"2023-08-25T04:45:38.845934+0000","last_became_active":"2023-08-25T04:45:37.488413+0000","last_became_peered":"2023-08-25T04:45:37.488413+0000","last_unstale":"2023-08-25T04:45:38.845934+0000","last_undegraded":"2023-08-25T04:45:38.845934+0000","last_fullsized":"2023-08-25T04:45:38.845934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:38.928881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475447+0000","last_change":"2023-08-25T04:45:32.235379+0000","last_active":"2023-08-25T04:45:39.475447+0000","last_peered":"2023-08-25T04:45:39.475447+0000","last_clean":"2023-08-25T04:45:39.475447+0000","last_became_active":"2023-08-25T04:45:32.235070+0000","last_became_peered":"2023-08-25T04:45:32.235070+0000","last_unstale":"2023-08-25T04:45:39.475447+0000","last_undegraded":"2023-08-25T04:45:39.475447+0000","last_fullsized":"2023-08-25T04:45:39.475447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:34:26.267011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653235+0000","last_change":"2023-08-25T04:45:33.181190+0000","last_active":"2023-08-25T04:45:38.653235+0000","last_peered":"2023-08-25T04:45:38.653235+0000","last_clean":"2023-08-25T04:45:38.653235+0000","last_became_active":"2023-08-25T04:45:33.180891+0000","last_became_peered":"2023-08-25T04:45:33.180891+0000","last_unstale":"2023-08-25T04:45:38.653235+0000","last_undegraded":"2023-08-25T04:45:38.653235+0000","last_fullsized":"2023-08-25T04:45:38.653235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:16.907159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652536+0000","last_change":"2023-08-25T04:45:37.480980+0000","last_active":"2023-08-25T04:45:38.652536+0000","last_peered":"2023-08-25T04:45:38.652536+0000","last_clean":"2023-08-25T04:45:38.652536+0000","last_became_active":"2023-08-25T04:45:37.480357+0000","last_became_peered":"2023-08-25T04:45:37.480357+0000","last_unstale":"2023-08-25T04:45:38.652536+0000","last_undegraded":"2023-08-25T04:45:38.652536+0000","last_fullsized":"2023-08-25T04:45:38.652536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:01.442164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845694+0000","last_change":"2023-08-25T04:45:32.242639+0000","last_active":"2023-08-25T04:45:38.845694+0000","last_peered":"2023-08-25T04:45:38.845694+0000","last_clean":"2023-08-25T04:45:38.845694+0000","last_became_active":"2023-08-25T04:45:32.242393+0000","last_became_peered":"2023-08-25T04:45:32.242393+0000","last_unstale":"2023-08-25T04:45:38.845694+0000","last_undegraded":"2023-08-25T04:45:38.845694+0000","last_fullsized":"2023-08-25T04:45:38.845694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:29.089180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475389+0000","last_change":"2023-08-25T04:45:33.190455+0000","last_active":"2023-08-25T04:45:39.475389+0000","last_peered":"2023-08-25T04:45:39.475389+0000","last_clean":"2023-08-25T04:45:39.475389+0000","last_became_active":"2023-08-25T04:45:33.190204+0000","last_became_peered":"2023-08-25T04:45:33.190204+0000","last_unstale":"2023-08-25T04:45:39.475389+0000","last_undegraded":"2023-08-25T04:45:39.475389+0000","last_fullsized":"2023-08-25T04:45:39.475389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:41.739700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475477+0000","last_change":"2023-08-25T04:45:37.495023+0000","last_active":"2023-08-25T04:45:39.475477+0000","last_peered":"2023-08-25T04:45:39.475477+0000","last_clean":"2023-08-25T04:45:39.475477+0000","last_became_active":"2023-08-25T04:45:37.494694+0000","last_became_peered":"2023-08-25T04:45:37.494694+0000","last_unstale":"2023-08-25T04:45:39.475477+0000","last_undegraded":"2023-08-25T04:45:39.475477+0000","last_fullsized":"2023-08-25T04:45:39.475477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:34.327962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460645+0000","last_change":"2023-08-25T04:45:32.239824+0000","last_active":"2023-08-25T04:45:38.460645+0000","last_peered":"2023-08-25T04:45:38.460645+0000","last_clean":"2023-08-25T04:45:38.460645+0000","last_became_active":"2023-08-25T04:45:32.239533+0000","last_became_peered":"2023-08-25T04:45:32.239533+0000","last_unstale":"2023-08-25T04:45:38.460645+0000","last_undegraded":"2023-08-25T04:45:38.460645+0000","last_fullsized":"2023-08-25T04:45:38.460645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:50.517646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475245+0000","last_change":"2023-08-25T04:45:33.178438+0000","last_active":"2023-08-25T04:45:39.475245+0000","last_peered":"2023-08-25T04:45:39.475245+0000","last_clean":"2023-08-25T04:45:39.475245+0000","last_became_active":"2023-08-25T04:45:33.178111+0000","last_became_peered":"2023-08-25T04:45:33.178111+0000","last_unstale":"2023-08-25T04:45:39.475245+0000","last_undegraded":"2023-08-25T04:45:39.475245+0000","last_fullsized":"2023-08-25T04:45:39.475245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:18.567030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476115+0000","last_change":"2023-08-25T04:45:37.491477+0000","last_active":"2023-08-25T04:45:39.476115+0000","last_peered":"2023-08-25T04:45:39.476115+0000","last_clean":"2023-08-25T04:45:39.476115+0000","last_became_active":"2023-08-25T04:45:37.491133+0000","last_became_peered":"2023-08-25T04:45:37.491133+0000","last_unstale":"2023-08-25T04:45:39.476115+0000","last_undegraded":"2023-08-25T04:45:39.476115+0000","last_fullsized":"2023-08-25T04:45:39.476115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:43.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476334+0000","last_change":"2023-08-25T04:45:32.236418+0000","last_active":"2023-08-25T04:45:39.476334+0000","last_peered":"2023-08-25T04:45:39.476334+0000","last_clean":"2023-08-25T04:45:39.476334+0000","last_became_active":"2023-08-25T04:45:32.236098+0000","last_became_peered":"2023-08-25T04:45:32.236098+0000","last_unstale":"2023-08-25T04:45:39.476334+0000","last_undegraded":"2023-08-25T04:45:39.476334+0000","last_fullsized":"2023-08-25T04:45:39.476334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:20.718480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121637+0000","last_change":"2023-08-25T04:45:33.189838+0000","last_active":"2023-08-25T04:45:39.121637+0000","last_peered":"2023-08-25T04:45:39.121637+0000","last_clean":"2023-08-25T04:45:39.121637+0000","last_became_active":"2023-08-25T04:45:33.189477+0000","last_became_peered":"2023-08-25T04:45:33.189477+0000","last_unstale":"2023-08-25T04:45:39.121637+0000","last_undegraded":"2023-08-25T04:45:39.121637+0000","last_fullsized":"2023-08-25T04:45:39.121637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:55.379189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121928+0000","last_change":"2023-08-25T04:45:37.481651+0000","last_active":"2023-08-25T04:45:39.121928+0000","last_peered":"2023-08-25T04:45:39.121928+0000","last_clean":"2023-08-25T04:45:39.121928+0000","last_became_active":"2023-08-25T04:45:37.481302+0000","last_became_peered":"2023-08-25T04:45:37.481302+0000","last_unstale":"2023-08-25T04:45:39.121928+0000","last_undegraded":"2023-08-25T04:45:39.121928+0000","last_fullsized":"2023-08-25T04:45:39.121928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:35.137823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.635942+0000","last_change":"2023-08-25T04:45:32.239434+0000","last_active":"2023-08-25T04:45:48.635942+0000","last_peered":"2023-08-25T04:45:48.635942+0000","last_clean":"2023-08-25T04:45:48.635942+0000","last_became_active":"2023-08-25T04:45:32.239151+0000","last_became_peered":"2023-08-25T04:45:32.239151+0000","last_unstale":"2023-08-25T04:45:48.635942+0000","last_undegraded":"2023-08-25T04:45:48.635942+0000","last_fullsized":"2023-08-25T04:45:48.635942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:58.197133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461057+0000","last_change":"2023-08-25T04:45:33.180869+0000","last_active":"2023-08-25T04:45:38.461057+0000","last_peered":"2023-08-25T04:45:38.461057+0000","last_clean":"2023-08-25T04:45:38.461057+0000","last_became_active":"2023-08-25T04:45:33.180505+0000","last_became_peered":"2023-08-25T04:45:33.180505+0000","last_unstale":"2023-08-25T04:45:38.461057+0000","last_undegraded":"2023-08-25T04:45:38.461057+0000","last_fullsized":"2023-08-25T04:45:38.461057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:35:18.068007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461020+0000","last_change":"2023-08-25T04:45:37.486816+0000","last_active":"2023-08-25T04:45:38.461020+0000","last_peered":"2023-08-25T04:45:38.461020+0000","last_clean":"2023-08-25T04:45:38.461020+0000","last_became_active":"2023-08-25T04:45:37.486420+0000","last_became_peered":"2023-08-25T04:45:37.486420+0000","last_unstale":"2023-08-25T04:45:38.461020+0000","last_undegraded":"2023-08-25T04:45:38.461020+0000","last_fullsized":"2023-08-25T04:45:38.461020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:44.168940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475889+0000","last_change":"2023-08-25T04:45:32.238252+0000","last_active":"2023-08-25T04:45:39.475889+0000","last_peered":"2023-08-25T04:45:39.475889+0000","last_clean":"2023-08-25T04:45:39.475889+0000","last_became_active":"2023-08-25T04:45:32.237891+0000","last_became_peered":"2023-08-25T04:45:32.237891+0000","last_unstale":"2023-08-25T04:45:39.475889+0000","last_undegraded":"2023-08-25T04:45:39.475889+0000","last_fullsized":"2023-08-25T04:45:39.475889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:14.432494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475538+0000","last_change":"2023-08-25T04:45:33.191207+0000","last_active":"2023-08-25T04:45:39.475538+0000","last_peered":"2023-08-25T04:45:39.475538+0000","last_clean":"2023-08-25T04:45:39.475538+0000","last_became_active":"2023-08-25T04:45:33.190881+0000","last_became_peered":"2023-08-25T04:45:33.190881+0000","last_unstale":"2023-08-25T04:45:39.475538+0000","last_undegraded":"2023-08-25T04:45:39.475538+0000","last_fullsized":"2023-08-25T04:45:39.475538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:34.898702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475931+0000","last_change":"2023-08-25T04:45:37.481672+0000","last_active":"2023-08-25T04:45:39.475931+0000","last_peered":"2023-08-25T04:45:39.475931+0000","last_clean":"2023-08-25T04:45:39.475931+0000","last_became_active":"2023-08-25T04:45:37.481257+0000","last_became_peered":"2023-08-25T04:45:37.481257+0000","last_unstale":"2023-08-25T04:45:39.475931+0000","last_undegraded":"2023-08-25T04:45:39.475931+0000","last_fullsized":"2023-08-25T04:45:39.475931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:54:14.466417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845469+0000","last_change":"2023-08-25T04:45:32.239060+0000","last_active":"2023-08-25T04:45:38.845469+0000","last_peered":"2023-08-25T04:45:38.845469+0000","last_clean":"2023-08-25T04:45:38.845469+0000","last_became_active":"2023-08-25T04:45:32.237855+0000","last_became_peered":"2023-08-25T04:45:32.237855+0000","last_unstale":"2023-08-25T04:45:38.845469+0000","last_undegraded":"2023-08-25T04:45:38.845469+0000","last_fullsized":"2023-08-25T04:45:38.845469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:22.321053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460613+0000","last_change":"2023-08-25T04:45:33.179488+0000","last_active":"2023-08-25T04:45:38.460613+0000","last_peered":"2023-08-25T04:45:38.460613+0000","last_clean":"2023-08-25T04:45:38.460613+0000","last_became_active":"2023-08-25T04:45:33.179179+0000","last_became_peered":"2023-08-25T04:45:33.179179+0000","last_unstale":"2023-08-25T04:45:38.460613+0000","last_undegraded":"2023-08-25T04:45:38.460613+0000","last_fullsized":"2023-08-25T04:45:38.460613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:30.091625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476139+0000","last_change":"2023-08-25T04:45:37.490744+0000","last_active":"2023-08-25T04:45:39.476139+0000","last_peered":"2023-08-25T04:45:39.476139+0000","last_clean":"2023-08-25T04:45:39.476139+0000","last_became_active":"2023-08-25T04:45:37.490339+0000","last_became_peered":"2023-08-25T04:45:37.490339+0000","last_unstale":"2023-08-25T04:45:39.476139+0000","last_undegraded":"2023-08-25T04:45:39.476139+0000","last_fullsized":"2023-08-25T04:45:39.476139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:12.857847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475618+0000","last_change":"2023-08-25T04:45:32.237744+0000","last_active":"2023-08-25T04:45:39.475618+0000","last_peered":"2023-08-25T04:45:39.475618+0000","last_clean":"2023-08-25T04:45:39.475618+0000","last_became_active":"2023-08-25T04:45:32.237386+0000","last_became_peered":"2023-08-25T04:45:32.237386+0000","last_unstale":"2023-08-25T04:45:39.475618+0000","last_undegraded":"2023-08-25T04:45:39.475618+0000","last_fullsized":"2023-08-25T04:45:39.475618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:50.517646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.846029+0000","last_change":"2023-08-25T04:45:33.184947+0000","last_active":"2023-08-25T04:45:38.846029+0000","last_peered":"2023-08-25T04:45:38.846029+0000","last_clean":"2023-08-25T04:45:38.846029+0000","last_became_active":"2023-08-25T04:45:33.184665+0000","last_became_peered":"2023-08-25T04:45:33.184665+0000","last_unstale":"2023-08-25T04:45:38.846029+0000","last_undegraded":"2023-08-25T04:45:38.846029+0000","last_fullsized":"2023-08-25T04:45:38.846029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:00.135600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460244+0000","last_change":"2023-08-25T04:45:37.478006+0000","last_active":"2023-08-25T04:45:38.460244+0000","last_peered":"2023-08-25T04:45:38.460244+0000","last_clean":"2023-08-25T04:45:38.460244+0000","last_became_active":"2023-08-25T04:45:37.477688+0000","last_became_peered":"2023-08-25T04:45:37.477688+0000","last_unstale":"2023-08-25T04:45:38.460244+0000","last_undegraded":"2023-08-25T04:45:38.460244+0000","last_fullsized":"2023-08-25T04:45:38.460244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:50.054137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652522+0000","last_change":"2023-08-25T04:45:32.239091+0000","last_active":"2023-08-25T04:45:38.652522+0000","last_peered":"2023-08-25T04:45:38.652522+0000","last_clean":"2023-08-25T04:45:38.652522+0000","last_became_active":"2023-08-25T04:45:32.238782+0000","last_became_peered":"2023-08-25T04:45:32.238782+0000","last_unstale":"2023-08-25T04:45:38.652522+0000","last_undegraded":"2023-08-25T04:45:38.652522+0000","last_fullsized":"2023-08-25T04:45:38.652522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:42.259140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476306+0000","last_change":"2023-08-25T04:45:33.181564+0000","last_active":"2023-08-25T04:45:39.476306+0000","last_peered":"2023-08-25T04:45:39.476306+0000","last_clean":"2023-08-25T04:45:39.476306+0000","last_became_active":"2023-08-25T04:45:33.181312+0000","last_became_peered":"2023-08-25T04:45:33.181312+0000","last_unstale":"2023-08-25T04:45:39.476306+0000","last_undegraded":"2023-08-25T04:45:39.476306+0000","last_fullsized":"2023-08-25T04:45:39.476306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:37.480877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476370+0000","last_change":"2023-08-25T04:45:37.488909+0000","last_active":"2023-08-25T04:45:39.476370+0000","last_peered":"2023-08-25T04:45:39.476370+0000","last_clean":"2023-08-25T04:45:39.476370+0000","last_became_active":"2023-08-25T04:45:37.488338+0000","last_became_peered":"2023-08-25T04:45:37.488338+0000","last_unstale":"2023-08-25T04:45:39.476370+0000","last_undegraded":"2023-08-25T04:45:39.476370+0000","last_fullsized":"2023-08-25T04:45:39.476370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:30.680527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476509+0000","last_change":"2023-08-25T04:45:32.237964+0000","last_active":"2023-08-25T04:45:39.476509+0000","last_peered":"2023-08-25T04:45:39.476509+0000","last_clean":"2023-08-25T04:45:39.476509+0000","last_became_active":"2023-08-25T04:45:32.237542+0000","last_became_peered":"2023-08-25T04:45:32.237542+0000","last_unstale":"2023-08-25T04:45:39.476509+0000","last_undegraded":"2023-08-25T04:45:39.476509+0000","last_fullsized":"2023-08-25T04:45:39.476509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:31:55.456937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459530+0000","last_change":"2023-08-25T04:45:33.192515+0000","last_active":"2023-08-25T04:45:38.459530+0000","last_peered":"2023-08-25T04:45:38.459530+0000","last_clean":"2023-08-25T04:45:38.459530+0000","last_became_active":"2023-08-25T04:45:33.192143+0000","last_became_peered":"2023-08-25T04:45:33.192143+0000","last_unstale":"2023-08-25T04:45:38.459530+0000","last_undegraded":"2023-08-25T04:45:38.459530+0000","last_fullsized":"2023-08-25T04:45:38.459530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:30.901486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459477+0000","last_change":"2023-08-25T04:45:37.488063+0000","last_active":"2023-08-25T04:45:38.459477+0000","last_peered":"2023-08-25T04:45:38.459477+0000","last_clean":"2023-08-25T04:45:38.459477+0000","last_became_active":"2023-08-25T04:45:37.487757+0000","last_became_peered":"2023-08-25T04:45:37.487757+0000","last_unstale":"2023-08-25T04:45:38.459477+0000","last_undegraded":"2023-08-25T04:45:38.459477+0000","last_fullsized":"2023-08-25T04:45:38.459477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:09.769950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476402+0000","last_change":"2023-08-25T04:45:32.237033+0000","last_active":"2023-08-25T04:45:39.476402+0000","last_peered":"2023-08-25T04:45:39.476402+0000","last_clean":"2023-08-25T04:45:39.476402+0000","last_became_active":"2023-08-25T04:45:32.236722+0000","last_became_peered":"2023-08-25T04:45:32.236722+0000","last_unstale":"2023-08-25T04:45:39.476402+0000","last_undegraded":"2023-08-25T04:45:39.476402+0000","last_fullsized":"2023-08-25T04:45:39.476402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:40.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461087+0000","last_change":"2023-08-25T04:45:33.173339+0000","last_active":"2023-08-25T04:45:38.461087+0000","last_peered":"2023-08-25T04:45:38.461087+0000","last_clean":"2023-08-25T04:45:38.461087+0000","last_became_active":"2023-08-25T04:45:33.173001+0000","last_became_peered":"2023-08-25T04:45:33.173001+0000","last_unstale":"2023-08-25T04:45:38.461087+0000","last_undegraded":"2023-08-25T04:45:38.461087+0000","last_fullsized":"2023-08-25T04:45:38.461087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:40.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459839+0000","last_change":"2023-08-25T04:45:37.492765+0000","last_active":"2023-08-25T04:45:38.459839+0000","last_peered":"2023-08-25T04:45:38.459839+0000","last_clean":"2023-08-25T04:45:38.459839+0000","last_became_active":"2023-08-25T04:45:37.492429+0000","last_became_peered":"2023-08-25T04:45:37.492429+0000","last_unstale":"2023-08-25T04:45:38.459839+0000","last_undegraded":"2023-08-25T04:45:38.459839+0000","last_fullsized":"2023-08-25T04:45:38.459839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:19:28.095175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476148+0000","last_change":"2023-08-25T04:45:32.240462+0000","last_active":"2023-08-25T04:45:39.476148+0000","last_peered":"2023-08-25T04:45:39.476148+0000","last_clean":"2023-08-25T04:45:39.476148+0000","last_became_active":"2023-08-25T04:45:32.240196+0000","last_became_peered":"2023-08-25T04:45:32.240196+0000","last_unstale":"2023-08-25T04:45:39.476148+0000","last_undegraded":"2023-08-25T04:45:39.476148+0000","last_fullsized":"2023-08-25T04:45:39.476148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:17.564585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652550+0000","last_change":"2023-08-25T04:45:33.193608+0000","last_active":"2023-08-25T04:45:38.652550+0000","last_peered":"2023-08-25T04:45:38.652550+0000","last_clean":"2023-08-25T04:45:38.652550+0000","last_became_active":"2023-08-25T04:45:33.193118+0000","last_became_peered":"2023-08-25T04:45:33.193118+0000","last_unstale":"2023-08-25T04:45:38.652550+0000","last_undegraded":"2023-08-25T04:45:38.652550+0000","last_fullsized":"2023-08-25T04:45:38.652550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:32.968362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459765+0000","last_change":"2023-08-25T04:45:37.476345+0000","last_active":"2023-08-25T04:45:38.459765+0000","last_peered":"2023-08-25T04:45:38.459765+0000","last_clean":"2023-08-25T04:45:38.459765+0000","last_became_active":"2023-08-25T04:45:37.475874+0000","last_became_peered":"2023-08-25T04:45:37.475874+0000","last_unstale":"2023-08-25T04:45:38.459765+0000","last_undegraded":"2023-08-25T04:45:38.459765+0000","last_fullsized":"2023-08-25T04:45:38.459765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:00:54.571481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460487+0000","last_change":"2023-08-25T04:45:32.233694+0000","last_active":"2023-08-25T04:45:38.460487+0000","last_peered":"2023-08-25T04:45:38.460487+0000","last_clean":"2023-08-25T04:45:38.460487+0000","last_became_active":"2023-08-25T04:45:32.233412+0000","last_became_peered":"2023-08-25T04:45:32.233412+0000","last_unstale":"2023-08-25T04:45:38.460487+0000","last_undegraded":"2023-08-25T04:45:38.460487+0000","last_fullsized":"2023-08-25T04:45:38.460487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:29.595483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845836+0000","last_change":"2023-08-25T04:45:33.186227+0000","last_active":"2023-08-25T04:45:38.845836+0000","last_peered":"2023-08-25T04:45:38.845836+0000","last_clean":"2023-08-25T04:45:38.845836+0000","last_became_active":"2023-08-25T04:45:33.185317+0000","last_became_peered":"2023-08-25T04:45:33.185317+0000","last_unstale":"2023-08-25T04:45:38.845836+0000","last_undegraded":"2023-08-25T04:45:38.845836+0000","last_fullsized":"2023-08-25T04:45:38.845836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:39.932603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459653+0000","last_change":"2023-08-25T04:45:37.481516+0000","last_active":"2023-08-25T04:45:38.459653+0000","last_peered":"2023-08-25T04:45:38.459653+0000","last_clean":"2023-08-25T04:45:38.459653+0000","last_became_active":"2023-08-25T04:45:37.481121+0000","last_became_peered":"2023-08-25T04:45:37.481121+0000","last_unstale":"2023-08-25T04:45:38.459653+0000","last_undegraded":"2023-08-25T04:45:38.459653+0000","last_fullsized":"2023-08-25T04:45:38.459653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:26:41.512610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475607+0000","last_change":"2023-08-25T04:45:32.238750+0000","last_active":"2023-08-25T04:45:39.475607+0000","last_peered":"2023-08-25T04:45:39.475607+0000","last_clean":"2023-08-25T04:45:39.475607+0000","last_became_active":"2023-08-25T04:45:32.238446+0000","last_became_peered":"2023-08-25T04:45:32.238446+0000","last_unstale":"2023-08-25T04:45:39.475607+0000","last_undegraded":"2023-08-25T04:45:39.475607+0000","last_fullsized":"2023-08-25T04:45:39.475607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:09.729389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461964+0000","last_change":"2023-08-25T04:45:33.181796+0000","last_active":"2023-08-25T04:45:38.461964+0000","last_peered":"2023-08-25T04:45:38.461964+0000","last_clean":"2023-08-25T04:45:38.461964+0000","last_became_active":"2023-08-25T04:45:33.180064+0000","last_became_peered":"2023-08-25T04:45:33.180064+0000","last_unstale":"2023-08-25T04:45:38.461964+0000","last_undegraded":"2023-08-25T04:45:38.461964+0000","last_fullsized":"2023-08-25T04:45:38.461964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:00:02.188322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122491+0000","last_change":"2023-08-25T04:45:37.483736+0000","last_active":"2023-08-25T04:45:39.122491+0000","last_peered":"2023-08-25T04:45:39.122491+0000","last_clean":"2023-08-25T04:45:39.122491+0000","last_became_active":"2023-08-25T04:45:37.483361+0000","last_became_peered":"2023-08-25T04:45:37.483361+0000","last_unstale":"2023-08-25T04:45:39.122491+0000","last_undegraded":"2023-08-25T04:45:39.122491+0000","last_fullsized":"2023-08-25T04:45:39.122491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:19.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652579+0000","last_change":"2023-08-25T04:45:32.238540+0000","last_active":"2023-08-25T04:45:38.652579+0000","last_peered":"2023-08-25T04:45:38.652579+0000","last_clean":"2023-08-25T04:45:38.652579+0000","last_became_active":"2023-08-25T04:45:32.238265+0000","last_became_peered":"2023-08-25T04:45:32.238265+0000","last_unstale":"2023-08-25T04:45:38.652579+0000","last_undegraded":"2023-08-25T04:45:38.652579+0000","last_fullsized":"2023-08-25T04:45:38.652579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:29:01.273137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460742+0000","last_change":"2023-08-25T04:45:33.184042+0000","last_active":"2023-08-25T04:45:38.460742+0000","last_peered":"2023-08-25T04:45:38.460742+0000","last_clean":"2023-08-25T04:45:38.460742+0000","last_became_active":"2023-08-25T04:45:33.183680+0000","last_became_peered":"2023-08-25T04:45:33.183680+0000","last_unstale":"2023-08-25T04:45:38.460742+0000","last_undegraded":"2023-08-25T04:45:38.460742+0000","last_fullsized":"2023-08-25T04:45:38.460742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:39.595770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460726+0000","last_change":"2023-08-25T04:45:37.476840+0000","last_active":"2023-08-25T04:45:38.460726+0000","last_peered":"2023-08-25T04:45:38.460726+0000","last_clean":"2023-08-25T04:45:38.460726+0000","last_became_active":"2023-08-25T04:45:37.476291+0000","last_became_peered":"2023-08-25T04:45:37.476291+0000","last_unstale":"2023-08-25T04:45:38.460726+0000","last_undegraded":"2023-08-25T04:45:38.460726+0000","last_fullsized":"2023-08-25T04:45:38.460726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:45.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460720+0000","last_change":"2023-08-25T04:45:32.235065+0000","last_active":"2023-08-25T04:45:38.460720+0000","last_peered":"2023-08-25T04:45:38.460720+0000","last_clean":"2023-08-25T04:45:38.460720+0000","last_became_active":"2023-08-25T04:45:32.234777+0000","last_became_peered":"2023-08-25T04:45:32.234777+0000","last_unstale":"2023-08-25T04:45:38.460720+0000","last_undegraded":"2023-08-25T04:45:38.460720+0000","last_fullsized":"2023-08-25T04:45:38.460720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:01.625394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461475+0000","last_change":"2023-08-25T04:45:33.179314+0000","last_active":"2023-08-25T04:45:38.461475+0000","last_peered":"2023-08-25T04:45:38.461475+0000","last_clean":"2023-08-25T04:45:38.461475+0000","last_became_active":"2023-08-25T04:45:33.178995+0000","last_became_peered":"2023-08-25T04:45:33.178995+0000","last_unstale":"2023-08-25T04:45:38.461475+0000","last_undegraded":"2023-08-25T04:45:38.461475+0000","last_fullsized":"2023-08-25T04:45:38.461475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:48:01.925682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461005+0000","last_change":"2023-08-25T04:45:37.490254+0000","last_active":"2023-08-25T04:45:38.461005+0000","last_peered":"2023-08-25T04:45:38.461005+0000","last_clean":"2023-08-25T04:45:38.461005+0000","last_became_active":"2023-08-25T04:45:37.489836+0000","last_became_peered":"2023-08-25T04:45:37.489836+0000","last_unstale":"2023-08-25T04:45:38.461005+0000","last_undegraded":"2023-08-25T04:45:38.461005+0000","last_fullsized":"2023-08-25T04:45:38.461005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:41.717214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475327+0000","last_change":"2023-08-25T04:45:32.230980+0000","last_active":"2023-08-25T04:45:39.475327+0000","last_peered":"2023-08-25T04:45:39.475327+0000","last_clean":"2023-08-25T04:45:39.475327+0000","last_became_active":"2023-08-25T04:45:32.230712+0000","last_became_peered":"2023-08-25T04:45:32.230712+0000","last_unstale":"2023-08-25T04:45:39.475327+0000","last_undegraded":"2023-08-25T04:45:39.475327+0000","last_fullsized":"2023-08-25T04:45:39.475327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:20.718480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122672+0000","last_change":"2023-08-25T04:45:33.182453+0000","last_active":"2023-08-25T04:45:39.122672+0000","last_peered":"2023-08-25T04:45:39.122672+0000","last_clean":"2023-08-25T04:45:39.122672+0000","last_became_active":"2023-08-25T04:45:33.182169+0000","last_became_peered":"2023-08-25T04:45:33.182169+0000","last_unstale":"2023-08-25T04:45:39.122672+0000","last_undegraded":"2023-08-25T04:45:39.122672+0000","last_fullsized":"2023-08-25T04:45:39.122672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:30.597928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461232+0000","last_change":"2023-08-25T04:45:37.483595+0000","last_active":"2023-08-25T04:45:38.461232+0000","last_peered":"2023-08-25T04:45:38.461232+0000","last_clean":"2023-08-25T04:45:38.461232+0000","last_became_active":"2023-08-25T04:45:37.483087+0000","last_became_peered":"2023-08-25T04:45:37.483087+0000","last_unstale":"2023-08-25T04:45:38.461232+0000","last_undegraded":"2023-08-25T04:45:38.461232+0000","last_fullsized":"2023-08-25T04:45:38.461232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:11:09.671424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476157+0000","last_change":"2023-08-25T04:45:32.237401+0000","last_active":"2023-08-25T04:45:39.476157+0000","last_peered":"2023-08-25T04:45:39.476157+0000","last_clean":"2023-08-25T04:45:39.476157+0000","last_became_active":"2023-08-25T04:45:32.237147+0000","last_became_peered":"2023-08-25T04:45:32.237147+0000","last_unstale":"2023-08-25T04:45:39.476157+0000","last_undegraded":"2023-08-25T04:45:39.476157+0000","last_fullsized":"2023-08-25T04:45:39.476157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:20.177142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460896+0000","last_change":"2023-08-25T04:45:26.770775+0000","last_active":"2023-08-25T04:45:38.460896+0000","last_peered":"2023-08-25T04:45:38.460896+0000","last_clean":"2023-08-25T04:45:38.460896+0000","last_became_active":"2023-08-25T04:45:26.770447+0000","last_became_peered":"2023-08-25T04:45:26.770447+0000","last_unstale":"2023-08-25T04:45:38.460896+0000","last_undegraded":"2023-08-25T04:45:38.460896+0000","last_fullsized":"2023-08-25T04:45:38.460896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:02.164906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475251+0000","last_change":"2023-08-25T04:45:33.180113+0000","last_active":"2023-08-25T04:45:39.475251+0000","last_peered":"2023-08-25T04:45:39.475251+0000","last_clean":"2023-08-25T04:45:39.475251+0000","last_became_active":"2023-08-25T04:45:33.179859+0000","last_became_peered":"2023-08-25T04:45:33.179859+0000","last_unstale":"2023-08-25T04:45:39.475251+0000","last_undegraded":"2023-08-25T04:45:39.475251+0000","last_fullsized":"2023-08-25T04:45:39.475251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:26.444190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475239+0000","last_change":"2023-08-25T04:45:37.483731+0000","last_active":"2023-08-25T04:45:39.475239+0000","last_peered":"2023-08-25T04:45:39.475239+0000","last_clean":"2023-08-25T04:45:39.475239+0000","last_became_active":"2023-08-25T04:45:37.483367+0000","last_became_peered":"2023-08-25T04:45:37.483367+0000","last_unstale":"2023-08-25T04:45:39.475239+0000","last_undegraded":"2023-08-25T04:45:39.475239+0000","last_fullsized":"2023-08-25T04:45:39.475239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:04.371937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475657+0000","last_change":"2023-08-25T04:45:26.768222+0000","last_active":"2023-08-25T04:45:39.475657+0000","last_peered":"2023-08-25T04:45:39.475657+0000","last_clean":"2023-08-25T04:45:39.475657+0000","last_became_active":"2023-08-25T04:45:26.767875+0000","last_became_peered":"2023-08-25T04:45:26.767875+0000","last_unstale":"2023-08-25T04:45:39.475657+0000","last_undegraded":"2023-08-25T04:45:39.475657+0000","last_fullsized":"2023-08-25T04:45:39.475657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:31:22.454559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845648+0000","last_change":"2023-08-25T04:45:32.238276+0000","last_active":"2023-08-25T04:45:38.845648+0000","last_peered":"2023-08-25T04:45:38.845648+0000","last_clean":"2023-08-25T04:45:38.845648+0000","last_became_active":"2023-08-25T04:45:32.237881+0000","last_became_peered":"2023-08-25T04:45:32.237881+0000","last_unstale":"2023-08-25T04:45:38.845648+0000","last_undegraded":"2023-08-25T04:45:38.845648+0000","last_fullsized":"2023-08-25T04:45:38.845648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:49.755802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460946+0000","last_change":"2023-08-25T04:45:33.175073+0000","last_active":"2023-08-25T04:45:38.460946+0000","last_peered":"2023-08-25T04:45:38.460946+0000","last_clean":"2023-08-25T04:45:38.460946+0000","last_became_active":"2023-08-25T04:45:33.174739+0000","last_became_peered":"2023-08-25T04:45:33.174739+0000","last_unstale":"2023-08-25T04:45:38.460946+0000","last_undegraded":"2023-08-25T04:45:38.460946+0000","last_fullsized":"2023-08-25T04:45:38.460946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:21.179587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460451+0000","last_change":"2023-08-25T04:45:37.491239+0000","last_active":"2023-08-25T04:45:38.460451+0000","last_peered":"2023-08-25T04:45:38.460451+0000","last_clean":"2023-08-25T04:45:38.460451+0000","last_became_active":"2023-08-25T04:45:37.490902+0000","last_became_peered":"2023-08-25T04:45:37.490902+0000","last_unstale":"2023-08-25T04:45:38.460451+0000","last_undegraded":"2023-08-25T04:45:38.460451+0000","last_fullsized":"2023-08-25T04:45:38.460451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:27.559835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122041+0000","last_change":"2023-08-25T04:45:26.767948+0000","last_active":"2023-08-25T04:45:39.122041+0000","last_peered":"2023-08-25T04:45:39.122041+0000","last_clean":"2023-08-25T04:45:39.122041+0000","last_became_active":"2023-08-25T04:45:26.767496+0000","last_became_peered":"2023-08-25T04:45:26.767496+0000","last_unstale":"2023-08-25T04:45:39.122041+0000","last_undegraded":"2023-08-25T04:45:39.122041+0000","last_fullsized":"2023-08-25T04:45:39.122041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:13.795305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475898+0000","last_change":"2023-08-25T04:45:27.771979+0000","last_active":"2023-08-25T04:45:39.475898+0000","last_peered":"2023-08-25T04:45:39.475898+0000","last_clean":"2023-08-25T04:45:39.475898+0000","last_became_active":"2023-08-25T04:45:27.770968+0000","last_became_peered":"2023-08-25T04:45:27.770968+0000","last_unstale":"2023-08-25T04:45:39.475898+0000","last_undegraded":"2023-08-25T04:45:39.475898+0000","last_fullsized":"2023-08-25T04:45:39.475898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_clean_scrub_stamp":"2023-08-25T04:45:26.752521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:46.377207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845326+0000","last_change":"2023-08-25T04:45:32.242202+0000","last_active":"2023-08-25T04:45:38.845326+0000","last_peered":"2023-08-25T04:45:38.845326+0000","last_clean":"2023-08-25T04:45:38.845326+0000","last_became_active":"2023-08-25T04:45:32.241904+0000","last_became_peered":"2023-08-25T04:45:32.241904+0000","last_unstale":"2023-08-25T04:45:38.845326+0000","last_undegraded":"2023-08-25T04:45:38.845326+0000","last_fullsized":"2023-08-25T04:45:38.845326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:49.404002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845976+0000","last_change":"2023-08-25T04:45:33.187739+0000","last_active":"2023-08-25T04:45:38.845976+0000","last_peered":"2023-08-25T04:45:38.845976+0000","last_clean":"2023-08-25T04:45:38.845976+0000","last_became_active":"2023-08-25T04:45:33.186521+0000","last_became_peered":"2023-08-25T04:45:33.186521+0000","last_unstale":"2023-08-25T04:45:38.845976+0000","last_undegraded":"2023-08-25T04:45:38.845976+0000","last_fullsized":"2023-08-25T04:45:38.845976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:51.831184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460199+0000","last_change":"2023-08-25T04:45:37.488145+0000","last_active":"2023-08-25T04:45:38.460199+0000","last_peered":"2023-08-25T04:45:38.460199+0000","last_clean":"2023-08-25T04:45:38.460199+0000","last_became_active":"2023-08-25T04:45:37.487669+0000","last_became_peered":"2023-08-25T04:45:37.487669+0000","last_unstale":"2023-08-25T04:45:38.460199+0000","last_undegraded":"2023-08-25T04:45:38.460199+0000","last_fullsized":"2023-08-25T04:45:38.460199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:16.119177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475782+0000","last_change":"2023-08-25T04:45:26.807286+0000","last_active":"2023-08-25T04:45:39.475782+0000","last_peered":"2023-08-25T04:45:39.475782+0000","last_clean":"2023-08-25T04:45:39.475782+0000","last_became_active":"2023-08-25T04:45:26.806698+0000","last_became_peered":"2023-08-25T04:45:26.806698+0000","last_unstale":"2023-08-25T04:45:39.475782+0000","last_undegraded":"2023-08-25T04:45:39.475782+0000","last_fullsized":"2023-08-25T04:45:39.475782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:28.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121731+0000","last_change":"2023-08-25T04:45:32.233634+0000","last_active":"2023-08-25T04:45:39.121731+0000","last_peered":"2023-08-25T04:45:39.121731+0000","last_clean":"2023-08-25T04:45:39.121731+0000","last_became_active":"2023-08-25T04:45:32.233114+0000","last_became_peered":"2023-08-25T04:45:32.233114+0000","last_unstale":"2023-08-25T04:45:39.121731+0000","last_undegraded":"2023-08-25T04:45:39.121731+0000","last_fullsized":"2023-08-25T04:45:39.121731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:41:01.219246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122577+0000","last_change":"2023-08-25T04:45:33.176186+0000","last_active":"2023-08-25T04:45:39.122577+0000","last_peered":"2023-08-25T04:45:39.122577+0000","last_clean":"2023-08-25T04:45:39.122577+0000","last_became_active":"2023-08-25T04:45:33.175948+0000","last_became_peered":"2023-08-25T04:45:33.175948+0000","last_unstale":"2023-08-25T04:45:39.122577+0000","last_undegraded":"2023-08-25T04:45:39.122577+0000","last_fullsized":"2023-08-25T04:45:39.122577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:23.323498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476087+0000","last_change":"2023-08-25T04:45:37.488913+0000","last_active":"2023-08-25T04:45:39.476087+0000","last_peered":"2023-08-25T04:45:39.476087+0000","last_clean":"2023-08-25T04:45:39.476087+0000","last_became_active":"2023-08-25T04:45:37.488517+0000","last_became_peered":"2023-08-25T04:45:37.488517+0000","last_unstale":"2023-08-25T04:45:39.476087+0000","last_undegraded":"2023-08-25T04:45:39.476087+0000","last_fullsized":"2023-08-25T04:45:39.476087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:56.688517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475596+0000","last_change":"2023-08-25T04:45:26.807096+0000","last_active":"2023-08-25T04:45:39.475596+0000","last_peered":"2023-08-25T04:45:39.475596+0000","last_clean":"2023-08-25T04:45:39.475596+0000","last_became_active":"2023-08-25T04:45:26.806713+0000","last_became_peered":"2023-08-25T04:45:26.806713+0000","last_unstale":"2023-08-25T04:45:39.475596+0000","last_undegraded":"2023-08-25T04:45:39.475596+0000","last_fullsized":"2023-08-25T04:45:39.475596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:35.196391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475423+0000","last_change":"2023-08-25T04:45:32.228181+0000","last_active":"2023-08-25T04:45:39.475423+0000","last_peered":"2023-08-25T04:45:39.475423+0000","last_clean":"2023-08-25T04:45:39.475423+0000","last_became_active":"2023-08-25T04:45:32.227866+0000","last_became_peered":"2023-08-25T04:45:32.227866+0000","last_unstale":"2023-08-25T04:45:39.475423+0000","last_undegraded":"2023-08-25T04:45:39.475423+0000","last_fullsized":"2023-08-25T04:45:39.475423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:11.034422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653005+0000","last_change":"2023-08-25T04:45:33.189112+0000","last_active":"2023-08-25T04:45:38.653005+0000","last_peered":"2023-08-25T04:45:38.653005+0000","last_clean":"2023-08-25T04:45:38.653005+0000","last_became_active":"2023-08-25T04:45:33.188826+0000","last_became_peered":"2023-08-25T04:45:33.188826+0000","last_unstale":"2023-08-25T04:45:38.653005+0000","last_undegraded":"2023-08-25T04:45:38.653005+0000","last_fullsized":"2023-08-25T04:45:38.653005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:37.230837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845808+0000","last_change":"2023-08-25T04:45:37.484004+0000","last_active":"2023-08-25T04:45:38.845808+0000","last_peered":"2023-08-25T04:45:38.845808+0000","last_clean":"2023-08-25T04:45:38.845808+0000","last_became_active":"2023-08-25T04:45:37.483640+0000","last_became_peered":"2023-08-25T04:45:37.483640+0000","last_unstale":"2023-08-25T04:45:38.845808+0000","last_undegraded":"2023-08-25T04:45:38.845808+0000","last_fullsized":"2023-08-25T04:45:38.845808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:55.756428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459530+0000","last_change":"2023-08-25T04:45:26.807065+0000","last_active":"2023-08-25T04:45:38.459530+0000","last_peered":"2023-08-25T04:45:38.459530+0000","last_clean":"2023-08-25T04:45:38.459530+0000","last_became_active":"2023-08-25T04:45:26.806737+0000","last_became_peered":"2023-08-25T04:45:26.806737+0000","last_unstale":"2023-08-25T04:45:38.459530+0000","last_undegraded":"2023-08-25T04:45:38.459530+0000","last_fullsized":"2023-08-25T04:45:38.459530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:11.279650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461215+0000","last_change":"2023-08-25T04:45:32.243699+0000","last_active":"2023-08-25T04:45:38.461215+0000","last_peered":"2023-08-25T04:45:38.461215+0000","last_clean":"2023-08-25T04:45:38.461215+0000","last_became_active":"2023-08-25T04:45:32.243274+0000","last_became_peered":"2023-08-25T04:45:32.243274+0000","last_unstale":"2023-08-25T04:45:38.461215+0000","last_undegraded":"2023-08-25T04:45:38.461215+0000","last_fullsized":"2023-08-25T04:45:38.461215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:24.791647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121774+0000","last_change":"2023-08-25T04:45:33.168891+0000","last_active":"2023-08-25T04:45:39.121774+0000","last_peered":"2023-08-25T04:45:39.121774+0000","last_clean":"2023-08-25T04:45:39.121774+0000","last_became_active":"2023-08-25T04:45:33.168678+0000","last_became_peered":"2023-08-25T04:45:33.168678+0000","last_unstale":"2023-08-25T04:45:39.121774+0000","last_undegraded":"2023-08-25T04:45:39.121774+0000","last_fullsized":"2023-08-25T04:45:39.121774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:33:22.522440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653080+0000","last_change":"2023-08-25T04:45:37.485021+0000","last_active":"2023-08-25T04:45:38.653080+0000","last_peered":"2023-08-25T04:45:38.653080+0000","last_clean":"2023-08-25T04:45:38.653080+0000","last_became_active":"2023-08-25T04:45:37.484610+0000","last_became_peered":"2023-08-25T04:45:37.484610+0000","last_unstale":"2023-08-25T04:45:38.653080+0000","last_undegraded":"2023-08-25T04:45:38.653080+0000","last_fullsized":"2023-08-25T04:45:38.653080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:10.974671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653028+0000","last_change":"2023-08-25T04:45:26.807090+0000","last_active":"2023-08-25T04:45:38.653028+0000","last_peered":"2023-08-25T04:45:38.653028+0000","last_clean":"2023-08-25T04:45:38.653028+0000","last_became_active":"2023-08-25T04:45:26.806685+0000","last_became_peered":"2023-08-25T04:45:26.806685+0000","last_unstale":"2023-08-25T04:45:38.653028+0000","last_undegraded":"2023-08-25T04:45:38.653028+0000","last_fullsized":"2023-08-25T04:45:38.653028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:15.681823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121905+0000","last_change":"2023-08-25T04:45:32.233460+0000","last_active":"2023-08-25T04:45:39.121905+0000","last_peered":"2023-08-25T04:45:39.121905+0000","last_clean":"2023-08-25T04:45:39.121905+0000","last_became_active":"2023-08-25T04:45:32.233102+0000","last_became_peered":"2023-08-25T04:45:32.233102+0000","last_unstale":"2023-08-25T04:45:39.121905+0000","last_undegraded":"2023-08-25T04:45:39.121905+0000","last_fullsized":"2023-08-25T04:45:39.121905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:32.845760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845981+0000","last_change":"2023-08-25T04:45:33.177772+0000","last_active":"2023-08-25T04:45:38.845981+0000","last_peered":"2023-08-25T04:45:38.845981+0000","last_clean":"2023-08-25T04:45:38.845981+0000","last_became_active":"2023-08-25T04:45:33.177547+0000","last_became_peered":"2023-08-25T04:45:33.177547+0000","last_unstale":"2023-08-25T04:45:38.845981+0000","last_undegraded":"2023-08-25T04:45:38.845981+0000","last_fullsized":"2023-08-25T04:45:38.845981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:52.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845774+0000","last_change":"2023-08-25T04:45:37.490313+0000","last_active":"2023-08-25T04:45:38.845774+0000","last_peered":"2023-08-25T04:45:38.845774+0000","last_clean":"2023-08-25T04:45:38.845774+0000","last_became_active":"2023-08-25T04:45:37.489828+0000","last_became_peered":"2023-08-25T04:45:37.489828+0000","last_unstale":"2023-08-25T04:45:38.845774+0000","last_undegraded":"2023-08-25T04:45:38.845774+0000","last_fullsized":"2023-08-25T04:45:38.845774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:45.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653039+0000","last_change":"2023-08-25T04:45:26.768150+0000","last_active":"2023-08-25T04:45:38.653039+0000","last_peered":"2023-08-25T04:45:38.653039+0000","last_clean":"2023-08-25T04:45:38.653039+0000","last_became_active":"2023-08-25T04:45:26.767845+0000","last_became_peered":"2023-08-25T04:45:26.767845+0000","last_unstale":"2023-08-25T04:45:38.653039+0000","last_undegraded":"2023-08-25T04:45:38.653039+0000","last_fullsized":"2023-08-25T04:45:38.653039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:42.888555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460497+0000","last_change":"2023-08-25T04:45:32.235113+0000","last_active":"2023-08-25T04:45:38.460497+0000","last_peered":"2023-08-25T04:45:38.460497+0000","last_clean":"2023-08-25T04:45:38.460497+0000","last_became_active":"2023-08-25T04:45:32.234769+0000","last_became_peered":"2023-08-25T04:45:32.234769+0000","last_unstale":"2023-08-25T04:45:38.460497+0000","last_undegraded":"2023-08-25T04:45:38.460497+0000","last_fullsized":"2023-08-25T04:45:38.460497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:04.089871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121833+0000","last_change":"2023-08-25T04:45:33.176251+0000","last_active":"2023-08-25T04:45:39.121833+0000","last_peered":"2023-08-25T04:45:39.121833+0000","last_clean":"2023-08-25T04:45:39.121833+0000","last_became_active":"2023-08-25T04:45:33.175905+0000","last_became_peered":"2023-08-25T04:45:33.175905+0000","last_unstale":"2023-08-25T04:45:39.121833+0000","last_undegraded":"2023-08-25T04:45:39.121833+0000","last_fullsized":"2023-08-25T04:45:39.121833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:17.736254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122068+0000","last_change":"2023-08-25T04:45:37.490783+0000","last_active":"2023-08-25T04:45:39.122068+0000","last_peered":"2023-08-25T04:45:39.122068+0000","last_clean":"2023-08-25T04:45:39.122068+0000","last_became_active":"2023-08-25T04:45:37.490007+0000","last_became_peered":"2023-08-25T04:45:37.490007+0000","last_unstale":"2023-08-25T04:45:39.122068+0000","last_undegraded":"2023-08-25T04:45:39.122068+0000","last_fullsized":"2023-08-25T04:45:39.122068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:50.054137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845866+0000","last_change":"2023-08-25T04:45:32.242734+0000","last_active":"2023-08-25T04:45:38.845866+0000","last_peered":"2023-08-25T04:45:38.845866+0000","last_clean":"2023-08-25T04:45:38.845866+0000","last_became_active":"2023-08-25T04:45:32.241971+0000","last_became_peered":"2023-08-25T04:45:32.241971+0000","last_unstale":"2023-08-25T04:45:38.845866+0000","last_undegraded":"2023-08-25T04:45:38.845866+0000","last_fullsized":"2023-08-25T04:45:38.845866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:17:09.408135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459937+0000","last_change":"2023-08-25T04:45:33.173345+0000","last_active":"2023-08-25T04:45:38.459937+0000","last_peered":"2023-08-25T04:45:38.459937+0000","last_clean":"2023-08-25T04:45:38.459937+0000","last_became_active":"2023-08-25T04:45:33.173020+0000","last_became_peered":"2023-08-25T04:45:33.173020+0000","last_unstale":"2023-08-25T04:45:38.459937+0000","last_undegraded":"2023-08-25T04:45:38.459937+0000","last_fullsized":"2023-08-25T04:45:38.459937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:25:18.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475713+0000","last_change":"2023-08-25T04:45:37.489214+0000","last_active":"2023-08-25T04:45:39.475713+0000","last_peered":"2023-08-25T04:45:39.475713+0000","last_clean":"2023-08-25T04:45:39.475713+0000","last_became_active":"2023-08-25T04:45:37.488142+0000","last_became_peered":"2023-08-25T04:45:37.488142+0000","last_unstale":"2023-08-25T04:45:39.475713+0000","last_undegraded":"2023-08-25T04:45:39.475713+0000","last_fullsized":"2023-08-25T04:45:39.475713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:44.168940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460273+0000","last_change":"2023-08-25T04:45:32.237652+0000","last_active":"2023-08-25T04:45:38.460273+0000","last_peered":"2023-08-25T04:45:38.460273+0000","last_clean":"2023-08-25T04:45:38.460273+0000","last_became_active":"2023-08-25T04:45:32.237377+0000","last_became_peered":"2023-08-25T04:45:32.237377+0000","last_unstale":"2023-08-25T04:45:38.460273+0000","last_undegraded":"2023-08-25T04:45:38.460273+0000","last_fullsized":"2023-08-25T04:45:38.460273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:49.404002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461705+0000","last_change":"2023-08-25T04:45:33.186012+0000","last_active":"2023-08-25T04:45:38.461705+0000","last_peered":"2023-08-25T04:45:38.461705+0000","last_clean":"2023-08-25T04:45:38.461705+0000","last_became_active":"2023-08-25T04:45:33.185728+0000","last_became_peered":"2023-08-25T04:45:33.185728+0000","last_unstale":"2023-08-25T04:45:38.461705+0000","last_undegraded":"2023-08-25T04:45:38.461705+0000","last_fullsized":"2023-08-25T04:45:38.461705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:13.906330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460189+0000","last_change":"2023-08-25T04:45:37.491674+0000","last_active":"2023-08-25T04:45:38.460189+0000","last_peered":"2023-08-25T04:45:38.460189+0000","last_clean":"2023-08-25T04:45:38.460189+0000","last_became_active":"2023-08-25T04:45:37.491231+0000","last_became_peered":"2023-08-25T04:45:37.491231+0000","last_unstale":"2023-08-25T04:45:38.460189+0000","last_undegraded":"2023-08-25T04:45:38.460189+0000","last_fullsized":"2023-08-25T04:45:38.460189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:38.084542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460262+0000","last_change":"2023-08-25T04:45:32.237694+0000","last_active":"2023-08-25T04:45:38.460262+0000","last_peered":"2023-08-25T04:45:38.460262+0000","last_clean":"2023-08-25T04:45:38.460262+0000","last_became_active":"2023-08-25T04:45:32.237349+0000","last_became_peered":"2023-08-25T04:45:32.237349+0000","last_unstale":"2023-08-25T04:45:38.460262+0000","last_undegraded":"2023-08-25T04:45:38.460262+0000","last_fullsized":"2023-08-25T04:45:38.460262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:19.249464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461404+0000","last_change":"2023-08-25T04:45:33.182578+0000","last_active":"2023-08-25T04:45:38.461404+0000","last_peered":"2023-08-25T04:45:38.461404+0000","last_clean":"2023-08-25T04:45:38.461404+0000","last_became_active":"2023-08-25T04:45:33.182247+0000","last_became_peered":"2023-08-25T04:45:33.182247+0000","last_unstale":"2023-08-25T04:45:38.461404+0000","last_undegraded":"2023-08-25T04:45:38.461404+0000","last_fullsized":"2023-08-25T04:45:38.461404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:07.921112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460509+0000","last_change":"2023-08-25T04:45:37.474385+0000","last_active":"2023-08-25T04:45:38.460509+0000","last_peered":"2023-08-25T04:45:38.460509+0000","last_clean":"2023-08-25T04:45:38.460509+0000","last_became_active":"2023-08-25T04:45:37.473906+0000","last_became_peered":"2023-08-25T04:45:37.473906+0000","last_unstale":"2023-08-25T04:45:38.460509+0000","last_undegraded":"2023-08-25T04:45:38.460509+0000","last_fullsized":"2023-08-25T04:45:38.460509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:54:14.466417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475836+0000","last_change":"2023-08-25T04:45:32.230006+0000","last_active":"2023-08-25T04:45:39.475836+0000","last_peered":"2023-08-25T04:45:39.475836+0000","last_clean":"2023-08-25T04:45:39.475836+0000","last_became_active":"2023-08-25T04:45:32.229669+0000","last_became_peered":"2023-08-25T04:45:32.229669+0000","last_unstale":"2023-08-25T04:45:39.475836+0000","last_undegraded":"2023-08-25T04:45:39.475836+0000","last_fullsized":"2023-08-25T04:45:39.475836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:05.707508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475400+0000","last_change":"2023-08-25T04:45:33.191243+0000","last_active":"2023-08-25T04:45:39.475400+0000","last_peered":"2023-08-25T04:45:39.475400+0000","last_clean":"2023-08-25T04:45:39.475400+0000","last_became_active":"2023-08-25T04:45:33.190978+0000","last_became_peered":"2023-08-25T04:45:33.190978+0000","last_unstale":"2023-08-25T04:45:39.475400+0000","last_undegraded":"2023-08-25T04:45:39.475400+0000","last_fullsized":"2023-08-25T04:45:39.475400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:31:56.459382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122653+0000","last_change":"2023-08-25T04:45:37.480208+0000","last_active":"2023-08-25T04:45:39.122653+0000","last_peered":"2023-08-25T04:45:39.122653+0000","last_clean":"2023-08-25T04:45:39.122653+0000","last_became_active":"2023-08-25T04:45:37.479756+0000","last_became_peered":"2023-08-25T04:45:37.479756+0000","last_unstale":"2023-08-25T04:45:39.122653+0000","last_undegraded":"2023-08-25T04:45:39.122653+0000","last_fullsized":"2023-08-25T04:45:39.122653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:09.328653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845931+0000","last_change":"2023-08-25T04:45:32.242698+0000","last_active":"2023-08-25T04:45:38.845931+0000","last_peered":"2023-08-25T04:45:38.845931+0000","last_clean":"2023-08-25T04:45:38.845931+0000","last_became_active":"2023-08-25T04:45:32.242434+0000","last_became_peered":"2023-08-25T04:45:32.242434+0000","last_unstale":"2023-08-25T04:45:38.845931+0000","last_undegraded":"2023-08-25T04:45:38.845931+0000","last_fullsized":"2023-08-25T04:45:38.845931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:22:28.862067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460720+0000","last_change":"2023-08-25T04:45:33.178625+0000","last_active":"2023-08-25T04:45:38.460720+0000","last_peered":"2023-08-25T04:45:38.460720+0000","last_clean":"2023-08-25T04:45:38.460720+0000","last_became_active":"2023-08-25T04:45:33.178339+0000","last_became_peered":"2023-08-25T04:45:33.178339+0000","last_unstale":"2023-08-25T04:45:38.460720+0000","last_undegraded":"2023-08-25T04:45:38.460720+0000","last_fullsized":"2023-08-25T04:45:38.460720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:27.545798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652789+0000","last_change":"2023-08-25T04:45:33.184848+0000","last_active":"2023-08-25T04:45:38.652789+0000","last_peered":"2023-08-25T04:45:38.652789+0000","last_clean":"2023-08-25T04:45:38.652789+0000","last_became_active":"2023-08-25T04:45:33.184561+0000","last_became_peered":"2023-08-25T04:45:33.184561+0000","last_unstale":"2023-08-25T04:45:38.652789+0000","last_undegraded":"2023-08-25T04:45:38.652789+0000","last_fullsized":"2023-08-25T04:45:38.652789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:51.096987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475832+0000","last_change":"2023-08-25T04:45:33.191054+0000","last_active":"2023-08-25T04:45:39.475832+0000","last_peered":"2023-08-25T04:45:39.475832+0000","last_clean":"2023-08-25T04:45:39.475832+0000","last_became_active":"2023-08-25T04:45:33.190791+0000","last_became_peered":"2023-08-25T04:45:33.190791+0000","last_unstale":"2023-08-25T04:45:39.475832+0000","last_undegraded":"2023-08-25T04:45:39.475832+0000","last_fullsized":"2023-08-25T04:45:39.475832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:11.510859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461862+0000","last_change":"2023-08-25T04:45:33.189475+0000","last_active":"2023-08-25T04:45:38.461862+0000","last_peered":"2023-08-25T04:45:38.461862+0000","last_clean":"2023-08-25T04:45:38.461862+0000","last_became_active":"2023-08-25T04:45:33.189067+0000","last_became_peered":"2023-08-25T04:45:33.189067+0000","last_unstale":"2023-08-25T04:45:38.461862+0000","last_undegraded":"2023-08-25T04:45:38.461862+0000","last_fullsized":"2023-08-25T04:45:38.461862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:19.369230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475668+0000","last_change":"2023-08-25T04:45:33.193380+0000","last_active":"2023-08-25T04:45:39.475668+0000","last_peered":"2023-08-25T04:45:39.475668+0000","last_clean":"2023-08-25T04:45:39.475668+0000","last_became_active":"2023-08-25T04:45:33.193083+0000","last_became_peered":"2023-08-25T04:45:33.193083+0000","last_unstale":"2023-08-25T04:45:39.475668+0000","last_undegraded":"2023-08-25T04:45:39.475668+0000","last_fullsized":"2023-08-25T04:45:39.475668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:19:48.510004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121877+0000","last_change":"2023-08-25T04:45:33.180446+0000","last_active":"2023-08-25T04:45:39.121877+0000","last_peered":"2023-08-25T04:45:39.121877+0000","last_clean":"2023-08-25T04:45:39.121877+0000","last_became_active":"2023-08-25T04:45:33.179711+0000","last_became_peered":"2023-08-25T04:45:33.179711+0000","last_unstale":"2023-08-25T04:45:39.121877+0000","last_undegraded":"2023-08-25T04:45:39.121877+0000","last_fullsized":"2023-08-25T04:45:39.121877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:10.645818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":704047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":700130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":109852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:45:59.385 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:45:59.385 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-25T04:45:59.385 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-25T04:45:59.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-25T04:45:59.387 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-25T04:45:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.613+0000 7fe7283ff700 1 Processor -- start 2023-08-25T04:45:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.613+0000 7fe7283ff700 1 -- start start 2023-08-25T04:45:59.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.614+0000 7fe7283ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe72015ce60 0x7fe7200d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.614+0000 7fe7283ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200b8770 0x7fe7200d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.614+0000 7fe7283ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7200d1fe0 con 0x7fe7200cda40 2023-08-25T04:45:59.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.614+0000 7fe7283ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7200d13d0 con 0x7fe72015ce60 2023-08-25T04:45:59.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.614+0000 7fe7283ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7200d16b0 con 0x7fe7200b8770 2023-08-25T04:45:59.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.614+0000 7fe72619b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe72015ce60 0x7fe7200d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.614+0000 7fe72699c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe7200cda40 0x7fe7200b5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53188/0 (socket says 172.21.15.72:53188) 2023-08-25T04:45:59.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.614+0000 7fe72699c700 1 -- 172.21.15.72:0/1170876653 learned_addr learned my addr 172.21.15.72:0/1170876653 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:45:59.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe72599a700 1 --2- 172.21.15.72:0/1170876653 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200b8770 0x7fe7200d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe72619b700 1 -- 172.21.15.72:0/1170876653 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200b8770 msgr2=0x7fe7200d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:45:59.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe72619b700 1 --2- 172.21.15.72:0/1170876653 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200b8770 0x7fe7200d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe72619b700 1 -- 172.21.15.72:0/1170876653 >> v1:172.21.15.72:6789/0 conn(0x7fe7200cda40 legacy=0x7fe7200b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe725199700 1 -- 172.21.15.72:0/1170876653 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944573096 0 0) 0x7fe7200d1fe0 con 0x7fe7200cda40 2023-08-25T04:45:59.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe72619b700 1 -- 172.21.15.72:0/1170876653 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7200d1990 con 0x7fe72015ce60 2023-08-25T04:45:59.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe72599a700 1 --2- 172.21.15.72:0/1170876653 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200b8770 0x7fe7200d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:45:59.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe72619b700 1 --2- 172.21.15.72:0/1170876653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72015ce60 0x7fe7200d0df0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009840 tx=0x7fe71c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a824ad075f300ac server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:59.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe725199700 1 -- 172.21.15.72:0/1170876653 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c011830 con 0x7fe72015ce60 2023-08-25T04:45:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe725199700 1 -- 172.21.15.72:0/1170876653 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c011990 con 0x7fe72015ce60 2023-08-25T04:45:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.615+0000 7fe725199700 1 -- 172.21.15.72:0/1170876653 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c011d20 con 0x7fe72015ce60 2023-08-25T04:45:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.616+0000 7fe7283ff700 1 -- 172.21.15.72:0/1170876653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72015ce60 msgr2=0x7fe7200d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.616+0000 7fe7283ff700 1 --2- 172.21.15.72:0/1170876653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72015ce60 0x7fe7200d0df0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009840 tx=0x7fe71c009b50 comp rx=0 tx=0).stop 2023-08-25T04:45:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.616+0000 7fe7283ff700 1 -- 172.21.15.72:0/1170876653 shutdown_connections 2023-08-25T04:45:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.616+0000 7fe7283ff700 1 --2- 172.21.15.72:0/1170876653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72015ce60 0x7fe7200d0df0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.616+0000 7fe7283ff700 1 --2- 172.21.15.72:0/1170876653 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200b8770 0x7fe7200d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.616+0000 7fe7283ff700 1 -- 172.21.15.72:0/1170876653 >> 172.21.15.72:0/1170876653 conn(0x7fe720071e10 msgr2=0x7fe720072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:59.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.616+0000 7fe7283ff700 1 -- 172.21.15.72:0/1170876653 shutdown_connections 2023-08-25T04:45:59.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.616+0000 7fe7283ff700 1 -- 172.21.15.72:0/1170876653 wait complete. 2023-08-25T04:45:59.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.618+0000 7fe7283ff700 1 Processor -- start 2023-08-25T04:45:59.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.618+0000 7fe7283ff700 1 -- start start 2023-08-25T04:45:59.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe7283ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7200b8770 0x7fe7201584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe7283ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200cda40 0x7fe7200c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe7283ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe72015ce60 0x7fe720159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe7283ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7200cb260 con 0x7fe7200b8770 2023-08-25T04:45:59.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe7283ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7200c7e00 con 0x7fe72015ce60 2023-08-25T04:45:59.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe7283ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe720158a10 con 0x7fe7200cda40 2023-08-25T04:45:59.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7200b8770 0x7fe7201584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7200b8770 0x7fe7201584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56046/0 (socket says 172.21.15.72:56046) 2023-08-25T04:45:59.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72619b700 1 -- 172.21.15.72:0/3658630535 learned_addr learned my addr 172.21.15.72:0/3658630535 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:45:59.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72599a700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200cda40 0x7fe7200c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72699c700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe72015ce60 0x7fe720159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72619b700 1 -- 172.21.15.72:0/3658630535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200cda40 msgr2=0x7fe7200c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72619b700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200cda40 0x7fe7200c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72619b700 1 -- 172.21.15.72:0/3658630535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe72015ce60 msgr2=0x7fe720159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72619b700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe72015ce60 0x7fe720159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72619b700 1 -- 172.21.15.72:0/3658630535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c0094a0 con 0x7fe7200b8770 2023-08-25T04:45:59.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.619+0000 7fe72619b700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7200b8770 0x7fe7201584d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe71c014040 tx=0x7fe71c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:59.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.620+0000 7fe716ffd700 1 -- 172.21.15.72:0/3658630535 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0045f0 con 0x7fe7200b8770 2023-08-25T04:45:59.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.620+0000 7fe716ffd700 1 -- 172.21.15.72:0/3658630535 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c01e070 con 0x7fe7200b8770 2023-08-25T04:45:59.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.620+0000 7fe7283ff700 1 -- 172.21.15.72:0/3658630535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7200c7280 con 0x7fe7200b8770 2023-08-25T04:45:59.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.620+0000 7fe716ffd700 1 -- 172.21.15.72:0/3658630535 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c003ae0 con 0x7fe7200b8770 2023-08-25T04:45:59.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.620+0000 7fe7283ff700 1 -- 172.21.15.72:0/3658630535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7200c7840 con 0x7fe7200b8770 2023-08-25T04:45:59.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.621+0000 7fe7283ff700 1 -- 172.21.15.72:0/3658630535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72004e620 con 0x7fe7200b8770 2023-08-25T04:45:59.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.622+0000 7fe716ffd700 1 -- 172.21.15.72:0/3658630535 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe71c003c40 con 0x7fe7200b8770 2023-08-25T04:45:59.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.623+0000 7fe716ffd700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe70406a0e0 0x7fe70406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:45:59.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.623+0000 7fe716ffd700 1 -- 172.21.15.72:0/3658630535 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe71c089990 con 0x7fe7200b8770 2023-08-25T04:45:59.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.623+0000 7fe72599a700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe70406a0e0 0x7fe70406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:45:59.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.623+0000 7fe72599a700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe70406a0e0 0x7fe70406c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7200cce90 tx=0x7fe710008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:45:59.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.627+0000 7fe716ffd700 1 -- 172.21.15.72:0/3658630535 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe71c054e20 con 0x7fe7200b8770 2023-08-25T04:45:59.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.879+0000 7fe7283ff700 1 -- 172.21.15.72:0/3658630535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe7200b7d90 con 0x7fe7200b8770 2023-08-25T04:45:59.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.882+0000 7fe716ffd700 1 -- 172.21.15.72:0/3658630535 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169492 (secure 0 0 0) 0x7fe71c058440 con 0x7fe7200b8770 2023-08-25T04:45:59.884 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:45:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 -- 172.21.15.72:0/3658630535 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe70406a0e0 msgr2=0x7fe70406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe70406a0e0 0x7fe70406c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7200cce90 tx=0x7fe710008040 comp rx=0 tx=0).stop 2023-08-25T04:45:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 -- 172.21.15.72:0/3658630535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7200b8770 msgr2=0x7fe7201584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:45:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7200b8770 0x7fe7201584d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe71c014040 tx=0x7fe71c004750 comp rx=0 tx=0).stop 2023-08-25T04:45:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 -- 172.21.15.72:0/3658630535 shutdown_connections 2023-08-25T04:45:59.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe70406a0e0 0x7fe70406c5a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe72015ce60 0x7fe720159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7200b8770 0x7fe7201584d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 --2- 172.21.15.72:0/3658630535 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7200cda40 0x7fe7200c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:45:59.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 -- 172.21.15.72:0/3658630535 >> 172.21.15.72:0/3658630535 conn(0x7fe720071e10 msgr2=0x7fe7200b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:45:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 -- 172.21.15.72:0/3658630535 shutdown_connections 2023-08-25T04:45:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:45:59.885+0000 7fe7283ff700 1 -- 172.21.15.72:0/3658630535 wait complete. 2023-08-25T04:45:59.903 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1377484023},{"type":"v1","addr":"172.21.15.72:6833","nonce":1377484023}]},"active_addr":"172.21.15.72:6833/1377484023","active_change":"2023-08-25T04:45:19.836670+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2090278364}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1634725897}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2600922731}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3164195961}]}]} 2023-08-25T04:45:59.909 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-25T04:45:59.910 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-25T04:45:59.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:00.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.106+0000 7f97097ff700 1 Processor -- start 2023-08-25T04:46:00.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.106+0000 7f97097ff700 1 -- start start 2023-08-25T04:46:00.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.107+0000 7f97097ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9704159b90 0x7f97040b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.107+0000 7f97097ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97040b0ab0 0x7f97040cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.107+0000 7f97097ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97040ce1f0 0x7f97040c3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.107+0000 7f97097ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97040c48f0 con 0x7f97040b0ab0 2023-08-25T04:46:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.107+0000 7f97097ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97040c5470 con 0x7f9704159b90 2023-08-25T04:46:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.107+0000 7f97097ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9704159f70 con 0x7f97040ce1f0 2023-08-25T04:46:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.107+0000 7f97027fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97040b0ab0 0x7f97040cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f97027fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97040b0ab0 0x7f97040cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56054/0 (socket says 172.21.15.72:56054) 2023-08-25T04:46:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f97027fc700 1 -- 172.21.15.72:0/2763555723 learned_addr learned my addr 172.21.15.72:0/2763555723 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:00.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f97027fc700 1 -- 172.21.15.72:0/2763555723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97040ce1f0 msgr2=0x7f97040c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f97027fc700 1 --2- 172.21.15.72:0/2763555723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97040ce1f0 0x7f97040c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f97027fc700 1 -- 172.21.15.72:0/2763555723 >> v2:172.21.15.137:3300/0 conn(0x7f9704159b90 msgr2=0x7f97040b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f9702ffd700 1 --2- 172.21.15.72:0/2763555723 >> v2:172.21.15.137:3300/0 conn(0x7f9704159b90 0x7f97040b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f97027fc700 1 --2- 172.21.15.72:0/2763555723 >> v2:172.21.15.137:3300/0 conn(0x7f9704159b90 0x7f97040b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f97027fc700 1 -- 172.21.15.72:0/2763555723 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97040c4b40 con 0x7f97040b0ab0 2023-08-25T04:46:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f9702ffd700 1 --2- 172.21.15.72:0/2763555723 >> v2:172.21.15.137:3300/0 conn(0x7f9704159b90 0x7f97040b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f97027fc700 1 --2- 172.21.15.72:0/2763555723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040b0ab0 0x7f97040cdcb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f97040b4ba0 tx=0x7f96f800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c278b2dbfd602 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f9701ffb700 1 -- 172.21.15.72:0/2763555723 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f800dd30 con 0x7f97040b0ab0 2023-08-25T04:46:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f9701ffb700 1 -- 172.21.15.72:0/2763555723 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f800de90 con 0x7f97040b0ab0 2023-08-25T04:46:00.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.108+0000 7f9701ffb700 1 -- 172.21.15.72:0/2763555723 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8010690 con 0x7f97040b0ab0 2023-08-25T04:46:00.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.109+0000 7f97097ff700 1 -- 172.21.15.72:0/2763555723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040b0ab0 msgr2=0x7f97040cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.109+0000 7f97097ff700 1 --2- 172.21.15.72:0/2763555723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040b0ab0 0x7f97040cdcb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f97040b4ba0 tx=0x7f96f800be70 comp rx=0 tx=0).stop 2023-08-25T04:46:00.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.109+0000 7f97097ff700 1 -- 172.21.15.72:0/2763555723 shutdown_connections 2023-08-25T04:46:00.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.109+0000 7f97097ff700 1 --2- 172.21.15.72:0/2763555723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97040ce1f0 0x7f97040c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.109+0000 7f97097ff700 1 --2- 172.21.15.72:0/2763555723 >> v2:172.21.15.137:3300/0 conn(0x7f9704159b90 0x7f97040b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.109+0000 7f97097ff700 1 --2- 172.21.15.72:0/2763555723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040b0ab0 0x7f97040cdcb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.109+0000 7f97097ff700 1 -- 172.21.15.72:0/2763555723 >> 172.21.15.72:0/2763555723 conn(0x7f97040ce990 msgr2=0x7f97040ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.109+0000 7f97097ff700 1 -- 172.21.15.72:0/2763555723 shutdown_connections 2023-08-25T04:46:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.109+0000 7f97097ff700 1 -- 172.21.15.72:0/2763555723 wait complete. 2023-08-25T04:46:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.111+0000 7f97097ff700 1 Processor -- start 2023-08-25T04:46:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.111+0000 7f97097ff700 1 -- start start 2023-08-25T04:46:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97097ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97040b0ab0 0x7f97041f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97097ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040ce1f0 0x7f970414b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97097ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9704159b90 0x7f97040c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97097ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97041f3750 con 0x7f97040ce1f0 2023-08-25T04:46:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97097ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970414bc50 con 0x7f9704159b90 2023-08-25T04:46:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97097ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97040c5eb0 con 0x7f97040b0ab0 2023-08-25T04:46:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97027fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040ce1f0 0x7f970414b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97027fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040ce1f0 0x7f970414b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56060/0 (socket says 172.21.15.72:56060) 2023-08-25T04:46:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97027fc700 1 -- 172.21.15.72:0/2560027601 learned_addr learned my addr 172.21.15.72:0/2560027601 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f9702ffd700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97040b0ab0 0x7f97041f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97037fe700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9704159b90 0x7f97040c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97027fc700 1 -- 172.21.15.72:0/2560027601 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97040b0ab0 msgr2=0x7f97041f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97027fc700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97040b0ab0 0x7f97041f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97027fc700 1 -- 172.21.15.72:0/2560027601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9704159b90 msgr2=0x7f97040c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97027fc700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9704159b90 0x7f97040c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.112+0000 7f97027fc700 1 -- 172.21.15.72:0/2560027601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f800b7f0 con 0x7f97040ce1f0 2023-08-25T04:46:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.113+0000 7f97027fc700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040ce1f0 0x7f970414b710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9704071a80 tx=0x7f96f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.113+0000 7f96eb7fe700 1 -- 172.21.15.72:0/2560027601 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8003cf0 con 0x7f97040ce1f0 2023-08-25T04:46:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.113+0000 7f96eb7fe700 1 -- 172.21.15.72:0/2560027601 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f8003e70 con 0x7f97040ce1f0 2023-08-25T04:46:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.113+0000 7f97097ff700 1 -- 172.21.15.72:0/2560027601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97040c6190 con 0x7f97040ce1f0 2023-08-25T04:46:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.113+0000 7f96eb7fe700 1 -- 172.21.15.72:0/2560027601 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8010690 con 0x7f97040ce1f0 2023-08-25T04:46:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.113+0000 7f97097ff700 1 -- 172.21.15.72:0/2560027601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97040c6750 con 0x7f97040ce1f0 2023-08-25T04:46:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.114+0000 7f97097ff700 1 -- 172.21.15.72:0/2560027601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970404e620 con 0x7f97040ce1f0 2023-08-25T04:46:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.115+0000 7f96eb7fe700 1 -- 172.21.15.72:0/2560027601 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f96f8019400 con 0x7f97040ce1f0 2023-08-25T04:46:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.116+0000 7f96eb7fe700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f96f006a0e0 0x7f96f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.116+0000 7f96eb7fe700 1 -- 172.21.15.72:0/2560027601 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f96f8089c50 con 0x7f97040ce1f0 2023-08-25T04:46:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.116+0000 7f9702ffd700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f96f006a0e0 0x7f96f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.117+0000 7f9702ffd700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f96f006a0e0 0x7f96f006c5a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96f4006fd0 tx=0x7f96f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.120+0000 7f96eb7fe700 1 -- 172.21.15.72:0/2560027601 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f96f808f020 con 0x7f97040ce1f0 2023-08-25T04:46:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.315+0000 7f97097ff700 1 -- 172.21.15.72:0/2560027601 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f970406d790 con 0x7f97040ce1f0 2023-08-25T04:46:00.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.317+0000 7f96eb7fe700 1 -- 172.21.15.72:0/2560027601 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f96f80550e0 con 0x7f97040ce1f0 2023-08-25T04:46:00.317 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:00.318 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:00.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.319+0000 7f97097ff700 1 -- 172.21.15.72:0/2560027601 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f96f006a0e0 msgr2=0x7f96f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.319+0000 7f97097ff700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f96f006a0e0 0x7f96f006c5a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96f4006fd0 tx=0x7f96f4008040 comp rx=0 tx=0).stop 2023-08-25T04:46:00.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.319+0000 7f97097ff700 1 -- 172.21.15.72:0/2560027601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040ce1f0 msgr2=0x7f970414b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.319+0000 7f97097ff700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040ce1f0 0x7f970414b710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9704071a80 tx=0x7f96f8004750 comp rx=0 tx=0).stop 2023-08-25T04:46:00.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.319+0000 7f97097ff700 1 -- 172.21.15.72:0/2560027601 shutdown_connections 2023-08-25T04:46:00.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.319+0000 7f97097ff700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f96f006a0e0 0x7f96f006c5a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.319+0000 7f97097ff700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9704159b90 0x7f97040c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.319+0000 7f97097ff700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f97040b0ab0 0x7f97041f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.319+0000 7f97097ff700 1 --2- 172.21.15.72:0/2560027601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97040ce1f0 0x7f970414b710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.319+0000 7f97097ff700 1 -- 172.21.15.72:0/2560027601 >> 172.21.15.72:0/2560027601 conn(0x7f97040ce990 msgr2=0x7f9704070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:00.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.320+0000 7f97097ff700 1 -- 172.21.15.72:0/2560027601 shutdown_connections 2023-08-25T04:46:00.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.320+0000 7f97097ff700 1 -- 172.21.15.72:0/2560027601 wait complete. 2023-08-25T04:46:00.338 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-25T04:46:00.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:00.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.533+0000 7f06b69ff700 1 Processor -- start 2023-08-25T04:46:00.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.533+0000 7f06b69ff700 1 -- start start 2023-08-25T04:46:00.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.534+0000 7f06b69ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b015ce60 0x7f06b00d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.534+0000 7f06b69ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f06b00cda40 0x7f06b00cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.534+0000 7f06b69ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b00d1fe0 con 0x7f06b00b8770 2023-08-25T04:46:00.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.534+0000 7f06b69ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b00d2b80 con 0x7f06b00cda40 2023-08-25T04:46:00.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.534+0000 7f06b69ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00ce410 con 0x7f06b015ce60 2023-08-25T04:46:00.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.535+0000 7f06b4f9c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f06b00cda40 0x7f06b00cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.535+0000 7f06affff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b015ce60 0x7f06b00d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.535+0000 7f06b4f9c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f06b00cda40 0x7f06b00cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:59860/0 (socket says 172.21.15.72:59860) 2023-08-25T04:46:00.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.535+0000 7f06b4f9c700 1 -- 172.21.15.72:0/846783632 learned_addr learned my addr 172.21.15.72:0/846783632 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:00.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.535+0000 7f06b4f9c700 1 -- 172.21.15.72:0/846783632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b015ce60 msgr2=0x7f06b00d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:00.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.535+0000 7f06b4f9c700 1 --2- 172.21.15.72:0/846783632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b015ce60 0x7f06b00d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.535+0000 7f06b4f9c700 1 -- 172.21.15.72:0/846783632 >> v1:172.21.15.137:6789/0 conn(0x7f06b00b8770 legacy=0x7f06b00d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.535+0000 7f06b4f9c700 1 -- 172.21.15.72:0/846783632 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b00d13d0 con 0x7f06b00cda40 2023-08-25T04:46:00.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06b4f9c700 1 --2- 172.21.15.72:0/846783632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b00cda40 0x7f06b00cded0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009e50 tx=0x7f06a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab8cb9da99cc0ad server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:00.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06aeffd700 1 -- 172.21.15.72:0/846783632 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800e070 con 0x7f06b00cda40 2023-08-25T04:46:00.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06aeffd700 1 -- 172.21.15.72:0/846783632 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a800b910 con 0x7f06b00cda40 2023-08-25T04:46:00.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06aeffd700 1 -- 172.21.15.72:0/846783632 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800bcc0 con 0x7f06b00cda40 2023-08-25T04:46:00.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06b69ff700 1 -- 172.21.15.72:0/846783632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b00cda40 msgr2=0x7f06b00cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06b69ff700 1 --2- 172.21.15.72:0/846783632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b00cda40 0x7f06b00cded0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009e50 tx=0x7f06a800b330 comp rx=0 tx=0).stop 2023-08-25T04:46:00.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06b69ff700 1 -- 172.21.15.72:0/846783632 shutdown_connections 2023-08-25T04:46:00.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06b69ff700 1 --2- 172.21.15.72:0/846783632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b00cda40 0x7f06b00cded0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06b69ff700 1 --2- 172.21.15.72:0/846783632 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b015ce60 0x7f06b00d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06b69ff700 1 -- 172.21.15.72:0/846783632 >> 172.21.15.72:0/846783632 conn(0x7f06b0071e10 msgr2=0x7f06b0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:00.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.536+0000 7f06b69ff700 1 -- 172.21.15.72:0/846783632 shutdown_connections 2023-08-25T04:46:00.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.537+0000 7f06b69ff700 1 -- 172.21.15.72:0/846783632 wait complete. 2023-08-25T04:46:00.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.538+0000 7f06b69ff700 1 Processor -- start 2023-08-25T04:46:00.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.539+0000 7f06b69ff700 1 -- start start 2023-08-25T04:46:00.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06b69ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8770 0x7f06b015fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06b69ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b00cda40 0x7f06b00b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06b69ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b015ce60 0x7f06b00b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06b69ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00c6650 con 0x7f06b00cda40 2023-08-25T04:46:00.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06b69ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b014ba40 con 0x7f06b015ce60 2023-08-25T04:46:00.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06b69ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b015dee0 con 0x7f06b00b8770 2023-08-25T04:46:00.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b00cda40 0x7f06b00b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06affff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8770 0x7f06b015fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06affff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8770 0x7f06b015fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51166/0 (socket says 172.21.15.72:51166) 2023-08-25T04:46:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06affff700 1 -- 172.21.15.72:0/2714357614 learned_addr learned my addr 172.21.15.72:0/2714357614 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06b4f9c700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b015ce60 0x7f06b00b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06af7fe700 1 -- 172.21.15.72:0/2714357614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8770 msgr2=0x7f06b015fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06af7fe700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8770 0x7f06b015fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06af7fe700 1 -- 172.21.15.72:0/2714357614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b015ce60 msgr2=0x7f06b00b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06af7fe700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b015ce60 0x7f06b00b70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.540+0000 7f06af7fe700 1 -- 172.21.15.72:0/2714357614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8009b30 con 0x7f06b00cda40 2023-08-25T04:46:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.541+0000 7f06af7fe700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b00cda40 0x7f06b00b6b70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000f60 tx=0x7f06a400c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.541+0000 7f06acff9700 1 -- 172.21.15.72:0/2714357614 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40052d0 con 0x7f06b00cda40 2023-08-25T04:46:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.541+0000 7f06acff9700 1 -- 172.21.15.72:0/2714357614 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4005430 con 0x7f06b00cda40 2023-08-25T04:46:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.541+0000 7f06b69ff700 1 -- 172.21.15.72:0/2714357614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b014bcf0 con 0x7f06b00cda40 2023-08-25T04:46:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.541+0000 7f06acff9700 1 -- 172.21.15.72:0/2714357614 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40038c0 con 0x7f06b00cda40 2023-08-25T04:46:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.541+0000 7f06b69ff700 1 -- 172.21.15.72:0/2714357614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b014c2b0 con 0x7f06b00cda40 2023-08-25T04:46:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.542+0000 7f06b69ff700 1 -- 172.21.15.72:0/2714357614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b014c4d0 con 0x7f06b00cda40 2023-08-25T04:46:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.543+0000 7f06acff9700 1 -- 172.21.15.72:0/2714357614 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f06a4003c30 con 0x7f06b00cda40 2023-08-25T04:46:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.544+0000 7f06acff9700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069c06a0e0 0x7f069c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.544+0000 7f06acff9700 1 -- 172.21.15.72:0/2714357614 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06a4087ce0 con 0x7f06b00cda40 2023-08-25T04:46:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.544+0000 7f06affff700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069c06a0e0 0x7f069c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.545+0000 7f06affff700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069c06a0e0 0x7f069c06c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009ca0 tx=0x7f06a0009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.551+0000 7f06acff9700 1 -- 172.21.15.72:0/2714357614 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f06a40530d0 con 0x7f06b00cda40 2023-08-25T04:46:00.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.747+0000 7f06b69ff700 1 -- 172.21.15.72:0/2714357614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06b004e620 con 0x7f06b00cda40 2023-08-25T04:46:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.748+0000 7f06acff9700 1 -- 172.21.15.72:0/2714357614 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f06a40566f0 con 0x7f06b00cda40 2023-08-25T04:46:00.751 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:00.751 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:00.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 -- 172.21.15.72:0/2714357614 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069c06a0e0 msgr2=0x7f069c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069c06a0e0 0x7f069c06c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009ca0 tx=0x7f06a0009210 comp rx=0 tx=0).stop 2023-08-25T04:46:00.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 -- 172.21.15.72:0/2714357614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b00cda40 msgr2=0x7f06b00b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:00.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b00cda40 0x7f06b00b6b70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000f60 tx=0x7f06a400c6e0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 -- 172.21.15.72:0/2714357614 shutdown_connections 2023-08-25T04:46:00.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069c06a0e0 0x7f069c06c5a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b015ce60 0x7f06b00b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8770 0x7f06b015fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 --2- 172.21.15.72:0/2714357614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b00cda40 0x7f06b00b6b70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:00.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 -- 172.21.15.72:0/2714357614 >> 172.21.15.72:0/2714357614 conn(0x7f06b0071e10 msgr2=0x7f06b00cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:00.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 -- 172.21.15.72:0/2714357614 shutdown_connections 2023-08-25T04:46:00.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:00.751+0000 7f06b69ff700 1 -- 172.21.15.72:0/2714357614 wait complete. 2023-08-25T04:46:00.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-25T04:46:00.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-25T04:46:00.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-25T04:46:00.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-25T04:46:00.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-25T04:46:00.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-25T04:46:00.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-25T04:46:00.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-25T04:46:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.127+0000 7f79821ff700 1 Processor -- start 2023-08-25T04:46:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.127+0000 7f79821ff700 1 -- start start 2023-08-25T04:46:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.128+0000 7f1f1b1ff700 1 Processor -- start 2023-08-25T04:46:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.129+0000 7f1f1b1ff700 1 -- start start 2023-08-25T04:46:01.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.128+0000 7f9e5f7ff700 1 Processor -- start 2023-08-25T04:46:01.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.129+0000 7f9e5f7ff700 1 -- start start 2023-08-25T04:46:01.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f9e5f7ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9e5806c990 0x7f9e58070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f9e5f7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5806d3c0 con 0x7f9e58158f30 2023-08-25T04:46:01.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f9e5f7ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5806d6a0 con 0x7f9e5806ce20 2023-08-25T04:46:01.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f9e5f7ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5806d980 con 0x7f9e5806c990 2023-08-25T04:46:01.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f9e5cd9a700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9e5806c990 0x7f9e58070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f9e5cd9a700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9e5806c990 0x7f9e58070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:59874/0 (socket says 172.21.15.72:59874) 2023-08-25T04:46:01.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f9e5cd9a700 1 -- 172.21.15.72:0/933849729 learned_addr learned my addr 172.21.15.72:0/933849729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f1f1b1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f14070fa0 0x7f1f1416c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f1f1b1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1406db40 con 0x7f1f140ca440 2023-08-25T04:46:01.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f1f1b1ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f14161ad0 con 0x7f1f140add00 2023-08-25T04:46:01.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.131+0000 7f1f1b1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140ca940 con 0x7f1f14070fa0 2023-08-25T04:46:01.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.132+0000 7f1f1979c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f14070fa0 0x7f1f1416c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.132+0000 7f1f1979c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f14070fa0 0x7f1f1416c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51176/0 (socket says 172.21.15.72:51176) 2023-08-25T04:46:01.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.132+0000 7f1f1979c700 1 -- 172.21.15.72:0/2277289616 learned_addr learned my addr 172.21.15.72:0/2277289616 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.132+0000 7f79821ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f797c06ea80 0x7f797c0cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.132+0000 7f79821ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c158cc0 0x7f797c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.132+0000 7f79821ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f797c06ced0 0x7f797c070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.132+0000 7f79821ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c06d980 con 0x7f797c06ced0 2023-08-25T04:46:01.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.132+0000 7f79821ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c06d6a0 con 0x7f797c06ea80 2023-08-25T04:46:01.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.132+0000 7f79821ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0ca440 con 0x7f797c158cc0 2023-08-25T04:46:01.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.132+0000 7f797affd700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c158cc0 0x7f797c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.133+0000 7f797affd700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c158cc0 0x7f797c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51178/0 (socket says 172.21.15.72:51178) 2023-08-25T04:46:01.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.133+0000 7f797affd700 1 -- 172.21.15.72:0/4164824082 learned_addr learned my addr 172.21.15.72:0/4164824082 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.133+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796900945 0 0) 0x7f9e5806d6a0 con 0x7f9e5806ce20 2023-08-25T04:46:01.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.133+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e440035b0 con 0x7f9e5806ce20 2023-08-25T04:46:01.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.133+0000 7f797b7fe700 1 --2- 172.21.15.72:0/4164824082 >> v2:172.21.15.137:3300/0 conn(0x7f797c06ea80 0x7f797c0cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.133+0000 7f797affd700 1 -- 172.21.15.72:0/4164824082 >> v2:172.21.15.137:3300/0 conn(0x7f797c06ea80 msgr2=0x7f797c0cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.133+0000 7f797affd700 1 --2- 172.21.15.72:0/4164824082 >> v2:172.21.15.137:3300/0 conn(0x7f797c06ea80 0x7f797c0cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.133+0000 7f797affd700 1 -- 172.21.15.72:0/4164824082 >> v2:172.21.15.72:3300/0 conn(0x7f797c06ced0 msgr2=0x7f797c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.133+0000 7f797affd700 1 --2- 172.21.15.72:0/4164824082 >> v2:172.21.15.72:3300/0 conn(0x7f797c06ced0 0x7f797c070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.133+0000 7f797affd700 1 -- 172.21.15.72:0/4164824082 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0ca720 con 0x7f797c158cc0 2023-08-25T04:46:01.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f1f1979c700 1 -- 172.21.15.72:0/2277289616 >> v1:172.21.15.137:6789/0 conn(0x7f1f140add00 legacy=0x7f1f1406d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f1f1979c700 1 -- 172.21.15.72:0/2277289616 >> v1:172.21.15.72:6789/0 conn(0x7f1f140ca440 legacy=0x7f1f14070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f1f1979c700 1 -- 172.21.15.72:0/2277289616 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f140cac20 con 0x7f1f14070fa0 2023-08-25T04:46:01.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 62579188 0 0) 0x7f9e440035b0 con 0x7f9e5806ce20 2023-08-25T04:46:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 >> v2:172.21.15.137:3300/0 conn(0x7f9e5806c990 msgr2=0x7f9e58070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 --2- 172.21.15.72:0/933849729 >> v2:172.21.15.137:3300/0 conn(0x7f9e5806c990 0x7f9e58070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 >> v1:172.21.15.72:6789/0 conn(0x7f9e58158f30 legacy=0x7f9e580cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e580ca440 con 0x7f9e5806ce20 2023-08-25T04:46:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f9e54001670 con 0x7f9e5806ce20 2023-08-25T04:46:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 >> v1:172.21.15.137:6789/0 conn(0x7f9e5806ce20 legacy=0x7f9e580afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 --2- 172.21.15.72:0/933849729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e44003a00 0x7f9e44003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 --2- 172.21.15.72:0/933849729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e44004850 0x7f9e44004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 --2- 172.21.15.72:0/933849729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e44009a00 0x7f9e440052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5806d980 con 0x7f9e44009a00 2023-08-25T04:46:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44014960 con 0x7f9e44003a00 2023-08-25T04:46:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44014b20 con 0x7f9e44004850 2023-08-25T04:46:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f797affd700 1 --2- 172.21.15.72:0/4164824082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c158cc0 0x7f797c06c990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f797c0720d0 tx=0x7f797400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=381717a407c8083 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f1f1979c700 1 --2- 172.21.15.72:0/2277289616 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f14070fa0 0x7f1f1416c200 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0098a0 tx=0x7f1f0c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1a22459517c185d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f9e5d59b700 1 --2- 172.21.15.72:0/933849729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e44003a00 0x7f9e44003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.135+0000 7f1f0b7fe700 1 -- 172.21.15.72:0/2277289616 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c004230 con 0x7f1f14070fa0 2023-08-25T04:46:01.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f1f0b7fe700 1 -- 172.21.15.72:0/2277289616 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c004390 con 0x7f1f14070fa0 2023-08-25T04:46:01.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f1f0b7fe700 1 -- 172.21.15.72:0/2277289616 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c0036a0 con 0x7f1f14070fa0 2023-08-25T04:46:01.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f9e5cd9a700 1 --2- 172.21.15.72:0/933849729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e44004850 0x7f9e44004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.134+0000 7f797a7fc700 1 -- 172.21.15.72:0/4164824082 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400e070 con 0x7f797c158cc0 2023-08-25T04:46:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.135+0000 7f797a7fc700 1 -- 172.21.15.72:0/4164824082 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797400b9c0 con 0x7f797c158cc0 2023-08-25T04:46:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.135+0000 7f797a7fc700 1 -- 172.21.15.72:0/4164824082 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400bd70 con 0x7f797c158cc0 2023-08-25T04:46:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f79821ff700 1 -- 172.21.15.72:0/4164824082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c158cc0 msgr2=0x7f797c06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f79821ff700 1 --2- 172.21.15.72:0/4164824082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c158cc0 0x7f797c06c990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f797c0720d0 tx=0x7f797400b330 comp rx=0 tx=0).stop 2023-08-25T04:46:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f79821ff700 1 -- 172.21.15.72:0/4164824082 shutdown_connections 2023-08-25T04:46:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f79821ff700 1 --2- 172.21.15.72:0/4164824082 >> v2:172.21.15.72:3300/0 conn(0x7f797c06ced0 0x7f797c070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f79821ff700 1 --2- 172.21.15.72:0/4164824082 >> v2:172.21.15.137:3300/0 conn(0x7f797c06ea80 0x7f797c0cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f79821ff700 1 --2- 172.21.15.72:0/4164824082 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c158cc0 0x7f797c06c990 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f79821ff700 1 -- 172.21.15.72:0/4164824082 >> 172.21.15.72:0/4164824082 conn(0x7f797c0ce9a0 msgr2=0x7f797c0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f9e5d59b700 1 -- 172.21.15.72:0/933849729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e44004850 msgr2=0x7f9e44004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f9e5d59b700 1 --2- 172.21.15.72:0/933849729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e44004850 0x7f9e44004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f9e5d59b700 1 -- 172.21.15.72:0/933849729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e44009a00 msgr2=0x7f9e440052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f9e5d59b700 1 --2- 172.21.15.72:0/933849729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e44009a00 0x7f9e440052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f9e5d59b700 1 -- 172.21.15.72:0/933849729 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e580ca440 con 0x7f9e44003a00 2023-08-25T04:46:01.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.136+0000 7f9e5dd9c700 1 -- 172.21.15.72:0/933849729 reap_dead start 2023-08-25T04:46:01.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.137+0000 7f1f1b1ff700 1 -- 172.21.15.72:0/2277289616 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f14070fa0 msgr2=0x7f1f1416c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.137+0000 7f1f1b1ff700 1 --2- 172.21.15.72:0/2277289616 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f14070fa0 0x7f1f1416c200 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0098a0 tx=0x7f1f0c009bb0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.137+0000 7f1f1b1ff700 1 -- 172.21.15.72:0/2277289616 shutdown_connections 2023-08-25T04:46:01.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.137+0000 7f1f1b1ff700 1 --2- 172.21.15.72:0/2277289616 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f14070fa0 0x7f1f1416c200 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.137+0000 7f1f1b1ff700 1 -- 172.21.15.72:0/2277289616 >> 172.21.15.72:0/2277289616 conn(0x7f1f140ce9a0 msgr2=0x7f1f140ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.137+0000 7f1f1b1ff700 1 -- 172.21.15.72:0/2277289616 shutdown_connections 2023-08-25T04:46:01.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.138+0000 7f9e5d59b700 1 --2- 172.21.15.72:0/933849729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e44003a00 0x7f9e44003e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e480016c0 tx=0x7f9e44005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32c3f33572196556 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.137+0000 7f1f1b1ff700 1 -- 172.21.15.72:0/2277289616 wait complete. 2023-08-25T04:46:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.137+0000 7f79821ff700 1 -- 172.21.15.72:0/4164824082 shutdown_connections 2023-08-25T04:46:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.138+0000 7f79821ff700 1 -- 172.21.15.72:0/4164824082 wait complete. 2023-08-25T04:46:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.139+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480052d0 con 0x7f9e44003a00 2023-08-25T04:46:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.139+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e48005430 con 0x7f9e44003a00 2023-08-25T04:46:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.139+0000 7f9e4ffff700 1 -- 172.21.15.72:0/933849729 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480038e0 con 0x7f9e44003a00 2023-08-25T04:46:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.140+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/933849729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e44003a00 msgr2=0x7f9e44003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.140+0000 7f9e5f7ff700 1 --2- 172.21.15.72:0/933849729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e44003a00 0x7f9e44003e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e480016c0 tx=0x7f9e44005880 comp rx=0 tx=0).stop 2023-08-25T04:46:01.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.140+0000 7f1f1b1ff700 1 Processor -- start 2023-08-25T04:46:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.140+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/933849729 shutdown_connections 2023-08-25T04:46:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.140+0000 7f9e5f7ff700 1 --2- 172.21.15.72:0/933849729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e44003a00 0x7f9e44003e00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.140+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/933849729 >> 172.21.15.72:0/933849729 conn(0x7f9e580ce9a0 msgr2=0x7f9e580ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.140+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/933849729 shutdown_connections 2023-08-25T04:46:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.140+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/933849729 wait complete. 2023-08-25T04:46:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.141+0000 7f1f1b1ff700 1 -- start start 2023-08-25T04:46:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f1f1b1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f14070fa0 0x7f1f1415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f1f1b1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f140add00 0x7f1f140bea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f1f1b1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140ca440 0x7f1f140c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f1f1b1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c3ba0 con 0x7f1f140ca440 2023-08-25T04:46:01.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f1f1b1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c7500 con 0x7f1f140add00 2023-08-25T04:46:01.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f1f1b1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c6bd0 con 0x7f1f14070fa0 2023-08-25T04:46:01.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.140+0000 7f79821ff700 1 Processor -- start 2023-08-25T04:46:01.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.143+0000 7f1f1979c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140ca440 0x7f1f140c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.143+0000 7f1f1979c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140ca440 0x7f1f140c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56126/0 (socket says 172.21.15.72:56126) 2023-08-25T04:46:01.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.143+0000 7f1f1979c700 1 -- 172.21.15.72:0/3259607132 learned_addr learned my addr 172.21.15.72:0/3259607132 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.141+0000 7f79821ff700 1 -- start start 2023-08-25T04:46:01.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.143+0000 7f9e5f7ff700 1 Processor -- start 2023-08-25T04:46:01.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.143+0000 7f9e5f7ff700 1 -- start start 2023-08-25T04:46:01.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f1f1979c700 1 -- 172.21.15.72:0/3259607132 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f14070fa0 msgr2=0x7f1f1415e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f1f1979c700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f14070fa0 0x7f1f1415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f1f1979c700 1 -- 172.21.15.72:0/3259607132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f140add00 msgr2=0x7f1f140bea50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:46:01.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f1f1979c700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f140add00 0x7f1f140bea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f1f1979c700 1 -- 172.21.15.72:0/3259607132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c009550 con 0x7f1f140ca440 2023-08-25T04:46:01.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f1f1979c700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140ca440 0x7f1f140c45e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c004000 tx=0x7f1f0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f79821ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c06ced0 0x7f797c0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f79821ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c06ea80 0x7f797c159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f79821ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f797c158cc0 0x7f797c1faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f79821ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c1552b0 con 0x7f797c06ea80 2023-08-25T04:46:01.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f79821ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0c0780 con 0x7f797c158cc0 2023-08-25T04:46:01.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.142+0000 7f79821ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0c0fe0 con 0x7f797c06ced0 2023-08-25T04:46:01.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.143+0000 7f797affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c06ea80 0x7f797c159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.143+0000 7f797affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c06ea80 0x7f797c159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56112/0 (socket says 172.21.15.72:56112) 2023-08-25T04:46:01.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.143+0000 7f797b7fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c06ced0 0x7f797c0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.143+0000 7f797affd700 1 -- 172.21.15.72:0/1785872216 learned_addr learned my addr 172.21.15.72:0/1785872216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.143+0000 7f797bfff700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f797c158cc0 0x7f797c1faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f797b7fe700 1 -- 172.21.15.72:0/1785872216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f797c158cc0 msgr2=0x7f797c1faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f797b7fe700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f797c158cc0 0x7f797c1faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f797b7fe700 1 -- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c06ea80 msgr2=0x7f797c159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f797b7fe700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c06ea80 0x7f797c159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f797b7fe700 1 -- 172.21.15.72:0/1785872216 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974009b30 con 0x7f797c06ced0 2023-08-25T04:46:01.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f797b7fe700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c06ced0 0x7f797c0c93c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f797000e810 tx=0x7f797000ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f7963fff700 1 -- 172.21.15.72:0/1785872216 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970013610 con 0x7f797c06ced0 2023-08-25T04:46:01.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f7963fff700 1 -- 172.21.15.72:0/1785872216 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7970013770 con 0x7f797c06ced0 2023-08-25T04:46:01.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.144+0000 7f7963fff700 1 -- 172.21.15.72:0/1785872216 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970013b00 con 0x7f797c06ced0 2023-08-25T04:46:01.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.145+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c0c9900 con 0x7f797c06ced0 2023-08-25T04:46:01.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.145+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c0c0d00 con 0x7f797c06ced0 2023-08-25T04:46:01.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.146+0000 7f9e5f7ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e44003a00 0x7f9e580c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.146+0000 7f9e5f7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e580c59e0 0x7f9e5814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.146+0000 7f9e5f7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e581edfb0 0x7f9e581ee430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.146+0000 7f9e5f7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580c47c0 con 0x7f9e581edfb0 2023-08-25T04:46:01.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.146+0000 7f9e5f7ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580c5850 con 0x7f9e44003a00 2023-08-25T04:46:01.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.146+0000 7f9e5f7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5815af90 con 0x7f9e580c59e0 2023-08-25T04:46:01.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.146+0000 7f2d9bfff700 1 Processor -- start 2023-08-25T04:46:01.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.146+0000 7f2d9bfff700 1 -- start start 2023-08-25T04:46:01.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.147+0000 7f9e5cd9a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e580c59e0 0x7f9e5814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.147+0000 7f9e5cd9a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e580c59e0 0x7f9e5814e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51216/0 (socket says 172.21.15.72:51216) 2023-08-25T04:46:01.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.147+0000 7f9e5cd9a700 1 -- 172.21.15.72:0/3831787187 learned_addr learned my addr 172.21.15.72:0/3831787187 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.147+0000 7f9e5dd9c700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e581edfb0 0x7f9e581ee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.145+0000 7f1f097fa700 1 -- 172.21.15.72:0/3259607132 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c011630 con 0x7f1f140ca440 2023-08-25T04:46:01.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.145+0000 7f1f097fa700 1 -- 172.21.15.72:0/3259607132 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c011790 con 0x7f1f140ca440 2023-08-25T04:46:01.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.145+0000 7f1f097fa700 1 -- 172.21.15.72:0/3259607132 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c011b00 con 0x7f1f140ca440 2023-08-25T04:46:01.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.145+0000 7f1f1b1ff700 1 -- 172.21.15.72:0/3259607132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f140c6eb0 con 0x7f1f140ca440 2023-08-25T04:46:01.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.147+0000 7f1f1b1ff700 1 -- 172.21.15.72:0/3259607132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1415e800 con 0x7f1f140ca440 2023-08-25T04:46:01.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.148+0000 7f1efaffd700 1 -- 172.21.15.72:0/3259607132 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f140afa90 con 0x7f1f140ca440 2023-08-25T04:46:01.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.148+0000 7f2d9bfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d94160710 0x7f2d940b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.149+0000 7f2d9bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d940b4800 0x7f2d940b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.149+0000 7f2d9bfff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2d940d10e0 0x7f2d940d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.149+0000 7f2d9bfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d940b51c0 con 0x7f2d940b4800 2023-08-25T04:46:01.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.149+0000 7f2d9bfff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d940b8d30 con 0x7f2d940d10e0 2023-08-25T04:46:01.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.149+0000 7f2d9bfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d940b7650 con 0x7f2d94160710 2023-08-25T04:46:01.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.149+0000 7f2d9a59c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2d940d10e0 0x7f2d940d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.150+0000 7f2d9a59c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2d940d10e0 0x7f2d940d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:59924/0 (socket says 172.21.15.72:59924) 2023-08-25T04:46:01.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.150+0000 7f2d9a59c700 1 -- 172.21.15.72:0/1759723932 learned_addr learned my addr 172.21.15.72:0/1759723932 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.150+0000 7f7963fff700 1 -- 172.21.15.72:0/1785872216 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7970013c60 con 0x7f797c06ced0 2023-08-25T04:46:01.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.150+0000 7f2d9959a700 1 --2- 172.21.15.72:0/1759723932 >> v2:172.21.15.72:3300/0 conn(0x7f2d940b4800 0x7f2d940b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.148+0000 7f9e5dd9c700 1 -- 172.21.15.72:0/3831787187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e580c59e0 msgr2=0x7f9e5814e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.148+0000 7f9e5dd9c700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e580c59e0 0x7f9e5814e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.148+0000 7f9e5dd9c700 1 -- 172.21.15.72:0/3831787187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e44003a00 msgr2=0x7f9e580c5310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:46:01.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.148+0000 7f9e5dd9c700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e44003a00 0x7f9e580c5310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.148+0000 7f9e5dd9c700 1 -- 172.21.15.72:0/3831787187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e581ee970 con 0x7f9e581edfb0 2023-08-25T04:46:01.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.148+0000 7f9e5dd9c700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e581edfb0 0x7f9e581ee430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9e58072180 tx=0x7f9e5400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.150+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f797c0cb180 con 0x7f797c06ced0 2023-08-25T04:46:01.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.151+0000 7f7963fff700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f796806a1b0 0x7f796806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.151+0000 7f7963fff700 1 -- 172.21.15.72:0/1785872216 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7970088380 con 0x7f797c06ced0 2023-08-25T04:46:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.151+0000 7f9e4dffb700 1 -- 172.21.15.72:0/3831787187 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540074e0 con 0x7f9e581edfb0 2023-08-25T04:46:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f9e4dffb700 1 -- 172.21.15.72:0/3831787187 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e54007640 con 0x7f9e581edfb0 2023-08-25T04:46:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f9e4dffb700 1 -- 172.21.15.72:0/3831787187 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54005a50 con 0x7f9e581edfb0 2023-08-25T04:46:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5815b230 con 0x7f9e581edfb0 2023-08-25T04:46:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5815b7f0 con 0x7f9e581edfb0 2023-08-25T04:46:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f7963fff700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:6800/3772137413,v1:172.21.15.72:6801/3772137413] conn(0x7f7968073e10 0x7f7968076250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f7963fff700 1 -- 172.21.15.72:0/1785872216 --> [v2:172.21.15.72:6800/3772137413,v1:172.21.15.72:6801/3772137413] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7968076920 con 0x7f7968073e10 2023-08-25T04:46:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f7963fff700 1 -- 172.21.15.72:0/1785872216 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7970053620 con 0x7f797c06ced0 2023-08-25T04:46:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f2d99d9b700 1 --2- 172.21.15.72:0/1759723932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d94160710 0x7f2d940b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f2d9a59c700 1 -- 172.21.15.72:0/1759723932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d94160710 msgr2=0x7f2d940b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f2d9a59c700 1 --2- 172.21.15.72:0/1759723932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d94160710 0x7f2d940b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f2d9a59c700 1 -- 172.21.15.72:0/1759723932 >> v2:172.21.15.72:3300/0 conn(0x7f2d940b4800 msgr2=0x7f2d940b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f2d9a59c700 1 --2- 172.21.15.72:0/1759723932 >> v2:172.21.15.72:3300/0 conn(0x7f2d940b4800 0x7f2d940b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.152+0000 7f2d9a59c700 1 -- 172.21.15.72:0/1759723932 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940b7930 con 0x7f2d940d10e0 2023-08-25T04:46:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.153+0000 7f797affd700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f796806a1b0 0x7f796806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.153+0000 7f2d9a59c700 1 --2- 172.21.15.72:0/1759723932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d940d10e0 0x7f2d940d1540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2d940d0900 tx=0x7f2d84009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c2fd97ba220b701 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.153+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e38000fc0 con 0x7f9e581edfb0 2023-08-25T04:46:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.153+0000 7f1f097fa700 1 -- 172.21.15.72:0/3259607132 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f0c021070 con 0x7f1f140ca440 2023-08-25T04:46:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.153+0000 7f797bfff700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:6800/3772137413,v1:172.21.15.72:6801/3772137413] conn(0x7f7968073e10 0x7f7968076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.154+0000 7f797affd700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f796806a1b0 0x7f796806c670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f797c0c28f0 tx=0x7f7974009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.156+0000 7f9e4dffb700 1 -- 172.21.15.72:0/3831787187 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9e54005bb0 con 0x7f9e581edfb0 2023-08-25T04:46:01.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.155+0000 7f1f097fa700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1f0006a130 0x7f1f0006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.155+0000 7f1f097fa700 1 -- 172.21.15.72:0/3259607132 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1f0c08a090 con 0x7f1f140ca440 2023-08-25T04:46:01.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.155+0000 7f1f097fa700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:6816/1825299555,v1:172.21.15.72:6817/1825299555] conn(0x7f1f00073e10 0x7f1f00076250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.155+0000 7f1f097fa700 1 -- 172.21.15.72:0/3259607132 --> [v2:172.21.15.72:6816/1825299555,v1:172.21.15.72:6817/1825299555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f00076920 con 0x7f1f00073e10 2023-08-25T04:46:01.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.155+0000 7f1f097fa700 1 -- 172.21.15.72:0/3259607132 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f0c08a400 con 0x7f1f140ca440 2023-08-25T04:46:01.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.155+0000 7f797bfff700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:6800/3772137413,v1:172.21.15.72:6801/3772137413] conn(0x7f7968073e10 0x7f7968076250 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.155+0000 7f2d98d99700 1 -- 172.21.15.72:0/1759723932 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400b870 con 0x7f2d940d10e0 2023-08-25T04:46:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.155+0000 7f2d98d99700 1 -- 172.21.15.72:0/1759723932 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8400b9d0 con 0x7f2d940d10e0 2023-08-25T04:46:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.155+0000 7f2d98d99700 1 -- 172.21.15.72:0/1759723932 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400bd40 con 0x7f2d940d10e0 2023-08-25T04:46:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.156+0000 7f2d9bfff700 1 -- 172.21.15.72:0/1759723932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d940d10e0 msgr2=0x7f2d940d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.156+0000 7f2d9bfff700 1 --2- 172.21.15.72:0/1759723932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d940d10e0 0x7f2d940d1540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2d940d0900 tx=0x7f2d84009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.156+0000 7f2d9bfff700 1 -- 172.21.15.72:0/1759723932 shutdown_connections 2023-08-25T04:46:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.156+0000 7f2d9bfff700 1 --2- 172.21.15.72:0/1759723932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d94160710 0x7f2d940b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.156+0000 7f2d9bfff700 1 --2- 172.21.15.72:0/1759723932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d940d10e0 0x7f2d940d1540 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.156+0000 7f2d9bfff700 1 --2- 172.21.15.72:0/1759723932 >> v2:172.21.15.72:3300/0 conn(0x7f2d940b4800 0x7f2d940b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.156+0000 7f2d9bfff700 1 -- 172.21.15.72:0/1759723932 >> 172.21.15.72:0/1759723932 conn(0x7f2d94071e40 msgr2=0x7f2d94072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.154+0000 7f95fd9ff700 1 Processor -- start 2023-08-25T04:46:01.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.156+0000 7f7963fff700 1 -- 172.21.15.72:0/1785872216 <== osd.2 v2:172.21.15.72:6800/3772137413 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7968076920 con 0x7f7968073e10 2023-08-25T04:46:01.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f2d9bfff700 1 -- 172.21.15.72:0/1759723932 shutdown_connections 2023-08-25T04:46:01.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f9e4dffb700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9e3c06a1b0 0x7f9e3c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f9e4dffb700 1 -- 172.21.15.72:0/3831787187 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9e54088640 con 0x7f9e581edfb0 2023-08-25T04:46:01.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f9e4dffb700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:6808/3711160113,v1:172.21.15.72:6809/3711160113] conn(0x7f9e3c073e90 0x7f9e3c0762d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f9e4dffb700 1 -- 172.21.15.72:0/3831787187 --> [v2:172.21.15.72:6808/3711160113,v1:172.21.15.72:6809/3711160113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e3c0769a0 con 0x7f9e3c073e90 2023-08-25T04:46:01.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f9e4dffb700 1 -- 172.21.15.72:0/3831787187 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e540889f0 con 0x7f9e581edfb0 2023-08-25T04:46:01.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.155+0000 7f95fd9ff700 1 -- start start 2023-08-25T04:46:01.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f95fd9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95f8070fa0 0x7f95f816c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f95fd9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f806db40 con 0x7f95f80ca440 2023-08-25T04:46:01.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f95fd9ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f8161ad0 con 0x7f95f80add00 2023-08-25T04:46:01.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f95fd9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f80ca940 con 0x7f95f8070fa0 2023-08-25T04:46:01.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.158+0000 7f1f0bfff700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:6816/1825299555,v1:172.21.15.72:6817/1825299555] conn(0x7f1f00073e10 0x7f1f00076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.158+0000 7f9e5cd9a700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:6808/3711160113,v1:172.21.15.72:6809/3711160113] conn(0x7f9e3c073e90 0x7f9e3c0762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.159+0000 7f9e5d59b700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9e3c06a1b0 0x7f9e3c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.159+0000 7f1f18f9b700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1f0006a130 0x7f1f0006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.159+0000 7f95f6ffd700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f95f80add00 0x7f95f806d430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:58054/0 (socket says 172.21.15.72:58054) 2023-08-25T04:46:01.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.159+0000 7f95f6ffd700 1 -- 172.21.15.72:0/3226333001 learned_addr learned my addr 172.21.15.72:0/3226333001 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:01.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.160+0000 7f9e5cd9a700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:6808/3711160113,v1:172.21.15.72:6809/3711160113] conn(0x7f9e3c073e90 0x7f9e3c0762d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f9e4dffb700 1 -- 172.21.15.72:0/3831787187 <== osd.0 v2:172.21.15.72:6808/3711160113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9e3c0769a0 con 0x7f9e3c073e90 2023-08-25T04:46:01.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.161+0000 7f1f18f9b700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1f0006a130 0x7f1f0006c5f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1f10007fd0 tx=0x7f1f10007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.157+0000 7f2d9bfff700 1 -- 172.21.15.72:0/1759723932 wait complete. 2023-08-25T04:46:01.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.160+0000 7f2d9bfff700 1 Processor -- start 2023-08-25T04:46:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.160+0000 7f2d9bfff700 1 -- start start 2023-08-25T04:46:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f2d9bfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d940b4800 0x7f2d941f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.159+0000 7efc2a9ff700 1 Processor -- start 2023-08-25T04:46:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.159+0000 7efc2a9ff700 1 -- start start 2023-08-25T04:46:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.161+0000 7efc2a9ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc24070890 0x7efc240c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.161+0000 7efc2a9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc240caeb0 con 0x7efc24070c70 2023-08-25T04:46:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.161+0000 7efc2a9ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc240afa70 con 0x7efc240b0550 2023-08-25T04:46:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.161+0000 7efc2a9ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc240b0130 con 0x7efc24070890 2023-08-25T04:46:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f2d9bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d940d10e0 0x7f2d941ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f2d9bfff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d94160710 0x7f2d9415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f2d9bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94200350 con 0x7f2d940d10e0 2023-08-25T04:46:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f2d9bfff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94200630 con 0x7f2d94160710 2023-08-25T04:46:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f2d9bfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94200910 con 0x7f2d940b4800 2023-08-25T04:46:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276184996 0 0) 0x7f95f8161ad0 con 0x7f95f80add00 2023-08-25T04:46:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e40035b0 con 0x7f95f80add00 2023-08-25T04:46:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f1f0bfff700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:6816/1825299555,v1:172.21.15.72:6817/1825299555] conn(0x7f1f00073e10 0x7f1f00076250 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f2d99d9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d940b4800 0x7f2d941f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f2d99d9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d940b4800 0x7f2d941f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51224/0 (socket says 172.21.15.72:51224) 2023-08-25T04:46:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.162+0000 7f2d99d9b700 1 -- 172.21.15.72:0/170808295 learned_addr learned my addr 172.21.15.72:0/170808295 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7f2d9a59c700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d94160710 0x7f2d9415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7f2d9959a700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d940d10e0 0x7f2d941ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7f2d99d9b700 1 -- 172.21.15.72:0/170808295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d94160710 msgr2=0x7f2d9415e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7f2d99d9b700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d94160710 0x7f2d9415e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7f2d99d9b700 1 -- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d940d10e0 msgr2=0x7f2d941ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7f2d99d9b700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d940d10e0 0x7f2d941ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7f2d99d9b700 1 -- 172.21.15.72:0/170808295 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d84009550 con 0x7f2d940b4800 2023-08-25T04:46:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7efc237fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efc24070c70 0x7efc240ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53218/0 (socket says 172.21.15.72:53218) 2023-08-25T04:46:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7efc28f9c700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7efc240b0550 0x7efc240b09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:58070/0 (socket says 172.21.15.72:58070) 2023-08-25T04:46:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7efc28f9c700 1 -- 172.21.15.72:0/3800051761 learned_addr learned my addr 172.21.15.72:0/3800051761 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7efc23fff700 1 --2- 172.21.15.72:0/3800051761 >> v2:172.21.15.137:3300/0 conn(0x7efc24070890 0x7efc240c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415298240 0 0) 0x7efc240afa70 con 0x7efc240b0550 2023-08-25T04:46:01.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc0c0035b0 con 0x7efc240b0550 2023-08-25T04:46:01.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.163+0000 7f95f77fe700 1 --2- 172.21.15.72:0/3226333001 >> v2:172.21.15.72:3300/0 conn(0x7f95f8070fa0 0x7f95f816c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2422707855 0 0) 0x7f95e40035b0 con 0x7f95f80add00 2023-08-25T04:46:01.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 >> v2:172.21.15.72:3300/0 conn(0x7f95f8070fa0 msgr2=0x7f95f816c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 --2- 172.21.15.72:0/3226333001 >> v2:172.21.15.72:3300/0 conn(0x7f95f8070fa0 0x7f95f816c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 >> v1:172.21.15.72:6789/0 conn(0x7f95f80ca440 legacy=0x7f95f8070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f1f097fa700 1 -- 172.21.15.72:0/3259607132 <== osd.1 v2:172.21.15.72:6816/1825299555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1f00076920 con 0x7f1f00073e10 2023-08-25T04:46:01.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f2d99d9b700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d940b4800 0x7f2d941f3590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00ccd0 tx=0x7f2d8c00a4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80cac20 con 0x7f95f80add00 2023-08-25T04:46:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f95e8001670 con 0x7f95f80add00 2023-08-25T04:46:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 >> v1:172.21.15.137:6789/0 conn(0x7f95f80add00 legacy=0x7f95f806d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 --2- 172.21.15.72:0/3226333001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95e4003a00 0x7f95e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 --2- 172.21.15.72:0/3226333001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95e4004850 0x7f95e4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 --2- 172.21.15.72:0/3226333001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e4005210 0x7f95e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80ca940 con 0x7f95e4004850 2023-08-25T04:46:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e400c140 con 0x7f95e4005210 2023-08-25T04:46:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e400c300 con 0x7f95e4003a00 2023-08-25T04:46:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7f95f77fe700 1 --2- 172.21.15.72:0/3226333001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e4005210 0x7f95e400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7f95f6ffd700 1 --2- 172.21.15.72:0/3226333001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95e4003a00 0x7f95e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.164+0000 7f9e5d59b700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9e3c06a1b0 0x7f9e3c06c670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e580c2af0 tx=0x7f9e4800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 381107732 0 0) 0x7efc0c0035b0 con 0x7efc240b0550 2023-08-25T04:46:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 >> v2:172.21.15.137:3300/0 conn(0x7efc24070890 msgr2=0x7efc240c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 --2- 172.21.15.72:0/3800051761 >> v2:172.21.15.137:3300/0 conn(0x7efc24070890 0x7efc240c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 >> v1:172.21.15.72:6789/0 conn(0x7efc24070c70 legacy=0x7efc240ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc240afd50 con 0x7efc240b0550 2023-08-25T04:46:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7efc1c0019f0 con 0x7efc240b0550 2023-08-25T04:46:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 >> v1:172.21.15.137:6789/0 conn(0x7efc240b0550 legacy=0x7efc240b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc0c003a00 0x7efc0c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc0c004850 0x7efc0c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c005210 0x7efc0c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc240b0130 con 0x7efc0c005210 2023-08-25T04:46:01.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c00c140 con 0x7efc0c004850 2023-08-25T04:46:01.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c00c300 con 0x7efc0c003a00 2023-08-25T04:46:01.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.165+0000 7f2d8a7fc700 1 -- 172.21.15.72:0/170808295 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c00ad30 con 0x7f2d940b4800 2023-08-25T04:46:01.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7f2d8a7fc700 1 -- 172.21.15.72:0/170808295 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c00ae90 con 0x7f2d940b4800 2023-08-25T04:46:01.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7f2d8a7fc700 1 -- 172.21.15.72:0/170808295 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c003c40 con 0x7f2d940b4800 2023-08-25T04:46:01.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d94200bf0 con 0x7f2d940b4800 2023-08-25T04:46:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9415ee00 con 0x7f2d940b4800 2023-08-25T04:46:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7f95f77fe700 1 -- 172.21.15.72:0/3226333001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95e4003a00 msgr2=0x7f95e4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7f95f77fe700 1 --2- 172.21.15.72:0/3226333001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95e4003a00 0x7f95e4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7f95f77fe700 1 -- 172.21.15.72:0/3226333001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95e4004850 msgr2=0x7f95e4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7f95f77fe700 1 --2- 172.21.15.72:0/3226333001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95e4004850 0x7f95e4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7f95f77fe700 1 -- 172.21.15.72:0/3226333001 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80cac20 con 0x7f95e4005210 2023-08-25T04:46:01.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7f95f77fe700 1 -- 172.21.15.72:0/3226333001 reap_dead start 2023-08-25T04:46:01.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.166+0000 7efc237fe700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc0c004850 0x7efc0c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.167+0000 7f95f77fe700 1 --2- 172.21.15.72:0/3226333001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e4005210 0x7f95e400ba10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f95f0007330 tx=0x7f95e4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a2e0ea162cea4c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.167+0000 7efc23fff700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc0c003a00 0x7efc0c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.167+0000 7efc28f9c700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c005210 0x7efc0c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.167+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0007e50 con 0x7f95e4005210 2023-08-25T04:46:01.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.167+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f0003a20 con 0x7f95e4005210 2023-08-25T04:46:01.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.167+0000 7f95f5ffb700 1 -- 172.21.15.72:0/3226333001 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0003dd0 con 0x7f95e4005210 2023-08-25T04:46:01.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.168+0000 7efc28f9c700 1 -- 172.21.15.72:0/3800051761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc0c003a00 msgr2=0x7efc0c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.168+0000 7efc28f9c700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc0c003a00 0x7efc0c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.168+0000 7efc28f9c700 1 -- 172.21.15.72:0/3800051761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc0c004850 msgr2=0x7efc0c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.168+0000 7efc28f9c700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc0c004850 0x7efc0c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.168+0000 7efc28f9c700 1 -- 172.21.15.72:0/3800051761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc240afd50 con 0x7efc0c005210 2023-08-25T04:46:01.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.168+0000 7efc28f9c700 1 -- 172.21.15.72:0/3800051761 reap_dead start 2023-08-25T04:46:01.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.168+0000 7efc28f9c700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c005210 0x7efc0c00ba10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00a850 tx=0x7efc0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c08c37d36933031 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.169+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c00a2f0 con 0x7efc0c005210 2023-08-25T04:46:01.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.169+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c012620 con 0x7efc0c005210 2023-08-25T04:46:01.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.169+0000 7efc22ffd700 1 -- 172.21.15.72:0/3800051761 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0129d0 con 0x7efc0c005210 2023-08-25T04:46:01.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.168+0000 7f95fd9ff700 1 -- 172.21.15.72:0/3226333001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e4005210 msgr2=0x7f95e400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.168+0000 7f95fd9ff700 1 --2- 172.21.15.72:0/3226333001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e4005210 0x7f95e400ba10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f95f0007330 tx=0x7f95e4005880 comp rx=0 tx=0).stop 2023-08-25T04:46:01.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.170+0000 7efc2a9ff700 1 -- 172.21.15.72:0/3800051761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c005210 msgr2=0x7efc0c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.170+0000 7efc2a9ff700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c005210 0x7efc0c00ba10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00a850 tx=0x7efc0c005880 comp rx=0 tx=0).stop 2023-08-25T04:46:01.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.170+0000 7efc2a9ff700 1 -- 172.21.15.72:0/3800051761 shutdown_connections 2023-08-25T04:46:01.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.170+0000 7efc2a9ff700 1 --2- 172.21.15.72:0/3800051761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc0c005210 0x7efc0c00ba10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.170+0000 7efc2a9ff700 1 -- 172.21.15.72:0/3800051761 >> 172.21.15.72:0/3800051761 conn(0x7efc240ce9a0 msgr2=0x7efc240ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.170+0000 7f95fd9ff700 1 -- 172.21.15.72:0/3226333001 shutdown_connections 2023-08-25T04:46:01.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.170+0000 7f95fd9ff700 1 --2- 172.21.15.72:0/3226333001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e4005210 0x7f95e400ba10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.170+0000 7f95fd9ff700 1 -- 172.21.15.72:0/3226333001 >> 172.21.15.72:0/3226333001 conn(0x7f95f80ce9a0 msgr2=0x7f95f80ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.170+0000 7f2d8a7fc700 1 -- 172.21.15.72:0/170808295 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2d8c004020 con 0x7f2d940b4800 2023-08-25T04:46:01.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.171+0000 7efc2a9ff700 1 -- 172.21.15.72:0/3800051761 shutdown_connections 2023-08-25T04:46:01.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.171+0000 7efc2a9ff700 1 -- 172.21.15.72:0/3800051761 wait complete. 2023-08-25T04:46:01.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.171+0000 7f95fd9ff700 1 -- 172.21.15.72:0/3226333001 shutdown_connections 2023-08-25T04:46:01.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.171+0000 7f2d8a7fc700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2d7806a1b0 0x7f2d7806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.172+0000 7f2d8a7fc700 1 -- 172.21.15.72:0/170808295 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d8c0889b0 con 0x7f2d940b4800 2023-08-25T04:46:01.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.173+0000 7f2d9bfff700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:6818/3896481440,v1:172.21.15.72:6820/3896481440] conn(0x7f2d7c0015e0 0x7f2d7c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.173+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 --> [v2:172.21.15.72:6818/3896481440,v1:172.21.15.72:6820/3896481440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d7c006bd0 con 0x7f2d7c0015e0 2023-08-25T04:46:01.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.173+0000 7f2d9959a700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2d7806a1b0 0x7f2d7806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.174+0000 7f2d9959a700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2d7806a1b0 0x7f2d7806c670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d941f3150 tx=0x7f2d90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.173+0000 7efc2a9ff700 1 Processor -- start 2023-08-25T04:46:01.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.171+0000 7f95fd9ff700 1 -- 172.21.15.72:0/3226333001 wait complete. 2023-08-25T04:46:01.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.174+0000 7f95fd9ff700 1 Processor -- start 2023-08-25T04:46:01.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.173+0000 7ff21e7ff700 1 Processor -- start 2023-08-25T04:46:01.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.173+0000 7ff21e7ff700 1 -- start start 2023-08-25T04:46:01.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.175+0000 7f2d9a59c700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:6818/3896481440,v1:172.21.15.72:6820/3896481440] conn(0x7f2d7c0015e0 0x7f2d7c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.174+0000 7efc2a9ff700 1 -- start start 2023-08-25T04:46:01.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7f2d9a59c700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:6818/3896481440,v1:172.21.15.72:6820/3896481440] conn(0x7f2d7c0015e0 0x7f2d7c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.175+0000 7ff21e7ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff21806ea80 0x7ff218158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.175+0000 7ff21e7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2180cac40 0x7ff21806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.175+0000 7ff21e7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff21806ced0 0x7ff218070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7ff21e7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21806d980 con 0x7ff21806ced0 2023-08-25T04:46:01.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7ff21e7ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2181593e0 con 0x7ff21806ea80 2023-08-25T04:46:01.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7ff21e7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21806d3c0 con 0x7ff2180cac40 2023-08-25T04:46:01.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7efc2a9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc0c005210 0x7efc24160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7efc2a9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc24160d60 0x7efc24143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7efc2a9ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc24144090 0x7efc241615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7efc2a9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc241611e0 con 0x7efc24160d60 2023-08-25T04:46:01.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7efc2a9ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc24145420 con 0x7efc24144090 2023-08-25T04:46:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7efc2a9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc241448a0 con 0x7efc0c005210 2023-08-25T04:46:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.174+0000 7f95fd9ff700 1 -- start start 2023-08-25T04:46:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7f95fd9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95e4005210 0x7f95f8160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7f95fd9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95f80b23e0 0x7f95f8200270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7f95fd9ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95f80b2860 0x7f95f82007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7f95fd9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b1340 con 0x7f95f80b23e0 2023-08-25T04:46:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7f95fd9ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b1620 con 0x7f95f80b2860 2023-08-25T04:46:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.176+0000 7f95fd9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b1900 con 0x7f95e4005210 2023-08-25T04:46:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.177+0000 7ff2177fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2180cac40 0x7ff21806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.177+0000 7ff2177fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2180cac40 0x7ff21806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51252/0 (socket says 172.21.15.72:51252) 2023-08-25T04:46:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.177+0000 7ff2177fe700 1 -- 172.21.15.72:0/4134953581 learned_addr learned my addr 172.21.15.72:0/4134953581 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.177+0000 7efc28f9c700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc24144090 0x7efc241615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.177+0000 7efc28f9c700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc24144090 0x7efc241615c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:59988/0 (socket says 172.21.15.72:59988) 2023-08-25T04:46:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.177+0000 7efc28f9c700 1 -- 172.21.15.72:0/2016425190 learned_addr learned my addr 172.21.15.72:0/2016425190 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.177+0000 7ff21cd9c700 1 --2- 172.21.15.72:0/4134953581 >> v2:172.21.15.72:3300/0 conn(0x7ff21806ced0 0x7ff218070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7efc237fe700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc24160d60 0x7efc24143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7efc28f9c700 1 -- 172.21.15.72:0/2016425190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc0c005210 msgr2=0x7efc24160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7efc28f9c700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc0c005210 0x7efc24160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7efc28f9c700 1 -- 172.21.15.72:0/2016425190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc24160d60 msgr2=0x7efc24143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7efc28f9c700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc24160d60 0x7efc24143b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7efc28f9c700 1 -- 172.21.15.72:0/2016425190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24144b80 con 0x7efc24144090 2023-08-25T04:46:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7f95f67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95f80b23e0 0x7f95f8200270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7f95f67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95f80b23e0 0x7f95f8200270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56182/0 (socket says 172.21.15.72:56182) 2023-08-25T04:46:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7f95f67fc700 1 -- 172.21.15.72:0/733859850 learned_addr learned my addr 172.21.15.72:0/733859850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7ff21cd9c700 1 -- 172.21.15.72:0/4134953581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2180cac40 msgr2=0x7ff21806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7ff21cd9c700 1 --2- 172.21.15.72:0/4134953581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2180cac40 0x7ff21806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7ff21cd9c700 1 -- 172.21.15.72:0/4134953581 >> v2:172.21.15.137:3300/0 conn(0x7ff21806ea80 msgr2=0x7ff218158ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:46:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7ff21cd9c700 1 --2- 172.21.15.72:0/4134953581 >> v2:172.21.15.137:3300/0 conn(0x7ff21806ea80 0x7ff218158ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.178+0000 7ff21cd9c700 1 -- 172.21.15.72:0/4134953581 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21806d6a0 con 0x7ff21806ced0 2023-08-25T04:46:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7f2d8a7fc700 1 -- 172.21.15.72:0/170808295 <== osd.3 v2:172.21.15.72:6818/3896481440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2d7c006bd0 con 0x7f2d7c0015e0 2023-08-25T04:46:01.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7efc28f9c700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc24144090 0x7efc241615c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc240c8e90 tx=0x7efc1c001cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7f95f67fc700 1 -- 172.21.15.72:0/733859850 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95e4005210 msgr2=0x7f95f8160ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:46:01.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7f95f67fc700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95e4005210 0x7f95f8160ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7f95f67fc700 1 -- 172.21.15.72:0/733859850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95f80b2860 msgr2=0x7f95f82007b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:46:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7f95f67fc700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95f80b2860 0x7f95f82007b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7ff21cd9c700 1 --2- 172.21.15.72:0/4134953581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff21806ced0 0x7ff218070890 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff2180720d0 tx=0x7ff20c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d06267aa9788064 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7f95f67fc700 1 -- 172.21.15.72:0/733859850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80b1be0 con 0x7f95f80b23e0 2023-08-25T04:46:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7efc20ff9700 1 -- 172.21.15.72:0/2016425190 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c013ea0 con 0x7efc24144090 2023-08-25T04:46:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7efc20ff9700 1 -- 172.21.15.72:0/2016425190 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c0019c0 con 0x7efc24144090 2023-08-25T04:46:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7efc20ff9700 1 -- 172.21.15.72:0/2016425190 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c01d640 con 0x7efc24144090 2023-08-25T04:46:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.181+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc24144e60 con 0x7efc24144090 2023-08-25T04:46:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.181+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc24144520 con 0x7efc24144090 2023-08-25T04:46:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.179+0000 7f95f67fc700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95f80b23e0 0x7f95f8200270 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f95e000c3c0 tx=0x7f95e000c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.180+0000 7fa9d4fff700 1 Processor -- start 2023-08-25T04:46:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.180+0000 7fa9d4fff700 1 -- start start 2023-08-25T04:46:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.180+0000 7ff216ffd700 1 -- 172.21.15.72:0/4134953581 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c011830 con 0x7ff21806ced0 2023-08-25T04:46:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.180+0000 7ff216ffd700 1 -- 172.21.15.72:0/4134953581 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c011990 con 0x7ff21806ced0 2023-08-25T04:46:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.180+0000 7ff216ffd700 1 -- 172.21.15.72:0/4134953581 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c011d00 con 0x7ff21806ced0 2023-08-25T04:46:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.181+0000 7ff21e7ff700 1 -- 172.21.15.72:0/4134953581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff21806ced0 msgr2=0x7ff218070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.181+0000 7ff21e7ff700 1 --2- 172.21.15.72:0/4134953581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff21806ced0 0x7ff218070890 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff2180720d0 tx=0x7ff20c009b20 comp rx=0 tx=0).stop 2023-08-25T04:46:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.181+0000 7ff21e7ff700 1 -- 172.21.15.72:0/4134953581 shutdown_connections 2023-08-25T04:46:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.181+0000 7ff21e7ff700 1 --2- 172.21.15.72:0/4134953581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff21806ced0 0x7ff218070890 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.181+0000 7ff21e7ff700 1 --2- 172.21.15.72:0/4134953581 >> v2:172.21.15.137:3300/0 conn(0x7ff21806ea80 0x7ff218158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.181+0000 7ff21e7ff700 1 --2- 172.21.15.72:0/4134953581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2180cac40 0x7ff21806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.181+0000 7ff21e7ff700 1 -- 172.21.15.72:0/4134953581 >> 172.21.15.72:0/4134953581 conn(0x7ff2180ce9a0 msgr2=0x7ff2180ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.183+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc240722d0 con 0x7efc24144090 2023-08-25T04:46:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.182+0000 7f95effff700 1 -- 172.21.15.72:0/733859850 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0011790 con 0x7f95f80b23e0 2023-08-25T04:46:01.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.182+0000 7f95effff700 1 -- 172.21.15.72:0/733859850 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e00118f0 con 0x7f95f80b23e0 2023-08-25T04:46:01.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.182+0000 7f95effff700 1 -- 172.21.15.72:0/733859850 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0011c60 con 0x7f95f80b23e0 2023-08-25T04:46:01.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.182+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f80b1ec0 con 0x7f95f80b23e0 2023-08-25T04:46:01.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.182+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f8162a70 con 0x7f95f80b23e0 2023-08-25T04:46:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.182+0000 7fa9d4fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa9d0159f10 0x7fa9d006dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.182+0000 7fa9d4fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d00b4350 con 0x7fa9d00ade50 2023-08-25T04:46:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.182+0000 7fa9d4fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d00b45a0 con 0x7fa9d0159b30 2023-08-25T04:46:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.182+0000 7fa9d4fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d00b4880 con 0x7fa9d0159f10 2023-08-25T04:46:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.184+0000 7fa9ced9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa9d00ade50 0x7fa9d00c8f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53232/0 (socket says 172.21.15.72:53232) 2023-08-25T04:46:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.184+0000 7fa9ced9d700 1 -- 172.21.15.72:0/2871355886 learned_addr learned my addr 172.21.15.72:0/2871355886 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.186+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95f80afa90 con 0x7f95f80b23e0 2023-08-25T04:46:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.186+0000 7f95effff700 1 -- 172.21.15.72:0/733859850 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f95e001c460 con 0x7f95f80b23e0 2023-08-25T04:46:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.186+0000 7ff21e7ff700 1 -- 172.21.15.72:0/4134953581 shutdown_connections 2023-08-25T04:46:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.185+0000 7efc20ff9700 1 -- 172.21.15.72:0/2016425190 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efc1c01d7a0 con 0x7efc24144090 2023-08-25T04:46:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7efc20ff9700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc1006a1b0 0x7efc1006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7efc20ff9700 1 -- 172.21.15.72:0/2016425190 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efc1c08a7f0 con 0x7efc24144090 2023-08-25T04:46:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796438127 0 0) 0x7fa9d00b45a0 con 0x7fa9d0159b30 2023-08-25T04:46:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b80035b0 con 0x7fa9d0159b30 2023-08-25T04:46:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246341514 0 0) 0x7fa9d00b4350 con 0x7fa9d00ade50 2023-08-25T04:46:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d00b45a0 con 0x7fa9d00ade50 2023-08-25T04:46:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7fa9cdd9b700 1 --2- 172.21.15.72:0/2871355886 >> v2:172.21.15.137:3300/0 conn(0x7fa9d0159f10 0x7fa9d006dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7efc20ff9700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.137:6824/3706321311,v1:172.21.15.137:6825/3706321311] conn(0x7efc10073e90 0x7efc100762d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7efc20ff9700 1 -- 172.21.15.72:0/2016425190 --> [v2:172.21.15.137:6824/3706321311,v1:172.21.15.137:6825/3706321311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc100769a0 con 0x7efc10073e90 2023-08-25T04:46:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7efc20ff9700 1 -- 172.21.15.72:0/2016425190 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc1c08ce10 con 0x7efc24144090 2023-08-25T04:46:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7f95effff700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d806a1b0 0x7f95d806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.187+0000 7f95effff700 1 -- 172.21.15.72:0/733859850 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95e0088480 con 0x7f95f80b23e0 2023-08-25T04:46:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.188+0000 7f95effff700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.137:6800/1114533448,v1:172.21.15.137:6801/1114533448] conn(0x7f95d8073e90 0x7f95d80762d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.188+0000 7f95effff700 1 -- 172.21.15.72:0/733859850 --> [v2:172.21.15.137:6800/1114533448,v1:172.21.15.137:6801/1114533448] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95d80769a0 con 0x7f95d8073e90 2023-08-25T04:46:01.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.188+0000 7f95effff700 1 -- 172.21.15.72:0/733859850 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95e008aa00 con 0x7f95f80b23e0 2023-08-25T04:46:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.188+0000 7efc23fff700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc1006a1b0 0x7efc1006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7efc237fe700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.137:6824/3706321311,v1:172.21.15.137:6825/3706321311] conn(0x7efc10073e90 0x7efc100762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1473805788 0 0) 0x7fa9b80035b0 con 0x7fa9d0159b30 2023-08-25T04:46:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 >> v2:172.21.15.137:3300/0 conn(0x7fa9d0159f10 msgr2=0x7fa9d006dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 --2- 172.21.15.72:0/2871355886 >> v2:172.21.15.137:3300/0 conn(0x7fa9d0159f10 0x7fa9d006dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 >> v1:172.21.15.72:6789/0 conn(0x7fa9d00ade50 legacy=0x7fa9d00c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d00ae3a0 con 0x7fa9d0159b30 2023-08-25T04:46:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fa9c80019f0 con 0x7fa9d0159b30 2023-08-25T04:46:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 >> v1:172.21.15.137:6789/0 conn(0x7fa9d0159b30 legacy=0x7fa9d00b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 --2- 172.21.15.72:0/2871355886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b8004c40 0x7fa9b8005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 --2- 172.21.15.72:0/2871355886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b80037f0 0x7fa9b8003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 --2- 172.21.15.72:0/2871355886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9b8004200 0x7fa9b800ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00b4880 con 0x7fa9b80037f0 2023-08-25T04:46:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b800c210 con 0x7fa9b8004c40 2023-08-25T04:46:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b800c3d0 con 0x7fa9b8004200 2023-08-25T04:46:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.186+0000 7ff21e7ff700 1 -- 172.21.15.72:0/4134953581 wait complete. 2023-08-25T04:46:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7ff21e7ff700 1 Processor -- start 2023-08-25T04:46:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7f95f6ffd700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d806a1b0 0x7f95d806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7efc23fff700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc1006a1b0 0x7efc1006c670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc14006fd0 tx=0x7efc14006f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.190+0000 7f95f77fe700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.137:6800/1114533448,v1:172.21.15.137:6801/1114533448] conn(0x7f95d8073e90 0x7f95d80762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.190+0000 7fa9ced9d700 1 --2- 172.21.15.72:0/2871355886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9b8004200 0x7fa9b800ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.189+0000 7ff21e7ff700 1 -- start start 2023-08-25T04:46:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.190+0000 7fa9ce59c700 1 --2- 172.21.15.72:0/2871355886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b8004c40 0x7fa9b8005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7efc237fe700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.137:6824/3706321311,v1:172.21.15.137:6825/3706321311] conn(0x7efc10073e90 0x7efc100762d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7fa9ced9d700 1 -- 172.21.15.72:0/2871355886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b8004c40 msgr2=0x7fa9b8005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7fa9ced9d700 1 --2- 172.21.15.72:0/2871355886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b8004c40 0x7fa9b8005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7fa9ced9d700 1 -- 172.21.15.72:0/2871355886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b80037f0 msgr2=0x7fa9b8003c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:46:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7fa9ced9d700 1 --2- 172.21.15.72:0/2871355886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b80037f0 0x7fa9b8003c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7fa9ced9d700 1 -- 172.21.15.72:0/2871355886 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d00ae3a0 con 0x7fa9b8004200 2023-08-25T04:46:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7fa9ced9d700 1 -- 172.21.15.72:0/2871355886 reap_dead start 2023-08-25T04:46:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7ff21e7ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff21806ced0 0x7ff2180bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7ff21e7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff21806ea80 0x7ff2180c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7ff21e7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2180cac40 0x7ff2180c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7ff21e7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180c39f0 con 0x7ff2180cac40 2023-08-25T04:46:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7ff21e7ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180c3cd0 con 0x7ff21806ced0 2023-08-25T04:46:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7ff21e7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180c3fb0 con 0x7ff21806ea80 2023-08-25T04:46:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7fa9ced9d700 1 --2- 172.21.15.72:0/2871355886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9b8004200 0x7fa9b800ba90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00018e0 tx=0x7fa9b8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=330b71509c4baa6d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.191+0000 7f95f6ffd700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d806a1b0 0x7f95d806c670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95f8202600 tx=0x7f95e8000f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7ff217fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff21806ced0 0x7ff2180bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7ff217fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff21806ced0 0x7ff2180bdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:60014/0 (socket says 172.21.15.72:60014) 2023-08-25T04:46:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7ff217fff700 1 -- 172.21.15.72:0/1644430362 learned_addr learned my addr 172.21.15.72:0/1644430362 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7ff2177fe700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff21806ea80 0x7ff2180c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7ff21cd9c700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2180cac40 0x7ff2180c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7efc20ff9700 1 -- 172.21.15.72:0/2016425190 <== osd.4 v2:172.21.15.137:6824/3706321311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efc100769a0 con 0x7efc10073e90 2023-08-25T04:46:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7f95f77fe700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.137:6800/1114533448,v1:172.21.15.137:6801/1114533448] conn(0x7f95d8073e90 0x7f95d80762d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7ff217fff700 1 -- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff21806ea80 msgr2=0x7ff2180c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7ff217fff700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff21806ea80 0x7ff2180c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7ff217fff700 1 -- 172.21.15.72:0/1644430362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2180cac40 msgr2=0x7ff2180c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7ff217fff700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2180cac40 0x7ff2180c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7ff217fff700 1 -- 172.21.15.72:0/1644430362 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0094a0 con 0x7ff21806ced0 2023-08-25T04:46:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c00072d0 con 0x7fa9b8004200 2023-08-25T04:46:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c0007450 con 0x7fa9b8004200 2023-08-25T04:46:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.192+0000 7fa9cd59a700 1 -- 172.21.15.72:0/2871355886 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0007800 con 0x7fa9b8004200 2023-08-25T04:46:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.193+0000 7fa9d4fff700 1 -- 172.21.15.72:0/2871355886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9b8004200 msgr2=0x7fa9b800ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.193+0000 7ff217fff700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff21806ced0 0x7ff2180bdfd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b550 tx=0x7ff20800b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.193+0000 7fa9d4fff700 1 --2- 172.21.15.72:0/2871355886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9b8004200 0x7fa9b800ba90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00018e0 tx=0x7fa9b8005880 comp rx=0 tx=0).stop 2023-08-25T04:46:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.193+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 --> [v2:172.21.15.72:6800/3772137413,v1:172.21.15.72:6801/3772137413] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f797c0722d0 con 0x7f7968073e10 2023-08-25T04:46:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.193+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 --> [v2:172.21.15.72:6808/3711160113,v1:172.21.15.72:6809/3711160113] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e38002d40 con 0x7f9e3c073e90 2023-08-25T04:46:01.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.194+0000 7f95effff700 1 -- 172.21.15.72:0/733859850 <== osd.5 v2:172.21.15.137:6800/1114533448 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f95d80769a0 con 0x7f95d8073e90 2023-08-25T04:46:01.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.194+0000 7f7963fff700 1 -- 172.21.15.72:0/1785872216 <== osd.2 v2:172.21.15.72:6800/3772137413 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f797c0722d0 con 0x7f7968073e10 2023-08-25T04:46:01.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.194+0000 7fa9d4fff700 1 -- 172.21.15.72:0/2871355886 shutdown_connections 2023-08-25T04:46:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.194+0000 7fa9d4fff700 1 --2- 172.21.15.72:0/2871355886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9b8004200 0x7fa9b800ba90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.194+0000 7fa9d4fff700 1 -- 172.21.15.72:0/2871355886 >> 172.21.15.72:0/2871355886 conn(0x7fa9d00ce9a0 msgr2=0x7fa9d00ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.193+0000 7ff214ff9700 1 -- 172.21.15.72:0/1644430362 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208011830 con 0x7ff21806ced0 2023-08-25T04:46:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.194+0000 7ff214ff9700 1 -- 172.21.15.72:0/1644430362 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2080119b0 con 0x7ff21806ced0 2023-08-25T04:46:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.194+0000 7ff214ff9700 1 -- 172.21.15.72:0/1644430362 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208011d60 con 0x7ff21806ced0 2023-08-25T04:46:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.195+0000 7fa9d4fff700 1 -- 172.21.15.72:0/2871355886 shutdown_connections 2023-08-25T04:46:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.195+0000 7fa9d4fff700 1 -- 172.21.15.72:0/2871355886 wait complete. 2023-08-25T04:46:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.195+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:6800/3772137413,v1:172.21.15.72:6801/3772137413] conn(0x7f7968073e10 msgr2=0x7f7968076250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.195+0000 7f79821ff700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:6800/3772137413,v1:172.21.15.72:6801/3772137413] conn(0x7f7968073e10 0x7f7968076250 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.195+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f796806a1b0 msgr2=0x7f796806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.195+0000 7f79821ff700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f796806a1b0 0x7f796806c670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f797c0c28f0 tx=0x7f7974009000 comp rx=0 tx=0).stop 2023-08-25T04:46:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.195+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c06ced0 msgr2=0x7f797c0c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.195+0000 7f79821ff700 1 --2- 172.21.15.72:0/1785872216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f797c06ced0 0x7f797c0c93c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f797000e810 tx=0x7f797000ebd0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.196+0000 7f797bfff700 1 -- 172.21.15.72:0/1785872216 reap_dead start 2023-08-25T04:46:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.196+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 shutdown_connections 2023-08-25T04:46:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.196+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 >> 172.21.15.72:0/1785872216 conn(0x7f797c0ce9a0 msgr2=0x7f797c1576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.196+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2180c4290 con 0x7ff21806ced0 2023-08-25T04:46:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.196+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2180c5510 con 0x7ff21806ced0 2023-08-25T04:46:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.197+0000 7f9e4dffb700 1 -- 172.21.15.72:0/3831787187 <== osd.0 v2:172.21.15.72:6808/3711160113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e38002d40 con 0x7f9e3c073e90 2023-08-25T04:46:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.198+0000 7fa9d4fff700 1 Processor -- start 2023-08-25T04:46:01.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.198+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 shutdown_connections 2023-08-25T04:46:01.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.199+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2180c3e40 con 0x7ff21806ced0 2023-08-25T04:46:01.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.198+0000 7f1efaffd700 1 -- 172.21.15.72:0/3259607132 --> [v2:172.21.15.72:6816/1825299555,v1:172.21.15.72:6817/1825299555] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f140caf00 con 0x7f1f00073e10 2023-08-25T04:46:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.199+0000 7fa9d4fff700 1 -- start start 2023-08-25T04:46:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.199+0000 7ff214ff9700 1 -- 172.21.15.72:0/1644430362 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff20801a400 con 0x7ff21806ced0 2023-08-25T04:46:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.200+0000 7f1f097fa700 1 -- 172.21.15.72:0/3259607132 <== osd.1 v2:172.21.15.72:6816/1825299555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1f040050b0 con 0x7f1f00073e10 2023-08-25T04:46:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.200+0000 7f79821ff700 1 -- 172.21.15.72:0/1785872216 wait complete. 2023-08-25T04:46:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.200+0000 7fa9d4fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b8004200 0x7fa9d014ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.200+0000 7fa9d4fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9d00c8990 0x7fa9d015b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.200+0000 7fa9d4fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9d015bd30 0x7fa9d00c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.200+0000 7fa9d4fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d015a750 con 0x7fa9b8004200 2023-08-25T04:46:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.200+0000 7fa9d4fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d015aa30 con 0x7fa9d015bd30 2023-08-25T04:46:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.200+0000 7fa9d4fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d015ad10 con 0x7fa9d00c8990 2023-08-25T04:46:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7f1efaffd700 1 -- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:6816/1825299555,v1:172.21.15.72:6817/1825299555] conn(0x7f1f00073e10 msgr2=0x7f1f00076250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7f1efaffd700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:6816/1825299555,v1:172.21.15.72:6817/1825299555] conn(0x7f1f00073e10 0x7f1f00076250 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.200+0000 7ff214ff9700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff20406a130 0x7ff20406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7ff214ff9700 1 -- 172.21.15.72:0/1644430362 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff2080885f0 con 0x7ff21806ced0 2023-08-25T04:46:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7ff214ff9700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:6816/610369633,v1:172.21.15.137:6817/610369633] conn(0x7ff204073e10 0x7ff204076250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7ff214ff9700 1 -- 172.21.15.72:0/1644430362 --> [v2:172.21.15.137:6816/610369633,v1:172.21.15.137:6817/610369633] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff204076920 con 0x7ff204073e10 2023-08-25T04:46:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7ff214ff9700 1 -- 172.21.15.72:0/1644430362 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff20808ad00 con 0x7ff21806ced0 2023-08-25T04:46:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7f1efaffd700 1 -- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1f0006a130 msgr2=0x7f1f0006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7f1efaffd700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1f0006a130 0x7f1f0006c5f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1f10007fd0 tx=0x7f1f10007dc0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7f1efaffd700 1 -- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140ca440 msgr2=0x7f1f140c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7f1efaffd700 1 --2- 172.21.15.72:0/3259607132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140ca440 0x7f1f140c45e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c004000 tx=0x7f1f0c004750 comp rx=0 tx=0).stop 2023-08-25T04:46:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7fa9ce59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b8004200 0x7fa9d014ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7fa9ce59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b8004200 0x7fa9d014ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56216/0 (socket says 172.21.15.72:56216) 2023-08-25T04:46:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7fa9ce59c700 1 -- 172.21.15.72:0/141683578 learned_addr learned my addr 172.21.15.72:0/141683578 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7f1f1979c700 1 -- 172.21.15.72:0/3259607132 reap_dead start 2023-08-25T04:46:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7f1efaffd700 1 -- 172.21.15.72:0/3259607132 shutdown_connections 2023-08-25T04:46:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7f1efaffd700 1 -- 172.21.15.72:0/3259607132 >> 172.21.15.72:0/3259607132 conn(0x7f1f140ce9a0 msgr2=0x7f1f14161c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.201+0000 7fa9cdd9b700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9d00c8990 0x7fa9d015b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.202+0000 7f1efaffd700 1 -- 172.21.15.72:0/3259607132 shutdown_connections 2023-08-25T04:46:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.202+0000 7f1efaffd700 1 -- 172.21.15.72:0/3259607132 wait complete. 2023-08-25T04:46:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.202+0000 7ff2177fe700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff20406a130 0x7ff20406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.202+0000 7ff21cd9c700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:6816/610369633,v1:172.21.15.137:6817/610369633] conn(0x7ff204073e10 0x7ff204076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.202+0000 7fa9cdd9b700 1 -- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9d015bd30 msgr2=0x7fa9d00c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.202+0000 7fa9cdd9b700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9d015bd30 0x7fa9d00c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.202+0000 7fa9cdd9b700 1 -- 172.21.15.72:0/141683578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b8004200 msgr2=0x7fa9d014ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.202+0000 7fa9cdd9b700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b8004200 0x7fa9d014ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.202+0000 7fa9cdd9b700 1 -- 172.21.15.72:0/141683578 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d015aff0 con 0x7fa9d00c8990 2023-08-25T04:46:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.202+0000 7fa9cdd9b700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9d00c8990 0x7fa9d015b7f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa9d006e200 tx=0x7fa9c400e8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.203+0000 7fa9beffd700 1 -- 172.21.15.72:0/141683578 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400c070 con 0x7fa9d00c8990 2023-08-25T04:46:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.203+0000 7fa9beffd700 1 -- 172.21.15.72:0/141683578 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c4004020 con 0x7fa9d00c8990 2023-08-25T04:46:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.203+0000 7fa9beffd700 1 -- 172.21.15.72:0/141683578 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40043d0 con 0x7fa9d00c8990 2023-08-25T04:46:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.203+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d015b2d0 con 0x7fa9d00c8990 2023-08-25T04:46:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.203+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d015a320 con 0x7fa9d00c8990 2023-08-25T04:46:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.203+0000 7ff21cd9c700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:6816/610369633,v1:172.21.15.137:6817/610369633] conn(0x7ff204073e10 0x7ff204076250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.203+0000 7ff2177fe700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff20406a130 0x7ff20406c5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2181553c0 tx=0x7ff21000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.204+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:6808/3711160113,v1:172.21.15.72:6809/3711160113] conn(0x7f9e3c073e90 msgr2=0x7f9e3c0762d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.204+0000 7f9e5f7ff700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:6808/3711160113,v1:172.21.15.72:6809/3711160113] conn(0x7f9e3c073e90 0x7f9e3c0762d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.204+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9e3c06a1b0 msgr2=0x7f9e3c06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.204+0000 7f9e5f7ff700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9e3c06a1b0 0x7f9e3c06c670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e580c2af0 tx=0x7f9e4800a000 comp rx=0 tx=0).stop 2023-08-25T04:46:01.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.204+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e581edfb0 msgr2=0x7f9e581ee430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.204+0000 7f9e5f7ff700 1 --2- 172.21.15.72:0/3831787187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e581edfb0 0x7f9e581ee430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9e58072180 tx=0x7f9e5400c9e0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.204+0000 7f9e5dd9c700 1 -- 172.21.15.72:0/3831787187 reap_dead start 2023-08-25T04:46:01.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.205+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 shutdown_connections 2023-08-25T04:46:01.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.205+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 >> 172.21.15.72:0/3831787187 conn(0x7f9e580ce9a0 msgr2=0x7f9e58152740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.205+0000 7ff214ff9700 1 -- 172.21.15.72:0/1644430362 <== osd.7 v2:172.21.15.137:6816/610369633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff204076920 con 0x7ff204073e10 2023-08-25T04:46:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.206+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 shutdown_connections 2023-08-25T04:46:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.206+0000 7f9e5f7ff700 1 -- 172.21.15.72:0/3831787187 wait complete. 2023-08-25T04:46:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.207+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9d00ae960 con 0x7fa9d00c8990 2023-08-25T04:46:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.207+0000 7fa9beffd700 1 -- 172.21.15.72:0/141683578 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa9c40036a0 con 0x7fa9d00c8990 2023-08-25T04:46:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.208+0000 7fa9beffd700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa9b006a1b0 0x7fa9b006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.209+0000 7fa9beffd700 1 -- 172.21.15.72:0/141683578 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9c40880d0 con 0x7fa9d00c8990 2023-08-25T04:46:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.209+0000 7fa9beffd700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:6808/2642428945,v1:172.21.15.137:6809/2642428945] conn(0x7fa9b0073e90 0x7fa9b00762d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.209+0000 7fa9beffd700 1 -- 172.21.15.72:0/141683578 --> [v2:172.21.15.137:6808/2642428945,v1:172.21.15.137:6809/2642428945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9b00769a0 con 0x7fa9b0073e90 2023-08-25T04:46:01.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.209+0000 7fa9beffd700 1 -- 172.21.15.72:0/141683578 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9c408a630 con 0x7fa9d00c8990 2023-08-25T04:46:01.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.211+0000 7fa9ced9d700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:6808/2642428945,v1:172.21.15.137:6809/2642428945] conn(0x7fa9b0073e90 0x7fa9b00762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.213+0000 7fa9ced9d700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:6808/2642428945,v1:172.21.15.137:6809/2642428945] conn(0x7fa9b0073e90 0x7fa9b00762d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.215+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 --> [v2:172.21.15.72:6818/3896481440,v1:172.21.15.72:6820/3896481440] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d7c005c50 con 0x7f2d7c0015e0 2023-08-25T04:46:01.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.216+0000 7f2d8a7fc700 1 -- 172.21.15.72:0/170808295 <== osd.3 v2:172.21.15.72:6818/3896481440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2d7c005c50 con 0x7f2d7c0015e0 2023-08-25T04:46:01.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.214+0000 7fa9beffd700 1 -- 172.21.15.72:0/141683578 <== osd.6 v2:172.21.15.137:6808/2642428945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa9b00769a0 con 0x7fa9b0073e90 2023-08-25T04:46:01.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.220+0000 7fa9ce59c700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa9b006a1b0 0x7fa9b006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.280 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-08-25T04:46:01.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-25T04:46:01.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.225+0000 7fa9ce59c700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa9b006a1b0 0x7fa9b006c670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8001350 tx=0x7fa9c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.226+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:6818/3896481440,v1:172.21.15.72:6820/3896481440] conn(0x7f2d7c0015e0 msgr2=0x7f2d7c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.226+0000 7f2d9bfff700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:6818/3896481440,v1:172.21.15.72:6820/3896481440] conn(0x7f2d7c0015e0 0x7f2d7c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.227+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 --> [v2:172.21.15.137:6800/1114533448,v1:172.21.15.137:6801/1114533448] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95f80caf00 con 0x7f95d8073e90 2023-08-25T04:46:01.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.228+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 --> [v2:172.21.15.137:6824/3706321311,v1:172.21.15.137:6825/3706321311] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc240744f0 con 0x7efc10073e90 2023-08-25T04:46:01.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.228+0000 7f95effff700 1 -- 172.21.15.72:0/733859850 <== osd.5 v2:172.21.15.137:6800/1114533448 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95f0007d70 con 0x7f95d8073e90 2023-08-25T04:46:01.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2d7806a1b0 msgr2=0x7f2d7806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f2d9bfff700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2d7806a1b0 0x7f2d7806c670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d941f3150 tx=0x7f2d90008040 comp rx=0 tx=0).stop 2023-08-25T04:46:01.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d940b4800 msgr2=0x7f2d941f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f2d9bfff700 1 --2- 172.21.15.72:0/170808295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d940b4800 0x7f2d941f3590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00ccd0 tx=0x7f2d8c00a4d0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f2d9a59c700 1 -- 172.21.15.72:0/170808295 reap_dead start 2023-08-25T04:46:01.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7efc20ff9700 1 -- 172.21.15.72:0/2016425190 <== osd.4 v2:172.21.15.137:6824/3706321311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc240744f0 con 0x7efc10073e90 2023-08-25T04:46:01.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 >> [v2:172.21.15.137:6800/1114533448,v1:172.21.15.137:6801/1114533448] conn(0x7f95d8073e90 msgr2=0x7f95d80762d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f95fd9ff700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.137:6800/1114533448,v1:172.21.15.137:6801/1114533448] conn(0x7f95d8073e90 0x7f95d80762d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 >> [v2:172.21.15.137:6824/3706321311,v1:172.21.15.137:6825/3706321311] conn(0x7efc10073e90 msgr2=0x7efc100762d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7efc2a9ff700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.137:6824/3706321311,v1:172.21.15.137:6825/3706321311] conn(0x7efc10073e90 0x7efc100762d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 shutdown_connections 2023-08-25T04:46:01.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 >> 172.21.15.72:0/170808295 conn(0x7f2d94071e40 msgr2=0x7f2d94072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 shutdown_connections 2023-08-25T04:46:01.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.229+0000 7f2d9bfff700 1 -- 172.21.15.72:0/170808295 wait complete. 2023-08-25T04:46:01.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.230+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc1006a1b0 msgr2=0x7efc1006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.230+0000 7efc2a9ff700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc1006a1b0 0x7efc1006c670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc14006fd0 tx=0x7efc14006f20 comp rx=0 tx=0).stop 2023-08-25T04:46:01.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.230+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc24144090 msgr2=0x7efc241615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.230+0000 7efc2a9ff700 1 --2- 172.21.15.72:0/2016425190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc24144090 0x7efc241615c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc240c8e90 tx=0x7efc1c001cb0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.230+0000 7efc28f9c700 1 -- 172.21.15.72:0/2016425190 reap_dead start 2023-08-25T04:46:01.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.230+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 shutdown_connections 2023-08-25T04:46:01.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.230+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 >> 172.21.15.72:0/2016425190 conn(0x7efc240ce9a0 msgr2=0x7efc240c2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.231+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d806a1b0 msgr2=0x7f95d806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.231+0000 7f95fd9ff700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d806a1b0 0x7f95d806c670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95f8202600 tx=0x7f95e8000f50 comp rx=0 tx=0).stop 2023-08-25T04:46:01.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.231+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95f80b23e0 msgr2=0x7f95f8200270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.231+0000 7f95fd9ff700 1 --2- 172.21.15.72:0/733859850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95f80b23e0 0x7f95f8200270 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f95e000c3c0 tx=0x7f95e000c780 comp rx=0 tx=0).stop 2023-08-25T04:46:01.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.231+0000 7f95f77fe700 1 -- 172.21.15.72:0/733859850 reap_dead start 2023-08-25T04:46:01.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.231+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 shutdown_connections 2023-08-25T04:46:01.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.231+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 >> 172.21.15.72:0/733859850 conn(0x7f95f80ce9a0 msgr2=0x7f95f8161c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.231+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 shutdown_connections 2023-08-25T04:46:01.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.231+0000 7efc2a9ff700 1 -- 172.21.15.72:0/2016425190 wait complete. 2023-08-25T04:46:01.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.231+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 shutdown_connections 2023-08-25T04:46:01.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.232+0000 7f95fd9ff700 1 -- 172.21.15.72:0/733859850 wait complete. 2023-08-25T04:46:01.290 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-08-25T04:46:01.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-25T04:46:01.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.237+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 --> [v2:172.21.15.137:6816/610369633,v1:172.21.15.137:6817/610369633] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2180c4120 con 0x7ff204073e10 2023-08-25T04:46:01.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.238+0000 7ff214ff9700 1 -- 172.21.15.72:0/1644430362 <== osd.7 v2:172.21.15.137:6816/610369633 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff2180c4120 con 0x7ff204073e10 2023-08-25T04:46:01.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.239+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:6816/610369633,v1:172.21.15.137:6817/610369633] conn(0x7ff204073e10 msgr2=0x7ff204076250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.239+0000 7ff21e7ff700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:6816/610369633,v1:172.21.15.137:6817/610369633] conn(0x7ff204073e10 0x7ff204076250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.239+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff20406a130 msgr2=0x7ff20406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.239+0000 7ff21e7ff700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff20406a130 0x7ff20406c5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2181553c0 tx=0x7ff21000b040 comp rx=0 tx=0).stop 2023-08-25T04:46:01.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.239+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff21806ced0 msgr2=0x7ff2180bdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.239+0000 7ff21e7ff700 1 --2- 172.21.15.72:0/1644430362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff21806ced0 0x7ff2180bdfd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b550 tx=0x7ff20800b860 comp rx=0 tx=0).stop 2023-08-25T04:46:01.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.239+0000 7ff21cd9c700 1 -- 172.21.15.72:0/1644430362 reap_dead start 2023-08-25T04:46:01.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.239+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 shutdown_connections 2023-08-25T04:46:01.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.239+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 >> 172.21.15.72:0/1644430362 conn(0x7ff2180ce9a0 msgr2=0x7ff218156520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.295 INFO:teuthology.orchestra.run.smithi072.stdout:55834574859 2023-08-25T04:46:01.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-25T04:46:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.241+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 shutdown_connections 2023-08-25T04:46:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.241+0000 7ff21e7ff700 1 -- 172.21.15.72:0/1644430362 wait complete. 2023-08-25T04:46:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.244+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 --> [v2:172.21.15.137:6808/2642428945,v1:172.21.15.137:6809/2642428945] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9d00ae680 con 0x7fa9b0073e90 2023-08-25T04:46:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.245+0000 7fa9beffd700 1 -- 172.21.15.72:0/141683578 <== osd.6 v2:172.21.15.137:6808/2642428945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa9c00070d0 con 0x7fa9b0073e90 2023-08-25T04:46:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:6808/2642428945,v1:172.21.15.137:6809/2642428945] conn(0x7fa9b0073e90 msgr2=0x7fa9b00762d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9d4fff700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:6808/2642428945,v1:172.21.15.137:6809/2642428945] conn(0x7fa9b0073e90 0x7fa9b00762d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa9b006a1b0 msgr2=0x7fa9b006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9d4fff700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa9b006a1b0 0x7fa9b006c670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8001350 tx=0x7fa9c8009040 comp rx=0 tx=0).stop 2023-08-25T04:46:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9d00c8990 msgr2=0x7fa9d015b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9d4fff700 1 --2- 172.21.15.72:0/141683578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9d00c8990 0x7fa9d015b7f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa9d006e200 tx=0x7fa9c400e8c0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9ced9d700 1 -- 172.21.15.72:0/141683578 reap_dead start 2023-08-25T04:46:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 shutdown_connections 2023-08-25T04:46:01.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 >> 172.21.15.72:0/141683578 conn(0x7fa9d00ce9a0 msgr2=0x7fa9d006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 shutdown_connections 2023-08-25T04:46:01.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.246+0000 7fa9d4fff700 1 -- 172.21.15.72:0/141683578 wait complete. 2023-08-25T04:46:01.299 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-08-25T04:46:01.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-25T04:46:01.300 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-08-25T04:46:01.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-25T04:46:01.302 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-08-25T04:46:01.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-25T04:46:01.303 INFO:teuthology.orchestra.run.smithi072.stdout:55834574859 2023-08-25T04:46:01.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-25T04:46:01.304 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-08-25T04:46:01.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-25T04:46:01.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:01.470 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:01.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.709+0000 7f99893ff700 1 Processor -- start 2023-08-25T04:46:01.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.709+0000 7f99893ff700 1 -- start start 2023-08-25T04:46:01.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.711+0000 7f99893ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9984071940 0x7f99840afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.711+0000 7f99893ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9984070890 0x7f9984070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.711+0000 7f99893ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998406c990 con 0x7f9984158fe0 2023-08-25T04:46:01.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.711+0000 7f99893ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998406d7f0 con 0x7f9984071940 2023-08-25T04:46:01.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.711+0000 7f99893ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99841593c0 con 0x7f9984070890 2023-08-25T04:46:01.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.712+0000 7f99837fe700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9984070890 0x7f9984070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.712+0000 7f99837fe700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9984070890 0x7f9984070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:60048/0 (socket says 172.21.15.72:60048) 2023-08-25T04:46:01.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.712+0000 7f99837fe700 1 -- 172.21.15.72:0/1594478537 learned_addr learned my addr 172.21.15.72:0/1594478537 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.713+0000 7f99837fe700 1 -- 172.21.15.72:0/1594478537 >> v2:172.21.15.72:3300/0 conn(0x7f9984071940 msgr2=0x7f99840afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.713+0000 7f99837fe700 1 --2- 172.21.15.72:0/1594478537 >> v2:172.21.15.72:3300/0 conn(0x7f9984071940 0x7f99840afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.713+0000 7f99837fe700 1 -- 172.21.15.72:0/1594478537 >> v1:172.21.15.137:6789/0 conn(0x7f9984158fe0 legacy=0x7f99840ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.713+0000 7f99837fe700 1 -- 172.21.15.72:0/1594478537 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99840711f0 con 0x7f9984070890 2023-08-25T04:46:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.707+0000 7fa83cbff700 1 Processor -- start 2023-08-25T04:46:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.708+0000 7fa83cbff700 1 -- start start 2023-08-25T04:46:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.710+0000 7fa83cbff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa838070fa0 0x7fa8380afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.710+0000 7fa83cbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83806c990 con 0x7fa838158fe0 2023-08-25T04:46:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.710+0000 7fa83cbff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83806d7f0 con 0x7fa838071940 2023-08-25T04:46:01.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.710+0000 7fa83cbff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8381593c0 con 0x7fa838070fa0 2023-08-25T04:46:01.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.711+0000 7fa83659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa838158fe0 0x7fa8380ae100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53234/0 (socket says 172.21.15.72:53234) 2023-08-25T04:46:01.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.711+0000 7fa83659c700 1 -- 172.21.15.72:0/3735038926 learned_addr learned my addr 172.21.15.72:0/3735038926 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:01.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.711+0000 7fa836d9d700 1 --2- 172.21.15.72:0/3735038926 >> v2:172.21.15.137:3300/0 conn(0x7fa838070fa0 0x7fa8380afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.712+0000 7fa836d9d700 1 -- 172.21.15.72:0/3735038926 >> v1:172.21.15.137:6789/0 conn(0x7fa838071940 legacy=0x7fa838070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.712+0000 7fa836d9d700 1 -- 172.21.15.72:0/3735038926 >> v1:172.21.15.72:6789/0 conn(0x7fa838158fe0 legacy=0x7fa8380ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.712+0000 7fa836d9d700 1 -- 172.21.15.72:0/3735038926 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83806cbe0 con 0x7fa838070fa0 2023-08-25T04:46:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.712+0000 7fa836d9d700 1 --2- 172.21.15.72:0/3735038926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa838070fa0 0x7fa8380afb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00a960 tx=0x7fa82c00ac70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d25c9172ad330add server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.713+0000 7fa83559a700 1 -- 172.21.15.72:0/3735038926 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c004230 con 0x7fa838070fa0 2023-08-25T04:46:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.713+0000 7fa83559a700 1 -- 172.21.15.72:0/3735038926 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c004390 con 0x7fa838070fa0 2023-08-25T04:46:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.713+0000 7fa83559a700 1 -- 172.21.15.72:0/3735038926 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00ae50 con 0x7fa838070fa0 2023-08-25T04:46:01.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.713+0000 7f99837fe700 1 --2- 172.21.15.72:0/1594478537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9984070890 0x7f9984070cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f99840c5960 tx=0x7f997800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e132372ecac47812 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.714+0000 7f9981ffb700 1 -- 172.21.15.72:0/1594478537 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978010070 con 0x7f9984070890 2023-08-25T04:46:01.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.714+0000 7f9981ffb700 1 -- 172.21.15.72:0/1594478537 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997800da80 con 0x7f9984070890 2023-08-25T04:46:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.714+0000 7f9981ffb700 1 -- 172.21.15.72:0/1594478537 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800de10 con 0x7f9984070890 2023-08-25T04:46:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.714+0000 7fa83cbff700 1 -- 172.21.15.72:0/3735038926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa838070fa0 msgr2=0x7fa8380afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.714+0000 7fa83cbff700 1 --2- 172.21.15.72:0/3735038926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa838070fa0 0x7fa8380afb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00a960 tx=0x7fa82c00ac70 comp rx=0 tx=0).stop 2023-08-25T04:46:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7fa83cbff700 1 -- 172.21.15.72:0/3735038926 shutdown_connections 2023-08-25T04:46:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7fa83cbff700 1 --2- 172.21.15.72:0/3735038926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa838070fa0 0x7fa8380afb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7fa83cbff700 1 -- 172.21.15.72:0/3735038926 >> 172.21.15.72:0/3735038926 conn(0x7fa8380ce9a0 msgr2=0x7fa8380ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.714+0000 7f18f1dff700 1 Processor -- start 2023-08-25T04:46:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7f99893ff700 1 -- 172.21.15.72:0/1594478537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9984070890 msgr2=0x7f9984070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7f99893ff700 1 --2- 172.21.15.72:0/1594478537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9984070890 0x7f9984070cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f99840c5960 tx=0x7f997800d330 comp rx=0 tx=0).stop 2023-08-25T04:46:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7f99893ff700 1 -- 172.21.15.72:0/1594478537 shutdown_connections 2023-08-25T04:46:01.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7f99893ff700 1 --2- 172.21.15.72:0/1594478537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9984070890 0x7f9984070cb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7f99893ff700 1 --2- 172.21.15.72:0/1594478537 >> v2:172.21.15.72:3300/0 conn(0x7f9984071940 0x7f99840afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7f99893ff700 1 -- 172.21.15.72:0/1594478537 >> 172.21.15.72:0/1594478537 conn(0x7f99840ce9a0 msgr2=0x7f99840ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.717+0000 7f2a643ff700 1 Processor -- start 2023-08-25T04:46:01.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7f18f1dff700 1 -- start start 2023-08-25T04:46:01.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.717+0000 7f18f1dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f18ec158fe0 0x7f18ec0afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.717+0000 7f18f1dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec070890 0x7f18ec070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.717+0000 7f18f1dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ec06c990 con 0x7f18ec071940 2023-08-25T04:46:01.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.717+0000 7f18f1dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ec071240 con 0x7f18ec158fe0 2023-08-25T04:46:01.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.717+0000 7f18f1dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec06d7f0 con 0x7f18ec070890 2023-08-25T04:46:01.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.717+0000 7f2a643ff700 1 -- start start 2023-08-25T04:46:01.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.718+0000 7fa83cbff700 1 -- 172.21.15.72:0/3735038926 shutdown_connections 2023-08-25T04:46:01.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.718+0000 7f18eaffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f18ec071940 0x7f18ec0ae100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53244/0 (socket says 172.21.15.72:53244) 2023-08-25T04:46:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.718+0000 7f18eaffd700 1 -- 172.21.15.72:0/3384965302 learned_addr learned my addr 172.21.15.72:0/3384965302 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f18ebfff700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec070890 0x7f18ec070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f18eb7fe700 1 --2- 172.21.15.72:0/3384965302 >> v2:172.21.15.137:3300/0 conn(0x7f18ec158fe0 0x7f18ec0afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.714+0000 7f0633dff700 1 Processor -- start 2023-08-25T04:46:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.715+0000 7f0633dff700 1 -- start start 2023-08-25T04:46:01.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.718+0000 7f0633dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0c2460 0x7f062c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.718+0000 7f0633dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f062c0ca9a0 0x7f062c0b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.718+0000 7f0633dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062c0c28c0 con 0x7f062c070890 2023-08-25T04:46:01.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.718+0000 7f0633dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062c0b0130 con 0x7f062c0ca9a0 2023-08-25T04:46:01.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.718+0000 7f0633dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0caeb0 con 0x7f062c0c2460 2023-08-25T04:46:01.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f0631b9b700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f062c070890 0x7f062c070c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:58110/0 (socket says 172.21.15.72:58110) 2023-08-25T04:46:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f0631b9b700 1 -- 172.21.15.72:0/2706393153 learned_addr learned my addr 172.21.15.72:0/2706393153 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f063139a700 1 --2- 172.21.15.72:0/2706393153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0c2460 0x7f062c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f2a643ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0b4800 0x7f2a5c0b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f2a643ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5c0b51a0 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f2a643ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5c0b8d40 con 0x7f2a5c15cf00 2023-08-25T04:46:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f2a643ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c0b8200 con 0x7f2a5c0b4800 2023-08-25T04:46:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f0630b99700 1 -- 172.21.15.72:0/2706393153 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823317102 0 0) 0x7f062c0c28c0 con 0x7f062c070890 2023-08-25T04:46:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7f0630b99700 1 -- 172.21.15.72:0/2706393153 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06180035b0 con 0x7f062c070890 2023-08-25T04:46:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.720+0000 7f063139a700 1 -- 172.21.15.72:0/2706393153 >> v2:172.21.15.72:3300/0 conn(0x7f062c0ca9a0 msgr2=0x7f062c0b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.720+0000 7f063139a700 1 --2- 172.21.15.72:0/2706393153 >> v2:172.21.15.72:3300/0 conn(0x7f062c0ca9a0 0x7f062c0b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.720+0000 7f063139a700 1 -- 172.21.15.72:0/2706393153 >> v1:172.21.15.137:6789/0 conn(0x7f062c070890 legacy=0x7f062c070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.720+0000 7f063139a700 1 -- 172.21.15.72:0/2706393153 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0afa70 con 0x7f062c0c2460 2023-08-25T04:46:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.720+0000 7f2a6199a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0b4800 0x7f2a5c0b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.720+0000 7f2a6199a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0b4800 0x7f2a5c0b4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51332/0 (socket says 172.21.15.72:51332) 2023-08-25T04:46:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.720+0000 7f2a6199a700 1 -- 172.21.15.72:0/2011975806 learned_addr learned my addr 172.21.15.72:0/2011975806 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.720+0000 7f063139a700 1 --2- 172.21.15.72:0/2706393153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0c2460 0x7f062c0ca460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f061c009840 tx=0x7f061c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aefee12382e4ff74 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.721+0000 7f0630b99700 1 -- 172.21.15.72:0/2706393153 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c011830 con 0x7f062c0c2460 2023-08-25T04:46:01.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.721+0000 7f0630b99700 1 -- 172.21.15.72:0/2706393153 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c011990 con 0x7f062c0c2460 2023-08-25T04:46:01.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.721+0000 7f0630b99700 1 -- 172.21.15.72:0/2706393153 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c011d20 con 0x7f062c0c2460 2023-08-25T04:46:01.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f0633dff700 1 -- 172.21.15.72:0/2706393153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0c2460 msgr2=0x7f062c0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f0633dff700 1 --2- 172.21.15.72:0/2706393153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0c2460 0x7f062c0ca460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f061c009840 tx=0x7f061c009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:01.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.719+0000 7fa83cbff700 1 -- 172.21.15.72:0/3735038926 wait complete. 2023-08-25T04:46:01.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7fa83cbff700 1 Processor -- start 2023-08-25T04:46:01.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.721+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068608126 0 0) 0x7f18ec06c990 con 0x7f18ec071940 2023-08-25T04:46:01.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.721+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d40035b0 con 0x7f18ec071940 2023-08-25T04:46:01.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3867679448 0 0) 0x7f18d40035b0 con 0x7f18ec071940 2023-08-25T04:46:01.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec070890 msgr2=0x7f18ec070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec070890 0x7f18ec070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 >> v2:172.21.15.137:3300/0 conn(0x7f18ec158fe0 msgr2=0x7f18ec0afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 --2- 172.21.15.72:0/3384965302 >> v2:172.21.15.137:3300/0 conn(0x7f18ec158fe0 0x7f18ec0afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec1593c0 con 0x7f18ec071940 2023-08-25T04:46:01.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f18e0000ed0 con 0x7f18ec071940 2023-08-25T04:46:01.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 >> v1:172.21.15.72:6789/0 conn(0x7f18ec071940 legacy=0x7f18ec0ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d4003a00 0x7f18d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18d4004850 0x7f18d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d4005210 0x7f18d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec071240 con 0x7f18d4003a00 2023-08-25T04:46:01.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec06d7f0 con 0x7f18d4005210 2023-08-25T04:46:01.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d400bf80 con 0x7f18d4004850 2023-08-25T04:46:01.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7f2a6199a700 1 -- 172.21.15.72:0/2011975806 >> v1:172.21.15.137:6789/0 conn(0x7f2a5c15cf00 legacy=0x7f2a5c0b8630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:46:01.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.723+0000 7f2a6199a700 1 -- 172.21.15.72:0/2011975806 >> v1:172.21.15.72:6789/0 conn(0x7f2a5c0d0da0 legacy=0x7f2a5c0d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.723+0000 7f2a6199a700 1 -- 172.21.15.72:0/2011975806 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c0b7160 con 0x7f2a5c0b4800 2023-08-25T04:46:01.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.723+0000 7f18eaffd700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18d4004850 0x7f18d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.723+0000 7f18ebfff700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d4005210 0x7f18d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.723+0000 7f2a6199a700 1 --2- 172.21.15.72:0/2011975806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0b4800 0x7f2a5c0b4c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009920 tx=0x7f2a4c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19c1bcd495a1aeff server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.723+0000 7f18eaffd700 1 -- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d4005210 msgr2=0x7f18d400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.723+0000 7f18eaffd700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d4005210 0x7f18d400ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.723+0000 7f18eaffd700 1 -- 172.21.15.72:0/3384965302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d4003a00 msgr2=0x7f18d4003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:46:01.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.723+0000 7f18eaffd700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d4003a00 0x7f18d4003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.723+0000 7f18eaffd700 1 -- 172.21.15.72:0/3384965302 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec1593c0 con 0x7f18d4004850 2023-08-25T04:46:01.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.717+0000 7f99893ff700 1 -- 172.21.15.72:0/1594478537 shutdown_connections 2023-08-25T04:46:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f0633dff700 1 -- 172.21.15.72:0/2706393153 shutdown_connections 2023-08-25T04:46:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f0633dff700 1 --2- 172.21.15.72:0/2706393153 >> v2:172.21.15.72:3300/0 conn(0x7f062c0ca9a0 0x7f062c0b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f0633dff700 1 --2- 172.21.15.72:0/2706393153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0c2460 0x7f062c0ca460 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f0633dff700 1 -- 172.21.15.72:0/2706393153 >> 172.21.15.72:0/2706393153 conn(0x7f062c0ce9a0 msgr2=0x7f062c0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.722+0000 7fa83cbff700 1 -- start start 2023-08-25T04:46:01.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f18eaffd700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18d4004850 0x7f18d4004cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f18e000d400 tx=0x7f18d4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d280a152abd71c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f0633dff700 1 -- 172.21.15.72:0/2706393153 shutdown_connections 2023-08-25T04:46:01.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f2a61199700 1 -- 172.21.15.72:0/2011975806 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c004230 con 0x7f2a5c0b4800 2023-08-25T04:46:01.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f2a61199700 1 -- 172.21.15.72:0/2011975806 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c004390 con 0x7f2a5c0b4800 2023-08-25T04:46:01.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f2a61199700 1 -- 172.21.15.72:0/2011975806 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c009e70 con 0x7f2a5c0b4800 2023-08-25T04:46:01.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.725+0000 7f2a643ff700 1 -- 172.21.15.72:0/2011975806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0b4800 msgr2=0x7f2a5c0b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.725+0000 7f2a643ff700 1 --2- 172.21.15.72:0/2011975806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0b4800 0x7f2a5c0b4c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009920 tx=0x7f2a4c009c30 comp rx=0 tx=0).stop 2023-08-25T04:46:01.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000f400 con 0x7f18d4004850 2023-08-25T04:46:01.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.725+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e000f560 con 0x7f18d4004850 2023-08-25T04:46:01.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.725+0000 7f18ea7fc700 1 -- 172.21.15.72:0/3384965302 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000f8f0 con 0x7f18d4004850 2023-08-25T04:46:01.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7f18f1dff700 1 -- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18d4004850 msgr2=0x7f18d4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7f18f1dff700 1 --2- 172.21.15.72:0/3384965302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18d4004850 0x7f18d4004cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f18e000d400 tx=0x7f18d4005880 comp rx=0 tx=0).stop 2023-08-25T04:46:01.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7f18ebfff700 1 -- 172.21.15.72:0/3384965302 reap_dead start 2023-08-25T04:46:01.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7fa83cbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa838070fa0 0x7fa8381fb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7fa83cbff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa838071940 0x7fa838152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7fa83cbff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa838158fe0 0x7fa8380c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7fa83cbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa838159bb0 con 0x7fa838070fa0 2023-08-25T04:46:01.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7fa83cbff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8381534c0 con 0x7fa838158fe0 2023-08-25T04:46:01.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7fa83cbff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380c7a50 con 0x7fa838071940 2023-08-25T04:46:01.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.725+0000 7f0633dff700 1 -- 172.21.15.72:0/2706393153 wait complete. 2023-08-25T04:46:01.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7fa836d9d700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa838158fe0 0x7fa8380c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7fa836d9d700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa838158fe0 0x7fa8380c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:60080/0 (socket says 172.21.15.72:60080) 2023-08-25T04:46:01.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7fa836d9d700 1 -- 172.21.15.72:0/3948639813 learned_addr learned my addr 172.21.15.72:0/3948639813 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7f2a643ff700 1 -- 172.21.15.72:0/2011975806 shutdown_connections 2023-08-25T04:46:01.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7f2a643ff700 1 --2- 172.21.15.72:0/2011975806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0b4800 0x7f2a5c0b4c60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.726+0000 7f2a643ff700 1 -- 172.21.15.72:0/2011975806 >> 172.21.15.72:0/2011975806 conn(0x7f2a5c071e40 msgr2=0x7f2a5c072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.727+0000 7f18f1dff700 1 -- 172.21.15.72:0/3384965302 shutdown_connections 2023-08-25T04:46:01.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.727+0000 7f18f1dff700 1 -- 172.21.15.72:0/3384965302 >> 172.21.15.72:0/3384965302 conn(0x7f18ec0ce9a0 msgr2=0x7f18ec0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.724+0000 7f99893ff700 1 -- 172.21.15.72:0/1594478537 wait complete. 2023-08-25T04:46:01.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.727+0000 7f99893ff700 1 Processor -- start 2023-08-25T04:46:01.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.727+0000 7f99893ff700 1 -- start start 2023-08-25T04:46:01.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7f99893ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9984070890 0x7f998415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7f99893ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9984071940 0x7f99841f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7f99893ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9984158fe0 0x7f9984155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7f99893ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9984159e30 con 0x7f9984071940 2023-08-25T04:46:01.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7f99893ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9984159560 con 0x7f9984158fe0 2023-08-25T04:46:01.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7f99893ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9984200230 con 0x7f9984070890 2023-08-25T04:46:01.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.728+0000 7f0633dff700 1 Processor -- start 2023-08-25T04:46:01.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.728+0000 7f0633dff700 1 -- start start 2023-08-25T04:46:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.727+0000 7fa835d9b700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa838071940 0x7fa838152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.727+0000 7fa83659c700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa838070fa0 0x7fa8381fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7fa835d9b700 1 -- 172.21.15.72:0/3948639813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa838158fe0 msgr2=0x7fa8380c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7fa835d9b700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa838158fe0 0x7fa8380c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7fa835d9b700 1 -- 172.21.15.72:0/3948639813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa838070fa0 msgr2=0x7fa8381fb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7fa835d9b700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa838070fa0 0x7fa8381fb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7fa835d9b700 1 -- 172.21.15.72:0/3948639813 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c00a640 con 0x7fa838071940 2023-08-25T04:46:01.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.729+0000 7fa835d9b700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa838071940 0x7fa838152f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa82800c750 tx=0x7fa82800ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.727+0000 7f18f1dff700 1 -- 172.21.15.72:0/3384965302 shutdown_connections 2023-08-25T04:46:01.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.727+0000 7f18f1dff700 1 -- 172.21.15.72:0/3384965302 wait complete. 2023-08-25T04:46:01.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.728+0000 7f2a643ff700 1 -- 172.21.15.72:0/2011975806 shutdown_connections 2023-08-25T04:46:01.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f99827fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9984071940 0x7f99841f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f99827fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9984071940 0x7f99841f5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56256/0 (socket says 172.21.15.72:56256) 2023-08-25T04:46:01.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f99827fc700 1 -- 172.21.15.72:0/2371843510 learned_addr learned my addr 172.21.15.72:0/2371843510 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f99827fc700 1 -- 172.21.15.72:0/2371843510 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9984070890 msgr2=0x7f998415a250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:46:01.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f99827fc700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9984070890 0x7f998415a250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f99827fc700 1 -- 172.21.15.72:0/2371843510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9984158fe0 msgr2=0x7f9984155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f99827fc700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9984158fe0 0x7f9984155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f99827fc700 1 -- 172.21.15.72:0/2371843510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99780085d0 con 0x7f9984071940 2023-08-25T04:46:01.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f99827fc700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9984071940 0x7f99841f5ca0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f997400b530 tx=0x7f997400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f0633dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f062c070890 0x7f062c143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f0633dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062c0c2460 0x7f062c1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f0633dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0ca9a0 0x7f062c0c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f0633dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c153700 con 0x7f062c070890 2023-08-25T04:46:01.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f0633dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c1523d0 con 0x7f062c0c2460 2023-08-25T04:46:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f0633dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c1517c0 con 0x7f062c0ca9a0 2023-08-25T04:46:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f063139a700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062c0c2460 0x7f062c1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f063139a700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062c0c2460 0x7f062c1531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:60104/0 (socket says 172.21.15.72:60104) 2023-08-25T04:46:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f063139a700 1 -- 172.21.15.72:0/1820607029 learned_addr learned my addr 172.21.15.72:0/1820607029 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f063239c700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0ca9a0 0x7f062c0c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f063139a700 1 -- 172.21.15.72:0/1820607029 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0ca9a0 msgr2=0x7f062c0c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f063139a700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0ca9a0 0x7f062c0c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f063139a700 1 -- 172.21.15.72:0/1820607029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f062c070890 msgr2=0x7f062c143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f063139a700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f062c070890 0x7f062c143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f063139a700 1 -- 172.21.15.72:0/1820607029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0094a0 con 0x7f062c0c2460 2023-08-25T04:46:01.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f063139a700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062c0c2460 0x7f062c1531c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f061c0090b0 tx=0x7f061c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f2a643ff700 1 -- 172.21.15.72:0/2011975806 wait complete. 2023-08-25T04:46:01.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f18f1dff700 1 Processor -- start 2023-08-25T04:46:01.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f18f1dff700 1 -- start start 2023-08-25T04:46:01.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f18f1dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d4004850 0x7f18ec1ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f18f1dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18ec15c2b0 0x7f18ec15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f18f1dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec1ec090 0x7f18ec1efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f18f1dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec159580 con 0x7f18ec15c2b0 2023-08-25T04:46:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f18f1dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec1ef910 con 0x7f18d4004850 2023-08-25T04:46:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f18f1dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec159790 con 0x7f18ec1ec090 2023-08-25T04:46:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f18ebfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec1ec090 0x7f18ec1efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f18ebfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec1ec090 0x7f18ec1efb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51380/0 (socket says 172.21.15.72:51380) 2023-08-25T04:46:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f18ebfff700 1 -- 172.21.15.72:0/173226193 learned_addr learned my addr 172.21.15.72:0/173226193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f18eb7fe700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d4004850 0x7f18ec1ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.731+0000 7f81c0fff700 1 Processor -- start 2023-08-25T04:46:01.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f81c0fff700 1 -- start start 2023-08-25T04:46:01.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f92907ff700 1 Processor -- start 2023-08-25T04:46:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.730+0000 7f92907ff700 1 -- start start 2023-08-25T04:46:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f92907ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92880ca440 0x7f9288070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f92907ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9288071230 con 0x7f92880add00 2023-08-25T04:46:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f92907ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928806db40 con 0x7f9288070dd0 2023-08-25T04:46:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.732+0000 7f92907ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9288161ad0 con 0x7f92880ca440 2023-08-25T04:46:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f928e59b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f92880add00 0x7f928806d430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53266/0 (socket says 172.21.15.72:53266) 2023-08-25T04:46:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f928e59b700 1 -- 172.21.15.72:0/3584095239 learned_addr learned my addr 172.21.15.72:0/3584095239 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:01.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f928dd9a700 1 --2- 172.21.15.72:0/3584095239 >> v2:172.21.15.72:3300/0 conn(0x7f92880ca440 0x7f9288070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f928dd9a700 1 -- 172.21.15.72:0/3584095239 >> v1:172.21.15.137:6789/0 conn(0x7f9288070dd0 legacy=0x7f92880affb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:46:01.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f928dd9a700 1 -- 172.21.15.72:0/3584095239 >> v1:172.21.15.72:6789/0 conn(0x7f92880add00 legacy=0x7f928806d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.733+0000 7f928dd9a700 1 -- 172.21.15.72:0/3584095239 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92880ca940 con 0x7f92880ca440 2023-08-25T04:46:01.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f06227fc700 1 -- 172.21.15.72:0/1820607029 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0036a0 con 0x7f062c0c2460 2023-08-25T04:46:01.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f06227fc700 1 -- 172.21.15.72:0/1820607029 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c01f070 con 0x7f062c0c2460 2023-08-25T04:46:01.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f06227fc700 1 -- 172.21.15.72:0/1820607029 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c003a00 con 0x7f062c0c2460 2023-08-25T04:46:01.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f18ebfff700 1 -- 172.21.15.72:0/173226193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d4004850 msgr2=0x7f18ec1ef3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f18ebfff700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d4004850 0x7f18ec1ef3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f18ebfff700 1 -- 172.21.15.72:0/173226193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18ec15c2b0 msgr2=0x7f18ec15a830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:46:01.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f18ebfff700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18ec15c2b0 0x7f18ec15a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f18ebfff700 1 -- 172.21.15.72:0/173226193 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec159a70 con 0x7f18ec1ec090 2023-08-25T04:46:01.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f0633dff700 1 -- 172.21.15.72:0/1820607029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062c151aa0 con 0x7f062c0c2460 2023-08-25T04:46:01.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f928dd9a700 1 --2- 172.21.15.72:0/3584095239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92880ca440 0x7f9288070890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9278009840 tx=0x7f9278009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92eb975f0691c0b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f81c0fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81bc0add00 0x7f81bc06d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f81c0fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f81bc0ca440 0x7f81bc070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f81c0fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81bc071230 con 0x7f81bc070dd0 2023-08-25T04:46:01.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f81c0fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81bc161ad0 con 0x7f81bc0add00 2023-08-25T04:46:01.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f81c0fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81bc0ca940 con 0x7f81bc0ca440 2023-08-25T04:46:01.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.734+0000 7f0633dff700 1 -- 172.21.15.72:0/1820607029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c152060 con 0x7f062c0c2460 2023-08-25T04:46:01.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.735+0000 7f81ba59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81bc0add00 0x7f81bc06d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f81ba59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81bc0add00 0x7f81bc06d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56286/0 (socket says 172.21.15.72:56286) 2023-08-25T04:46:01.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f81ba59c700 1 -- 172.21.15.72:0/1237542309 learned_addr learned my addr 172.21.15.72:0/1237542309 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f2a643ff700 1 Processor -- start 2023-08-25T04:46:01.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f060ffff700 1 -- 172.21.15.72:0/1820607029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c0722d0 con 0x7f062c0c2460 2023-08-25T04:46:01.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f18ebfff700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec1ec090 0x7f18ec1efb10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0ae0b0 tx=0x7f18e40088b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f2a643ff700 1 -- start start 2023-08-25T04:46:01.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f81ba59c700 1 -- 172.21.15.72:0/1237542309 >> v2:172.21.15.137:3300/0 conn(0x7f81bc0ca440 msgr2=0x7f81bc070890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:46:01.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f81ba59c700 1 --2- 172.21.15.72:0/1237542309 >> v2:172.21.15.137:3300/0 conn(0x7f81bc0ca440 0x7f81bc070890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f81ba59c700 1 -- 172.21.15.72:0/1237542309 >> v1:172.21.15.72:6789/0 conn(0x7f81bc070dd0 legacy=0x7f81bc0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f81ba59c700 1 -- 172.21.15.72:0/1237542309 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc0cac20 con 0x7f81bc0add00 2023-08-25T04:46:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.735+0000 7f996b7fe700 1 -- 172.21.15.72:0/2371843510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974011830 con 0x7f9984071940 2023-08-25T04:46:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f996b7fe700 1 -- 172.21.15.72:0/2371843510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974011990 con 0x7f9984071940 2023-08-25T04:46:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f996b7fe700 1 -- 172.21.15.72:0/2371843510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974011d40 con 0x7f9984071940 2023-08-25T04:46:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f99893ff700 1 -- 172.21.15.72:0/2371843510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9984159770 con 0x7f9984071940 2023-08-25T04:46:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.736+0000 7f99893ff700 1 -- 172.21.15.72:0/2371843510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99841f61e0 con 0x7f9984071940 2023-08-25T04:46:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.737+0000 7f81ba59c700 1 --2- 172.21.15.72:0/1237542309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81bc0add00 0x7f81bc06d430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0ce710 tx=0x7f81ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fc2c0eb375fe4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.739+0000 7f99893ff700 1 -- 172.21.15.72:0/2371843510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99640052f0 con 0x7f9984071940 2023-08-25T04:46:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.737+0000 7fa826ffd700 1 -- 172.21.15.72:0/3948639813 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280054e0 con 0x7fa838071940 2023-08-25T04:46:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.737+0000 7fa826ffd700 1 -- 172.21.15.72:0/3948639813 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa828003680 con 0x7fa838071940 2023-08-25T04:46:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.737+0000 7fa826ffd700 1 -- 172.21.15.72:0/3948639813 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828003a30 con 0x7fa838071940 2023-08-25T04:46:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f2a643ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a5c0b4800 0x7f2a5c1523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f2a643ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0d0da0 0x7f2a5c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f2a643ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a5c15cf00 0x7f2a5c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f2a643ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c1528e0 con 0x7f2a5c15cf00 2023-08-25T04:46:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f2a643ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c0c6c50 con 0x7f2a5c0b4800 2023-08-25T04:46:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f2a643ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c0c6f30 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f2a6219b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a5c0b4800 0x7f2a5c1523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f2a6219b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a5c0b4800 0x7f2a5c1523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:60134/0 (socket says 172.21.15.72:60134) 2023-08-25T04:46:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f2a6219b700 1 -- 172.21.15.72:0/3404166274 learned_addr learned my addr 172.21.15.72:0/3404166274 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f2a6199a700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0d0da0 0x7f2a5c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.737+0000 7f18d3fff700 1 -- 172.21.15.72:0/173226193 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4019070 con 0x7f18ec1ec090 2023-08-25T04:46:01.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.737+0000 7f18d3fff700 1 -- 172.21.15.72:0/173226193 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e4008e50 con 0x7f18ec1ec090 2023-08-25T04:46:01.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.737+0000 7f18d3fff700 1 -- 172.21.15.72:0/173226193 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4009820 con 0x7f18ec1ec090 2023-08-25T04:46:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.737+0000 7f18f1dff700 1 -- 172.21.15.72:0/173226193 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec159d50 con 0x7f18ec1ec090 2023-08-25T04:46:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.737+0000 7f18f1dff700 1 -- 172.21.15.72:0/173226193 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec15a310 con 0x7f18ec1ec090 2023-08-25T04:46:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f81b959a700 1 -- 172.21.15.72:0/1237542309 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac004230 con 0x7f81bc0add00 2023-08-25T04:46:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f81b959a700 1 -- 172.21.15.72:0/1237542309 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac004390 con 0x7f81bc0add00 2023-08-25T04:46:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.738+0000 7f81b959a700 1 -- 172.21.15.72:0/1237542309 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac0036a0 con 0x7f81bc0add00 2023-08-25T04:46:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.739+0000 7f81c0fff700 1 -- 172.21.15.72:0/1237542309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81bc0add00 msgr2=0x7f81bc06d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.739+0000 7f81c0fff700 1 --2- 172.21.15.72:0/1237542309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81bc0add00 0x7f81bc06d430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0ce710 tx=0x7f81ac009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.739+0000 7fa83cbff700 1 -- 172.21.15.72:0/3948639813 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8380c7cf0 con 0x7fa838071940 2023-08-25T04:46:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.739+0000 7fa83cbff700 1 -- 172.21.15.72:0/3948639813 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa838159560 con 0x7fa838071940 2023-08-25T04:46:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.739+0000 7f928d599700 1 -- 172.21.15.72:0/3584095239 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278004230 con 0x7f92880ca440 2023-08-25T04:46:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.739+0000 7f928d599700 1 -- 172.21.15.72:0/3584095239 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9278004390 con 0x7f92880ca440 2023-08-25T04:46:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.739+0000 7f928d599700 1 -- 172.21.15.72:0/3584095239 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780036a0 con 0x7f92880ca440 2023-08-25T04:46:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.740+0000 7f81c0fff700 1 -- 172.21.15.72:0/1237542309 shutdown_connections 2023-08-25T04:46:01.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.740+0000 7f81c0fff700 1 --2- 172.21.15.72:0/1237542309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81bc0add00 0x7f81bc06d430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.740+0000 7f81c0fff700 1 --2- 172.21.15.72:0/1237542309 >> v2:172.21.15.137:3300/0 conn(0x7f81bc0ca440 0x7f81bc070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.740+0000 7f81c0fff700 1 -- 172.21.15.72:0/1237542309 >> 172.21.15.72:0/1237542309 conn(0x7f81bc0ce9a0 msgr2=0x7f81bc0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.739+0000 7f18f1dff700 1 -- 172.21.15.72:0/173226193 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc0052f0 con 0x7f18ec1ec090 2023-08-25T04:46:01.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.740+0000 7f92907ff700 1 -- 172.21.15.72:0/3584095239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92880ca440 msgr2=0x7f9288070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.740+0000 7f92907ff700 1 --2- 172.21.15.72:0/3584095239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92880ca440 0x7f9288070890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9278009840 tx=0x7f9278009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:01.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.741+0000 7f92907ff700 1 -- 172.21.15.72:0/3584095239 shutdown_connections 2023-08-25T04:46:01.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.741+0000 7f92907ff700 1 --2- 172.21.15.72:0/3584095239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92880ca440 0x7f9288070890 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.741+0000 7f92907ff700 1 -- 172.21.15.72:0/3584095239 >> 172.21.15.72:0/3584095239 conn(0x7f92880ce9a0 msgr2=0x7f92880ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.741+0000 7f2a6199a700 1 -- 172.21.15.72:0/3404166274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a5c0b4800 msgr2=0x7f2a5c1523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.741+0000 7f2a6199a700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a5c0b4800 0x7f2a5c1523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.741+0000 7f2a6199a700 1 -- 172.21.15.72:0/3404166274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a5c15cf00 msgr2=0x7f2a5c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.741+0000 7f81c0fff700 1 -- 172.21.15.72:0/1237542309 shutdown_connections 2023-08-25T04:46:01.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.741+0000 7f2a6199a700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a5c15cf00 0x7f2a5c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.741+0000 7f2a6199a700 1 -- 172.21.15.72:0/3404166274 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c009550 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.741+0000 7f92907ff700 1 -- 172.21.15.72:0/3584095239 shutdown_connections 2023-08-25T04:46:01.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.742+0000 7f06227fc700 1 -- 172.21.15.72:0/1820607029 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f061c003b60 con 0x7f062c0c2460 2023-08-25T04:46:01.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.743+0000 7f06227fc700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f061006a160 0x7f061006c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.744+0000 7f06227fc700 1 -- 172.21.15.72:0/1820607029 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f061c021070 con 0x7f062c0c2460 2023-08-25T04:46:01.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.745+0000 7f0631b9b700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f061006a160 0x7f061006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.742+0000 7fa83cbff700 1 -- 172.21.15.72:0/3948639813 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa838071450 con 0x7fa838071940 2023-08-25T04:46:01.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.744+0000 7fa826ffd700 1 -- 172.21.15.72:0/3948639813 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa828003b90 con 0x7fa838071940 2023-08-25T04:46:01.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.742+0000 7f2a6199a700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0d0da0 0x7f2a5c15dc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c015000 tx=0x7f2a4c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.743+0000 7f18d3fff700 1 -- 172.21.15.72:0/173226193 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f18e4009980 con 0x7f18ec1ec090 2023-08-25T04:46:01.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.744+0000 7f18d3fff700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f18d806a1b0 0x7f18d806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.745+0000 7f18d3fff700 1 -- 172.21.15.72:0/173226193 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f18e4090c90 con 0x7f18ec1ec090 2023-08-25T04:46:01.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.742+0000 7f81c0fff700 1 -- 172.21.15.72:0/1237542309 wait complete. 2023-08-25T04:46:01.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.745+0000 7f81c0fff700 1 Processor -- start 2023-08-25T04:46:01.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.742+0000 7f92907ff700 1 -- 172.21.15.72:0/3584095239 wait complete. 2023-08-25T04:46:01.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.745+0000 7f92907ff700 1 Processor -- start 2023-08-25T04:46:01.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.745+0000 7fa826ffd700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa81806a1b0 0x7fa81806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.746+0000 7f0631b9b700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f061006a160 0x7f061006c620 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f062c16ce20 tx=0x7f0624001690 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.746+0000 7fa826ffd700 1 -- 172.21.15.72:0/3948639813 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa828087bf0 con 0x7fa838071940 2023-08-25T04:46:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.746+0000 7fa83659c700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa81806a1b0 0x7fa81806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.746+0000 7f06227fc700 1 -- 172.21.15.72:0/1820607029 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f061c055890 con 0x7f062c0c2460 2023-08-25T04:46:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.747+0000 7f2a52ffd700 1 -- 172.21.15.72:0/3404166274 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00bdf0 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.745+0000 7f92907ff700 1 -- start start 2023-08-25T04:46:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.747+0000 7f92907ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9288070dd0 0x7f92880b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.747+0000 7f92907ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92880add00 0x7f92880c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.747+0000 7f92907ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92880ca440 0x7f92880c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.747+0000 7f92907ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288157640 con 0x7f9288070dd0 2023-08-25T04:46:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.747+0000 7f92907ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92880b08f0 con 0x7f92880add00 2023-08-25T04:46:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.747+0000 7f92907ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9288159bc0 con 0x7f92880ca440 2023-08-25T04:46:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f18d3fff700 1 -- 172.21.15.72:0/173226193 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f18e405c070 con 0x7f18ec1ec090 2023-08-25T04:46:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f928ed9c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92880ca440 0x7f92880c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f928ed9c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92880ca440 0x7f92880c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51398/0 (socket says 172.21.15.72:51398) 2023-08-25T04:46:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f928ed9c700 1 -- 172.21.15.72:0/3286983742 learned_addr learned my addr 172.21.15.72:0/3286983742 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7fa83659c700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa81806a1b0 0x7fa81806c670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa830004d10 tx=0x7fa830004bf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f18eb7fe700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f18d806a1b0 0x7f18d806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.746+0000 7f81c0fff700 1 -- start start 2023-08-25T04:46:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f81c0fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81bc070dd0 0x7f81bc15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f81c0fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81bc0add00 0x7f81bc14c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f81c0fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81bc0ca440 0x7f81bc159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f81c0fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc0c8ce0 con 0x7f81bc0add00 2023-08-25T04:46:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f81c0fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc14cce0 con 0x7f81bc0ca440 2023-08-25T04:46:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f81c0fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc0c6d80 con 0x7f81bc070dd0 2023-08-25T04:46:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f928ed9c700 1 -- 172.21.15.72:0/3286983742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92880add00 msgr2=0x7f92880c46c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:46:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f928ed9c700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92880add00 0x7f92880c46c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f928ed9c700 1 -- 172.21.15.72:0/3286983742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9288070dd0 msgr2=0x7f92880b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f928ed9c700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9288070dd0 0x7f92880b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.748+0000 7f928ed9c700 1 -- 172.21.15.72:0/3286983742 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92780094a0 con 0x7f92880ca440 2023-08-25T04:46:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f81ba59c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81bc070dd0 0x7f81bc15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f38e4bff700 1 Processor -- start 2023-08-25T04:46:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f81ba59c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81bc070dd0 0x7f81bc15b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:51406/0 (socket says 172.21.15.72:51406) 2023-08-25T04:46:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f81ba59c700 1 -- 172.21.15.72:0/1167062581 learned_addr learned my addr 172.21.15.72:0/1167062581 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f928ed9c700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92880ca440 0x7f92880c4c00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f928000b780 tx=0x7f928000bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f81bad9d700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81bc0ca440 0x7f81bc159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f81ba59c700 1 -- 172.21.15.72:0/1167062581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81bc0ca440 msgr2=0x7f81bc159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f81ba59c700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81bc0ca440 0x7f81bc159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f81ba59c700 1 -- 172.21.15.72:0/1167062581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81bc0add00 msgr2=0x7f81bc14c7a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:46:01.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f81ba59c700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81bc0add00 0x7f81bc14c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f81ba59c700 1 -- 172.21.15.72:0/1167062581 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac009550 con 0x7f81bc070dd0 2023-08-25T04:46:01.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f38e4bff700 1 -- start start 2023-08-25T04:46:01.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.749+0000 7f996b7fe700 1 -- 172.21.15.72:0/2371843510 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f997401a400 con 0x7f9984071940 2023-08-25T04:46:01.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.750+0000 7f18eb7fe700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f18d806a1b0 0x7f18d806c670 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0c7870 tx=0x7f18dc00f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.750+0000 7f81ba59c700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81bc070dd0 0x7f81bc15b340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81ac000c00 tx=0x7f81ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.750+0000 7f2a643ff700 1 -- 172.21.15.72:0/3404166274 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c0c7210 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.750+0000 7f2a643ff700 1 -- 172.21.15.72:0/3404166274 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c0c77d0 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.751+0000 7f996b7fe700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f997006a1b0 0x7f997006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.751+0000 7f996b7fe700 1 -- 172.21.15.72:0/2371843510 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9974088df0 con 0x7f9984071940 2023-08-25T04:46:01.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.751+0000 7f9982ffd700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f997006a1b0 0x7f997006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.751+0000 7f38e4bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38e00b4f10 0x7f38e00b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.751+0000 7f38e4bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e00b7400 con 0x7f38e0160710 2023-08-25T04:46:01.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.751+0000 7f38e4bff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e00b7650 con 0x7f38e00d20f0 2023-08-25T04:46:01.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.751+0000 7f38e4bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e00b7930 con 0x7f38e00b4f10 2023-08-25T04:46:01.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.751+0000 7f996b7fe700 1 -- 172.21.15.72:0/2371843510 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f99740891d0 con 0x7f9984071940 2023-08-25T04:46:01.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.751+0000 7f2a643ff700 1 -- 172.21.15.72:0/3404166274 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5c0c7070 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.752+0000 7f2a52ffd700 1 -- 172.21.15.72:0/3404166274 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c0036a0 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.752+0000 7f2a52ffd700 1 -- 172.21.15.72:0/3404166274 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c003a30 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.752+0000 7f38ded9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38e00b4f10 0x7f38e00b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.752+0000 7f38ded9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38e00b4f10 0x7f38e00b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56332/0 (socket says 172.21.15.72:56332) 2023-08-25T04:46:01.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.752+0000 7f38ded9d700 1 -- 172.21.15.72:0/465462819 learned_addr learned my addr 172.21.15.72:0/465462819 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.752+0000 7f81aaffd700 1 -- 172.21.15.72:0/1167062581 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac011630 con 0x7f81bc070dd0 2023-08-25T04:46:01.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.752+0000 7f81c0fff700 1 -- 172.21.15.72:0/1167062581 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81bc0c7060 con 0x7f81bc070dd0 2023-08-25T04:46:01.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.752+0000 7f81c0fff700 1 -- 172.21.15.72:0/1167062581 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81bc0c7620 con 0x7f81bc070dd0 2023-08-25T04:46:01.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.752+0000 7f9982ffd700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f997006a1b0 0x7f997006c670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f997c0012e0 tx=0x7f997c001670 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f81aaffd700 1 -- 172.21.15.72:0/1167062581 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac011790 con 0x7f81bc070dd0 2023-08-25T04:46:01.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f81aaffd700 1 -- 172.21.15.72:0/1167062581 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac011b00 con 0x7f81bc070dd0 2023-08-25T04:46:01.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532112853 0 0) 0x7f38e00b7650 con 0x7f38e00d20f0 2023-08-25T04:46:01.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38cc0035b0 con 0x7f38e00d20f0 2023-08-25T04:46:01.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1050861432 0 0) 0x7f38cc0035b0 con 0x7f38e00d20f0 2023-08-25T04:46:01.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 >> v2:172.21.15.72:3300/0 conn(0x7f38e00b4f10 msgr2=0x7f38e00b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 --2- 172.21.15.72:0/465462819 >> v2:172.21.15.72:3300/0 conn(0x7f38e00b4f10 0x7f38e00b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 >> v1:172.21.15.72:6789/0 conn(0x7f38e0160710 legacy=0x7f38e00b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e00b7c10 con 0x7f38e00d20f0 2023-08-25T04:46:01.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f38c8001670 con 0x7f38e00d20f0 2023-08-25T04:46:01.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 >> v1:172.21.15.137:6789/0 conn(0x7f38e00d20f0 legacy=0x7f38e00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38cc003a00 0x7f38cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38cc004850 0x7f38cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38cc005210 0x7f38cc014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e00b7930 con 0x7f38cc005210 2023-08-25T04:46:01.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc0148c0 con 0x7f38cc004850 2023-08-25T04:46:01.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.753+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc014a80 con 0x7f38cc003a00 2023-08-25T04:46:01.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.754+0000 7f38de59c700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38cc003a00 0x7f38cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.752+0000 7f927effd700 1 -- 172.21.15.72:0/3286983742 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000f840 con 0x7f92880ca440 2023-08-25T04:46:01.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.754+0000 7f92907ff700 1 -- 172.21.15.72:0/3286983742 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9288156d10 con 0x7f92880ca440 2023-08-25T04:46:01.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.754+0000 7f92907ff700 1 -- 172.21.15.72:0/3286983742 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92881572d0 con 0x7f92880ca440 2023-08-25T04:46:01.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.754+0000 7f38ded9d700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38cc005210 0x7f38cc014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.754+0000 7f38d7fff700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38cc004850 0x7f38cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.754+0000 7f38de59c700 1 -- 172.21.15.72:0/465462819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38cc004850 msgr2=0x7f38cc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.754+0000 7f38de59c700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38cc004850 0x7f38cc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.754+0000 7f38de59c700 1 -- 172.21.15.72:0/465462819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38cc005210 msgr2=0x7f38cc014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:01.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.754+0000 7f38de59c700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38cc005210 0x7f38cc014220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.754+0000 7f38de59c700 1 -- 172.21.15.72:0/465462819 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e00b7c10 con 0x7f38cc003a00 2023-08-25T04:46:01.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.755+0000 7f38ded9d700 1 -- 172.21.15.72:0/465462819 reap_dead start 2023-08-25T04:46:01.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.755+0000 7fa826ffd700 1 -- 172.21.15.72:0/3948639813 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa828053060 con 0x7fa838071940 2023-08-25T04:46:01.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.755+0000 7f38de59c700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38cc003a00 0x7f38cc003e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f38d00017c0 tx=0x7f38cc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5224cea51463858d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.755+0000 7f2a52ffd700 1 -- 172.21.15.72:0/3404166274 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2a4c022070 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.755+0000 7f927effd700 1 -- 172.21.15.72:0/3286983742 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928000f9a0 con 0x7f92880ca440 2023-08-25T04:46:01.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.755+0000 7f92907ff700 1 -- 172.21.15.72:0/3286983742 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92880722d0 con 0x7f92880ca440 2023-08-25T04:46:01.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.755+0000 7f927effd700 1 -- 172.21.15.72:0/3286983742 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000fd50 con 0x7f92880ca440 2023-08-25T04:46:01.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.756+0000 7f81c0fff700 1 -- 172.21.15.72:0/1167062581 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a00052f0 con 0x7f81bc070dd0 2023-08-25T04:46:01.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.756+0000 7f2a52ffd700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2a4006a0e0 0x7f2a4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.756+0000 7f2a52ffd700 1 -- 172.21.15.72:0/3404166274 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a4c08a4c0 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.757+0000 7f2a6219b700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2a4006a0e0 0x7f2a4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.757+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00052d0 con 0x7f38cc003a00 2023-08-25T04:46:01.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.758+0000 7f2a52ffd700 1 -- 172.21.15.72:0/3404166274 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2a4c0558c0 con 0x7f2a5c0d0da0 2023-08-25T04:46:01.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.758+0000 7f2a6219b700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2a4006a0e0 0x7f2a4006c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a58006fd0 tx=0x7f2a58009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.761+0000 7f81aaffd700 1 -- 172.21.15.72:0/1167062581 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f81ac022070 con 0x7f81bc070dd0 2023-08-25T04:46:01.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.758+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d0005430 con 0x7f38cc003a00 2023-08-25T04:46:01.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.758+0000 7f38ddd9b700 1 -- 172.21.15.72:0/465462819 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00038c0 con 0x7f38cc003a00 2023-08-25T04:46:01.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.759+0000 7f38e4bff700 1 -- 172.21.15.72:0/465462819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38cc003a00 msgr2=0x7f38cc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.759+0000 7f38e4bff700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38cc003a00 0x7f38cc003e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f38d00017c0 tx=0x7f38cc005880 comp rx=0 tx=0).stop 2023-08-25T04:46:01.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.763+0000 7f927effd700 1 -- 172.21.15.72:0/3286983742 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9280017400 con 0x7f92880ca440 2023-08-25T04:46:01.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.763+0000 7f81aaffd700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f819c06a0e0 0x7f819c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.763+0000 7f81aaffd700 1 -- 172.21.15.72:0/1167062581 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f81ac08ac30 con 0x7f81bc070dd0 2023-08-25T04:46:01.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.764+0000 7f81aaffd700 1 -- 172.21.15.72:0/1167062581 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f81ac0b6a30 con 0x7f81bc070dd0 2023-08-25T04:46:01.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.764+0000 7f927effd700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f926c06a0e0 0x7f926c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.764+0000 7f927effd700 1 -- 172.21.15.72:0/3286983742 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9280089250 con 0x7f92880ca440 2023-08-25T04:46:01.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.765+0000 7f928e59b700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f926c06a0e0 0x7f926c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.766+0000 7f928e59b700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f926c06a0e0 0x7f926c06c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9284000f60 tx=0x7f9284007b10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.767+0000 7f81b9d9b700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f819c06a0e0 0x7f819c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.767+0000 7f81b9d9b700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f819c06a0e0 0x7f819c06c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81bc160570 tx=0x7f81b4009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.768+0000 7f38e4bff700 1 -- 172.21.15.72:0/465462819 shutdown_connections 2023-08-25T04:46:01.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.768+0000 7f38e4bff700 1 --2- 172.21.15.72:0/465462819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38cc003a00 0x7f38cc003e20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.768+0000 7f38e4bff700 1 -- 172.21.15.72:0/465462819 >> 172.21.15.72:0/465462819 conn(0x7f38e0071e40 msgr2=0x7f38e0072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:01.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.768+0000 7f927effd700 1 -- 172.21.15.72:0/3286983742 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f92800546c0 con 0x7f92880ca440 2023-08-25T04:46:01.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.768+0000 7f38e4bff700 1 -- 172.21.15.72:0/465462819 shutdown_connections 2023-08-25T04:46:01.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.773+0000 7f38e4bff700 1 -- 172.21.15.72:0/465462819 wait complete. 2023-08-25T04:46:01.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.777+0000 7f38e4bff700 1 Processor -- start 2023-08-25T04:46:01.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.778+0000 7f38e4bff700 1 -- start start 2023-08-25T04:46:01.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.779+0000 7f38e4bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38cc003a00 0x7f38e014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.779+0000 7f38e4bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e015e000 0x7f38e015e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.779+0000 7f38e4bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38e00cb290 0x7f38e00cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.779+0000 7f38e4bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e00cbc80 con 0x7f38e015e000 2023-08-25T04:46:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.779+0000 7f38e4bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e014f820 con 0x7f38cc003a00 2023-08-25T04:46:01.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.779+0000 7f38e4bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e01571e0 con 0x7f38e00cb290 2023-08-25T04:46:01.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.781+0000 7f38d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e015e000 0x7f38e015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.781+0000 7f38d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e015e000 0x7f38e015e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56342/0 (socket says 172.21.15.72:56342) 2023-08-25T04:46:01.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.781+0000 7f38d7fff700 1 -- 172.21.15.72:0/3005833140 learned_addr learned my addr 172.21.15.72:0/3005833140 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:01.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.782+0000 7f38de59c700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38cc003a00 0x7f38e014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.782+0000 7f38ded9d700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38e00cb290 0x7f38e00cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.782+0000 7f38d7fff700 1 -- 172.21.15.72:0/3005833140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38e00cb290 msgr2=0x7f38e00cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.782+0000 7f38d7fff700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38e00cb290 0x7f38e00cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.782+0000 7f38d7fff700 1 -- 172.21.15.72:0/3005833140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38cc003a00 msgr2=0x7f38e014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.782+0000 7f38d7fff700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38cc003a00 0x7f38e014f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.782+0000 7f38d7fff700 1 -- 172.21.15.72:0/3005833140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e01574c0 con 0x7f38e015e000 2023-08-25T04:46:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.782+0000 7f38de59c700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38cc003a00 0x7f38e014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.782+0000 7f38d7fff700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e015e000 0x7f38e015e480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f38c800e840 tx=0x7f38c800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.788+0000 7f38d6ffd700 1 -- 172.21.15.72:0/3005833140 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c80052e0 con 0x7f38e015e000 2023-08-25T04:46:01.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.788+0000 7f38d6ffd700 1 -- 172.21.15.72:0/3005833140 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c8005460 con 0x7f38e015e000 2023-08-25T04:46:01.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.788+0000 7f38d6ffd700 1 -- 172.21.15.72:0/3005833140 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c80038c0 con 0x7f38e015e000 2023-08-25T04:46:01.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.788+0000 7f38e4bff700 1 -- 172.21.15.72:0/3005833140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e01577a0 con 0x7f38e015e000 2023-08-25T04:46:01.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.788+0000 7f38e4bff700 1 -- 172.21.15.72:0/3005833140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e0157d60 con 0x7f38e015e000 2023-08-25T04:46:01.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.792+0000 7f38d6ffd700 1 -- 172.21.15.72:0/3005833140 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f38c8003a20 con 0x7f38e015e000 2023-08-25T04:46:01.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.794+0000 7f38d6ffd700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f38c006a1b0 0x7f38c006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:01.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.794+0000 7f38d6ffd700 1 -- 172.21.15.72:0/3005833140 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38c80886d0 con 0x7f38e015e000 2023-08-25T04:46:01.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.795+0000 7f38de59c700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f38c006a1b0 0x7f38c006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:01.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.796+0000 7f38de59c700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f38c006a1b0 0x7f38c006c670 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f38d0005040 tx=0x7f38d0009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:01.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.796+0000 7f38e4bff700 1 -- 172.21.15.72:0/3005833140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c40052f0 con 0x7f38e015e000 2023-08-25T04:46:01.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:01.807+0000 7f38d6ffd700 1 -- 172.21.15.72:0/3005833140 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f38c8053ab0 con 0x7f38e015e000 2023-08-25T04:46:02.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.186+0000 7f99893ff700 1 -- 172.21.15.72:0/2371843510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9964005870 con 0x7f9984071940 2023-08-25T04:46:02.192 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2023-08-25T04:46:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.187+0000 7f996b7fe700 1 -- 172.21.15.72:0/2371843510 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9974054260 con 0x7f9984071940 2023-08-25T04:46:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.191+0000 7f99893ff700 1 -- 172.21.15.72:0/2371843510 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f997006a1b0 msgr2=0x7f997006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.191+0000 7f99893ff700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f997006a1b0 0x7f997006c670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f997c0012e0 tx=0x7f997c001670 comp rx=0 tx=0).stop 2023-08-25T04:46:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.191+0000 7f99893ff700 1 -- 172.21.15.72:0/2371843510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9984071940 msgr2=0x7f99841f5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.191+0000 7f99893ff700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9984071940 0x7f99841f5ca0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f997400b530 tx=0x7f997400b8f0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.192+0000 7f99893ff700 1 -- 172.21.15.72:0/2371843510 shutdown_connections 2023-08-25T04:46:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.192+0000 7f99893ff700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f997006a1b0 0x7f997006c670 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.192+0000 7f99893ff700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9984158fe0 0x7f9984155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.192+0000 7f99893ff700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9984070890 0x7f998415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.192+0000 7f99893ff700 1 --2- 172.21.15.72:0/2371843510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9984071940 0x7f99841f5ca0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.192+0000 7f99893ff700 1 -- 172.21.15.72:0/2371843510 >> 172.21.15.72:0/2371843510 conn(0x7f99840ce9a0 msgr2=0x7f99840cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:02.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.193+0000 7f99893ff700 1 -- 172.21.15.72:0/2371843510 shutdown_connections 2023-08-25T04:46:02.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.193+0000 7f99893ff700 1 -- 172.21.15.72:0/2371843510 wait complete. 2023-08-25T04:46:02.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.212+0000 7f2a643ff700 1 -- 172.21.15.72:0/3404166274 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2a5c0c7070 con 0x7f2a5c0d0da0 2023-08-25T04:46:02.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.212+0000 7fa83cbff700 1 -- 172.21.15.72:0/3948639813 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa8380af430 con 0x7fa838071940 2023-08-25T04:46:02.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.212+0000 7fa826ffd700 1 -- 172.21.15.72:0/3948639813 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa828056680 con 0x7fa838071940 2023-08-25T04:46:02.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.212+0000 7f2a52ffd700 1 -- 172.21.15.72:0/3404166274 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a5c0c7070 con 0x7f2a5c0d0da0 2023-08-25T04:46:02.214 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-08-25T04:46:02.215 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-08-25T04:46:02.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.214+0000 7f18f1dff700 1 -- 172.21.15.72:0/173226193 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f18cc0055a0 con 0x7f18ec1ec090 2023-08-25T04:46:02.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.215+0000 7f18d3fff700 1 -- 172.21.15.72:0/173226193 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18e408ee60 con 0x7f18ec1ec090 2023-08-25T04:46:02.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.217+0000 7fa83cbff700 1 -- 172.21.15.72:0/3948639813 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa81806a1b0 msgr2=0x7fa81806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.217+0000 7fa83cbff700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa81806a1b0 0x7fa81806c670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa830004d10 tx=0x7fa830004bf0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.217+0000 7fa83cbff700 1 -- 172.21.15.72:0/3948639813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa838071940 msgr2=0x7fa838152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.217+0000 7fa83cbff700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa838071940 0x7fa838152f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa82800c750 tx=0x7fa82800ca60 comp rx=0 tx=0).stop 2023-08-25T04:46:02.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.216+0000 7f2a643ff700 1 -- 172.21.15.72:0/3404166274 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2a4006a0e0 msgr2=0x7f2a4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.216+0000 7f2a643ff700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2a4006a0e0 0x7f2a4006c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a58006fd0 tx=0x7f2a58009190 comp rx=0 tx=0).stop 2023-08-25T04:46:02.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.216+0000 7f2a643ff700 1 -- 172.21.15.72:0/3404166274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0d0da0 msgr2=0x7f2a5c15dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.217+0000 7f2a643ff700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0d0da0 0x7f2a5c15dc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c015000 tx=0x7f2a4c004750 comp rx=0 tx=0).stop 2023-08-25T04:46:02.223 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-08-25T04:46:02.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.218+0000 7f81c0fff700 1 -- 172.21.15.72:0/1167062581 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f81a0005870 con 0x7f81bc070dd0 2023-08-25T04:46:02.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7f92907ff700 1 -- 172.21.15.72:0/3286983742 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f92881577b0 con 0x7f92880ca440 2023-08-25T04:46:02.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7f81aaffd700 1 -- 172.21.15.72:0/1167062581 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81ac0560a0 con 0x7f81bc070dd0 2023-08-25T04:46:02.225 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-08-25T04:46:02.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7f060ffff700 1 -- 172.21.15.72:0/1820607029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f062c152510 con 0x7f062c0c2460 2023-08-25T04:46:02.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7fa83cbff700 1 -- 172.21.15.72:0/3948639813 shutdown_connections 2023-08-25T04:46:02.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7fa83cbff700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa81806a1b0 0x7fa81806c670 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7fa83cbff700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa838158fe0 0x7fa8380c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7fa83cbff700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa838070fa0 0x7fa8381fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7fa83cbff700 1 --2- 172.21.15.72:0/3948639813 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa838071940 0x7fa838152f80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7fa83cbff700 1 -- 172.21.15.72:0/3948639813 >> 172.21.15.72:0/3948639813 conn(0x7fa8380ce9a0 msgr2=0x7fa8380ad6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:02.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7f2a643ff700 1 -- 172.21.15.72:0/3404166274 shutdown_connections 2023-08-25T04:46:02.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7f2a643ff700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2a4006a0e0 0x7f2a4006c5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7f2a643ff700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a5c15cf00 0x7f2a5c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7f2a643ff700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a5c0b4800 0x7f2a5c1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7f2a643ff700 1 --2- 172.21.15.72:0/3404166274 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a5c0d0da0 0x7f2a5c15dc70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.219+0000 7f2a643ff700 1 -- 172.21.15.72:0/3404166274 >> 172.21.15.72:0/3404166274 conn(0x7f2a5c071e40 msgr2=0x7f2a5c0d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:02.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7fa83cbff700 1 -- 172.21.15.72:0/3948639813 shutdown_connections 2023-08-25T04:46:02.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f2a643ff700 1 -- 172.21.15.72:0/3404166274 shutdown_connections 2023-08-25T04:46:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f927effd700 1 -- 172.21.15.72:0/3286983742 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9280057ce0 con 0x7f92880ca440 2023-08-25T04:46:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f06227fc700 1 -- 172.21.15.72:0/1820607029 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f061c058eb0 con 0x7f062c0c2460 2023-08-25T04:46:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7fa83cbff700 1 -- 172.21.15.72:0/3948639813 wait complete. 2023-08-25T04:46:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f2a643ff700 1 -- 172.21.15.72:0/3404166274 wait complete. 2023-08-25T04:46:02.230 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-08-25T04:46:02.230 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-08-25T04:46:02.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f18f1dff700 1 -- 172.21.15.72:0/173226193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f18d806a1b0 msgr2=0x7f18d806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f18f1dff700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f18d806a1b0 0x7f18d806c670 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0c7870 tx=0x7f18dc00f040 comp rx=0 tx=0).stop 2023-08-25T04:46:02.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f18f1dff700 1 -- 172.21.15.72:0/173226193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec1ec090 msgr2=0x7f18ec1efb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f18f1dff700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec1ec090 0x7f18ec1efb10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0ae0b0 tx=0x7f18e40088b0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f18f1dff700 1 -- 172.21.15.72:0/173226193 shutdown_connections 2023-08-25T04:46:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f18f1dff700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f18d806a1b0 0x7f18d806c670 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0c7870 tx=0x7f18dc00f040 comp rx=0 tx=0).stop 2023-08-25T04:46:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f18f1dff700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18ec1ec090 0x7f18ec1efb10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f18f1dff700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d4004850 0x7f18ec1ef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f18f1dff700 1 --2- 172.21.15.72:0/173226193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18ec15c2b0 0x7f18ec15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.220+0000 7f18f1dff700 1 -- 172.21.15.72:0/173226193 >> 172.21.15.72:0/173226193 conn(0x7f18ec0ce9a0 msgr2=0x7f18ec0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:02.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.221+0000 7f18f1dff700 1 -- 172.21.15.72:0/173226193 shutdown_connections 2023-08-25T04:46:02.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.221+0000 7f18f1dff700 1 -- 172.21.15.72:0/173226193 wait complete. 2023-08-25T04:46:02.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.223+0000 7f81c0fff700 1 -- 172.21.15.72:0/1167062581 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f819c06a0e0 msgr2=0x7f819c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.223+0000 7f81c0fff700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f819c06a0e0 0x7f819c06c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81bc160570 tx=0x7f81b4009250 comp rx=0 tx=0).stop 2023-08-25T04:46:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.223+0000 7f81c0fff700 1 -- 172.21.15.72:0/1167062581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81bc070dd0 msgr2=0x7f81bc15b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.223+0000 7f81c0fff700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81bc070dd0 0x7f81bc15b340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81ac000c00 tx=0x7f81ac004750 comp rx=0 tx=0).stop 2023-08-25T04:46:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.223+0000 7f81c0fff700 1 -- 172.21.15.72:0/1167062581 shutdown_connections 2023-08-25T04:46:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.223+0000 7f81c0fff700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f819c06a0e0 0x7f819c06c5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.223+0000 7f81c0fff700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81bc0ca440 0x7f81bc159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.223+0000 7f81c0fff700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f81bc070dd0 0x7f81bc15b340 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.223+0000 7f81c0fff700 1 --2- 172.21.15.72:0/1167062581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81bc0add00 0x7f81bc14c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.223+0000 7f81c0fff700 1 -- 172.21.15.72:0/1167062581 >> 172.21.15.72:0/1167062581 conn(0x7f81bc0ce9a0 msgr2=0x7f81bc1622d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.224+0000 7f81c0fff700 1 -- 172.21.15.72:0/1167062581 shutdown_connections 2023-08-25T04:46:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.224+0000 7f81c0fff700 1 -- 172.21.15.72:0/1167062581 wait complete. 2023-08-25T04:46:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.224+0000 7f92907ff700 1 -- 172.21.15.72:0/3286983742 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f926c06a0e0 msgr2=0x7f926c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.224+0000 7f92907ff700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f926c06a0e0 0x7f926c06c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9284000f60 tx=0x7f9284007b10 comp rx=0 tx=0).stop 2023-08-25T04:46:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.224+0000 7f92907ff700 1 -- 172.21.15.72:0/3286983742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92880ca440 msgr2=0x7f92880c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.224+0000 7f92907ff700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92880ca440 0x7f92880c4c00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f928000b780 tx=0x7f928000bb40 comp rx=0 tx=0).stop 2023-08-25T04:46:02.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2023-08-25T04:46:02.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 -- 172.21.15.72:0/1820607029 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f061006a160 msgr2=0x7f061006c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f061006a160 0x7f061006c620 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f062c16ce20 tx=0x7f0624001690 comp rx=0 tx=0).stop 2023-08-25T04:46:02.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 -- 172.21.15.72:0/1820607029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062c0c2460 msgr2=0x7f062c1531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062c0c2460 0x7f062c1531c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f061c0090b0 tx=0x7f061c004750 comp rx=0 tx=0).stop 2023-08-25T04:46:02.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 -- 172.21.15.72:0/1820607029 shutdown_connections 2023-08-25T04:46:02.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f061006a160 0x7f061006c620 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f062c0ca9a0 0x7f062c0c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f062c070890 0x7f062c143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 --2- 172.21.15.72:0/1820607029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062c0c2460 0x7f062c1531c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 -- 172.21.15.72:0/1820607029 >> 172.21.15.72:0/1820607029 conn(0x7f062c0ce9a0 msgr2=0x7f062c154260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:02.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.227+0000 7f060ffff700 1 -- 172.21.15.72:0/1820607029 shutdown_connections 2023-08-25T04:46:02.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.228+0000 7f060ffff700 1 -- 172.21.15.72:0/1820607029 wait complete. 2023-08-25T04:46:02.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.231+0000 7f92907ff700 1 -- 172.21.15.72:0/3286983742 shutdown_connections 2023-08-25T04:46:02.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.231+0000 7f92907ff700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f926c06a0e0 0x7f926c06c5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.231+0000 7f92907ff700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92880ca440 0x7f92880c4c00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.231+0000 7f92907ff700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9288070dd0 0x7f92880b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.231+0000 7f92907ff700 1 --2- 172.21.15.72:0/3286983742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92880add00 0x7f92880c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.231+0000 7f92907ff700 1 -- 172.21.15.72:0/3286983742 >> 172.21.15.72:0/3286983742 conn(0x7f92880ce9a0 msgr2=0x7f9288162be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:02.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.231+0000 7f92907ff700 1 -- 172.21.15.72:0/3286983742 shutdown_connections 2023-08-25T04:46:02.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.231+0000 7f92907ff700 1 -- 172.21.15.72:0/3286983742 wait complete. 2023-08-25T04:46:02.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.3 2023-08-25T04:46:02.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.251+0000 7f38e4bff700 1 -- 172.21.15.72:0/3005833140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f38c40055a0 con 0x7f38e015e000 2023-08-25T04:46:02.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.252+0000 7f38d6ffd700 1 -- 172.21.15.72:0/3005833140 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38c80570d0 con 0x7f38e015e000 2023-08-25T04:46:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-08-25T04:46:02.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.5 2023-08-25T04:46:02.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 -- 172.21.15.72:0/3005833140 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f38c006a1b0 msgr2=0x7f38c006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f38c006a1b0 0x7f38c006c670 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f38d0005040 tx=0x7f38d0009030 comp rx=0 tx=0).stop 2023-08-25T04:46:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 -- 172.21.15.72:0/3005833140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e015e000 msgr2=0x7f38e015e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e015e000 0x7f38e015e480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f38c800e840 tx=0x7f38c800ec00 comp rx=0 tx=0).stop 2023-08-25T04:46:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 -- 172.21.15.72:0/3005833140 shutdown_connections 2023-08-25T04:46:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f38c006a1b0 0x7f38c006c670 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f38e00cb290 0x7f38e00cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38cc003a00 0x7f38e014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 --2- 172.21.15.72:0/3005833140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38e015e000 0x7f38e015e480 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:02.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 -- 172.21.15.72:0/3005833140 >> 172.21.15.72:0/3005833140 conn(0x7f38e0071e40 msgr2=0x7f38e00d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:02.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 -- 172.21.15.72:0/3005833140 shutdown_connections 2023-08-25T04:46:02.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:02.255+0000 7f38e4bff700 1 -- 172.21.15.72:0/3005833140 wait complete. 2023-08-25T04:46:02.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2023-08-25T04:46:02.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.6 2023-08-25T04:46:02.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.0 2023-08-25T04:46:02.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.2 2023-08-25T04:46:02.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.4 2023-08-25T04:46:03.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-25T04:46:03.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-25T04:46:03.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-25T04:46:03.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-25T04:46:03.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-25T04:46:03.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-25T04:46:03.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-25T04:46:03.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-25T04:46:03.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.552+0000 7f4efe3ff700 1 Processor -- start 2023-08-25T04:46:03.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.553+0000 7f4efe3ff700 1 -- start start 2023-08-25T04:46:03.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.554+0000 7f4efe3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 0x7f4ef8070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.555+0000 7f4efe3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef806d3c0 con 0x7f4ef806cdf0 2023-08-25T04:46:03.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.555+0000 7f4efe3ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef806d6a0 con 0x7f4ef8158f30 2023-08-25T04:46:03.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.555+0000 7f4efe3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef806d980 con 0x7f4ef806c990 2023-08-25T04:46:03.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.556+0000 7f4efc99c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4ef806cdf0 0x7f4ef80afb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41638/0 (socket says 172.21.15.72:41638) 2023-08-25T04:46:03.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.556+0000 7f4efc99c700 1 -- 172.21.15.72:0/2844185183 learned_addr learned my addr 172.21.15.72:0/2844185183 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:03.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.556+0000 7f4ef77fe700 1 --2- 172.21.15.72:0/2844185183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 0x7f4ef8070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.557+0000 7f4ef77fe700 1 -- 172.21.15.72:0/2844185183 >> v1:172.21.15.137:6789/0 conn(0x7f4ef8158f30 legacy=0x7f4ef80cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.557+0000 7f4ef77fe700 1 -- 172.21.15.72:0/2844185183 >> v1:172.21.15.72:6789/0 conn(0x7f4ef806cdf0 legacy=0x7f4ef80afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.557+0000 7f4ef77fe700 1 -- 172.21.15.72:0/2844185183 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80ca440 con 0x7f4ef806c990 2023-08-25T04:46:03.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.558+0000 7f4ef77fe700 1 --2- 172.21.15.72:0/2844185183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 0x7f4ef8070890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009dc0 tx=0x7f4ef000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff7ca2a2a1444452 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.559+0000 7f4ef6ffd700 1 -- 172.21.15.72:0/2844185183 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000e070 con 0x7f4ef806c990 2023-08-25T04:46:03.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.559+0000 7f4ef6ffd700 1 -- 172.21.15.72:0/2844185183 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef000bad0 con 0x7f4ef806c990 2023-08-25T04:46:03.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.559+0000 7f4ef6ffd700 1 -- 172.21.15.72:0/2844185183 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000be60 con 0x7f4ef806c990 2023-08-25T04:46:03.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.561+0000 7f4efe3ff700 1 -- 172.21.15.72:0/2844185183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 msgr2=0x7f4ef8070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.561+0000 7f4efe3ff700 1 --2- 172.21.15.72:0/2844185183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 0x7f4ef8070890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009dc0 tx=0x7f4ef000b330 comp rx=0 tx=0).stop 2023-08-25T04:46:03.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.561+0000 7f4efe3ff700 1 -- 172.21.15.72:0/2844185183 shutdown_connections 2023-08-25T04:46:03.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.561+0000 7f4efe3ff700 1 --2- 172.21.15.72:0/2844185183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 0x7f4ef8070890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.561+0000 7f4efe3ff700 1 -- 172.21.15.72:0/2844185183 >> 172.21.15.72:0/2844185183 conn(0x7f4ef80ce9a0 msgr2=0x7f4ef80ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:03.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.562+0000 7f4efe3ff700 1 -- 172.21.15.72:0/2844185183 shutdown_connections 2023-08-25T04:46:03.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.562+0000 7f4efe3ff700 1 -- 172.21.15.72:0/2844185183 wait complete. 2023-08-25T04:46:03.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.565+0000 7f4efe3ff700 1 Processor -- start 2023-08-25T04:46:03.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.566+0000 7f4efe3ff700 1 -- start start 2023-08-25T04:46:03.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.568+0000 7f4efe3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 0x7f4ef8148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.568+0000 7f4efe3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef806cdf0 0x7f4ef814ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.568+0000 7f4efe3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ef8158f30 0x7f4ef814f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.568+0000 7f4efe3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef815c2d0 con 0x7f4ef8158f30 2023-08-25T04:46:03.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.568+0000 7f4efe3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef815b690 con 0x7f4ef806cdf0 2023-08-25T04:46:03.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.568+0000 7f4efe3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef815b930 con 0x7f4ef806c990 2023-08-25T04:46:03.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.570+0000 7f4ef77fe700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef806cdf0 0x7f4ef814ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.570+0000 7f4ef7fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 0x7f4ef8148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.570+0000 7f4efc99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ef8158f30 0x7f4ef814f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.571+0000 7f4ef77fe700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef806cdf0 0x7f4ef814ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:50702/0 (socket says 172.21.15.72:50702) 2023-08-25T04:46:03.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.571+0000 7f4ef77fe700 1 -- 172.21.15.72:0/630967817 learned_addr learned my addr 172.21.15.72:0/630967817 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.572+0000 7f4ef7fff700 1 -- 172.21.15.72:0/630967817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef806cdf0 msgr2=0x7f4ef814ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.572+0000 7f4ef7fff700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef806cdf0 0x7f4ef814ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.572+0000 7f4ef7fff700 1 -- 172.21.15.72:0/630967817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ef8158f30 msgr2=0x7f4ef814f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.572+0000 7f4ef7fff700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ef8158f30 0x7f4ef814f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.572+0000 7f4ef7fff700 1 -- 172.21.15.72:0/630967817 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0009a70 con 0x7f4ef806c990 2023-08-25T04:46:03.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.573+0000 7f4ef7fff700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 0x7f4ef8148ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4eec001eb0 tx=0x7f4eec00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.574+0000 7f4ef4ff9700 1 -- 172.21.15.72:0/630967817 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec0054e0 con 0x7f4ef806c990 2023-08-25T04:46:03.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.574+0000 7f4ef4ff9700 1 -- 172.21.15.72:0/630967817 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec003680 con 0x7f4ef806c990 2023-08-25T04:46:03.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.574+0000 7f4ef4ff9700 1 -- 172.21.15.72:0/630967817 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec0039f0 con 0x7f4ef806c990 2023-08-25T04:46:03.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.574+0000 7f4efe3ff700 1 -- 172.21.15.72:0/630967817 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef815bc10 con 0x7f4ef806c990 2023-08-25T04:46:03.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.574+0000 7f4efe3ff700 1 -- 172.21.15.72:0/630967817 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef8149400 con 0x7f4ef806c990 2023-08-25T04:46:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.579+0000 7f4ef4ff9700 1 -- 172.21.15.72:0/630967817 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4eec003b50 con 0x7f4ef806c990 2023-08-25T04:46:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.580+0000 7f4ef4ff9700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ee406a1b0 0x7f4ee406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.580+0000 7f4ef4ff9700 1 -- 172.21.15.72:0/630967817 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4eec087b00 con 0x7f4ef806c990 2023-08-25T04:46:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.582+0000 7f4ef77fe700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ee406a1b0 0x7f4ee406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.583+0000 7f4ef77fe700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ee406a1b0 0x7f4ee406c670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80c1850 tx=0x7f4ef0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.587+0000 7f4efe3ff700 1 -- 172.21.15.72:0/630967817 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed80052f0 con 0x7f4ef806c990 2023-08-25T04:46:03.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.603+0000 7f4ef4ff9700 1 -- 172.21.15.72:0/630967817 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4eec053020 con 0x7f4ef806c990 2023-08-25T04:46:03.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.631+0000 7f575fbff700 1 Processor -- start 2023-08-25T04:46:03.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.631+0000 7f575fbff700 1 -- start start 2023-08-25T04:46:03.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.633+0000 7f575fbff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f575806dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.633+0000 7f575fbff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5758089b30 0x7f57580afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.633+0000 7f575fbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575806e100 con 0x7f575816e680 2023-08-25T04:46:03.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.633+0000 7f575fbff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5758071c70 con 0x7f5758089b30 2023-08-25T04:46:03.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.633+0000 7f575fbff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57580ae210 con 0x7f5758070b00 2023-08-25T04:46:03.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.634+0000 7f575d99b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f575806dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.634+0000 7f575d99b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f575806dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57602/0 (socket says 172.21.15.72:57602) 2023-08-25T04:46:03.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.634+0000 7f575d99b700 1 -- 172.21.15.72:0/3250867773 learned_addr learned my addr 172.21.15.72:0/3250867773 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.634+0000 7f575e19c700 1 --2- 172.21.15.72:0/3250867773 >> v2:172.21.15.137:3300/0 conn(0x7f5758089b30 0x7f57580afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.635+0000 7f575c999700 1 -- 172.21.15.72:0/3250867773 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738092620 0 0) 0x7f575806e100 con 0x7f575816e680 2023-08-25T04:46:03.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.636+0000 7f575c999700 1 -- 172.21.15.72:0/3250867773 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57440079c0 con 0x7f575816e680 2023-08-25T04:46:03.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.635+0000 7f1f079ff700 1 Processor -- start 2023-08-25T04:46:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.636+0000 7f1f079ff700 1 -- start start 2023-08-25T04:46:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.637+0000 7f575d99b700 1 -- 172.21.15.72:0/3250867773 >> v2:172.21.15.137:3300/0 conn(0x7f5758089b30 msgr2=0x7f57580afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.637+0000 7f575d99b700 1 --2- 172.21.15.72:0/3250867773 >> v2:172.21.15.137:3300/0 conn(0x7f5758089b30 0x7f57580afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.637+0000 7f575d99b700 1 -- 172.21.15.72:0/3250867773 >> v1:172.21.15.72:6789/0 conn(0x7f575816e680 legacy=0x7f5758089420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.637+0000 7f575d99b700 1 -- 172.21.15.72:0/3250867773 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57580af7d0 con 0x7f5758070b00 2023-08-25T04:46:03.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.637+0000 7f575d99b700 1 --2- 172.21.15.72:0/3250867773 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f575806dbc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5750014e60 tx=0x7f5750008ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f73d0462b0e5bd5c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.638+0000 7f1f079ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f00070890 0x7f1f000c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.638+0000 7f1f079ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f000caeb0 con 0x7f1f00070c70 2023-08-25T04:46:03.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.638+0000 7f1f079ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f000afa70 con 0x7f1f000b0550 2023-08-25T04:46:03.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.638+0000 7f1f079ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f000b0130 con 0x7f1f00070890 2023-08-25T04:46:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.639+0000 7f1f04f9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1f00070c70 0x7f1f000ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41652/0 (socket says 172.21.15.72:41652) 2023-08-25T04:46:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.639+0000 7f1f05f9c700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1f000b0550 0x7f1f000b09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:41464/0 (socket says 172.21.15.72:41464) 2023-08-25T04:46:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.639+0000 7f1f04f9a700 1 -- 172.21.15.72:0/219612777 learned_addr learned my addr 172.21.15.72:0/219612777 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.639+0000 7f1f0579b700 1 --2- 172.21.15.72:0/219612777 >> v2:172.21.15.72:3300/0 conn(0x7f1f00070890 0x7f1f000c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.640+0000 7f575c999700 1 -- 172.21.15.72:0/3250867773 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575001a520 con 0x7f5758070b00 2023-08-25T04:46:03.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.640+0000 7f575c999700 1 -- 172.21.15.72:0/3250867773 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575001a680 con 0x7f5758070b00 2023-08-25T04:46:03.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.640+0000 7f575c999700 1 -- 172.21.15.72:0/3250867773 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575001aa10 con 0x7f5758070b00 2023-08-25T04:46:03.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.640+0000 7f1f0579b700 1 -- 172.21.15.72:0/219612777 >> v1:172.21.15.137:6789/0 conn(0x7f1f000b0550 legacy=0x7f1f000b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.640+0000 7f1f0579b700 1 -- 172.21.15.72:0/219612777 >> v1:172.21.15.72:6789/0 conn(0x7f1f00070c70 legacy=0x7f1f000ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.640+0000 7f1f0579b700 1 -- 172.21.15.72:0/219612777 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f000afd50 con 0x7f1f00070890 2023-08-25T04:46:03.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.641+0000 7f1f0579b700 1 --2- 172.21.15.72:0/219612777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f00070890 0x7f1f000c2460 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009840 tx=0x7f1efc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d81f35de71ac946 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.642+0000 7f575fbff700 1 -- 172.21.15.72:0/3250867773 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 msgr2=0x7f575806dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.642+0000 7f575fbff700 1 --2- 172.21.15.72:0/3250867773 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f575806dbc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5750014e60 tx=0x7f5750008ce0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.641+0000 7f1ef7fff700 1 -- 172.21.15.72:0/219612777 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc004230 con 0x7f1f00070890 2023-08-25T04:46:03.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.642+0000 7f1ef7fff700 1 -- 172.21.15.72:0/219612777 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc004390 con 0x7f1f00070890 2023-08-25T04:46:03.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.642+0000 7f1ef7fff700 1 -- 172.21.15.72:0/219612777 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc0036a0 con 0x7f1f00070890 2023-08-25T04:46:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.642+0000 7f1f079ff700 1 -- 172.21.15.72:0/219612777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f00070890 msgr2=0x7f1f000c2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.642+0000 7f1f079ff700 1 --2- 172.21.15.72:0/219612777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f00070890 0x7f1f000c2460 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009840 tx=0x7f1efc009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.643+0000 7f1f079ff700 1 -- 172.21.15.72:0/219612777 shutdown_connections 2023-08-25T04:46:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.643+0000 7f1f079ff700 1 --2- 172.21.15.72:0/219612777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f00070890 0x7f1f000c2460 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.643+0000 7f1f079ff700 1 -- 172.21.15.72:0/219612777 >> 172.21.15.72:0/219612777 conn(0x7f1f000ce9a0 msgr2=0x7f1f000ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:03.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.643+0000 7f1f079ff700 1 -- 172.21.15.72:0/219612777 shutdown_connections 2023-08-25T04:46:03.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.643+0000 7f575fbff700 1 -- 172.21.15.72:0/3250867773 shutdown_connections 2023-08-25T04:46:03.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.643+0000 7f575fbff700 1 --2- 172.21.15.72:0/3250867773 >> v2:172.21.15.137:3300/0 conn(0x7f5758089b30 0x7f57580afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.643+0000 7f575fbff700 1 --2- 172.21.15.72:0/3250867773 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f575806dbc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.643+0000 7f575fbff700 1 -- 172.21.15.72:0/3250867773 >> 172.21.15.72:0/3250867773 conn(0x7f57580ce9a0 msgr2=0x7f57580ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:03.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.643+0000 7f1f079ff700 1 -- 172.21.15.72:0/219612777 wait complete. 2023-08-25T04:46:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.645+0000 7f575fbff700 1 -- 172.21.15.72:0/3250867773 shutdown_connections 2023-08-25T04:46:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.645+0000 7f575fbff700 1 -- 172.21.15.72:0/3250867773 wait complete. 2023-08-25T04:46:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.646+0000 7f1f079ff700 1 Processor -- start 2023-08-25T04:46:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.646+0000 7f1f079ff700 1 -- start start 2023-08-25T04:46:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.648+0000 7f575fbff700 1 Processor -- start 2023-08-25T04:46:03.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.648+0000 7f575fbff700 1 -- start start 2023-08-25T04:46:03.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.650+0000 7f575fbff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f57580b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f575d99b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f57580b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f575d99b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f57580b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57616/0 (socket says 172.21.15.72:57616) 2023-08-25T04:46:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.650+0000 7f1f079ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f00070890 0x7f1f0015d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.650+0000 7f1f079ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f00070c70 0x7f1f0015a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.650+0000 7f1f079ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f000b0550 0x7f1f0015b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.650+0000 7f1f079ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000b09f0 con 0x7f1f00070c70 2023-08-25T04:46:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.650+0000 7f1f079ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000b4730 con 0x7f1f00070890 2023-08-25T04:46:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.650+0000 7f1f079ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0015bfe0 con 0x7f1f000b0550 2023-08-25T04:46:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.652+0000 7f575fbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5758089b30 0x7f57580a7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.652+0000 7f575fbff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f575816e680 0x7f57580c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.652+0000 7f575fbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57580b3eb0 con 0x7f5758089b30 2023-08-25T04:46:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.652+0000 7f575fbff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57580b4810 con 0x7f575816e680 2023-08-25T04:46:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.652+0000 7f575fbff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57580b3230 con 0x7f5758070b00 2023-08-25T04:46:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.652+0000 7f575d99b700 1 -- 172.21.15.72:0/1068337054 learned_addr learned my addr 172.21.15.72:0/1068337054 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f1f0579b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f00070890 0x7f1f0015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f1f0579b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f00070890 0x7f1f0015d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:50728/0 (socket says 172.21.15.72:50728) 2023-08-25T04:46:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f1f0579b700 1 -- 172.21.15.72:0/2936953745 learned_addr learned my addr 172.21.15.72:0/2936953745 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f1f04f9a700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f00070c70 0x7f1f0015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f1f0579b700 1 -- 172.21.15.72:0/2936953745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f000b0550 msgr2=0x7f1f0015b470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:46:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f1f0579b700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f000b0550 0x7f1f0015b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f1f0579b700 1 -- 172.21.15.72:0/2936953745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f00070c70 msgr2=0x7f1f0015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f1f0579b700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f00070c70 0x7f1f0015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.651+0000 7f1f0579b700 1 -- 172.21.15.72:0/2936953745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0094a0 con 0x7f1f00070890 2023-08-25T04:46:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.652+0000 7f1f0579b700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f00070890 0x7f1f0015d080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0090b0 tx=0x7f1efc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.652+0000 7f1ef5ffb700 1 -- 172.21.15.72:0/2936953745 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc003d00 con 0x7f1f00070890 2023-08-25T04:46:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.652+0000 7f1ef5ffb700 1 -- 172.21.15.72:0/2936953745 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc01f070 con 0x7f1f00070890 2023-08-25T04:46:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.652+0000 7f1ef5ffb700 1 -- 172.21.15.72:0/2936953745 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc011850 con 0x7f1f00070890 2023-08-25T04:46:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.653+0000 7f575d99b700 1 -- 172.21.15.72:0/1068337054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f575816e680 msgr2=0x7f57580c9440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:46:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.653+0000 7f575d99b700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f575816e680 0x7f57580c9440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.653+0000 7f575d99b700 1 -- 172.21.15.72:0/1068337054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5758089b30 msgr2=0x7f57580a7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.653+0000 7f575d99b700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5758089b30 0x7f57580a7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.653+0000 7f575d99b700 1 -- 172.21.15.72:0/1068337054 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750014ac0 con 0x7f5758070b00 2023-08-25T04:46:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.653+0000 7fd4995ff700 1 Processor -- start 2023-08-25T04:46:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.653+0000 7f1f079ff700 1 -- 172.21.15.72:0/2936953745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0015c2c0 con 0x7f1f00070890 2023-08-25T04:46:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.653+0000 7f1f079ff700 1 -- 172.21.15.72:0/2936953745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0015c880 con 0x7f1f00070890 2023-08-25T04:46:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.654+0000 7f575d99b700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f57580b42d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5750016010 tx=0x7f5750004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.654+0000 7fd4995ff700 1 -- start start 2023-08-25T04:46:03.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.655+0000 7f574e7fc700 1 -- 172.21.15.72:0/1068337054 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575001a520 con 0x7f5758070b00 2023-08-25T04:46:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.655+0000 7f574e7fc700 1 -- 172.21.15.72:0/1068337054 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750003e10 con 0x7f5758070b00 2023-08-25T04:46:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.655+0000 7f574e7fc700 1 -- 172.21.15.72:0/1068337054 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750004470 con 0x7f5758070b00 2023-08-25T04:46:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.656+0000 7f575fbff700 1 -- 172.21.15.72:0/1068337054 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57580b3510 con 0x7f5758070b00 2023-08-25T04:46:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.656+0000 7f575fbff700 1 -- 172.21.15.72:0/1068337054 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57580b3ad0 con 0x7f5758070b00 2023-08-25T04:46:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.657+0000 7f1f079ff700 1 -- 172.21.15.72:0/2936953745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee00052f0 con 0x7f1f00070890 2023-08-25T04:46:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.657+0000 7f1ef5ffb700 1 -- 172.21.15.72:0/2936953745 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1efc021030 con 0x7f1f00070890 2023-08-25T04:46:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.659+0000 7f1ef5ffb700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1ee406a1b0 0x7f1ee406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.659+0000 7f1ef5ffb700 1 -- 172.21.15.72:0/2936953745 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1efc0898b0 con 0x7f1f00070890 2023-08-25T04:46:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.660+0000 7f575fbff700 1 -- 172.21.15.72:0/1068337054 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57580b3ff0 con 0x7f5758070b00 2023-08-25T04:46:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.660+0000 7f1f04f9a700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1ee406a1b0 0x7f1ee406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.659+0000 7fd4995ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940add00 0x7fd49406d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.659+0000 7fd4995ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4940ca440 0x7fd494070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.659+0000 7fd4995ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd494161ad0 con 0x7fd494070dd0 2023-08-25T04:46:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.659+0000 7fd4995ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd494071280 con 0x7fd4940ca440 2023-08-25T04:46:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.659+0000 7fd4995ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940ca940 con 0x7fd4940add00 2023-08-25T04:46:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.660+0000 7fd492ffd700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940add00 0x7fd49406d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.660+0000 7fd492ffd700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940add00 0x7fd49406d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57630/0 (socket says 172.21.15.72:57630) 2023-08-25T04:46:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.660+0000 7fd492ffd700 1 -- 172.21.15.72:0/1627321047 learned_addr learned my addr 172.21.15.72:0/1627321047 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.660+0000 7fd4927fc700 1 --2- 172.21.15.72:0/1627321047 >> v2:172.21.15.137:3300/0 conn(0x7fd4940ca440 0x7fd494070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.660+0000 7fd492ffd700 1 -- 172.21.15.72:0/1627321047 >> v2:172.21.15.137:3300/0 conn(0x7fd4940ca440 msgr2=0x7fd494070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.660+0000 7fd492ffd700 1 --2- 172.21.15.72:0/1627321047 >> v2:172.21.15.137:3300/0 conn(0x7fd4940ca440 0x7fd494070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.660+0000 7fd492ffd700 1 -- 172.21.15.72:0/1627321047 >> v1:172.21.15.137:6789/0 conn(0x7fd494070dd0 legacy=0x7fd4940c8f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:46:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.660+0000 7fd492ffd700 1 -- 172.21.15.72:0/1627321047 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940cac20 con 0x7fd4940add00 2023-08-25T04:46:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.661+0000 7f574e7fc700 1 -- 172.21.15.72:0/1068337054 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5750023070 con 0x7f5758070b00 2023-08-25T04:46:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.661+0000 7f1f04f9a700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1ee406a1b0 0x7f1ee406c670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00012e0 tx=0x7f1ef0001270 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.661+0000 7fd492ffd700 1 --2- 172.21.15.72:0/1627321047 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940add00 0x7fd49406d430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009e50 tx=0x7fd48c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=336f50e1d491bf63 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.662+0000 7f574e7fc700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f573c06a130 0x7f573c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.662+0000 7f574e7fc700 1 -- 172.21.15.72:0/1068337054 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5750092100 con 0x7f5758070b00 2023-08-25T04:46:03.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.663+0000 7f575d19a700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f573c06a130 0x7f573c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.664+0000 7feb387ff700 1 Processor -- start 2023-08-25T04:46:03.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.664+0000 7f575d19a700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f573c06a130 0x7f573c06c5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f57540010e0 tx=0x7f57540079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.664+0000 7f1ef5ffb700 1 -- 172.21.15.72:0/2936953745 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1efc054c90 con 0x7f1f00070890 2023-08-25T04:46:03.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.664+0000 7feb387ff700 1 -- start start 2023-08-25T04:46:03.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.665+0000 7fcdcdfff700 1 Processor -- start 2023-08-25T04:46:03.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.665+0000 7fcdcdfff700 1 -- start start 2023-08-25T04:46:03.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.665+0000 7fd9b6dff700 1 Processor -- start 2023-08-25T04:46:03.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.666+0000 7fd9b6dff700 1 -- start start 2023-08-25T04:46:03.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.666+0000 7fd491ffb700 1 -- 172.21.15.72:0/1627321047 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00e070 con 0x7fd4940add00 2023-08-25T04:46:03.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.666+0000 7fd491ffb700 1 -- 172.21.15.72:0/1627321047 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c003a20 con 0x7fd4940add00 2023-08-25T04:46:03.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.666+0000 7fd491ffb700 1 -- 172.21.15.72:0/1627321047 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c003dd0 con 0x7fd4940add00 2023-08-25T04:46:03.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.666+0000 7feb387ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300ca440 0x7feb30070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.666+0000 7feb387ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feb30070dd0 0x7feb300affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.666+0000 7feb387ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3006db40 con 0x7feb300add00 2023-08-25T04:46:03.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.666+0000 7feb387ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb30071280 con 0x7feb30070dd0 2023-08-25T04:46:03.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.666+0000 7feb387ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb30161ad0 con 0x7feb300ca440 2023-08-25T04:46:03.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.667+0000 7feb35d9a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300ca440 0x7feb30070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.667+0000 7feb35d9a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300ca440 0x7feb30070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57634/0 (socket says 172.21.15.72:57634) 2023-08-25T04:46:03.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.667+0000 7feb35d9a700 1 -- 172.21.15.72:0/2129439836 learned_addr learned my addr 172.21.15.72:0/2129439836 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.667+0000 7feb36d9c700 1 --2- 172.21.15.72:0/2129439836 >> v2:172.21.15.137:3300/0 conn(0x7feb30070dd0 0x7feb300affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7feb35d9a700 1 -- 172.21.15.72:0/2129439836 >> v2:172.21.15.137:3300/0 conn(0x7feb30070dd0 msgr2=0x7feb300affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:03.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7feb35d9a700 1 --2- 172.21.15.72:0/2129439836 >> v2:172.21.15.137:3300/0 conn(0x7feb30070dd0 0x7feb300affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7f574e7fc700 1 -- 172.21.15.72:0/1068337054 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f575005d690 con 0x7f5758070b00 2023-08-25T04:46:03.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7feb35d9a700 1 -- 172.21.15.72:0/2129439836 >> v1:172.21.15.72:6789/0 conn(0x7feb300add00 legacy=0x7feb3006d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7feb35d9a700 1 -- 172.21.15.72:0/2129439836 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb300ca940 con 0x7feb300ca440 2023-08-25T04:46:03.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.667+0000 7fd4995ff700 1 -- 172.21.15.72:0/1627321047 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940add00 msgr2=0x7fd49406d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.667+0000 7fd4995ff700 1 --2- 172.21.15.72:0/1627321047 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940add00 0x7fd49406d430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009e50 tx=0x7fd48c00b330 comp rx=0 tx=0).stop 2023-08-25T04:46:03.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7fcdcdfff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcdc815cf00 0x7fcdc80b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7fcdcdfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcdc80b4c90 0x7fcdc80b6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7fcdcdfff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc80b8200 con 0x7fcdc80b4800 2023-08-25T04:46:03.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7fcdcdfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc80b7160 con 0x7fcdc80b4c90 2023-08-25T04:46:03.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7fcdcdfff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc80b7440 con 0x7fcdc815cf00 2023-08-25T04:46:03.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fd4995ff700 1 -- 172.21.15.72:0/1627321047 shutdown_connections 2023-08-25T04:46:03.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fd4995ff700 1 --2- 172.21.15.72:0/1627321047 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940add00 0x7fd49406d430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fd4995ff700 1 --2- 172.21.15.72:0/1627321047 >> v2:172.21.15.137:3300/0 conn(0x7fd4940ca440 0x7fd494070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fd4995ff700 1 -- 172.21.15.72:0/1627321047 >> 172.21.15.72:0/1627321047 conn(0x7fd4940ce9a0 msgr2=0x7fd4940ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:03.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.668+0000 7fcdc77fe700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcdc815cf00 0x7fcdc80b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fcdc77fe700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcdc815cf00 0x7fcdc80b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:50760/0 (socket says 172.21.15.72:50760) 2023-08-25T04:46:03.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fcdc77fe700 1 -- 172.21.15.72:0/3356667970 learned_addr learned my addr 172.21.15.72:0/3356667970 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fcdc7fff700 1 --2- 172.21.15.72:0/3356667970 >> v2:172.21.15.72:3300/0 conn(0x7fcdc80b4c90 0x7fcdc80b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fcdc77fe700 1 -- 172.21.15.72:0/3356667970 >> v2:172.21.15.72:3300/0 conn(0x7fcdc80b4c90 msgr2=0x7fcdc80b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fcdc77fe700 1 --2- 172.21.15.72:0/3356667970 >> v2:172.21.15.72:3300/0 conn(0x7fcdc80b4c90 0x7fcdc80b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fcdc77fe700 1 -- 172.21.15.72:0/3356667970 >> v1:172.21.15.137:6789/0 conn(0x7fcdc80b4800 legacy=0x7fcdc80b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7fcdc6ffd700 1 -- 172.21.15.72:0/3356667970 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692541685 0 0) 0x7fcdc80b8200 con 0x7fcdc80b4800 2023-08-25T04:46:03.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7fcdc77fe700 1 -- 172.21.15.72:0/3356667970 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc80b7720 con 0x7fcdc815cf00 2023-08-25T04:46:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fd9b6dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b0160710 0x7fd9b00b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fd9b6dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd9b00b4c80 0x7fd9b00b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fd9b6dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b00b7400 con 0x7fd9b00b4800 2023-08-25T04:46:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fd9b6dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b00b8d30 con 0x7fd9b00b4c80 2023-08-25T04:46:03.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7fd9b6dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00b7650 con 0x7fd9b0160710 2023-08-25T04:46:03.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7fd4995ff700 1 -- 172.21.15.72:0/1627321047 shutdown_connections 2023-08-25T04:46:03.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7fd9b4b9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b0160710 0x7fd9b00b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7fd9b4b9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b0160710 0x7fd9b00b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57648/0 (socket says 172.21.15.72:57648) 2023-08-25T04:46:03.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7fd9b4b9b700 1 -- 172.21.15.72:0/3288993289 learned_addr learned my addr 172.21.15.72:0/3288993289 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7fcdc77fe700 1 --2- 172.21.15.72:0/3356667970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc815cf00 0x7fcdc80b8630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80b5900 tx=0x7fcdb0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32f9dec4993af23 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.671+0000 7fd9b539c700 1 --2- 172.21.15.72:0/3288993289 >> v2:172.21.15.137:3300/0 conn(0x7fd9b00b4c80 0x7fd9b00b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.671+0000 7fcdc6ffd700 1 -- 172.21.15.72:0/3356667970 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0011830 con 0x7fcdc815cf00 2023-08-25T04:46:03.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.671+0000 7fcdc6ffd700 1 -- 172.21.15.72:0/3356667970 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb0011990 con 0x7fcdc815cf00 2023-08-25T04:46:03.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.671+0000 7fcdc6ffd700 1 -- 172.21.15.72:0/3356667970 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0011d20 con 0x7fcdc815cf00 2023-08-25T04:46:03.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.669+0000 7feb35d9a700 1 --2- 172.21.15.72:0/2129439836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300ca440 0x7feb30070890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb240098f0 tx=0x7feb24009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24c5a12ec29c0bf5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7feb35599700 1 -- 172.21.15.72:0/2129439836 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24011830 con 0x7feb300ca440 2023-08-25T04:46:03.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7feb35599700 1 -- 172.21.15.72:0/2129439836 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb24011990 con 0x7feb300ca440 2023-08-25T04:46:03.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7feb35599700 1 -- 172.21.15.72:0/2129439836 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24011d20 con 0x7feb300ca440 2023-08-25T04:46:03.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7feb387ff700 1 -- 172.21.15.72:0/2129439836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300ca440 msgr2=0x7feb30070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7feb387ff700 1 --2- 172.21.15.72:0/2129439836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300ca440 0x7feb30070890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb240098f0 tx=0x7feb24009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:03.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7feb387ff700 1 -- 172.21.15.72:0/2129439836 shutdown_connections 2023-08-25T04:46:03.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7feb387ff700 1 --2- 172.21.15.72:0/2129439836 >> v2:172.21.15.137:3300/0 conn(0x7feb30070dd0 0x7feb300affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7feb387ff700 1 --2- 172.21.15.72:0/2129439836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300ca440 0x7feb30070890 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb240098f0 tx=0x7feb24009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:03.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7feb387ff700 1 -- 172.21.15.72:0/2129439836 >> 172.21.15.72:0/2129439836 conn(0x7feb300ce9a0 msgr2=0x7feb300ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:03.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fd9af7fe700 1 -- 172.21.15.72:0/3288993289 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540925659 0 0) 0x7fd9b00b7400 con 0x7fd9b00b4800 2023-08-25T04:46:03.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fd9af7fe700 1 -- 172.21.15.72:0/3288993289 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a00035b0 con 0x7fd9b00b4800 2023-08-25T04:46:03.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3356667970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc815cf00 msgr2=0x7fcdc80b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fcdcdfff700 1 --2- 172.21.15.72:0/3356667970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc815cf00 0x7fcdc80b8630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80b5900 tx=0x7fcdb0009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fd9b4b9b700 1 -- 172.21.15.72:0/3288993289 >> v2:172.21.15.137:3300/0 conn(0x7fd9b00b4c80 msgr2=0x7fd9b00b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:03.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fd9b4b9b700 1 --2- 172.21.15.72:0/3288993289 >> v2:172.21.15.137:3300/0 conn(0x7fd9b00b4c80 0x7fd9b00b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fd9b4b9b700 1 -- 172.21.15.72:0/3288993289 >> v1:172.21.15.72:6789/0 conn(0x7fd9b00b4800 legacy=0x7fd9b00d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fd9b4b9b700 1 -- 172.21.15.72:0/3288993289 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00b7930 con 0x7fd9b0160710 2023-08-25T04:46:03.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3356667970 shutdown_connections 2023-08-25T04:46:03.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fcdcdfff700 1 --2- 172.21.15.72:0/3356667970 >> v2:172.21.15.72:3300/0 conn(0x7fcdc80b4c90 0x7fcdc80b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fcdcdfff700 1 --2- 172.21.15.72:0/3356667970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc815cf00 0x7fcdc80b8630 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.672+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3356667970 >> 172.21.15.72:0/3356667970 conn(0x7fcdc8071e40 msgr2=0x7fcdc8072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:03.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.673+0000 7fd9b4b9b700 1 --2- 172.21.15.72:0/3288993289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b0160710 0x7fd9b00b87f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40098f0 tx=0x7fd9a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7871081827d2a45f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.673+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3356667970 shutdown_connections 2023-08-25T04:46:03.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.673+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3356667970 wait complete. 2023-08-25T04:46:03.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.673+0000 7fd9af7fe700 1 -- 172.21.15.72:0/3288993289 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4011830 con 0x7fd9b0160710 2023-08-25T04:46:03.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.673+0000 7fd9af7fe700 1 -- 172.21.15.72:0/3288993289 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a4011990 con 0x7fd9b0160710 2023-08-25T04:46:03.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.673+0000 7fd9af7fe700 1 -- 172.21.15.72:0/3288993289 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4011d20 con 0x7fd9b0160710 2023-08-25T04:46:03.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.670+0000 7fd4995ff700 1 -- 172.21.15.72:0/1627321047 wait complete. 2023-08-25T04:46:03.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.673+0000 7fd4995ff700 1 Processor -- start 2023-08-25T04:46:03.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.673+0000 7fd4995ff700 1 -- start start 2023-08-25T04:46:03.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.674+0000 7fd9b6dff700 1 -- 172.21.15.72:0/3288993289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b0160710 msgr2=0x7fd9b00b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.674+0000 7fd9b6dff700 1 --2- 172.21.15.72:0/3288993289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b0160710 0x7fd9b00b87f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40098f0 tx=0x7fd9a4009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:03.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.674+0000 7fd9b6dff700 1 -- 172.21.15.72:0/3288993289 shutdown_connections 2023-08-25T04:46:03.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.674+0000 7fd9b6dff700 1 --2- 172.21.15.72:0/3288993289 >> v2:172.21.15.137:3300/0 conn(0x7fd9b00b4c80 0x7fd9b00b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.674+0000 7fd9b6dff700 1 --2- 172.21.15.72:0/3288993289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b0160710 0x7fd9b00b87f0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40098f0 tx=0x7fd9a4009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:03.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.674+0000 7fd9b6dff700 1 -- 172.21.15.72:0/3288993289 >> 172.21.15.72:0/3288993289 conn(0x7fd9b0071e40 msgr2=0x7fd9b0072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:03.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.675+0000 7fd9b6dff700 1 -- 172.21.15.72:0/3288993289 shutdown_connections 2023-08-25T04:46:03.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.675+0000 7fcdcdfff700 1 Processor -- start 2023-08-25T04:46:03.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.675+0000 7fd9b6dff700 1 -- 172.21.15.72:0/3288993289 wait complete. 2023-08-25T04:46:03.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.676+0000 7fcdcdfff700 1 -- start start 2023-08-25T04:46:03.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.676+0000 7feb387ff700 1 -- 172.21.15.72:0/2129439836 shutdown_connections 2023-08-25T04:46:03.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.677+0000 7fcdcdfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdc80b4800 0x7fcdc815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.677+0000 7fcdcdfff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc80b4c90 0x7fcdc814f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.677+0000 7fcdcdfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdc815cf00 0x7fcdc80c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.677+0000 7fcdcdfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc806d610 con 0x7fcdc80b4800 2023-08-25T04:46:03.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.677+0000 7fcdcdfff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc814fec0 con 0x7fcdc80b4c90 2023-08-25T04:46:03.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.677+0000 7fcdcdfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc806de20 con 0x7fcdc815cf00 2023-08-25T04:46:03.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.677+0000 7fd9b6dff700 1 Processor -- start 2023-08-25T04:46:03.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.678+0000 7fcdc7fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdc815cf00 0x7fcdc80c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.678+0000 7fcdc7fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdc815cf00 0x7fcdc80c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57656/0 (socket says 172.21.15.72:57656) 2023-08-25T04:46:03.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.678+0000 7fcdc7fff700 1 -- 172.21.15.72:0/3140453219 learned_addr learned my addr 172.21.15.72:0/3140453219 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fcdbeffd700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc80b4c90 0x7fcdc814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.678+0000 7fd9b6dff700 1 -- start start 2023-08-25T04:46:03.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fcdc77fe700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdc80b4800 0x7fcdc815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.676+0000 7feb387ff700 1 -- 172.21.15.72:0/2129439836 wait complete. 2023-08-25T04:46:03.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7feb387ff700 1 Processor -- start 2023-08-25T04:46:03.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7feb387ff700 1 -- start start 2023-08-25T04:46:03.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fcdc77fe700 1 -- 172.21.15.72:0/3140453219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdc815cf00 msgr2=0x7fcdc80c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fcdc77fe700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdc815cf00 0x7fcdc80c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fcdc77fe700 1 -- 172.21.15.72:0/3140453219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc80b4c90 msgr2=0x7fcdc814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fcdc77fe700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc80b4c90 0x7fcdc814f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fcdc77fe700 1 -- 172.21.15.72:0/3140453219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb0009550 con 0x7fcdc80b4800 2023-08-25T04:46:03.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.680+0000 7fcdc7fff700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdc815cf00 0x7fcdc80c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:03.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fd4995ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd494070dd0 0x7fd494152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fd4995ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4940add00 0x7fd494163b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fd4995ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940ca440 0x7fd494164090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fd4995ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940c88f0 con 0x7fd494070dd0 2023-08-25T04:46:03.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fd4995ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940c4d20 con 0x7fd4940add00 2023-08-25T04:46:03.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.679+0000 7fd4995ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940c5000 con 0x7fd4940ca440 2023-08-25T04:46:03.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.680+0000 7fcdc77fe700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdc80b4800 0x7fcdc815d7f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0016000 tx=0x7fcdb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7feb387ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb30070dd0 0x7feb3014efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7feb387ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300add00 0x7feb30152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7feb387ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb300c4500 0x7feb300c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7feb387ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb300c4ef0 con 0x7feb30070dd0 2023-08-25T04:46:03.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7feb387ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb300b2d30 con 0x7feb300c4500 2023-08-25T04:46:03.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7feb387ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb300b3010 con 0x7feb300add00 2023-08-25T04:46:03.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7feb35d9a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300add00 0x7feb30152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7feb36d9c700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb300c4500 0x7feb300c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7feb35d9a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300add00 0x7feb30152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57660/0 (socket says 172.21.15.72:57660) 2023-08-25T04:46:03.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7feb35d9a700 1 -- 172.21.15.72:0/2863605706 learned_addr learned my addr 172.21.15.72:0/2863605706 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7fcdc4ff9700 1 -- 172.21.15.72:0/3140453219 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0004450 con 0x7fcdc80b4800 2023-08-25T04:46:03.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7fcdc4ff9700 1 -- 172.21.15.72:0/3140453219 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb00045b0 con 0x7fcdc80b4800 2023-08-25T04:46:03.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7fcdc4ff9700 1 -- 172.21.15.72:0/3140453219 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00038e0 con 0x7fcdc80b4800 2023-08-25T04:46:03.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3140453219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc806d860 con 0x7fcdc80b4800 2023-08-25T04:46:03.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3140453219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc814fb50 con 0x7fcdc80b4800 2023-08-25T04:46:03.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7feb35d9a700 1 -- 172.21.15.72:0/2863605706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb300c4500 msgr2=0x7feb300c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7feb35d9a700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb300c4500 0x7feb300c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7feb35d9a700 1 -- 172.21.15.72:0/2863605706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb30070dd0 msgr2=0x7feb3014efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7feb35d9a700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb30070dd0 0x7feb3014efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7feb35d9a700 1 -- 172.21.15.72:0/2863605706 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb24009550 con 0x7feb300add00 2023-08-25T04:46:03.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7feb35d9a700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300add00 0x7feb30152d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb24009c40 tx=0x7feb24004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7feb22ffd700 1 -- 172.21.15.72:0/2863605706 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24004450 con 0x7feb300add00 2023-08-25T04:46:03.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7feb22ffd700 1 -- 172.21.15.72:0/2863605706 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb240045b0 con 0x7feb300add00 2023-08-25T04:46:03.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7feb22ffd700 1 -- 172.21.15.72:0/2863605706 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb240038e0 con 0x7feb300add00 2023-08-25T04:46:03.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7feb387ff700 1 -- 172.21.15.72:0/2863605706 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb300b32f0 con 0x7feb300add00 2023-08-25T04:46:03.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7feb387ff700 1 -- 172.21.15.72:0/2863605706 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3014f510 con 0x7feb300add00 2023-08-25T04:46:03.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7fd9b6dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b00b4800 0x7fd9b0154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7fd9b6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9b00b4c80 0x7fd9b0159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7fd9b6dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9b00cadb0 0x7fd9b0159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7fd9b6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0155840 con 0x7fd9b00b4c80 2023-08-25T04:46:03.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7fd9b6dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00c9ff0 con 0x7fd9b00cadb0 2023-08-25T04:46:03.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.683+0000 7fd9b6dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00ca2d0 con 0x7fd9b00b4800 2023-08-25T04:46:03.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.685+0000 7feb387ff700 1 -- 172.21.15.72:0/2863605706 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb300b3810 con 0x7feb300add00 2023-08-25T04:46:03.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.680+0000 7fd492ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd494070dd0 0x7fd494152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.680+0000 7fd492ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd494070dd0 0x7fd494152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57818/0 (socket says 172.21.15.72:57818) 2023-08-25T04:46:03.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.680+0000 7fd492ffd700 1 -- 172.21.15.72:0/3745118189 learned_addr learned my addr 172.21.15.72:0/3745118189 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7fd492ffd700 1 -- 172.21.15.72:0/3745118189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940ca440 msgr2=0x7fd494164090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:46:03.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7fd492ffd700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940ca440 0x7fd494164090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7fd492ffd700 1 -- 172.21.15.72:0/3745118189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4940add00 msgr2=0x7fd494163b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:46:03.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7fd492ffd700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4940add00 0x7fd494163b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.681+0000 7fd492ffd700 1 -- 172.21.15.72:0/3745118189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c009b30 con 0x7fd494070dd0 2023-08-25T04:46:03.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7fd492ffd700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd494070dd0 0x7fd494152ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00b680 tx=0x7fd48c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7fd47b7fe700 1 -- 172.21.15.72:0/3745118189 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c004440 con 0x7fd494070dd0 2023-08-25T04:46:03.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7fd47b7fe700 1 -- 172.21.15.72:0/3745118189 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c0045c0 con 0x7fd494070dd0 2023-08-25T04:46:03.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7fd47b7fe700 1 -- 172.21.15.72:0/3745118189 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c004970 con 0x7fd494070dd0 2023-08-25T04:46:03.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7fd4995ff700 1 -- 172.21.15.72:0/3745118189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4940c52e0 con 0x7fd494070dd0 2023-08-25T04:46:03.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.682+0000 7fd4995ff700 1 -- 172.21.15.72:0/3745118189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd494153000 con 0x7fd494070dd0 2023-08-25T04:46:03.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.685+0000 7fd4995ff700 1 -- 172.21.15.72:0/3745118189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4740052f0 con 0x7fd494070dd0 2023-08-25T04:46:03.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.686+0000 7fd9b4b9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b00b4800 0x7fd9b0154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.686+0000 7fd9b539c700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9b00cadb0 0x7fd9b0159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.686+0000 7fd9b4b9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b00b4800 0x7fd9b0154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57670/0 (socket says 172.21.15.72:57670) 2023-08-25T04:46:03.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.686+0000 7fd9b4b9b700 1 -- 172.21.15.72:0/641056301 learned_addr learned my addr 172.21.15.72:0/641056301 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.686+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3140453219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc814f9b0 con 0x7fcdc80b4800 2023-08-25T04:46:03.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.686+0000 7fd9affff700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9b00b4c80 0x7fd9b0159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.686+0000 7fd47b7fe700 1 -- 172.21.15.72:0/3745118189 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd48c019070 con 0x7fd494070dd0 2023-08-25T04:46:03.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.688+0000 7fd47b7fe700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd48006a1b0 0x7fd48006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.688+0000 7fd47b7fe700 1 -- 172.21.15.72:0/3745118189 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd48c0898b0 con 0x7fd494070dd0 2023-08-25T04:46:03.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.688+0000 7feb22ffd700 1 -- 172.21.15.72:0/2863605706 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb24003a40 con 0x7feb300add00 2023-08-25T04:46:03.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.689+0000 7feb22ffd700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7feb1406a1b0 0x7feb1406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.689+0000 7feb22ffd700 1 -- 172.21.15.72:0/2863605706 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb24089d70 con 0x7feb300add00 2023-08-25T04:46:03.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.689+0000 7fd9b4b9b700 1 -- 172.21.15.72:0/641056301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9b00cadb0 msgr2=0x7fd9b0159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.689+0000 7fd9b4b9b700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9b00cadb0 0x7fd9b0159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.689+0000 7fd9b4b9b700 1 -- 172.21.15.72:0/641056301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9b00b4c80 msgr2=0x7fd9b0159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.689+0000 7fd9b4b9b700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9b00b4c80 0x7fd9b0159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.689+0000 7fd9b4b9b700 1 -- 172.21.15.72:0/641056301 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a4009550 con 0x7fd9b00b4800 2023-08-25T04:46:03.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.690+0000 7fd9b4b9b700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b00b4800 0x7fd9b0154780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4000c00 tx=0x7fd9a4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.690+0000 7feb3659b700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7feb1406a1b0 0x7feb1406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.691+0000 7feb22ffd700 1 -- 172.21.15.72:0/2863605706 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feb240551e0 con 0x7feb300add00 2023-08-25T04:46:03.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7fd4927fc700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd48006a1b0 0x7fd48006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7fd9ad7fa700 1 -- 172.21.15.72:0/641056301 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4004240 con 0x7fd9b00b4800 2023-08-25T04:46:03.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7fd9ad7fa700 1 -- 172.21.15.72:0/641056301 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a401f070 con 0x7fd9b00b4800 2023-08-25T04:46:03.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7fd9ad7fa700 1 -- 172.21.15.72:0/641056301 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a40045a0 con 0x7fd9b00b4800 2023-08-25T04:46:03.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7fd9b6dff700 1 -- 172.21.15.72:0/641056301 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b00ca5b0 con 0x7fd9b00b4800 2023-08-25T04:46:03.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7fd9b6dff700 1 -- 172.21.15.72:0/641056301 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b0154cc0 con 0x7fd9b00b4800 2023-08-25T04:46:03.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7feb3659b700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7feb1406a1b0 0x7feb1406c670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb2c000f60 tx=0x7feb2c007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7fd4927fc700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd48006a1b0 0x7fd48006c670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd494157620 tx=0x7fd484009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.687+0000 7f3592fff700 1 Processor -- start 2023-08-25T04:46:03.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.687+0000 7f3592fff700 1 -- start start 2023-08-25T04:46:03.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.690+0000 7f3592fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f358c070890 0x7f358c0c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.690+0000 7f3592fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c0b0550 0x7f358c0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.690+0000 7f3592fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358c0caeb0 con 0x7f358c070c70 2023-08-25T04:46:03.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.690+0000 7f3592fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c0b0130 con 0x7f358c070890 2023-08-25T04:46:03.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.690+0000 7f3592fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0afa70 con 0x7f358c0b0550 2023-08-25T04:46:03.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.691+0000 7f359159c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c0b0550 0x7f358c0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.691+0000 7f359159c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c0b0550 0x7f358c0b09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57676/0 (socket says 172.21.15.72:57676) 2023-08-25T04:46:03.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.691+0000 7f359159c700 1 -- 172.21.15.72:0/1533185951 learned_addr learned my addr 172.21.15.72:0/1533185951 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7f359159c700 1 -- 172.21.15.72:0/1533185951 >> v2:172.21.15.137:3300/0 conn(0x7f358c070890 msgr2=0x7f358c0c2460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:46:03.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7f359159c700 1 --2- 172.21.15.72:0/1533185951 >> v2:172.21.15.137:3300/0 conn(0x7f358c070890 0x7f358c0c2460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7f359159c700 1 -- 172.21.15.72:0/1533185951 >> v1:172.21.15.137:6789/0 conn(0x7f358c070c70 legacy=0x7f358c0ca460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:46:03.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7f359159c700 1 -- 172.21.15.72:0/1533185951 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c0afd50 con 0x7f358c0b0550 2023-08-25T04:46:03.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.692+0000 7f359159c700 1 --2- 172.21.15.72:0/1533185951 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c0b0550 0x7f358c0b09e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35800098f0 tx=0x7f3580009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679b792c01f43d3d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.693+0000 7fcdc4ff9700 1 -- 172.21.15.72:0/3140453219 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcdb0003a40 con 0x7fcdc80b4800 2023-08-25T04:46:03.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.693+0000 7f358b7fe700 1 -- 172.21.15.72:0/1533185951 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580004230 con 0x7f358c0b0550 2023-08-25T04:46:03.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.693+0000 7f358b7fe700 1 -- 172.21.15.72:0/1533185951 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3580004390 con 0x7f358c0b0550 2023-08-25T04:46:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.693+0000 7f358b7fe700 1 -- 172.21.15.72:0/1533185951 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35800036a0 con 0x7f358c0b0550 2023-08-25T04:46:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.694+0000 7f3592fff700 1 -- 172.21.15.72:0/1533185951 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c0b0550 msgr2=0x7f358c0b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.694+0000 7f3592fff700 1 --2- 172.21.15.72:0/1533185951 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c0b0550 0x7f358c0b09e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35800098f0 tx=0x7f3580009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.694+0000 7f3592fff700 1 -- 172.21.15.72:0/1533185951 shutdown_connections 2023-08-25T04:46:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.694+0000 7f3592fff700 1 --2- 172.21.15.72:0/1533185951 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c0b0550 0x7f358c0b09e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.694+0000 7f3592fff700 1 --2- 172.21.15.72:0/1533185951 >> v2:172.21.15.137:3300/0 conn(0x7f358c070890 0x7f358c0c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.694+0000 7f3592fff700 1 -- 172.21.15.72:0/1533185951 >> 172.21.15.72:0/1533185951 conn(0x7f358c0ce9a0 msgr2=0x7f358c0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:03.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.695+0000 7f3592fff700 1 -- 172.21.15.72:0/1533185951 shutdown_connections 2023-08-25T04:46:03.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.694+0000 7fcdc4ff9700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcda806a1b0 0x7fcda806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.695+0000 7fcdc4ff9700 1 -- 172.21.15.72:0/3140453219 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdb0089fe0 con 0x7fcdc80b4800 2023-08-25T04:46:03.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.696+0000 7fcdbeffd700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcda806a1b0 0x7fcda806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.697+0000 7fcdbeffd700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcda806a1b0 0x7fcda806c670 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcdc81fa010 tx=0x7fcdb8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.697+0000 7f3592fff700 1 -- 172.21.15.72:0/1533185951 wait complete. 2023-08-25T04:46:03.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.696+0000 7fd9b6dff700 1 -- 172.21.15.72:0/641056301 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9900052f0 con 0x7fd9b00b4800 2023-08-25T04:46:03.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.697+0000 7fd9ad7fa700 1 -- 172.21.15.72:0/641056301 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd9a4021030 con 0x7fd9b00b4800 2023-08-25T04:46:03.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.700+0000 7f3592fff700 1 Processor -- start 2023-08-25T04:46:03.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.700+0000 7f3592fff700 1 -- start start 2023-08-25T04:46:03.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.700+0000 7fcdc4ff9700 1 -- 172.21.15.72:0/3140453219 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcdb0055450 con 0x7fcdc80b4800 2023-08-25T04:46:03.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.702+0000 7f3592fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f358c0b0550 0x7f358c087e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.702+0000 7f3592fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f358c088580 0x7f358c0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.702+0000 7f3592fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c151c30 0x7f358c1520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.702+0000 7f3592fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0883a0 con 0x7f358c0b0550 2023-08-25T04:46:03.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.702+0000 7f3592fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c089750 con 0x7f358c088580 2023-08-25T04:46:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.702+0000 7f3592fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c088b40 con 0x7f358c151c30 2023-08-25T04:46:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.702+0000 7f359159c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c151c30 0x7f358c1520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.703+0000 7f359159c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c151c30 0x7f358c1520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57678/0 (socket says 172.21.15.72:57678) 2023-08-25T04:46:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.703+0000 7f359159c700 1 -- 172.21.15.72:0/4153663316 learned_addr learned my addr 172.21.15.72:0/4153663316 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.703+0000 7f3590d9b700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f358c0b0550 0x7f358c087e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.703+0000 7f358bfff700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f358c088580 0x7f358c0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.703+0000 7f359159c700 1 -- 172.21.15.72:0/4153663316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f358c088580 msgr2=0x7f358c0ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.703+0000 7f359159c700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f358c088580 0x7f358c0ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.703+0000 7f359159c700 1 -- 172.21.15.72:0/4153663316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f358c0b0550 msgr2=0x7f358c087e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.703+0000 7f359159c700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f358c0b0550 0x7f358c087e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.703+0000 7f359159c700 1 -- 172.21.15.72:0/4153663316 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3580009550 con 0x7f358c151c30 2023-08-25T04:46:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.703+0000 7f358bfff700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f358c088580 0x7f358c0ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.704+0000 7f359159c700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c151c30 0x7f358c1520c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f358000b0e0 tx=0x7f3580004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.704+0000 7f35897fa700 1 -- 172.21.15.72:0/4153663316 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358000b660 con 0x7f358c151c30 2023-08-25T04:46:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.704+0000 7f35897fa700 1 -- 172.21.15.72:0/4153663316 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358000b7e0 con 0x7f358c151c30 2023-08-25T04:46:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.704+0000 7f35897fa700 1 -- 172.21.15.72:0/4153663316 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358000bb90 con 0x7f358c151c30 2023-08-25T04:46:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.704+0000 7f3592fff700 1 -- 172.21.15.72:0/4153663316 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c088e20 con 0x7f358c151c30 2023-08-25T04:46:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.704+0000 7f3592fff700 1 -- 172.21.15.72:0/4153663316 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c0893e0 con 0x7f358c151c30 2023-08-25T04:46:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.706+0000 7f3592fff700 1 -- 172.21.15.72:0/4153663316 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c0722d0 con 0x7f358c151c30 2023-08-25T04:46:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.699+0000 7fd9ad7fa700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd99406a1e0 0x7fd99406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.699+0000 7fd9ad7fa700 1 -- 172.21.15.72:0/641056301 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd9a4089380 con 0x7fd9b00b4800 2023-08-25T04:46:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.701+0000 7fd9affff700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd99406a1e0 0x7fd99406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.701+0000 7fd9affff700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd99406a1e0 0x7fd99406c6a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00d0890 tx=0x7fd99c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.702+0000 7fd9ad7fa700 1 -- 172.21.15.72:0/641056301 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd9a4054760 con 0x7fd9b00b4800 2023-08-25T04:46:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.709+0000 7f35897fa700 1 -- 172.21.15.72:0/4153663316 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3580021070 con 0x7f358c151c30 2023-08-25T04:46:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.710+0000 7f35897fa700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f357806a1b0 0x7f357806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:03.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.711+0000 7f35897fa700 1 -- 172.21.15.72:0/4153663316 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f358008a360 con 0x7f358c151c30 2023-08-25T04:46:03.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.712+0000 7f35897fa700 1 -- 172.21.15.72:0/4153663316 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f35800557d0 con 0x7f358c151c30 2023-08-25T04:46:03.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.711+0000 7fd47b7fe700 1 -- 172.21.15.72:0/3745118189 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd48c0587b0 con 0x7fd494070dd0 2023-08-25T04:46:03.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.720+0000 7f3590d9b700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f357806a1b0 0x7f357806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:03.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:03.747+0000 7f3590d9b700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f357806a1b0 0x7f357806c670 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f358c16cb00 tx=0x7f35840094f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:04.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.062+0000 7f4efe3ff700 1 -- 172.21.15.72:0/630967817 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4ed80055a0 con 0x7f4ef806c990 2023-08-25T04:46:04.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.063+0000 7f4ef4ff9700 1 -- 172.21.15.72:0/630967817 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4eec017070 con 0x7f4ef806c990 2023-08-25T04:46:04.068 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-08-25T04:46:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.068+0000 7f4efe3ff700 1 -- 172.21.15.72:0/630967817 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ee406a1b0 msgr2=0x7f4ee406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.068+0000 7f4efe3ff700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ee406a1b0 0x7f4ee406c670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80c1850 tx=0x7f4ef0010000 comp rx=0 tx=0).stop 2023-08-25T04:46:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.068+0000 7f4efe3ff700 1 -- 172.21.15.72:0/630967817 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 msgr2=0x7f4ef8148ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.068+0000 7f4efe3ff700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 0x7f4ef8148ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4eec001eb0 tx=0x7f4eec00c800 comp rx=0 tx=0).stop 2023-08-25T04:46:04.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.069+0000 7f4efe3ff700 1 -- 172.21.15.72:0/630967817 shutdown_connections 2023-08-25T04:46:04.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.069+0000 7f4efe3ff700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ee406a1b0 0x7f4ee406c670 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.069+0000 7f4efe3ff700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ef8158f30 0x7f4ef814f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.069+0000 7f4efe3ff700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ef806c990 0x7f4ef8148ec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.069+0000 7f4efe3ff700 1 --2- 172.21.15.72:0/630967817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef806cdf0 0x7f4ef814ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.069+0000 7f4efe3ff700 1 -- 172.21.15.72:0/630967817 >> 172.21.15.72:0/630967817 conn(0x7f4ef80ce9a0 msgr2=0x7f4ef8156520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.069+0000 7f4efe3ff700 1 -- 172.21.15.72:0/630967817 shutdown_connections 2023-08-25T04:46:04.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.069+0000 7f4efe3ff700 1 -- 172.21.15.72:0/630967817 wait complete. 2023-08-25T04:46:04.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-08-25T04:46:04.102 DEBUG:teuthology.parallel:result is None 2023-08-25T04:46:04.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.106+0000 7f1f079ff700 1 -- 172.21.15.72:0/2936953745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1ee00055a0 con 0x7f1f00070890 2023-08-25T04:46:04.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.106+0000 7f1ef5ffb700 1 -- 172.21.15.72:0/2936953745 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1efc0582b0 con 0x7f1f00070890 2023-08-25T04:46:04.108 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-08-25T04:46:04.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.109+0000 7f1f079ff700 1 -- 172.21.15.72:0/2936953745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1ee406a1b0 msgr2=0x7f1ee406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.109+0000 7f1f079ff700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1ee406a1b0 0x7f1ee406c670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00012e0 tx=0x7f1ef0001270 comp rx=0 tx=0).stop 2023-08-25T04:46:04.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.109+0000 7f1f079ff700 1 -- 172.21.15.72:0/2936953745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f00070890 msgr2=0x7f1f0015d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.109+0000 7f1f079ff700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f00070890 0x7f1f0015d080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0090b0 tx=0x7f1efc004750 comp rx=0 tx=0).stop 2023-08-25T04:46:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.109+0000 7f1f079ff700 1 -- 172.21.15.72:0/2936953745 shutdown_connections 2023-08-25T04:46:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.109+0000 7f1f079ff700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f1ee406a1b0 0x7f1ee406c670 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.109+0000 7f1f079ff700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f000b0550 0x7f1f0015b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.109+0000 7f1f079ff700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f00070890 0x7f1f0015d080 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.109+0000 7f1f079ff700 1 --2- 172.21.15.72:0/2936953745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f00070c70 0x7f1f0015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.109+0000 7f1f079ff700 1 -- 172.21.15.72:0/2936953745 >> 172.21.15.72:0/2936953745 conn(0x7f1f000ce9a0 msgr2=0x7f1f000c2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.110+0000 7f1f079ff700 1 -- 172.21.15.72:0/2936953745 shutdown_connections 2023-08-25T04:46:04.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.110+0000 7f1f079ff700 1 -- 172.21.15.72:0/2936953745 wait complete. 2023-08-25T04:46:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.119+0000 7f575fbff700 1 -- 172.21.15.72:0/1068337054 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f57580722d0 con 0x7f5758070b00 2023-08-25T04:46:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.121+0000 7f574e7fc700 1 -- 172.21.15.72:0/1068337054 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5750021020 con 0x7f5758070b00 2023-08-25T04:46:04.124 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-08-25T04:46:04.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.127+0000 7f575fbff700 1 -- 172.21.15.72:0/1068337054 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f573c06a130 msgr2=0x7f573c06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.127+0000 7f575fbff700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f573c06a130 0x7f573c06c5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f57540010e0 tx=0x7f57540079e0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.127+0000 7f575fbff700 1 -- 172.21.15.72:0/1068337054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 msgr2=0x7f57580b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.127+0000 7f575fbff700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f57580b42d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5750016010 tx=0x7f5750004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.127+0000 7f575fbff700 1 -- 172.21.15.72:0/1068337054 shutdown_connections 2023-08-25T04:46:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.127+0000 7f575fbff700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f573c06a130 0x7f573c06c5f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.127+0000 7f575fbff700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f575816e680 0x7f57580c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.127+0000 7f575fbff700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5758070b00 0x7f57580b42d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.127+0000 7f575fbff700 1 --2- 172.21.15.72:0/1068337054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5758089b30 0x7f57580a7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.127+0000 7f575fbff700 1 -- 172.21.15.72:0/1068337054 >> 172.21.15.72:0/1068337054 conn(0x7f57580ce9a0 msgr2=0x7f57580891f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.128+0000 7f575fbff700 1 -- 172.21.15.72:0/1068337054 shutdown_connections 2023-08-25T04:46:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.128+0000 7f575fbff700 1 -- 172.21.15.72:0/1068337054 wait complete. 2023-08-25T04:46:04.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-08-25T04:46:04.136 DEBUG:teuthology.parallel:result is None 2023-08-25T04:46:04.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.151+0000 7fd4995ff700 1 -- 172.21.15.72:0/3745118189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd4740055a0 con 0x7fd494070dd0 2023-08-25T04:46:04.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.152+0000 7fd47b7fe700 1 -- 172.21.15.72:0/3745118189 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd48c058340 con 0x7fd494070dd0 2023-08-25T04:46:04.153 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-08-25T04:46:04.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.154+0000 7feb387ff700 1 -- 172.21.15.72:0/2863605706 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7feb300b3810 con 0x7feb300add00 2023-08-25T04:46:04.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.154+0000 7fd4995ff700 1 -- 172.21.15.72:0/3745118189 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd48006a1b0 msgr2=0x7fd48006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.154+0000 7fd4995ff700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd48006a1b0 0x7fd48006c670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd494157620 tx=0x7fd484009210 comp rx=0 tx=0).stop 2023-08-25T04:46:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.154+0000 7fd4995ff700 1 -- 172.21.15.72:0/3745118189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd494070dd0 msgr2=0x7fd494152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.154+0000 7fd4995ff700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd494070dd0 0x7fd494152ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00b680 tx=0x7fd48c004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.155+0000 7fd4995ff700 1 -- 172.21.15.72:0/3745118189 shutdown_connections 2023-08-25T04:46:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.155+0000 7fd4995ff700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd48006a1b0 0x7fd48006c670 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.155+0000 7fd4995ff700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4940ca440 0x7fd494164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.155+0000 7fd4995ff700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd494070dd0 0x7fd494152ac0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.155+0000 7fd4995ff700 1 --2- 172.21.15.72:0/3745118189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4940add00 0x7fd494163b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.155+0000 7fd4995ff700 1 -- 172.21.15.72:0/3745118189 >> 172.21.15.72:0/3745118189 conn(0x7fd4940ce9a0 msgr2=0x7fd49406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.155+0000 7feb22ffd700 1 -- 172.21.15.72:0/2863605706 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feb24015020 con 0x7feb300add00 2023-08-25T04:46:04.158 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-08-25T04:46:04.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.155+0000 7fd4995ff700 1 -- 172.21.15.72:0/3745118189 shutdown_connections 2023-08-25T04:46:04.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.155+0000 7fd4995ff700 1 -- 172.21.15.72:0/3745118189 wait complete. 2023-08-25T04:46:04.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-08-25T04:46:04.159 DEBUG:teuthology.parallel:result is None 2023-08-25T04:46:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.157+0000 7feb387ff700 1 -- 172.21.15.72:0/2863605706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7feb1406a1b0 msgr2=0x7feb1406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7feb1406a1b0 0x7feb1406c670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb2c000f60 tx=0x7feb2c007a40 comp rx=0 tx=0).stop 2023-08-25T04:46:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 -- 172.21.15.72:0/2863605706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300add00 msgr2=0x7feb30152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300add00 0x7feb30152d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb24009c40 tx=0x7feb24004750 comp rx=0 tx=0).stop 2023-08-25T04:46:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 -- 172.21.15.72:0/2863605706 shutdown_connections 2023-08-25T04:46:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7feb1406a1b0 0x7feb1406c670 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb300c4500 0x7feb300c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb30070dd0 0x7feb3014efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 --2- 172.21.15.72:0/2863605706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feb300add00 0x7feb30152d10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 -- 172.21.15.72:0/2863605706 >> 172.21.15.72:0/2863605706 conn(0x7feb300ce9a0 msgr2=0x7feb300b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 -- 172.21.15.72:0/2863605706 shutdown_connections 2023-08-25T04:46:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.158+0000 7feb387ff700 1 -- 172.21.15.72:0/2863605706 wait complete. 2023-08-25T04:46:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.160+0000 7fd9b6dff700 1 -- 172.21.15.72:0/641056301 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9900055a0 con 0x7fd9b00b4800 2023-08-25T04:46:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.160+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3140453219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcdc814f9b0 con 0x7fcdc80b4800 2023-08-25T04:46:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.160+0000 7fd9ad7fa700 1 -- 172.21.15.72:0/641056301 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9a4000e60 con 0x7fd9b00b4800 2023-08-25T04:46:04.164 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-08-25T04:46:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.161+0000 7fcdc4ff9700 1 -- 172.21.15.72:0/3140453219 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcdc814f9b0 con 0x7fcdc80b4800 2023-08-25T04:46:04.165 INFO:teuthology.orchestra.run.smithi072.stdout:55834574859 2023-08-25T04:46:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.163+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcda806a1b0 msgr2=0x7fcda806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.163+0000 7fcdcdfff700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcda806a1b0 0x7fcda806c670 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcdc81fa010 tx=0x7fcdb8009040 comp rx=0 tx=0).stop 2023-08-25T04:46:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.163+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdc80b4800 msgr2=0x7fcdc815d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.163+0000 7fcdcdfff700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdc80b4800 0x7fcdc815d7f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0016000 tx=0x7fcdb0004750 comp rx=0 tx=0).stop 2023-08-25T04:46:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.163+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3140453219 shutdown_connections 2023-08-25T04:46:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.163+0000 7fcdcdfff700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcda806a1b0 0x7fcda806c670 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.163+0000 7fcdcdfff700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcdc815cf00 0x7fcdc80c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.163+0000 7fcdcdfff700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdc80b4800 0x7fcdc815d7f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.163+0000 7fcdcdfff700 1 --2- 172.21.15.72:0/3140453219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc80b4c90 0x7fcdc814f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.163+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3140453219 >> 172.21.15.72:0/3140453219 conn(0x7fcdc8071e40 msgr2=0x7fcdc80d2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3140453219 shutdown_connections 2023-08-25T04:46:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fcdcdfff700 1 -- 172.21.15.72:0/3140453219 wait complete. 2023-08-25T04:46:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 -- 172.21.15.72:0/641056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd99406a1e0 msgr2=0x7fd99406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd99406a1e0 0x7fd99406c6a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00d0890 tx=0x7fd99c009040 comp rx=0 tx=0).stop 2023-08-25T04:46:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 -- 172.21.15.72:0/641056301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b00b4800 msgr2=0x7fd9b0154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b00b4800 0x7fd9b0154780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4000c00 tx=0x7fd9a4004750 comp rx=0 tx=0).stop 2023-08-25T04:46:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 -- 172.21.15.72:0/641056301 shutdown_connections 2023-08-25T04:46:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd99406a1e0 0x7fd99406c6a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9b00cadb0 0x7fd9b0159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd9b00b4800 0x7fd9b0154780 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 --2- 172.21.15.72:0/641056301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9b00b4c80 0x7fd9b0159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 -- 172.21.15.72:0/641056301 >> 172.21.15.72:0/641056301 conn(0x7fd9b0071e40 msgr2=0x7fd9b015dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.164+0000 7fd9b6dff700 1 -- 172.21.15.72:0/641056301 shutdown_connections 2023-08-25T04:46:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.165+0000 7fd9b6dff700 1 -- 172.21.15.72:0/641056301 wait complete. 2023-08-25T04:46:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.167+0000 7f3592fff700 1 -- 172.21.15.72:0/4153663316 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f358c071350 con 0x7f358c151c30 2023-08-25T04:46:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.168+0000 7f35897fa700 1 -- 172.21.15.72:0/4153663316 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3580058df0 con 0x7f358c151c30 2023-08-25T04:46:04.172 INFO:teuthology.orchestra.run.smithi072.stdout:55834574859 2023-08-25T04:46:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.171+0000 7f3592fff700 1 -- 172.21.15.72:0/4153663316 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f357806a1b0 msgr2=0x7f357806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.171+0000 7f3592fff700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f357806a1b0 0x7f357806c670 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f358c16cb00 tx=0x7f35840094f0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.171+0000 7f3592fff700 1 -- 172.21.15.72:0/4153663316 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c151c30 msgr2=0x7f358c1520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.171+0000 7f3592fff700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c151c30 0x7f358c1520c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f358000b0e0 tx=0x7f3580004750 comp rx=0 tx=0).stop 2023-08-25T04:46:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.171+0000 7f3592fff700 1 -- 172.21.15.72:0/4153663316 shutdown_connections 2023-08-25T04:46:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.171+0000 7f3592fff700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f357806a1b0 0x7f357806c670 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.171+0000 7f3592fff700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f358c151c30 0x7f358c1520c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.171+0000 7f3592fff700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f358c0b0550 0x7f358c087e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.171+0000 7f3592fff700 1 --2- 172.21.15.72:0/4153663316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f358c088580 0x7f358c0ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.171+0000 7f3592fff700 1 -- 172.21.15.72:0/4153663316 >> 172.21.15.72:0/4153663316 conn(0x7f358c0ce9a0 msgr2=0x7f358c0c2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.172+0000 7f3592fff700 1 -- 172.21.15.72:0/4153663316 shutdown_connections 2023-08-25T04:46:04.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.172+0000 7f3592fff700 1 -- 172.21.15.72:0/4153663316 wait complete. 2023-08-25T04:46:04.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-08-25T04:46:04.186 DEBUG:teuthology.parallel:result is None 2023-08-25T04:46:04.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-08-25T04:46:04.188 DEBUG:teuthology.parallel:result is None 2023-08-25T04:46:04.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2023-08-25T04:46:04.190 DEBUG:teuthology.parallel:result is None 2023-08-25T04:46:04.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-08-25T04:46:04.193 DEBUG:teuthology.parallel:result is None 2023-08-25T04:46:04.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-08-25T04:46:04.194 DEBUG:teuthology.parallel:result is None 2023-08-25T04:46:04.194 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-25T04:46:04.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:46:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.430+0000 7f7c927ff700 1 Processor -- start 2023-08-25T04:46:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.430+0000 7f7c927ff700 1 -- start start 2023-08-25T04:46:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.431+0000 7f7c927ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7c8c159b90 0x7f7c8c0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.432+0000 7f7c927ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c0b0ab0 0x7f7c8c0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.432+0000 7f7c927ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8c0c48f0 con 0x7f7c8c0ce1f0 2023-08-25T04:46:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.432+0000 7f7c927ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c0c5470 con 0x7f7c8c159b90 2023-08-25T04:46:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.432+0000 7f7c927ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c159f70 con 0x7f7c8c0b0ab0 2023-08-25T04:46:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.432+0000 7f7c90d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7c8c0ce1f0 0x7f7c8c0c3850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41684/0 (socket says 172.21.15.72:41684) 2023-08-25T04:46:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.432+0000 7f7c90d9c700 1 -- 172.21.15.72:0/646314154 learned_addr learned my addr 172.21.15.72:0/646314154 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:04.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.432+0000 7f7c8bfff700 1 --2- 172.21.15.72:0/646314154 >> v2:172.21.15.137:3300/0 conn(0x7f7c8c159b90 0x7f7c8c0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.432+0000 7f7c8b7fe700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c0b0ab0 0x7f7c8c0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.432+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660501306 0 0) 0x7f7c8c0c48f0 con 0x7f7c8c0ce1f0 2023-08-25T04:46:04.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.432+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c740035b0 con 0x7f7c8c0ce1f0 2023-08-25T04:46:04.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503004572 0 0) 0x7f7c740035b0 con 0x7f7c8c0ce1f0 2023-08-25T04:46:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c0b0ab0 msgr2=0x7f7c8c0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c0b0ab0 0x7f7c8c0cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 >> v2:172.21.15.137:3300/0 conn(0x7f7c8c159b90 msgr2=0x7f7c8c0b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:04.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 --2- 172.21.15.72:0/646314154 >> v2:172.21.15.137:3300/0 conn(0x7f7c8c159b90 0x7f7c8c0b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c0c4b40 con 0x7f7c8c0ce1f0 2023-08-25T04:46:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f7c840019f0 con 0x7f7c8c0ce1f0 2023-08-25T04:46:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 >> v1:172.21.15.72:6789/0 conn(0x7f7c8c0ce1f0 legacy=0x7f7c8c0c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c0b0ab0 0x7f7c74003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c74003f80 0x7f7c74004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 0x7f7c74005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c0c5470 con 0x7f7c74004d90 2023-08-25T04:46:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c159f70 con 0x7f7c74003f80 2023-08-25T04:46:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7400ba60 con 0x7f7c8c0b0ab0 2023-08-25T04:46:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c90d9c700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 0x7f7c74005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8bfff700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c0b0ab0 0x7f7c74003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.433+0000 7f7c8b7fe700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c74003f80 0x7f7c74004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c90d9c700 1 -- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c0b0ab0 msgr2=0x7f7c74003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c90d9c700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c0b0ab0 0x7f7c74003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c90d9c700 1 -- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c74003f80 msgr2=0x7f7c74004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c90d9c700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c74003f80 0x7f7c74004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c90d9c700 1 -- 172.21.15.72:0/646314154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740035b0 con 0x7f7c74004d90 2023-08-25T04:46:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c8b7fe700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c74003f80 0x7f7c74004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c8bfff700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c0b0ab0 0x7f7c74003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c90d9c700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 0x7f7c74005210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400a890 tx=0x7f7c74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a257ee53ecce49 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84012600 con 0x7f7c74004d90 2023-08-25T04:46:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c84012780 con 0x7f7c74004d90 2023-08-25T04:46:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c8affd700 1 -- 172.21.15.72:0/646314154 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84012b30 con 0x7f7c74004d90 2023-08-25T04:46:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c927ff700 1 -- 172.21.15.72:0/646314154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 msgr2=0x7f7c74005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c927ff700 1 --2- 172.21.15.72:0/646314154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 0x7f7c74005210 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400a890 tx=0x7f7c74005880 comp rx=0 tx=0).stop 2023-08-25T04:46:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.434+0000 7f7c90d9c700 1 -- 172.21.15.72:0/646314154 reap_dead start 2023-08-25T04:46:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.435+0000 7f7c927ff700 1 -- 172.21.15.72:0/646314154 shutdown_connections 2023-08-25T04:46:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.435+0000 7f7c927ff700 1 -- 172.21.15.72:0/646314154 >> 172.21.15.72:0/646314154 conn(0x7f7c8c0ce990 msgr2=0x7f7c8c0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.435+0000 7f7c927ff700 1 -- 172.21.15.72:0/646314154 shutdown_connections 2023-08-25T04:46:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.435+0000 7f7c927ff700 1 -- 172.21.15.72:0/646314154 wait complete. 2023-08-25T04:46:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.436+0000 7f7c927ff700 1 Processor -- start 2023-08-25T04:46:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.437+0000 7f7c927ff700 1 -- start start 2023-08-25T04:46:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.437+0000 7f7c927ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 0x7f7c8c13dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.437+0000 7f7c927ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c15cca0 0x7f7c8c13bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.437+0000 7f7c927ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c8c13c300 0x7f7c8c14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c927ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c13bc30 con 0x7f7c74004d90 2023-08-25T04:46:04.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c927ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c13e190 con 0x7f7c8c13c300 2023-08-25T04:46:04.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c927ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c14aa70 con 0x7f7c8c15cca0 2023-08-25T04:46:04.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c8bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 0x7f7c8c13dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c8bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 0x7f7c8c13dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57874/0 (socket says 172.21.15.72:57874) 2023-08-25T04:46:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c8bfff700 1 -- 172.21.15.72:0/3008601439 learned_addr learned my addr 172.21.15.72:0/3008601439 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c8b7fe700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c15cca0 0x7f7c8c13bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c90d9c700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c8c13c300 0x7f7c8c14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c8bfff700 1 -- 172.21.15.72:0/3008601439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c15cca0 msgr2=0x7f7c8c13bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c8bfff700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c15cca0 0x7f7c8c13bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c8bfff700 1 -- 172.21.15.72:0/3008601439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c8c13c300 msgr2=0x7f7c8c14ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c8bfff700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c8c13c300 0x7f7c8c14ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c8bfff700 1 -- 172.21.15.72:0/3008601439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c14acc0 con 0x7f7c74004d90 2023-08-25T04:46:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c90d9c700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c8c13c300 0x7f7c8c14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.438+0000 7f7c8bfff700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 0x7f7c8c13dc50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c011c30 tx=0x7f7c7c00f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.439+0000 7f7c88ff9700 1 -- 172.21.15.72:0/3008601439 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00fa00 con 0x7f7c74004d90 2023-08-25T04:46:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.439+0000 7f7c88ff9700 1 -- 172.21.15.72:0/3008601439 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c00fb60 con 0x7f7c74004d90 2023-08-25T04:46:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.439+0000 7f7c927ff700 1 -- 172.21.15.72:0/3008601439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8c14afa0 con 0x7f7c74004d90 2023-08-25T04:46:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.439+0000 7f7c88ff9700 1 -- 172.21.15.72:0/3008601439 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c004020 con 0x7f7c74004d90 2023-08-25T04:46:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.439+0000 7f7c927ff700 1 -- 172.21.15.72:0/3008601439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8c14b560 con 0x7f7c74004d90 2023-08-25T04:46:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.440+0000 7f7c927ff700 1 -- 172.21.15.72:0/3008601439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8c14b8d0 con 0x7f7c74004d90 2023-08-25T04:46:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.441+0000 7f7c88ff9700 1 -- 172.21.15.72:0/3008601439 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7c7c004180 con 0x7f7c74004d90 2023-08-25T04:46:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.442+0000 7f7c88ff9700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7c7806a0e0 0x7f7c7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.442+0000 7f7c88ff9700 1 -- 172.21.15.72:0/3008601439 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7c7c088e30 con 0x7f7c74004d90 2023-08-25T04:46:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.442+0000 7f7c8b7fe700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7c7806a0e0 0x7f7c7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.443+0000 7f7c8b7fe700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7c7806a0e0 0x7f7c7806c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009e00 tx=0x7f7c80009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.446+0000 7f7c88ff9700 1 -- 172.21.15.72:0/3008601439 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7c7c054220 con 0x7f7c74004d90 2023-08-25T04:46:04.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.640+0000 7f7c927ff700 1 -- 172.21.15.72:0/3008601439 --> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c8c0c5100 con 0x7f7c7806a0e0 2023-08-25T04:46:04.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.650+0000 7f7c88ff9700 1 -- 172.21.15.72:0/3008601439 <== mgr.4101 v2:172.21.15.72:6832/1377484023 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367641 (secure 0 0 0) 0x7f7c80019070 con 0x7f7c7806a0e0 2023-08-25T04:46:04.655 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:04.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 -- 172.21.15.72:0/3008601439 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7c7806a0e0 msgr2=0x7f7c7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7c7806a0e0 0x7f7c7806c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009e00 tx=0x7f7c80009210 comp rx=0 tx=0).stop 2023-08-25T04:46:04.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 -- 172.21.15.72:0/3008601439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 msgr2=0x7f7c8c13dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 0x7f7c8c13dc50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c011c30 tx=0x7f7c7c00f240 comp rx=0 tx=0).stop 2023-08-25T04:46:04.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 -- 172.21.15.72:0/3008601439 shutdown_connections 2023-08-25T04:46:04.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7c7806a0e0 0x7f7c7806c5a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c8c13c300 0x7f7c8c14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c74004d90 0x7f7c8c13dc50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 --2- 172.21.15.72:0/3008601439 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7c8c15cca0 0x7f7c8c13bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 -- 172.21.15.72:0/3008601439 >> 172.21.15.72:0/3008601439 conn(0x7f7c8c0ce990 msgr2=0x7f7c8c158900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 -- 172.21.15.72:0/3008601439 shutdown_connections 2023-08-25T04:46:04.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.655+0000 7f7c927ff700 1 -- 172.21.15.72:0/3008601439 wait complete. 2023-08-25T04:46:04.659 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-25T04:46:04.674 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-08-25T04:46:03.866836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219456,"kb_used_data":3300,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755264,"statfs":{"total":773094113280,"available":772869390336,"internally_reserved":0,"allocated":3379200,"data_stored":2067176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009549"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460126+0000","last_change":"2023-08-25T04:45:33.185383+0000","last_active":"2023-08-25T04:45:38.460126+0000","last_peered":"2023-08-25T04:45:38.460126+0000","last_clean":"2023-08-25T04:45:38.460126+0000","last_became_active":"2023-08-25T04:45:33.184169+0000","last_became_peered":"2023-08-25T04:45:33.184169+0000","last_unstale":"2023-08-25T04:45:38.460126+0000","last_undegraded":"2023-08-25T04:45:38.460126+0000","last_fullsized":"2023-08-25T04:45:38.460126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:42:04.862278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460260+0000","last_change":"2023-08-25T04:45:33.187575+0000","last_active":"2023-08-25T04:45:38.460260+0000","last_peered":"2023-08-25T04:45:38.460260+0000","last_clean":"2023-08-25T04:45:38.460260+0000","last_became_active":"2023-08-25T04:45:33.187289+0000","last_became_peered":"2023-08-25T04:45:33.187289+0000","last_unstale":"2023-08-25T04:45:38.460260+0000","last_undegraded":"2023-08-25T04:45:38.460260+0000","last_fullsized":"2023-08-25T04:45:38.460260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:14.806194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461583+0000","last_change":"2023-08-25T04:45:33.179277+0000","last_active":"2023-08-25T04:45:38.461583+0000","last_peered":"2023-08-25T04:45:38.461583+0000","last_clean":"2023-08-25T04:45:38.461583+0000","last_became_active":"2023-08-25T04:45:33.178903+0000","last_became_peered":"2023-08-25T04:45:33.178903+0000","last_unstale":"2023-08-25T04:45:38.461583+0000","last_undegraded":"2023-08-25T04:45:38.461583+0000","last_fullsized":"2023-08-25T04:45:38.461583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:22:43.697767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652749+0000","last_change":"2023-08-25T04:45:33.187260+0000","last_active":"2023-08-25T04:45:38.652749+0000","last_peered":"2023-08-25T04:45:38.652749+0000","last_clean":"2023-08-25T04:45:38.652749+0000","last_became_active":"2023-08-25T04:45:33.186900+0000","last_became_peered":"2023-08-25T04:45:33.186900+0000","last_unstale":"2023-08-25T04:45:38.652749+0000","last_undegraded":"2023-08-25T04:45:38.652749+0000","last_fullsized":"2023-08-25T04:45:38.652749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:30.486107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845968+0000","last_change":"2023-08-25T04:45:33.184990+0000","last_active":"2023-08-25T04:45:38.845968+0000","last_peered":"2023-08-25T04:45:38.845968+0000","last_clean":"2023-08-25T04:45:38.845968+0000","last_became_active":"2023-08-25T04:45:33.184741+0000","last_became_peered":"2023-08-25T04:45:33.184741+0000","last_unstale":"2023-08-25T04:45:38.845968+0000","last_undegraded":"2023-08-25T04:45:38.845968+0000","last_fullsized":"2023-08-25T04:45:38.845968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:15.434939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461899+0000","last_change":"2023-08-25T04:45:33.182357+0000","last_active":"2023-08-25T04:45:38.461899+0000","last_peered":"2023-08-25T04:45:38.461899+0000","last_clean":"2023-08-25T04:45:38.461899+0000","last_became_active":"2023-08-25T04:45:33.182046+0000","last_became_peered":"2023-08-25T04:45:33.182046+0000","last_unstale":"2023-08-25T04:45:38.461899+0000","last_undegraded":"2023-08-25T04:45:38.461899+0000","last_fullsized":"2023-08-25T04:45:38.461899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:23.439531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475830+0000","last_change":"2023-08-25T04:45:33.188333+0000","last_active":"2023-08-25T04:45:39.475830+0000","last_peered":"2023-08-25T04:45:39.475830+0000","last_clean":"2023-08-25T04:45:39.475830+0000","last_became_active":"2023-08-25T04:45:33.187968+0000","last_became_peered":"2023-08-25T04:45:33.187968+0000","last_unstale":"2023-08-25T04:45:39.475830+0000","last_undegraded":"2023-08-25T04:45:39.475830+0000","last_fullsized":"2023-08-25T04:45:39.475830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:22:29.864512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459977+0000","last_change":"2023-08-25T04:45:33.186253+0000","last_active":"2023-08-25T04:45:38.459977+0000","last_peered":"2023-08-25T04:45:38.459977+0000","last_clean":"2023-08-25T04:45:38.459977+0000","last_became_active":"2023-08-25T04:45:33.185966+0000","last_became_peered":"2023-08-25T04:45:33.185966+0000","last_unstale":"2023-08-25T04:45:38.459977+0000","last_undegraded":"2023-08-25T04:45:38.459977+0000","last_fullsized":"2023-08-25T04:45:38.459977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:10.645818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845570+0000","last_change":"2023-08-25T04:45:33.186028+0000","last_active":"2023-08-25T04:45:38.845570+0000","last_peered":"2023-08-25T04:45:38.845570+0000","last_clean":"2023-08-25T04:45:38.845570+0000","last_became_active":"2023-08-25T04:45:33.185568+0000","last_became_peered":"2023-08-25T04:45:33.185568+0000","last_unstale":"2023-08-25T04:45:38.845570+0000","last_undegraded":"2023-08-25T04:45:38.845570+0000","last_fullsized":"2023-08-25T04:45:38.845570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:05.092316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460526+0000","last_change":"2023-08-25T04:45:33.178499+0000","last_active":"2023-08-25T04:45:38.460526+0000","last_peered":"2023-08-25T04:45:38.460526+0000","last_clean":"2023-08-25T04:45:38.460526+0000","last_became_active":"2023-08-25T04:45:33.178145+0000","last_became_peered":"2023-08-25T04:45:33.178145+0000","last_unstale":"2023-08-25T04:45:38.460526+0000","last_undegraded":"2023-08-25T04:45:38.460526+0000","last_fullsized":"2023-08-25T04:45:38.460526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:50.758247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461421+0000","last_change":"2023-08-25T04:45:33.173857+0000","last_active":"2023-08-25T04:45:38.461421+0000","last_peered":"2023-08-25T04:45:38.461421+0000","last_clean":"2023-08-25T04:45:38.461421+0000","last_became_active":"2023-08-25T04:45:33.173577+0000","last_became_peered":"2023-08-25T04:45:33.173577+0000","last_unstale":"2023-08-25T04:45:38.461421+0000","last_undegraded":"2023-08-25T04:45:38.461421+0000","last_fullsized":"2023-08-25T04:45:38.461421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:45:23.452085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459669+0000","last_change":"2023-08-25T04:45:33.186989+0000","last_active":"2023-08-25T04:45:38.459669+0000","last_peered":"2023-08-25T04:45:38.459669+0000","last_clean":"2023-08-25T04:45:38.459669+0000","last_became_active":"2023-08-25T04:45:33.186701+0000","last_became_peered":"2023-08-25T04:45:33.186701+0000","last_unstale":"2023-08-25T04:45:38.459669+0000","last_undegraded":"2023-08-25T04:45:38.459669+0000","last_fullsized":"2023-08-25T04:45:38.459669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:19.431020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459722+0000","last_change":"2023-08-25T04:45:33.183696+0000","last_active":"2023-08-25T04:45:38.459722+0000","last_peered":"2023-08-25T04:45:38.459722+0000","last_clean":"2023-08-25T04:45:38.459722+0000","last_became_active":"2023-08-25T04:45:33.183381+0000","last_became_peered":"2023-08-25T04:45:33.183381+0000","last_unstale":"2023-08-25T04:45:38.459722+0000","last_undegraded":"2023-08-25T04:45:38.459722+0000","last_fullsized":"2023-08-25T04:45:38.459722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:36.669250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459977+0000","last_change":"2023-08-25T04:45:33.183979+0000","last_active":"2023-08-25T04:45:38.459977+0000","last_peered":"2023-08-25T04:45:38.459977+0000","last_clean":"2023-08-25T04:45:38.459977+0000","last_became_active":"2023-08-25T04:45:33.183700+0000","last_became_peered":"2023-08-25T04:45:33.183700+0000","last_unstale":"2023-08-25T04:45:38.459977+0000","last_undegraded":"2023-08-25T04:45:38.459977+0000","last_fullsized":"2023-08-25T04:45:38.459977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475604+0000","last_change":"2023-08-25T04:45:33.188668+0000","last_active":"2023-08-25T04:45:39.475604+0000","last_peered":"2023-08-25T04:45:39.475604+0000","last_clean":"2023-08-25T04:45:39.475604+0000","last_became_active":"2023-08-25T04:45:33.188447+0000","last_became_peered":"2023-08-25T04:45:33.188447+0000","last_unstale":"2023-08-25T04:45:39.475604+0000","last_undegraded":"2023-08-25T04:45:39.475604+0000","last_fullsized":"2023-08-25T04:45:39.475604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461770+0000","last_change":"2023-08-25T04:45:33.175887+0000","last_active":"2023-08-25T04:45:38.461770+0000","last_peered":"2023-08-25T04:45:38.461770+0000","last_clean":"2023-08-25T04:45:38.461770+0000","last_became_active":"2023-08-25T04:45:33.175585+0000","last_became_peered":"2023-08-25T04:45:33.175585+0000","last_unstale":"2023-08-25T04:45:38.461770+0000","last_undegraded":"2023-08-25T04:45:38.461770+0000","last_fullsized":"2023-08-25T04:45:38.461770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:37.935438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845602+0000","last_change":"2023-08-25T04:45:33.185875+0000","last_active":"2023-08-25T04:45:38.845602+0000","last_peered":"2023-08-25T04:45:38.845602+0000","last_clean":"2023-08-25T04:45:38.845602+0000","last_became_active":"2023-08-25T04:45:33.185200+0000","last_became_peered":"2023-08-25T04:45:33.185200+0000","last_unstale":"2023-08-25T04:45:38.845602+0000","last_undegraded":"2023-08-25T04:45:38.845602+0000","last_fullsized":"2023-08-25T04:45:38.845602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:30.597928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461261+0000","last_change":"2023-08-25T04:45:33.170738+0000","last_active":"2023-08-25T04:45:38.461261+0000","last_peered":"2023-08-25T04:45:38.461261+0000","last_clean":"2023-08-25T04:45:38.461261+0000","last_became_active":"2023-08-25T04:45:33.170445+0000","last_became_peered":"2023-08-25T04:45:33.170445+0000","last_unstale":"2023-08-25T04:45:38.461261+0000","last_undegraded":"2023-08-25T04:45:38.461261+0000","last_fullsized":"2023-08-25T04:45:38.461261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:42:18.697261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459973+0000","last_change":"2023-08-25T04:45:33.189985+0000","last_active":"2023-08-25T04:45:38.459973+0000","last_peered":"2023-08-25T04:45:38.459973+0000","last_clean":"2023-08-25T04:45:38.459973+0000","last_became_active":"2023-08-25T04:45:33.189741+0000","last_became_peered":"2023-08-25T04:45:33.189741+0000","last_unstale":"2023-08-25T04:45:38.459973+0000","last_undegraded":"2023-08-25T04:45:38.459973+0000","last_fullsized":"2023-08-25T04:45:38.459973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:54:14.813343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.462063+0000","last_change":"2023-08-25T04:45:33.190893+0000","last_active":"2023-08-25T04:45:38.462063+0000","last_peered":"2023-08-25T04:45:38.462063+0000","last_clean":"2023-08-25T04:45:38.462063+0000","last_became_active":"2023-08-25T04:45:33.190613+0000","last_became_peered":"2023-08-25T04:45:33.190613+0000","last_unstale":"2023-08-25T04:45:38.462063+0000","last_undegraded":"2023-08-25T04:45:38.462063+0000","last_fullsized":"2023-08-25T04:45:38.462063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:30:18.502488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476050+0000","last_change":"2023-08-25T04:45:33.184588+0000","last_active":"2023-08-25T04:45:39.476050+0000","last_peered":"2023-08-25T04:45:39.476050+0000","last_clean":"2023-08-25T04:45:39.476050+0000","last_became_active":"2023-08-25T04:45:33.184240+0000","last_became_peered":"2023-08-25T04:45:33.184240+0000","last_unstale":"2023-08-25T04:45:39.476050+0000","last_undegraded":"2023-08-25T04:45:39.476050+0000","last_fullsized":"2023-08-25T04:45:39.476050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:00.135600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845427+0000","last_change":"2023-08-25T04:45:33.187776+0000","last_active":"2023-08-25T04:45:38.845427+0000","last_peered":"2023-08-25T04:45:38.845427+0000","last_clean":"2023-08-25T04:45:38.845427+0000","last_became_active":"2023-08-25T04:45:33.187529+0000","last_became_peered":"2023-08-25T04:45:33.187529+0000","last_unstale":"2023-08-25T04:45:38.845427+0000","last_undegraded":"2023-08-25T04:45:38.845427+0000","last_fullsized":"2023-08-25T04:45:38.845427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475970+0000","last_change":"2023-08-25T04:45:33.182244+0000","last_active":"2023-08-25T04:45:39.475970+0000","last_peered":"2023-08-25T04:45:39.475970+0000","last_clean":"2023-08-25T04:45:39.475970+0000","last_became_active":"2023-08-25T04:45:33.181940+0000","last_became_peered":"2023-08-25T04:45:33.181940+0000","last_unstale":"2023-08-25T04:45:39.475970+0000","last_undegraded":"2023-08-25T04:45:39.475970+0000","last_fullsized":"2023-08-25T04:45:39.475970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:02.627838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475607+0000","last_change":"2023-08-25T04:45:33.184900+0000","last_active":"2023-08-25T04:45:39.475607+0000","last_peered":"2023-08-25T04:45:39.475607+0000","last_clean":"2023-08-25T04:45:39.475607+0000","last_became_active":"2023-08-25T04:45:33.184589+0000","last_became_peered":"2023-08-25T04:45:33.184589+0000","last_unstale":"2023-08-25T04:45:39.475607+0000","last_undegraded":"2023-08-25T04:45:39.475607+0000","last_fullsized":"2023-08-25T04:45:39.475607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:17:10.410580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122553+0000","last_change":"2023-08-25T04:45:33.191724+0000","last_active":"2023-08-25T04:45:39.122553+0000","last_peered":"2023-08-25T04:45:39.122553+0000","last_clean":"2023-08-25T04:45:39.122553+0000","last_became_active":"2023-08-25T04:45:33.191388+0000","last_became_peered":"2023-08-25T04:45:33.191388+0000","last_unstale":"2023-08-25T04:45:39.122553+0000","last_undegraded":"2023-08-25T04:45:39.122553+0000","last_fullsized":"2023-08-25T04:45:39.122553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122544+0000","last_change":"2023-08-25T04:45:33.168956+0000","last_active":"2023-08-25T04:45:39.122544+0000","last_peered":"2023-08-25T04:45:39.122544+0000","last_clean":"2023-08-25T04:45:39.122544+0000","last_became_active":"2023-08-25T04:45:33.168694+0000","last_became_peered":"2023-08-25T04:45:33.168694+0000","last_unstale":"2023-08-25T04:45:39.122544+0000","last_undegraded":"2023-08-25T04:45:39.122544+0000","last_fullsized":"2023-08-25T04:45:39.122544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:50.406447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460744+0000","last_change":"2023-08-25T04:45:33.185807+0000","last_active":"2023-08-25T04:45:38.460744+0000","last_peered":"2023-08-25T04:45:38.460744+0000","last_clean":"2023-08-25T04:45:38.460744+0000","last_became_active":"2023-08-25T04:45:33.185511+0000","last_became_peered":"2023-08-25T04:45:33.185511+0000","last_unstale":"2023-08-25T04:45:38.460744+0000","last_undegraded":"2023-08-25T04:45:38.460744+0000","last_fullsized":"2023-08-25T04:45:38.460744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.462370+0000","last_change":"2023-08-25T04:45:37.484174+0000","last_active":"2023-08-25T04:45:38.462370+0000","last_peered":"2023-08-25T04:45:38.462370+0000","last_clean":"2023-08-25T04:45:38.462370+0000","last_became_active":"2023-08-25T04:45:37.483785+0000","last_became_peered":"2023-08-25T04:45:37.483785+0000","last_unstale":"2023-08-25T04:45:38.462370+0000","last_undegraded":"2023-08-25T04:45:38.462370+0000","last_fullsized":"2023-08-25T04:45:38.462370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:09.116862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461690+0000","last_change":"2023-08-25T04:45:32.241316+0000","last_active":"2023-08-25T04:45:38.461690+0000","last_peered":"2023-08-25T04:45:38.461690+0000","last_clean":"2023-08-25T04:45:38.461690+0000","last_became_active":"2023-08-25T04:45:32.235835+0000","last_became_peered":"2023-08-25T04:45:32.235835+0000","last_unstale":"2023-08-25T04:45:38.461690+0000","last_undegraded":"2023-08-25T04:45:38.461690+0000","last_fullsized":"2023-08-25T04:45:38.461690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:23:28.852339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475699+0000","last_change":"2023-08-25T04:45:33.191163+0000","last_active":"2023-08-25T04:45:39.475699+0000","last_peered":"2023-08-25T04:45:39.475699+0000","last_clean":"2023-08-25T04:45:39.475699+0000","last_became_active":"2023-08-25T04:45:33.190820+0000","last_became_peered":"2023-08-25T04:45:33.190820+0000","last_unstale":"2023-08-25T04:45:39.475699+0000","last_undegraded":"2023-08-25T04:45:39.475699+0000","last_fullsized":"2023-08-25T04:45:39.475699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:47:58.777265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653134+0000","last_change":"2023-08-25T04:45:37.480700+0000","last_active":"2023-08-25T04:45:38.653134+0000","last_peered":"2023-08-25T04:45:38.653134+0000","last_clean":"2023-08-25T04:45:38.653134+0000","last_became_active":"2023-08-25T04:45:37.480204+0000","last_became_peered":"2023-08-25T04:45:37.480204+0000","last_unstale":"2023-08-25T04:45:38.653134+0000","last_undegraded":"2023-08-25T04:45:38.653134+0000","last_fullsized":"2023-08-25T04:45:38.653134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:59.030524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121571+0000","last_change":"2023-08-25T04:45:32.228380+0000","last_active":"2023-08-25T04:45:39.121571+0000","last_peered":"2023-08-25T04:45:39.121571+0000","last_clean":"2023-08-25T04:45:39.121571+0000","last_became_active":"2023-08-25T04:45:32.228067+0000","last_became_peered":"2023-08-25T04:45:32.228067+0000","last_unstale":"2023-08-25T04:45:39.121571+0000","last_undegraded":"2023-08-25T04:45:39.121571+0000","last_fullsized":"2023-08-25T04:45:39.121571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:52.789398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845784+0000","last_change":"2023-08-25T04:45:33.194235+0000","last_active":"2023-08-25T04:45:38.845784+0000","last_peered":"2023-08-25T04:45:38.845784+0000","last_clean":"2023-08-25T04:45:38.845784+0000","last_became_active":"2023-08-25T04:45:33.193947+0000","last_became_peered":"2023-08-25T04:45:33.193947+0000","last_unstale":"2023-08-25T04:45:38.845784+0000","last_undegraded":"2023-08-25T04:45:38.845784+0000","last_fullsized":"2023-08-25T04:45:38.845784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845934+0000","last_change":"2023-08-25T04:45:37.488780+0000","last_active":"2023-08-25T04:45:38.845934+0000","last_peered":"2023-08-25T04:45:38.845934+0000","last_clean":"2023-08-25T04:45:38.845934+0000","last_became_active":"2023-08-25T04:45:37.488413+0000","last_became_peered":"2023-08-25T04:45:37.488413+0000","last_unstale":"2023-08-25T04:45:38.845934+0000","last_undegraded":"2023-08-25T04:45:38.845934+0000","last_fullsized":"2023-08-25T04:45:38.845934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:38.928881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475447+0000","last_change":"2023-08-25T04:45:32.235379+0000","last_active":"2023-08-25T04:45:39.475447+0000","last_peered":"2023-08-25T04:45:39.475447+0000","last_clean":"2023-08-25T04:45:39.475447+0000","last_became_active":"2023-08-25T04:45:32.235070+0000","last_became_peered":"2023-08-25T04:45:32.235070+0000","last_unstale":"2023-08-25T04:45:39.475447+0000","last_undegraded":"2023-08-25T04:45:39.475447+0000","last_fullsized":"2023-08-25T04:45:39.475447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:34:26.267011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653235+0000","last_change":"2023-08-25T04:45:33.181190+0000","last_active":"2023-08-25T04:45:38.653235+0000","last_peered":"2023-08-25T04:45:38.653235+0000","last_clean":"2023-08-25T04:45:38.653235+0000","last_became_active":"2023-08-25T04:45:33.180891+0000","last_became_peered":"2023-08-25T04:45:33.180891+0000","last_unstale":"2023-08-25T04:45:38.653235+0000","last_undegraded":"2023-08-25T04:45:38.653235+0000","last_fullsized":"2023-08-25T04:45:38.653235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:16.907159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652536+0000","last_change":"2023-08-25T04:45:37.480980+0000","last_active":"2023-08-25T04:45:38.652536+0000","last_peered":"2023-08-25T04:45:38.652536+0000","last_clean":"2023-08-25T04:45:38.652536+0000","last_became_active":"2023-08-25T04:45:37.480357+0000","last_became_peered":"2023-08-25T04:45:37.480357+0000","last_unstale":"2023-08-25T04:45:38.652536+0000","last_undegraded":"2023-08-25T04:45:38.652536+0000","last_fullsized":"2023-08-25T04:45:38.652536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:01.442164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845694+0000","last_change":"2023-08-25T04:45:32.242639+0000","last_active":"2023-08-25T04:45:38.845694+0000","last_peered":"2023-08-25T04:45:38.845694+0000","last_clean":"2023-08-25T04:45:38.845694+0000","last_became_active":"2023-08-25T04:45:32.242393+0000","last_became_peered":"2023-08-25T04:45:32.242393+0000","last_unstale":"2023-08-25T04:45:38.845694+0000","last_undegraded":"2023-08-25T04:45:38.845694+0000","last_fullsized":"2023-08-25T04:45:38.845694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:29.089180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475389+0000","last_change":"2023-08-25T04:45:33.190455+0000","last_active":"2023-08-25T04:45:39.475389+0000","last_peered":"2023-08-25T04:45:39.475389+0000","last_clean":"2023-08-25T04:45:39.475389+0000","last_became_active":"2023-08-25T04:45:33.190204+0000","last_became_peered":"2023-08-25T04:45:33.190204+0000","last_unstale":"2023-08-25T04:45:39.475389+0000","last_undegraded":"2023-08-25T04:45:39.475389+0000","last_fullsized":"2023-08-25T04:45:39.475389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:41.739700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475477+0000","last_change":"2023-08-25T04:45:37.495023+0000","last_active":"2023-08-25T04:45:39.475477+0000","last_peered":"2023-08-25T04:45:39.475477+0000","last_clean":"2023-08-25T04:45:39.475477+0000","last_became_active":"2023-08-25T04:45:37.494694+0000","last_became_peered":"2023-08-25T04:45:37.494694+0000","last_unstale":"2023-08-25T04:45:39.475477+0000","last_undegraded":"2023-08-25T04:45:39.475477+0000","last_fullsized":"2023-08-25T04:45:39.475477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:34.327962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460645+0000","last_change":"2023-08-25T04:45:32.239824+0000","last_active":"2023-08-25T04:45:38.460645+0000","last_peered":"2023-08-25T04:45:38.460645+0000","last_clean":"2023-08-25T04:45:38.460645+0000","last_became_active":"2023-08-25T04:45:32.239533+0000","last_became_peered":"2023-08-25T04:45:32.239533+0000","last_unstale":"2023-08-25T04:45:38.460645+0000","last_undegraded":"2023-08-25T04:45:38.460645+0000","last_fullsized":"2023-08-25T04:45:38.460645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:50.517646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475245+0000","last_change":"2023-08-25T04:45:33.178438+0000","last_active":"2023-08-25T04:45:39.475245+0000","last_peered":"2023-08-25T04:45:39.475245+0000","last_clean":"2023-08-25T04:45:39.475245+0000","last_became_active":"2023-08-25T04:45:33.178111+0000","last_became_peered":"2023-08-25T04:45:33.178111+0000","last_unstale":"2023-08-25T04:45:39.475245+0000","last_undegraded":"2023-08-25T04:45:39.475245+0000","last_fullsized":"2023-08-25T04:45:39.475245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:18.567030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476115+0000","last_change":"2023-08-25T04:45:37.491477+0000","last_active":"2023-08-25T04:45:39.476115+0000","last_peered":"2023-08-25T04:45:39.476115+0000","last_clean":"2023-08-25T04:45:39.476115+0000","last_became_active":"2023-08-25T04:45:37.491133+0000","last_became_peered":"2023-08-25T04:45:37.491133+0000","last_unstale":"2023-08-25T04:45:39.476115+0000","last_undegraded":"2023-08-25T04:45:39.476115+0000","last_fullsized":"2023-08-25T04:45:39.476115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:43.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476334+0000","last_change":"2023-08-25T04:45:32.236418+0000","last_active":"2023-08-25T04:45:39.476334+0000","last_peered":"2023-08-25T04:45:39.476334+0000","last_clean":"2023-08-25T04:45:39.476334+0000","last_became_active":"2023-08-25T04:45:32.236098+0000","last_became_peered":"2023-08-25T04:45:32.236098+0000","last_unstale":"2023-08-25T04:45:39.476334+0000","last_undegraded":"2023-08-25T04:45:39.476334+0000","last_fullsized":"2023-08-25T04:45:39.476334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:20.718480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121637+0000","last_change":"2023-08-25T04:45:33.189838+0000","last_active":"2023-08-25T04:45:39.121637+0000","last_peered":"2023-08-25T04:45:39.121637+0000","last_clean":"2023-08-25T04:45:39.121637+0000","last_became_active":"2023-08-25T04:45:33.189477+0000","last_became_peered":"2023-08-25T04:45:33.189477+0000","last_unstale":"2023-08-25T04:45:39.121637+0000","last_undegraded":"2023-08-25T04:45:39.121637+0000","last_fullsized":"2023-08-25T04:45:39.121637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:55.379189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121928+0000","last_change":"2023-08-25T04:45:37.481651+0000","last_active":"2023-08-25T04:45:39.121928+0000","last_peered":"2023-08-25T04:45:39.121928+0000","last_clean":"2023-08-25T04:45:39.121928+0000","last_became_active":"2023-08-25T04:45:37.481302+0000","last_became_peered":"2023-08-25T04:45:37.481302+0000","last_unstale":"2023-08-25T04:45:39.121928+0000","last_undegraded":"2023-08-25T04:45:39.121928+0000","last_fullsized":"2023-08-25T04:45:39.121928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:35.137823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.636391+0000","last_change":"2023-08-25T04:45:32.239434+0000","last_active":"2023-08-25T04:45:48.636391+0000","last_peered":"2023-08-25T04:45:48.636391+0000","last_clean":"2023-08-25T04:45:48.636391+0000","last_became_active":"2023-08-25T04:45:32.239151+0000","last_became_peered":"2023-08-25T04:45:32.239151+0000","last_unstale":"2023-08-25T04:45:48.636391+0000","last_undegraded":"2023-08-25T04:45:48.636391+0000","last_fullsized":"2023-08-25T04:45:48.636391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:58.197133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461057+0000","last_change":"2023-08-25T04:45:33.180869+0000","last_active":"2023-08-25T04:45:38.461057+0000","last_peered":"2023-08-25T04:45:38.461057+0000","last_clean":"2023-08-25T04:45:38.461057+0000","last_became_active":"2023-08-25T04:45:33.180505+0000","last_became_peered":"2023-08-25T04:45:33.180505+0000","last_unstale":"2023-08-25T04:45:38.461057+0000","last_undegraded":"2023-08-25T04:45:38.461057+0000","last_fullsized":"2023-08-25T04:45:38.461057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:35:18.068007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461020+0000","last_change":"2023-08-25T04:45:37.486816+0000","last_active":"2023-08-25T04:45:38.461020+0000","last_peered":"2023-08-25T04:45:38.461020+0000","last_clean":"2023-08-25T04:45:38.461020+0000","last_became_active":"2023-08-25T04:45:37.486420+0000","last_became_peered":"2023-08-25T04:45:37.486420+0000","last_unstale":"2023-08-25T04:45:38.461020+0000","last_undegraded":"2023-08-25T04:45:38.461020+0000","last_fullsized":"2023-08-25T04:45:38.461020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:44.168940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475889+0000","last_change":"2023-08-25T04:45:32.238252+0000","last_active":"2023-08-25T04:45:39.475889+0000","last_peered":"2023-08-25T04:45:39.475889+0000","last_clean":"2023-08-25T04:45:39.475889+0000","last_became_active":"2023-08-25T04:45:32.237891+0000","last_became_peered":"2023-08-25T04:45:32.237891+0000","last_unstale":"2023-08-25T04:45:39.475889+0000","last_undegraded":"2023-08-25T04:45:39.475889+0000","last_fullsized":"2023-08-25T04:45:39.475889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:14.432494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475538+0000","last_change":"2023-08-25T04:45:33.191207+0000","last_active":"2023-08-25T04:45:39.475538+0000","last_peered":"2023-08-25T04:45:39.475538+0000","last_clean":"2023-08-25T04:45:39.475538+0000","last_became_active":"2023-08-25T04:45:33.190881+0000","last_became_peered":"2023-08-25T04:45:33.190881+0000","last_unstale":"2023-08-25T04:45:39.475538+0000","last_undegraded":"2023-08-25T04:45:39.475538+0000","last_fullsized":"2023-08-25T04:45:39.475538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:34.898702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475931+0000","last_change":"2023-08-25T04:45:37.481672+0000","last_active":"2023-08-25T04:45:39.475931+0000","last_peered":"2023-08-25T04:45:39.475931+0000","last_clean":"2023-08-25T04:45:39.475931+0000","last_became_active":"2023-08-25T04:45:37.481257+0000","last_became_peered":"2023-08-25T04:45:37.481257+0000","last_unstale":"2023-08-25T04:45:39.475931+0000","last_undegraded":"2023-08-25T04:45:39.475931+0000","last_fullsized":"2023-08-25T04:45:39.475931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:54:14.466417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845469+0000","last_change":"2023-08-25T04:45:32.239060+0000","last_active":"2023-08-25T04:45:38.845469+0000","last_peered":"2023-08-25T04:45:38.845469+0000","last_clean":"2023-08-25T04:45:38.845469+0000","last_became_active":"2023-08-25T04:45:32.237855+0000","last_became_peered":"2023-08-25T04:45:32.237855+0000","last_unstale":"2023-08-25T04:45:38.845469+0000","last_undegraded":"2023-08-25T04:45:38.845469+0000","last_fullsized":"2023-08-25T04:45:38.845469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:22.321053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460613+0000","last_change":"2023-08-25T04:45:33.179488+0000","last_active":"2023-08-25T04:45:38.460613+0000","last_peered":"2023-08-25T04:45:38.460613+0000","last_clean":"2023-08-25T04:45:38.460613+0000","last_became_active":"2023-08-25T04:45:33.179179+0000","last_became_peered":"2023-08-25T04:45:33.179179+0000","last_unstale":"2023-08-25T04:45:38.460613+0000","last_undegraded":"2023-08-25T04:45:38.460613+0000","last_fullsized":"2023-08-25T04:45:38.460613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:30.091625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476139+0000","last_change":"2023-08-25T04:45:37.490744+0000","last_active":"2023-08-25T04:45:39.476139+0000","last_peered":"2023-08-25T04:45:39.476139+0000","last_clean":"2023-08-25T04:45:39.476139+0000","last_became_active":"2023-08-25T04:45:37.490339+0000","last_became_peered":"2023-08-25T04:45:37.490339+0000","last_unstale":"2023-08-25T04:45:39.476139+0000","last_undegraded":"2023-08-25T04:45:39.476139+0000","last_fullsized":"2023-08-25T04:45:39.476139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:12.857847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475618+0000","last_change":"2023-08-25T04:45:32.237744+0000","last_active":"2023-08-25T04:45:39.475618+0000","last_peered":"2023-08-25T04:45:39.475618+0000","last_clean":"2023-08-25T04:45:39.475618+0000","last_became_active":"2023-08-25T04:45:32.237386+0000","last_became_peered":"2023-08-25T04:45:32.237386+0000","last_unstale":"2023-08-25T04:45:39.475618+0000","last_undegraded":"2023-08-25T04:45:39.475618+0000","last_fullsized":"2023-08-25T04:45:39.475618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:50.517646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.846029+0000","last_change":"2023-08-25T04:45:33.184947+0000","last_active":"2023-08-25T04:45:38.846029+0000","last_peered":"2023-08-25T04:45:38.846029+0000","last_clean":"2023-08-25T04:45:38.846029+0000","last_became_active":"2023-08-25T04:45:33.184665+0000","last_became_peered":"2023-08-25T04:45:33.184665+0000","last_unstale":"2023-08-25T04:45:38.846029+0000","last_undegraded":"2023-08-25T04:45:38.846029+0000","last_fullsized":"2023-08-25T04:45:38.846029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:00.135600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460244+0000","last_change":"2023-08-25T04:45:37.478006+0000","last_active":"2023-08-25T04:45:38.460244+0000","last_peered":"2023-08-25T04:45:38.460244+0000","last_clean":"2023-08-25T04:45:38.460244+0000","last_became_active":"2023-08-25T04:45:37.477688+0000","last_became_peered":"2023-08-25T04:45:37.477688+0000","last_unstale":"2023-08-25T04:45:38.460244+0000","last_undegraded":"2023-08-25T04:45:38.460244+0000","last_fullsized":"2023-08-25T04:45:38.460244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:50.054137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652522+0000","last_change":"2023-08-25T04:45:32.239091+0000","last_active":"2023-08-25T04:45:38.652522+0000","last_peered":"2023-08-25T04:45:38.652522+0000","last_clean":"2023-08-25T04:45:38.652522+0000","last_became_active":"2023-08-25T04:45:32.238782+0000","last_became_peered":"2023-08-25T04:45:32.238782+0000","last_unstale":"2023-08-25T04:45:38.652522+0000","last_undegraded":"2023-08-25T04:45:38.652522+0000","last_fullsized":"2023-08-25T04:45:38.652522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:42.259140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476306+0000","last_change":"2023-08-25T04:45:33.181564+0000","last_active":"2023-08-25T04:45:39.476306+0000","last_peered":"2023-08-25T04:45:39.476306+0000","last_clean":"2023-08-25T04:45:39.476306+0000","last_became_active":"2023-08-25T04:45:33.181312+0000","last_became_peered":"2023-08-25T04:45:33.181312+0000","last_unstale":"2023-08-25T04:45:39.476306+0000","last_undegraded":"2023-08-25T04:45:39.476306+0000","last_fullsized":"2023-08-25T04:45:39.476306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:37.480877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476370+0000","last_change":"2023-08-25T04:45:37.488909+0000","last_active":"2023-08-25T04:45:39.476370+0000","last_peered":"2023-08-25T04:45:39.476370+0000","last_clean":"2023-08-25T04:45:39.476370+0000","last_became_active":"2023-08-25T04:45:37.488338+0000","last_became_peered":"2023-08-25T04:45:37.488338+0000","last_unstale":"2023-08-25T04:45:39.476370+0000","last_undegraded":"2023-08-25T04:45:39.476370+0000","last_fullsized":"2023-08-25T04:45:39.476370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:30.680527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476509+0000","last_change":"2023-08-25T04:45:32.237964+0000","last_active":"2023-08-25T04:45:39.476509+0000","last_peered":"2023-08-25T04:45:39.476509+0000","last_clean":"2023-08-25T04:45:39.476509+0000","last_became_active":"2023-08-25T04:45:32.237542+0000","last_became_peered":"2023-08-25T04:45:32.237542+0000","last_unstale":"2023-08-25T04:45:39.476509+0000","last_undegraded":"2023-08-25T04:45:39.476509+0000","last_fullsized":"2023-08-25T04:45:39.476509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:31:55.456937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459530+0000","last_change":"2023-08-25T04:45:33.192515+0000","last_active":"2023-08-25T04:45:38.459530+0000","last_peered":"2023-08-25T04:45:38.459530+0000","last_clean":"2023-08-25T04:45:38.459530+0000","last_became_active":"2023-08-25T04:45:33.192143+0000","last_became_peered":"2023-08-25T04:45:33.192143+0000","last_unstale":"2023-08-25T04:45:38.459530+0000","last_undegraded":"2023-08-25T04:45:38.459530+0000","last_fullsized":"2023-08-25T04:45:38.459530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:30.901486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459477+0000","last_change":"2023-08-25T04:45:37.488063+0000","last_active":"2023-08-25T04:45:38.459477+0000","last_peered":"2023-08-25T04:45:38.459477+0000","last_clean":"2023-08-25T04:45:38.459477+0000","last_became_active":"2023-08-25T04:45:37.487757+0000","last_became_peered":"2023-08-25T04:45:37.487757+0000","last_unstale":"2023-08-25T04:45:38.459477+0000","last_undegraded":"2023-08-25T04:45:38.459477+0000","last_fullsized":"2023-08-25T04:45:38.459477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:09.769950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476402+0000","last_change":"2023-08-25T04:45:32.237033+0000","last_active":"2023-08-25T04:45:39.476402+0000","last_peered":"2023-08-25T04:45:39.476402+0000","last_clean":"2023-08-25T04:45:39.476402+0000","last_became_active":"2023-08-25T04:45:32.236722+0000","last_became_peered":"2023-08-25T04:45:32.236722+0000","last_unstale":"2023-08-25T04:45:39.476402+0000","last_undegraded":"2023-08-25T04:45:39.476402+0000","last_fullsized":"2023-08-25T04:45:39.476402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:40.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461087+0000","last_change":"2023-08-25T04:45:33.173339+0000","last_active":"2023-08-25T04:45:38.461087+0000","last_peered":"2023-08-25T04:45:38.461087+0000","last_clean":"2023-08-25T04:45:38.461087+0000","last_became_active":"2023-08-25T04:45:33.173001+0000","last_became_peered":"2023-08-25T04:45:33.173001+0000","last_unstale":"2023-08-25T04:45:38.461087+0000","last_undegraded":"2023-08-25T04:45:38.461087+0000","last_fullsized":"2023-08-25T04:45:38.461087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:40.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459839+0000","last_change":"2023-08-25T04:45:37.492765+0000","last_active":"2023-08-25T04:45:38.459839+0000","last_peered":"2023-08-25T04:45:38.459839+0000","last_clean":"2023-08-25T04:45:38.459839+0000","last_became_active":"2023-08-25T04:45:37.492429+0000","last_became_peered":"2023-08-25T04:45:37.492429+0000","last_unstale":"2023-08-25T04:45:38.459839+0000","last_undegraded":"2023-08-25T04:45:38.459839+0000","last_fullsized":"2023-08-25T04:45:38.459839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:19:28.095175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476148+0000","last_change":"2023-08-25T04:45:32.240462+0000","last_active":"2023-08-25T04:45:39.476148+0000","last_peered":"2023-08-25T04:45:39.476148+0000","last_clean":"2023-08-25T04:45:39.476148+0000","last_became_active":"2023-08-25T04:45:32.240196+0000","last_became_peered":"2023-08-25T04:45:32.240196+0000","last_unstale":"2023-08-25T04:45:39.476148+0000","last_undegraded":"2023-08-25T04:45:39.476148+0000","last_fullsized":"2023-08-25T04:45:39.476148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:17.564585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652550+0000","last_change":"2023-08-25T04:45:33.193608+0000","last_active":"2023-08-25T04:45:38.652550+0000","last_peered":"2023-08-25T04:45:38.652550+0000","last_clean":"2023-08-25T04:45:38.652550+0000","last_became_active":"2023-08-25T04:45:33.193118+0000","last_became_peered":"2023-08-25T04:45:33.193118+0000","last_unstale":"2023-08-25T04:45:38.652550+0000","last_undegraded":"2023-08-25T04:45:38.652550+0000","last_fullsized":"2023-08-25T04:45:38.652550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:32.968362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459765+0000","last_change":"2023-08-25T04:45:37.476345+0000","last_active":"2023-08-25T04:45:38.459765+0000","last_peered":"2023-08-25T04:45:38.459765+0000","last_clean":"2023-08-25T04:45:38.459765+0000","last_became_active":"2023-08-25T04:45:37.475874+0000","last_became_peered":"2023-08-25T04:45:37.475874+0000","last_unstale":"2023-08-25T04:45:38.459765+0000","last_undegraded":"2023-08-25T04:45:38.459765+0000","last_fullsized":"2023-08-25T04:45:38.459765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:00:54.571481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460487+0000","last_change":"2023-08-25T04:45:32.233694+0000","last_active":"2023-08-25T04:45:38.460487+0000","last_peered":"2023-08-25T04:45:38.460487+0000","last_clean":"2023-08-25T04:45:38.460487+0000","last_became_active":"2023-08-25T04:45:32.233412+0000","last_became_peered":"2023-08-25T04:45:32.233412+0000","last_unstale":"2023-08-25T04:45:38.460487+0000","last_undegraded":"2023-08-25T04:45:38.460487+0000","last_fullsized":"2023-08-25T04:45:38.460487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:29.595483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845836+0000","last_change":"2023-08-25T04:45:33.186227+0000","last_active":"2023-08-25T04:45:38.845836+0000","last_peered":"2023-08-25T04:45:38.845836+0000","last_clean":"2023-08-25T04:45:38.845836+0000","last_became_active":"2023-08-25T04:45:33.185317+0000","last_became_peered":"2023-08-25T04:45:33.185317+0000","last_unstale":"2023-08-25T04:45:38.845836+0000","last_undegraded":"2023-08-25T04:45:38.845836+0000","last_fullsized":"2023-08-25T04:45:38.845836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:39.932603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459653+0000","last_change":"2023-08-25T04:45:37.481516+0000","last_active":"2023-08-25T04:45:38.459653+0000","last_peered":"2023-08-25T04:45:38.459653+0000","last_clean":"2023-08-25T04:45:38.459653+0000","last_became_active":"2023-08-25T04:45:37.481121+0000","last_became_peered":"2023-08-25T04:45:37.481121+0000","last_unstale":"2023-08-25T04:45:38.459653+0000","last_undegraded":"2023-08-25T04:45:38.459653+0000","last_fullsized":"2023-08-25T04:45:38.459653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:26:41.512610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475607+0000","last_change":"2023-08-25T04:45:32.238750+0000","last_active":"2023-08-25T04:45:39.475607+0000","last_peered":"2023-08-25T04:45:39.475607+0000","last_clean":"2023-08-25T04:45:39.475607+0000","last_became_active":"2023-08-25T04:45:32.238446+0000","last_became_peered":"2023-08-25T04:45:32.238446+0000","last_unstale":"2023-08-25T04:45:39.475607+0000","last_undegraded":"2023-08-25T04:45:39.475607+0000","last_fullsized":"2023-08-25T04:45:39.475607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:09.729389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461964+0000","last_change":"2023-08-25T04:45:33.181796+0000","last_active":"2023-08-25T04:45:38.461964+0000","last_peered":"2023-08-25T04:45:38.461964+0000","last_clean":"2023-08-25T04:45:38.461964+0000","last_became_active":"2023-08-25T04:45:33.180064+0000","last_became_peered":"2023-08-25T04:45:33.180064+0000","last_unstale":"2023-08-25T04:45:38.461964+0000","last_undegraded":"2023-08-25T04:45:38.461964+0000","last_fullsized":"2023-08-25T04:45:38.461964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:00:02.188322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122491+0000","last_change":"2023-08-25T04:45:37.483736+0000","last_active":"2023-08-25T04:45:39.122491+0000","last_peered":"2023-08-25T04:45:39.122491+0000","last_clean":"2023-08-25T04:45:39.122491+0000","last_became_active":"2023-08-25T04:45:37.483361+0000","last_became_peered":"2023-08-25T04:45:37.483361+0000","last_unstale":"2023-08-25T04:45:39.122491+0000","last_undegraded":"2023-08-25T04:45:39.122491+0000","last_fullsized":"2023-08-25T04:45:39.122491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:19.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652579+0000","last_change":"2023-08-25T04:45:32.238540+0000","last_active":"2023-08-25T04:45:38.652579+0000","last_peered":"2023-08-25T04:45:38.652579+0000","last_clean":"2023-08-25T04:45:38.652579+0000","last_became_active":"2023-08-25T04:45:32.238265+0000","last_became_peered":"2023-08-25T04:45:32.238265+0000","last_unstale":"2023-08-25T04:45:38.652579+0000","last_undegraded":"2023-08-25T04:45:38.652579+0000","last_fullsized":"2023-08-25T04:45:38.652579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:29:01.273137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460742+0000","last_change":"2023-08-25T04:45:33.184042+0000","last_active":"2023-08-25T04:45:38.460742+0000","last_peered":"2023-08-25T04:45:38.460742+0000","last_clean":"2023-08-25T04:45:38.460742+0000","last_became_active":"2023-08-25T04:45:33.183680+0000","last_became_peered":"2023-08-25T04:45:33.183680+0000","last_unstale":"2023-08-25T04:45:38.460742+0000","last_undegraded":"2023-08-25T04:45:38.460742+0000","last_fullsized":"2023-08-25T04:45:38.460742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:39.595770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460726+0000","last_change":"2023-08-25T04:45:37.476840+0000","last_active":"2023-08-25T04:45:38.460726+0000","last_peered":"2023-08-25T04:45:38.460726+0000","last_clean":"2023-08-25T04:45:38.460726+0000","last_became_active":"2023-08-25T04:45:37.476291+0000","last_became_peered":"2023-08-25T04:45:37.476291+0000","last_unstale":"2023-08-25T04:45:38.460726+0000","last_undegraded":"2023-08-25T04:45:38.460726+0000","last_fullsized":"2023-08-25T04:45:38.460726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:45.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460720+0000","last_change":"2023-08-25T04:45:32.235065+0000","last_active":"2023-08-25T04:45:38.460720+0000","last_peered":"2023-08-25T04:45:38.460720+0000","last_clean":"2023-08-25T04:45:38.460720+0000","last_became_active":"2023-08-25T04:45:32.234777+0000","last_became_peered":"2023-08-25T04:45:32.234777+0000","last_unstale":"2023-08-25T04:45:38.460720+0000","last_undegraded":"2023-08-25T04:45:38.460720+0000","last_fullsized":"2023-08-25T04:45:38.460720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:01.625394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461475+0000","last_change":"2023-08-25T04:45:33.179314+0000","last_active":"2023-08-25T04:45:38.461475+0000","last_peered":"2023-08-25T04:45:38.461475+0000","last_clean":"2023-08-25T04:45:38.461475+0000","last_became_active":"2023-08-25T04:45:33.178995+0000","last_became_peered":"2023-08-25T04:45:33.178995+0000","last_unstale":"2023-08-25T04:45:38.461475+0000","last_undegraded":"2023-08-25T04:45:38.461475+0000","last_fullsized":"2023-08-25T04:45:38.461475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:48:01.925682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461005+0000","last_change":"2023-08-25T04:45:37.490254+0000","last_active":"2023-08-25T04:45:38.461005+0000","last_peered":"2023-08-25T04:45:38.461005+0000","last_clean":"2023-08-25T04:45:38.461005+0000","last_became_active":"2023-08-25T04:45:37.489836+0000","last_became_peered":"2023-08-25T04:45:37.489836+0000","last_unstale":"2023-08-25T04:45:38.461005+0000","last_undegraded":"2023-08-25T04:45:38.461005+0000","last_fullsized":"2023-08-25T04:45:38.461005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:41.717214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475327+0000","last_change":"2023-08-25T04:45:32.230980+0000","last_active":"2023-08-25T04:45:39.475327+0000","last_peered":"2023-08-25T04:45:39.475327+0000","last_clean":"2023-08-25T04:45:39.475327+0000","last_became_active":"2023-08-25T04:45:32.230712+0000","last_became_peered":"2023-08-25T04:45:32.230712+0000","last_unstale":"2023-08-25T04:45:39.475327+0000","last_undegraded":"2023-08-25T04:45:39.475327+0000","last_fullsized":"2023-08-25T04:45:39.475327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:20.718480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122672+0000","last_change":"2023-08-25T04:45:33.182453+0000","last_active":"2023-08-25T04:45:39.122672+0000","last_peered":"2023-08-25T04:45:39.122672+0000","last_clean":"2023-08-25T04:45:39.122672+0000","last_became_active":"2023-08-25T04:45:33.182169+0000","last_became_peered":"2023-08-25T04:45:33.182169+0000","last_unstale":"2023-08-25T04:45:39.122672+0000","last_undegraded":"2023-08-25T04:45:39.122672+0000","last_fullsized":"2023-08-25T04:45:39.122672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:30.597928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461232+0000","last_change":"2023-08-25T04:45:37.483595+0000","last_active":"2023-08-25T04:45:38.461232+0000","last_peered":"2023-08-25T04:45:38.461232+0000","last_clean":"2023-08-25T04:45:38.461232+0000","last_became_active":"2023-08-25T04:45:37.483087+0000","last_became_peered":"2023-08-25T04:45:37.483087+0000","last_unstale":"2023-08-25T04:45:38.461232+0000","last_undegraded":"2023-08-25T04:45:38.461232+0000","last_fullsized":"2023-08-25T04:45:38.461232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:11:09.671424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476157+0000","last_change":"2023-08-25T04:45:32.237401+0000","last_active":"2023-08-25T04:45:39.476157+0000","last_peered":"2023-08-25T04:45:39.476157+0000","last_clean":"2023-08-25T04:45:39.476157+0000","last_became_active":"2023-08-25T04:45:32.237147+0000","last_became_peered":"2023-08-25T04:45:32.237147+0000","last_unstale":"2023-08-25T04:45:39.476157+0000","last_undegraded":"2023-08-25T04:45:39.476157+0000","last_fullsized":"2023-08-25T04:45:39.476157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:20.177142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460896+0000","last_change":"2023-08-25T04:45:26.770775+0000","last_active":"2023-08-25T04:45:38.460896+0000","last_peered":"2023-08-25T04:45:38.460896+0000","last_clean":"2023-08-25T04:45:38.460896+0000","last_became_active":"2023-08-25T04:45:26.770447+0000","last_became_peered":"2023-08-25T04:45:26.770447+0000","last_unstale":"2023-08-25T04:45:38.460896+0000","last_undegraded":"2023-08-25T04:45:38.460896+0000","last_fullsized":"2023-08-25T04:45:38.460896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:02.164906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475251+0000","last_change":"2023-08-25T04:45:33.180113+0000","last_active":"2023-08-25T04:45:39.475251+0000","last_peered":"2023-08-25T04:45:39.475251+0000","last_clean":"2023-08-25T04:45:39.475251+0000","last_became_active":"2023-08-25T04:45:33.179859+0000","last_became_peered":"2023-08-25T04:45:33.179859+0000","last_unstale":"2023-08-25T04:45:39.475251+0000","last_undegraded":"2023-08-25T04:45:39.475251+0000","last_fullsized":"2023-08-25T04:45:39.475251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:26.444190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475239+0000","last_change":"2023-08-25T04:45:37.483731+0000","last_active":"2023-08-25T04:45:39.475239+0000","last_peered":"2023-08-25T04:45:39.475239+0000","last_clean":"2023-08-25T04:45:39.475239+0000","last_became_active":"2023-08-25T04:45:37.483367+0000","last_became_peered":"2023-08-25T04:45:37.483367+0000","last_unstale":"2023-08-25T04:45:39.475239+0000","last_undegraded":"2023-08-25T04:45:39.475239+0000","last_fullsized":"2023-08-25T04:45:39.475239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:04.371937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475657+0000","last_change":"2023-08-25T04:45:26.768222+0000","last_active":"2023-08-25T04:45:39.475657+0000","last_peered":"2023-08-25T04:45:39.475657+0000","last_clean":"2023-08-25T04:45:39.475657+0000","last_became_active":"2023-08-25T04:45:26.767875+0000","last_became_peered":"2023-08-25T04:45:26.767875+0000","last_unstale":"2023-08-25T04:45:39.475657+0000","last_undegraded":"2023-08-25T04:45:39.475657+0000","last_fullsized":"2023-08-25T04:45:39.475657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:31:22.454559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845648+0000","last_change":"2023-08-25T04:45:32.238276+0000","last_active":"2023-08-25T04:45:38.845648+0000","last_peered":"2023-08-25T04:45:38.845648+0000","last_clean":"2023-08-25T04:45:38.845648+0000","last_became_active":"2023-08-25T04:45:32.237881+0000","last_became_peered":"2023-08-25T04:45:32.237881+0000","last_unstale":"2023-08-25T04:45:38.845648+0000","last_undegraded":"2023-08-25T04:45:38.845648+0000","last_fullsized":"2023-08-25T04:45:38.845648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:49.755802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460946+0000","last_change":"2023-08-25T04:45:33.175073+0000","last_active":"2023-08-25T04:45:38.460946+0000","last_peered":"2023-08-25T04:45:38.460946+0000","last_clean":"2023-08-25T04:45:38.460946+0000","last_became_active":"2023-08-25T04:45:33.174739+0000","last_became_peered":"2023-08-25T04:45:33.174739+0000","last_unstale":"2023-08-25T04:45:38.460946+0000","last_undegraded":"2023-08-25T04:45:38.460946+0000","last_fullsized":"2023-08-25T04:45:38.460946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:21.179587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460451+0000","last_change":"2023-08-25T04:45:37.491239+0000","last_active":"2023-08-25T04:45:38.460451+0000","last_peered":"2023-08-25T04:45:38.460451+0000","last_clean":"2023-08-25T04:45:38.460451+0000","last_became_active":"2023-08-25T04:45:37.490902+0000","last_became_peered":"2023-08-25T04:45:37.490902+0000","last_unstale":"2023-08-25T04:45:38.460451+0000","last_undegraded":"2023-08-25T04:45:38.460451+0000","last_fullsized":"2023-08-25T04:45:38.460451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:27.559835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122041+0000","last_change":"2023-08-25T04:45:26.767948+0000","last_active":"2023-08-25T04:45:39.122041+0000","last_peered":"2023-08-25T04:45:39.122041+0000","last_clean":"2023-08-25T04:45:39.122041+0000","last_became_active":"2023-08-25T04:45:26.767496+0000","last_became_peered":"2023-08-25T04:45:26.767496+0000","last_unstale":"2023-08-25T04:45:39.122041+0000","last_undegraded":"2023-08-25T04:45:39.122041+0000","last_fullsized":"2023-08-25T04:45:39.122041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:13.795305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475898+0000","last_change":"2023-08-25T04:45:27.771979+0000","last_active":"2023-08-25T04:45:39.475898+0000","last_peered":"2023-08-25T04:45:39.475898+0000","last_clean":"2023-08-25T04:45:39.475898+0000","last_became_active":"2023-08-25T04:45:27.770968+0000","last_became_peered":"2023-08-25T04:45:27.770968+0000","last_unstale":"2023-08-25T04:45:39.475898+0000","last_undegraded":"2023-08-25T04:45:39.475898+0000","last_fullsized":"2023-08-25T04:45:39.475898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_clean_scrub_stamp":"2023-08-25T04:45:26.752521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:46.377207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845326+0000","last_change":"2023-08-25T04:45:32.242202+0000","last_active":"2023-08-25T04:45:38.845326+0000","last_peered":"2023-08-25T04:45:38.845326+0000","last_clean":"2023-08-25T04:45:38.845326+0000","last_became_active":"2023-08-25T04:45:32.241904+0000","last_became_peered":"2023-08-25T04:45:32.241904+0000","last_unstale":"2023-08-25T04:45:38.845326+0000","last_undegraded":"2023-08-25T04:45:38.845326+0000","last_fullsized":"2023-08-25T04:45:38.845326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:49.404002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845976+0000","last_change":"2023-08-25T04:45:33.187739+0000","last_active":"2023-08-25T04:45:38.845976+0000","last_peered":"2023-08-25T04:45:38.845976+0000","last_clean":"2023-08-25T04:45:38.845976+0000","last_became_active":"2023-08-25T04:45:33.186521+0000","last_became_peered":"2023-08-25T04:45:33.186521+0000","last_unstale":"2023-08-25T04:45:38.845976+0000","last_undegraded":"2023-08-25T04:45:38.845976+0000","last_fullsized":"2023-08-25T04:45:38.845976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:51.831184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460199+0000","last_change":"2023-08-25T04:45:37.488145+0000","last_active":"2023-08-25T04:45:38.460199+0000","last_peered":"2023-08-25T04:45:38.460199+0000","last_clean":"2023-08-25T04:45:38.460199+0000","last_became_active":"2023-08-25T04:45:37.487669+0000","last_became_peered":"2023-08-25T04:45:37.487669+0000","last_unstale":"2023-08-25T04:45:38.460199+0000","last_undegraded":"2023-08-25T04:45:38.460199+0000","last_fullsized":"2023-08-25T04:45:38.460199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:16.119177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475782+0000","last_change":"2023-08-25T04:45:26.807286+0000","last_active":"2023-08-25T04:45:39.475782+0000","last_peered":"2023-08-25T04:45:39.475782+0000","last_clean":"2023-08-25T04:45:39.475782+0000","last_became_active":"2023-08-25T04:45:26.806698+0000","last_became_peered":"2023-08-25T04:45:26.806698+0000","last_unstale":"2023-08-25T04:45:39.475782+0000","last_undegraded":"2023-08-25T04:45:39.475782+0000","last_fullsized":"2023-08-25T04:45:39.475782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:28.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121731+0000","last_change":"2023-08-25T04:45:32.233634+0000","last_active":"2023-08-25T04:45:39.121731+0000","last_peered":"2023-08-25T04:45:39.121731+0000","last_clean":"2023-08-25T04:45:39.121731+0000","last_became_active":"2023-08-25T04:45:32.233114+0000","last_became_peered":"2023-08-25T04:45:32.233114+0000","last_unstale":"2023-08-25T04:45:39.121731+0000","last_undegraded":"2023-08-25T04:45:39.121731+0000","last_fullsized":"2023-08-25T04:45:39.121731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:41:01.219246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122577+0000","last_change":"2023-08-25T04:45:33.176186+0000","last_active":"2023-08-25T04:45:39.122577+0000","last_peered":"2023-08-25T04:45:39.122577+0000","last_clean":"2023-08-25T04:45:39.122577+0000","last_became_active":"2023-08-25T04:45:33.175948+0000","last_became_peered":"2023-08-25T04:45:33.175948+0000","last_unstale":"2023-08-25T04:45:39.122577+0000","last_undegraded":"2023-08-25T04:45:39.122577+0000","last_fullsized":"2023-08-25T04:45:39.122577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:23.323498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476087+0000","last_change":"2023-08-25T04:45:37.488913+0000","last_active":"2023-08-25T04:45:39.476087+0000","last_peered":"2023-08-25T04:45:39.476087+0000","last_clean":"2023-08-25T04:45:39.476087+0000","last_became_active":"2023-08-25T04:45:37.488517+0000","last_became_peered":"2023-08-25T04:45:37.488517+0000","last_unstale":"2023-08-25T04:45:39.476087+0000","last_undegraded":"2023-08-25T04:45:39.476087+0000","last_fullsized":"2023-08-25T04:45:39.476087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:56.688517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475596+0000","last_change":"2023-08-25T04:45:26.807096+0000","last_active":"2023-08-25T04:45:39.475596+0000","last_peered":"2023-08-25T04:45:39.475596+0000","last_clean":"2023-08-25T04:45:39.475596+0000","last_became_active":"2023-08-25T04:45:26.806713+0000","last_became_peered":"2023-08-25T04:45:26.806713+0000","last_unstale":"2023-08-25T04:45:39.475596+0000","last_undegraded":"2023-08-25T04:45:39.475596+0000","last_fullsized":"2023-08-25T04:45:39.475596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:35.196391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475423+0000","last_change":"2023-08-25T04:45:32.228181+0000","last_active":"2023-08-25T04:45:39.475423+0000","last_peered":"2023-08-25T04:45:39.475423+0000","last_clean":"2023-08-25T04:45:39.475423+0000","last_became_active":"2023-08-25T04:45:32.227866+0000","last_became_peered":"2023-08-25T04:45:32.227866+0000","last_unstale":"2023-08-25T04:45:39.475423+0000","last_undegraded":"2023-08-25T04:45:39.475423+0000","last_fullsized":"2023-08-25T04:45:39.475423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:11.034422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653005+0000","last_change":"2023-08-25T04:45:33.189112+0000","last_active":"2023-08-25T04:45:38.653005+0000","last_peered":"2023-08-25T04:45:38.653005+0000","last_clean":"2023-08-25T04:45:38.653005+0000","last_became_active":"2023-08-25T04:45:33.188826+0000","last_became_peered":"2023-08-25T04:45:33.188826+0000","last_unstale":"2023-08-25T04:45:38.653005+0000","last_undegraded":"2023-08-25T04:45:38.653005+0000","last_fullsized":"2023-08-25T04:45:38.653005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:37.230837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845808+0000","last_change":"2023-08-25T04:45:37.484004+0000","last_active":"2023-08-25T04:45:38.845808+0000","last_peered":"2023-08-25T04:45:38.845808+0000","last_clean":"2023-08-25T04:45:38.845808+0000","last_became_active":"2023-08-25T04:45:37.483640+0000","last_became_peered":"2023-08-25T04:45:37.483640+0000","last_unstale":"2023-08-25T04:45:38.845808+0000","last_undegraded":"2023-08-25T04:45:38.845808+0000","last_fullsized":"2023-08-25T04:45:38.845808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:55.756428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459530+0000","last_change":"2023-08-25T04:45:26.807065+0000","last_active":"2023-08-25T04:45:38.459530+0000","last_peered":"2023-08-25T04:45:38.459530+0000","last_clean":"2023-08-25T04:45:38.459530+0000","last_became_active":"2023-08-25T04:45:26.806737+0000","last_became_peered":"2023-08-25T04:45:26.806737+0000","last_unstale":"2023-08-25T04:45:38.459530+0000","last_undegraded":"2023-08-25T04:45:38.459530+0000","last_fullsized":"2023-08-25T04:45:38.459530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:11.279650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461215+0000","last_change":"2023-08-25T04:45:32.243699+0000","last_active":"2023-08-25T04:45:38.461215+0000","last_peered":"2023-08-25T04:45:38.461215+0000","last_clean":"2023-08-25T04:45:38.461215+0000","last_became_active":"2023-08-25T04:45:32.243274+0000","last_became_peered":"2023-08-25T04:45:32.243274+0000","last_unstale":"2023-08-25T04:45:38.461215+0000","last_undegraded":"2023-08-25T04:45:38.461215+0000","last_fullsized":"2023-08-25T04:45:38.461215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:24.791647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121774+0000","last_change":"2023-08-25T04:45:33.168891+0000","last_active":"2023-08-25T04:45:39.121774+0000","last_peered":"2023-08-25T04:45:39.121774+0000","last_clean":"2023-08-25T04:45:39.121774+0000","last_became_active":"2023-08-25T04:45:33.168678+0000","last_became_peered":"2023-08-25T04:45:33.168678+0000","last_unstale":"2023-08-25T04:45:39.121774+0000","last_undegraded":"2023-08-25T04:45:39.121774+0000","last_fullsized":"2023-08-25T04:45:39.121774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:33:22.522440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653080+0000","last_change":"2023-08-25T04:45:37.485021+0000","last_active":"2023-08-25T04:45:38.653080+0000","last_peered":"2023-08-25T04:45:38.653080+0000","last_clean":"2023-08-25T04:45:38.653080+0000","last_became_active":"2023-08-25T04:45:37.484610+0000","last_became_peered":"2023-08-25T04:45:37.484610+0000","last_unstale":"2023-08-25T04:45:38.653080+0000","last_undegraded":"2023-08-25T04:45:38.653080+0000","last_fullsized":"2023-08-25T04:45:38.653080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:10.974671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653028+0000","last_change":"2023-08-25T04:45:26.807090+0000","last_active":"2023-08-25T04:45:38.653028+0000","last_peered":"2023-08-25T04:45:38.653028+0000","last_clean":"2023-08-25T04:45:38.653028+0000","last_became_active":"2023-08-25T04:45:26.806685+0000","last_became_peered":"2023-08-25T04:45:26.806685+0000","last_unstale":"2023-08-25T04:45:38.653028+0000","last_undegraded":"2023-08-25T04:45:38.653028+0000","last_fullsized":"2023-08-25T04:45:38.653028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:15.681823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121905+0000","last_change":"2023-08-25T04:45:32.233460+0000","last_active":"2023-08-25T04:45:39.121905+0000","last_peered":"2023-08-25T04:45:39.121905+0000","last_clean":"2023-08-25T04:45:39.121905+0000","last_became_active":"2023-08-25T04:45:32.233102+0000","last_became_peered":"2023-08-25T04:45:32.233102+0000","last_unstale":"2023-08-25T04:45:39.121905+0000","last_undegraded":"2023-08-25T04:45:39.121905+0000","last_fullsized":"2023-08-25T04:45:39.121905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:32.845760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845981+0000","last_change":"2023-08-25T04:45:33.177772+0000","last_active":"2023-08-25T04:45:38.845981+0000","last_peered":"2023-08-25T04:45:38.845981+0000","last_clean":"2023-08-25T04:45:38.845981+0000","last_became_active":"2023-08-25T04:45:33.177547+0000","last_became_peered":"2023-08-25T04:45:33.177547+0000","last_unstale":"2023-08-25T04:45:38.845981+0000","last_undegraded":"2023-08-25T04:45:38.845981+0000","last_fullsized":"2023-08-25T04:45:38.845981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:52.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845774+0000","last_change":"2023-08-25T04:45:37.490313+0000","last_active":"2023-08-25T04:45:38.845774+0000","last_peered":"2023-08-25T04:45:38.845774+0000","last_clean":"2023-08-25T04:45:38.845774+0000","last_became_active":"2023-08-25T04:45:37.489828+0000","last_became_peered":"2023-08-25T04:45:37.489828+0000","last_unstale":"2023-08-25T04:45:38.845774+0000","last_undegraded":"2023-08-25T04:45:38.845774+0000","last_fullsized":"2023-08-25T04:45:38.845774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:45.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653039+0000","last_change":"2023-08-25T04:45:26.768150+0000","last_active":"2023-08-25T04:45:38.653039+0000","last_peered":"2023-08-25T04:45:38.653039+0000","last_clean":"2023-08-25T04:45:38.653039+0000","last_became_active":"2023-08-25T04:45:26.767845+0000","last_became_peered":"2023-08-25T04:45:26.767845+0000","last_unstale":"2023-08-25T04:45:38.653039+0000","last_undegraded":"2023-08-25T04:45:38.653039+0000","last_fullsized":"2023-08-25T04:45:38.653039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:42.888555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460497+0000","last_change":"2023-08-25T04:45:32.235113+0000","last_active":"2023-08-25T04:45:38.460497+0000","last_peered":"2023-08-25T04:45:38.460497+0000","last_clean":"2023-08-25T04:45:38.460497+0000","last_became_active":"2023-08-25T04:45:32.234769+0000","last_became_peered":"2023-08-25T04:45:32.234769+0000","last_unstale":"2023-08-25T04:45:38.460497+0000","last_undegraded":"2023-08-25T04:45:38.460497+0000","last_fullsized":"2023-08-25T04:45:38.460497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:04.089871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121833+0000","last_change":"2023-08-25T04:45:33.176251+0000","last_active":"2023-08-25T04:45:39.121833+0000","last_peered":"2023-08-25T04:45:39.121833+0000","last_clean":"2023-08-25T04:45:39.121833+0000","last_became_active":"2023-08-25T04:45:33.175905+0000","last_became_peered":"2023-08-25T04:45:33.175905+0000","last_unstale":"2023-08-25T04:45:39.121833+0000","last_undegraded":"2023-08-25T04:45:39.121833+0000","last_fullsized":"2023-08-25T04:45:39.121833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:17.736254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122068+0000","last_change":"2023-08-25T04:45:37.490783+0000","last_active":"2023-08-25T04:45:39.122068+0000","last_peered":"2023-08-25T04:45:39.122068+0000","last_clean":"2023-08-25T04:45:39.122068+0000","last_became_active":"2023-08-25T04:45:37.490007+0000","last_became_peered":"2023-08-25T04:45:37.490007+0000","last_unstale":"2023-08-25T04:45:39.122068+0000","last_undegraded":"2023-08-25T04:45:39.122068+0000","last_fullsized":"2023-08-25T04:45:39.122068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:50.054137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845866+0000","last_change":"2023-08-25T04:45:32.242734+0000","last_active":"2023-08-25T04:45:38.845866+0000","last_peered":"2023-08-25T04:45:38.845866+0000","last_clean":"2023-08-25T04:45:38.845866+0000","last_became_active":"2023-08-25T04:45:32.241971+0000","last_became_peered":"2023-08-25T04:45:32.241971+0000","last_unstale":"2023-08-25T04:45:38.845866+0000","last_undegraded":"2023-08-25T04:45:38.845866+0000","last_fullsized":"2023-08-25T04:45:38.845866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:17:09.408135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459937+0000","last_change":"2023-08-25T04:45:33.173345+0000","last_active":"2023-08-25T04:45:38.459937+0000","last_peered":"2023-08-25T04:45:38.459937+0000","last_clean":"2023-08-25T04:45:38.459937+0000","last_became_active":"2023-08-25T04:45:33.173020+0000","last_became_peered":"2023-08-25T04:45:33.173020+0000","last_unstale":"2023-08-25T04:45:38.459937+0000","last_undegraded":"2023-08-25T04:45:38.459937+0000","last_fullsized":"2023-08-25T04:45:38.459937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:25:18.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475713+0000","last_change":"2023-08-25T04:45:37.489214+0000","last_active":"2023-08-25T04:45:39.475713+0000","last_peered":"2023-08-25T04:45:39.475713+0000","last_clean":"2023-08-25T04:45:39.475713+0000","last_became_active":"2023-08-25T04:45:37.488142+0000","last_became_peered":"2023-08-25T04:45:37.488142+0000","last_unstale":"2023-08-25T04:45:39.475713+0000","last_undegraded":"2023-08-25T04:45:39.475713+0000","last_fullsized":"2023-08-25T04:45:39.475713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:44.168940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460273+0000","last_change":"2023-08-25T04:45:32.237652+0000","last_active":"2023-08-25T04:45:38.460273+0000","last_peered":"2023-08-25T04:45:38.460273+0000","last_clean":"2023-08-25T04:45:38.460273+0000","last_became_active":"2023-08-25T04:45:32.237377+0000","last_became_peered":"2023-08-25T04:45:32.237377+0000","last_unstale":"2023-08-25T04:45:38.460273+0000","last_undegraded":"2023-08-25T04:45:38.460273+0000","last_fullsized":"2023-08-25T04:45:38.460273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:49.404002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461705+0000","last_change":"2023-08-25T04:45:33.186012+0000","last_active":"2023-08-25T04:45:38.461705+0000","last_peered":"2023-08-25T04:45:38.461705+0000","last_clean":"2023-08-25T04:45:38.461705+0000","last_became_active":"2023-08-25T04:45:33.185728+0000","last_became_peered":"2023-08-25T04:45:33.185728+0000","last_unstale":"2023-08-25T04:45:38.461705+0000","last_undegraded":"2023-08-25T04:45:38.461705+0000","last_fullsized":"2023-08-25T04:45:38.461705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:13.906330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460189+0000","last_change":"2023-08-25T04:45:37.491674+0000","last_active":"2023-08-25T04:45:38.460189+0000","last_peered":"2023-08-25T04:45:38.460189+0000","last_clean":"2023-08-25T04:45:38.460189+0000","last_became_active":"2023-08-25T04:45:37.491231+0000","last_became_peered":"2023-08-25T04:45:37.491231+0000","last_unstale":"2023-08-25T04:45:38.460189+0000","last_undegraded":"2023-08-25T04:45:38.460189+0000","last_fullsized":"2023-08-25T04:45:38.460189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:38.084542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460262+0000","last_change":"2023-08-25T04:45:32.237694+0000","last_active":"2023-08-25T04:45:38.460262+0000","last_peered":"2023-08-25T04:45:38.460262+0000","last_clean":"2023-08-25T04:45:38.460262+0000","last_became_active":"2023-08-25T04:45:32.237349+0000","last_became_peered":"2023-08-25T04:45:32.237349+0000","last_unstale":"2023-08-25T04:45:38.460262+0000","last_undegraded":"2023-08-25T04:45:38.460262+0000","last_fullsized":"2023-08-25T04:45:38.460262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:19.249464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461404+0000","last_change":"2023-08-25T04:45:33.182578+0000","last_active":"2023-08-25T04:45:38.461404+0000","last_peered":"2023-08-25T04:45:38.461404+0000","last_clean":"2023-08-25T04:45:38.461404+0000","last_became_active":"2023-08-25T04:45:33.182247+0000","last_became_peered":"2023-08-25T04:45:33.182247+0000","last_unstale":"2023-08-25T04:45:38.461404+0000","last_undegraded":"2023-08-25T04:45:38.461404+0000","last_fullsized":"2023-08-25T04:45:38.461404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:07.921112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460509+0000","last_change":"2023-08-25T04:45:37.474385+0000","last_active":"2023-08-25T04:45:38.460509+0000","last_peered":"2023-08-25T04:45:38.460509+0000","last_clean":"2023-08-25T04:45:38.460509+0000","last_became_active":"2023-08-25T04:45:37.473906+0000","last_became_peered":"2023-08-25T04:45:37.473906+0000","last_unstale":"2023-08-25T04:45:38.460509+0000","last_undegraded":"2023-08-25T04:45:38.460509+0000","last_fullsized":"2023-08-25T04:45:38.460509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:54:14.466417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475836+0000","last_change":"2023-08-25T04:45:32.230006+0000","last_active":"2023-08-25T04:45:39.475836+0000","last_peered":"2023-08-25T04:45:39.475836+0000","last_clean":"2023-08-25T04:45:39.475836+0000","last_became_active":"2023-08-25T04:45:32.229669+0000","last_became_peered":"2023-08-25T04:45:32.229669+0000","last_unstale":"2023-08-25T04:45:39.475836+0000","last_undegraded":"2023-08-25T04:45:39.475836+0000","last_fullsized":"2023-08-25T04:45:39.475836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:05.707508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475400+0000","last_change":"2023-08-25T04:45:33.191243+0000","last_active":"2023-08-25T04:45:39.475400+0000","last_peered":"2023-08-25T04:45:39.475400+0000","last_clean":"2023-08-25T04:45:39.475400+0000","last_became_active":"2023-08-25T04:45:33.190978+0000","last_became_peered":"2023-08-25T04:45:33.190978+0000","last_unstale":"2023-08-25T04:45:39.475400+0000","last_undegraded":"2023-08-25T04:45:39.475400+0000","last_fullsized":"2023-08-25T04:45:39.475400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:31:56.459382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122653+0000","last_change":"2023-08-25T04:45:37.480208+0000","last_active":"2023-08-25T04:45:39.122653+0000","last_peered":"2023-08-25T04:45:39.122653+0000","last_clean":"2023-08-25T04:45:39.122653+0000","last_became_active":"2023-08-25T04:45:37.479756+0000","last_became_peered":"2023-08-25T04:45:37.479756+0000","last_unstale":"2023-08-25T04:45:39.122653+0000","last_undegraded":"2023-08-25T04:45:39.122653+0000","last_fullsized":"2023-08-25T04:45:39.122653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:09.328653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845931+0000","last_change":"2023-08-25T04:45:32.242698+0000","last_active":"2023-08-25T04:45:38.845931+0000","last_peered":"2023-08-25T04:45:38.845931+0000","last_clean":"2023-08-25T04:45:38.845931+0000","last_became_active":"2023-08-25T04:45:32.242434+0000","last_became_peered":"2023-08-25T04:45:32.242434+0000","last_unstale":"2023-08-25T04:45:38.845931+0000","last_undegraded":"2023-08-25T04:45:38.845931+0000","last_fullsized":"2023-08-25T04:45:38.845931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:22:28.862067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460720+0000","last_change":"2023-08-25T04:45:33.178625+0000","last_active":"2023-08-25T04:45:38.460720+0000","last_peered":"2023-08-25T04:45:38.460720+0000","last_clean":"2023-08-25T04:45:38.460720+0000","last_became_active":"2023-08-25T04:45:33.178339+0000","last_became_peered":"2023-08-25T04:45:33.178339+0000","last_unstale":"2023-08-25T04:45:38.460720+0000","last_undegraded":"2023-08-25T04:45:38.460720+0000","last_fullsized":"2023-08-25T04:45:38.460720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:27.545798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652789+0000","last_change":"2023-08-25T04:45:33.184848+0000","last_active":"2023-08-25T04:45:38.652789+0000","last_peered":"2023-08-25T04:45:38.652789+0000","last_clean":"2023-08-25T04:45:38.652789+0000","last_became_active":"2023-08-25T04:45:33.184561+0000","last_became_peered":"2023-08-25T04:45:33.184561+0000","last_unstale":"2023-08-25T04:45:38.652789+0000","last_undegraded":"2023-08-25T04:45:38.652789+0000","last_fullsized":"2023-08-25T04:45:38.652789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:51.096987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475832+0000","last_change":"2023-08-25T04:45:33.191054+0000","last_active":"2023-08-25T04:45:39.475832+0000","last_peered":"2023-08-25T04:45:39.475832+0000","last_clean":"2023-08-25T04:45:39.475832+0000","last_became_active":"2023-08-25T04:45:33.190791+0000","last_became_peered":"2023-08-25T04:45:33.190791+0000","last_unstale":"2023-08-25T04:45:39.475832+0000","last_undegraded":"2023-08-25T04:45:39.475832+0000","last_fullsized":"2023-08-25T04:45:39.475832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:11.510859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461862+0000","last_change":"2023-08-25T04:45:33.189475+0000","last_active":"2023-08-25T04:45:38.461862+0000","last_peered":"2023-08-25T04:45:38.461862+0000","last_clean":"2023-08-25T04:45:38.461862+0000","last_became_active":"2023-08-25T04:45:33.189067+0000","last_became_peered":"2023-08-25T04:45:33.189067+0000","last_unstale":"2023-08-25T04:45:38.461862+0000","last_undegraded":"2023-08-25T04:45:38.461862+0000","last_fullsized":"2023-08-25T04:45:38.461862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:19.369230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475668+0000","last_change":"2023-08-25T04:45:33.193380+0000","last_active":"2023-08-25T04:45:39.475668+0000","last_peered":"2023-08-25T04:45:39.475668+0000","last_clean":"2023-08-25T04:45:39.475668+0000","last_became_active":"2023-08-25T04:45:33.193083+0000","last_became_peered":"2023-08-25T04:45:33.193083+0000","last_unstale":"2023-08-25T04:45:39.475668+0000","last_undegraded":"2023-08-25T04:45:39.475668+0000","last_fullsized":"2023-08-25T04:45:39.475668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:19:48.510004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121877+0000","last_change":"2023-08-25T04:45:33.180446+0000","last_active":"2023-08-25T04:45:39.121877+0000","last_peered":"2023-08-25T04:45:39.121877+0000","last_clean":"2023-08-25T04:45:39.121877+0000","last_became_active":"2023-08-25T04:45:33.179711+0000","last_became_peered":"2023-08-25T04:45:33.179711+0000","last_unstale":"2023-08-25T04:45:39.121877+0000","last_undegraded":"2023-08-25T04:45:39.121877+0000","last_fullsized":"2023-08-25T04:45:39.121877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:10.645818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":704188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":700130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":109852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:46:04.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:46:04.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.908+0000 7fba553ff700 1 Processor -- start 2023-08-25T04:46:04.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.908+0000 7fba553ff700 1 -- start start 2023-08-25T04:46:04.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.909+0000 7fba553ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba500b47c0 0x7fba500b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.909+0000 7fba553ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba5015d130 0x7fba500d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.909+0000 7fba553ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba500b50e0 con 0x7fba500b86b0 2023-08-25T04:46:04.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.909+0000 7fba553ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba500b6db0 con 0x7fba500b47c0 2023-08-25T04:46:04.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.909+0000 7fba553ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba500d1780 con 0x7fba5015d130 2023-08-25T04:46:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.909+0000 7fba4f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fba500b86b0 0x7fba5006b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41696/0 (socket says 172.21.15.72:41696) 2023-08-25T04:46:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.909+0000 7fba4f7fe700 1 -- 172.21.15.72:0/1128701748 learned_addr learned my addr 172.21.15.72:0/1128701748 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.910+0000 7fba4e7fc700 1 --2- 172.21.15.72:0/1128701748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba5015d130 0x7fba500d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.910+0000 7fba4effd700 1 --2- 172.21.15.72:0/1128701748 >> v2:172.21.15.137:3300/0 conn(0x7fba500b47c0 0x7fba500b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.910+0000 7fba4dffb700 1 -- 172.21.15.72:0/1128701748 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813244718 0 0) 0x7fba500b50e0 con 0x7fba500b86b0 2023-08-25T04:46:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.910+0000 7fba4dffb700 1 -- 172.21.15.72:0/1128701748 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba380035b0 con 0x7fba500b86b0 2023-08-25T04:46:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.910+0000 7fba4e7fc700 1 -- 172.21.15.72:0/1128701748 >> v2:172.21.15.137:3300/0 conn(0x7fba500b47c0 msgr2=0x7fba500b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.910+0000 7fba4e7fc700 1 --2- 172.21.15.72:0/1128701748 >> v2:172.21.15.137:3300/0 conn(0x7fba500b47c0 0x7fba500b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.910+0000 7fba4e7fc700 1 -- 172.21.15.72:0/1128701748 >> v1:172.21.15.72:6789/0 conn(0x7fba500b86b0 legacy=0x7fba5006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.910+0000 7fba4e7fc700 1 -- 172.21.15.72:0/1128701748 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500d1a60 con 0x7fba5015d130 2023-08-25T04:46:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.910+0000 7fba4effd700 1 --2- 172.21.15.72:0/1128701748 >> v2:172.21.15.137:3300/0 conn(0x7fba500b47c0 0x7fba500b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.910+0000 7fba4e7fc700 1 --2- 172.21.15.72:0/1128701748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba5015d130 0x7fba500d0e80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba44009840 tx=0x7fba44009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65cbd702bbf41ee2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.911+0000 7fba4dffb700 1 -- 172.21.15.72:0/1128701748 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44011830 con 0x7fba5015d130 2023-08-25T04:46:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.911+0000 7fba4dffb700 1 -- 172.21.15.72:0/1128701748 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba44011990 con 0x7fba5015d130 2023-08-25T04:46:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.911+0000 7fba4dffb700 1 -- 172.21.15.72:0/1128701748 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44011d20 con 0x7fba5015d130 2023-08-25T04:46:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.911+0000 7fba553ff700 1 -- 172.21.15.72:0/1128701748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba5015d130 msgr2=0x7fba500d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.911+0000 7fba553ff700 1 --2- 172.21.15.72:0/1128701748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba5015d130 0x7fba500d0e80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba44009840 tx=0x7fba44009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.911+0000 7fba553ff700 1 -- 172.21.15.72:0/1128701748 shutdown_connections 2023-08-25T04:46:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.911+0000 7fba553ff700 1 --2- 172.21.15.72:0/1128701748 >> v2:172.21.15.137:3300/0 conn(0x7fba500b47c0 0x7fba500b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.911+0000 7fba553ff700 1 --2- 172.21.15.72:0/1128701748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba5015d130 0x7fba500d0e80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.911+0000 7fba553ff700 1 -- 172.21.15.72:0/1128701748 >> 172.21.15.72:0/1128701748 conn(0x7fba50072050 msgr2=0x7fba500d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.911+0000 7fba553ff700 1 -- 172.21.15.72:0/1128701748 shutdown_connections 2023-08-25T04:46:04.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.912+0000 7fba553ff700 1 -- 172.21.15.72:0/1128701748 wait complete. 2023-08-25T04:46:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.913+0000 7fba553ff700 1 Processor -- start 2023-08-25T04:46:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.913+0000 7fba553ff700 1 -- start start 2023-08-25T04:46:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.914+0000 7fba553ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba500b47c0 0x7fba500cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.914+0000 7fba553ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba500b86b0 0x7fba5015fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.914+0000 7fba553ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5015d130 0x7fba500cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.914+0000 7fba553ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba500ca160 con 0x7fba500b86b0 2023-08-25T04:46:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.914+0000 7fba553ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba500ca440 con 0x7fba5015d130 2023-08-25T04:46:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.914+0000 7fba553ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba500ca720 con 0x7fba500b47c0 2023-08-25T04:46:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.914+0000 7fba4e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba500b86b0 0x7fba5015fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba4e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba500b86b0 0x7fba5015fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57890/0 (socket says 172.21.15.72:57890) 2023-08-25T04:46:04.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba4e7fc700 1 -- 172.21.15.72:0/914839350 learned_addr learned my addr 172.21.15.72:0/914839350 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:04.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba4effd700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba500b47c0 0x7fba500cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba4f7fe700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5015d130 0x7fba500cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba4e7fc700 1 -- 172.21.15.72:0/914839350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba500b47c0 msgr2=0x7fba500cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba4e7fc700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba500b47c0 0x7fba500cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba4e7fc700 1 -- 172.21.15.72:0/914839350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5015d130 msgr2=0x7fba500cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:04.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba4e7fc700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5015d130 0x7fba500cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:04.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba4e7fc700 1 -- 172.21.15.72:0/914839350 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba400094a0 con 0x7fba500b86b0 2023-08-25T04:46:04.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba4e7fc700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba500b86b0 0x7fba5015fed0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba440090b0 tx=0x7fba44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:04.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba377fe700 1 -- 172.21.15.72:0/914839350 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba440036a0 con 0x7fba500b86b0 2023-08-25T04:46:04.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba377fe700 1 -- 172.21.15.72:0/914839350 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4401f070 con 0x7fba500b86b0 2023-08-25T04:46:04.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba553ff700 1 -- 172.21.15.72:0/914839350 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba440094a0 con 0x7fba500b86b0 2023-08-25T04:46:04.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.915+0000 7fba377fe700 1 -- 172.21.15.72:0/914839350 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44003a20 con 0x7fba500b86b0 2023-08-25T04:46:04.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.916+0000 7fba553ff700 1 -- 172.21.15.72:0/914839350 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba500cace0 con 0x7fba500b86b0 2023-08-25T04:46:04.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.917+0000 7fba553ff700 1 -- 172.21.15.72:0/914839350 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5004e620 con 0x7fba500b86b0 2023-08-25T04:46:04.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.917+0000 7fba377fe700 1 -- 172.21.15.72:0/914839350 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fba44003b80 con 0x7fba500b86b0 2023-08-25T04:46:04.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.918+0000 7fba377fe700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba3c06a0e0 0x7fba3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:04.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.918+0000 7fba377fe700 1 -- 172.21.15.72:0/914839350 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba44021070 con 0x7fba500b86b0 2023-08-25T04:46:04.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.918+0000 7fba4effd700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba3c06a0e0 0x7fba3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:04.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.919+0000 7fba4effd700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba3c06a0e0 0x7fba3c06c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fba40009cd0 tx=0x7fba40009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:04.922+0000 7fba377fe700 1 -- 172.21.15.72:0/914839350 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fba44054e50 con 0x7fba500b86b0 2023-08-25T04:46:05.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.113+0000 7fba553ff700 1 -- 172.21.15.72:0/914839350 --> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba500d2020 con 0x7fba3c06a0e0 2023-08-25T04:46:05.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.123+0000 7fba377fe700 1 -- 172.21.15.72:0/914839350 <== mgr.4101 v2:172.21.15.72:6832/1377484023 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367641 (secure 0 0 0) 0x7fba40009e10 con 0x7fba3c06a0e0 2023-08-25T04:46:05.129 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:05.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 -- 172.21.15.72:0/914839350 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba3c06a0e0 msgr2=0x7fba3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba3c06a0e0 0x7fba3c06c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fba40009cd0 tx=0x7fba40009210 comp rx=0 tx=0).stop 2023-08-25T04:46:05.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 -- 172.21.15.72:0/914839350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba500b86b0 msgr2=0x7fba5015fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba500b86b0 0x7fba5015fed0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba440090b0 tx=0x7fba44004750 comp rx=0 tx=0).stop 2023-08-25T04:46:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 -- 172.21.15.72:0/914839350 shutdown_connections 2023-08-25T04:46:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba3c06a0e0 0x7fba3c06c5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba5015d130 0x7fba500cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba500b47c0 0x7fba500cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 --2- 172.21.15.72:0/914839350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba500b86b0 0x7fba5015fed0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 -- 172.21.15.72:0/914839350 >> 172.21.15.72:0/914839350 conn(0x7fba50072050 msgr2=0x7fba5015a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 -- 172.21.15.72:0/914839350 shutdown_connections 2023-08-25T04:46:05.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.128+0000 7fba553ff700 1 -- 172.21.15.72:0/914839350 wait complete. 2023-08-25T04:46:05.137 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-25T04:46:05.147 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-08-25T04:46:03.866836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219456,"kb_used_data":3300,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755264,"statfs":{"total":773094113280,"available":772869390336,"internally_reserved":0,"allocated":3379200,"data_stored":2067176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009549"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460126+0000","last_change":"2023-08-25T04:45:33.185383+0000","last_active":"2023-08-25T04:45:38.460126+0000","last_peered":"2023-08-25T04:45:38.460126+0000","last_clean":"2023-08-25T04:45:38.460126+0000","last_became_active":"2023-08-25T04:45:33.184169+0000","last_became_peered":"2023-08-25T04:45:33.184169+0000","last_unstale":"2023-08-25T04:45:38.460126+0000","last_undegraded":"2023-08-25T04:45:38.460126+0000","last_fullsized":"2023-08-25T04:45:38.460126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:42:04.862278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460260+0000","last_change":"2023-08-25T04:45:33.187575+0000","last_active":"2023-08-25T04:45:38.460260+0000","last_peered":"2023-08-25T04:45:38.460260+0000","last_clean":"2023-08-25T04:45:38.460260+0000","last_became_active":"2023-08-25T04:45:33.187289+0000","last_became_peered":"2023-08-25T04:45:33.187289+0000","last_unstale":"2023-08-25T04:45:38.460260+0000","last_undegraded":"2023-08-25T04:45:38.460260+0000","last_fullsized":"2023-08-25T04:45:38.460260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:14.806194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461583+0000","last_change":"2023-08-25T04:45:33.179277+0000","last_active":"2023-08-25T04:45:38.461583+0000","last_peered":"2023-08-25T04:45:38.461583+0000","last_clean":"2023-08-25T04:45:38.461583+0000","last_became_active":"2023-08-25T04:45:33.178903+0000","last_became_peered":"2023-08-25T04:45:33.178903+0000","last_unstale":"2023-08-25T04:45:38.461583+0000","last_undegraded":"2023-08-25T04:45:38.461583+0000","last_fullsized":"2023-08-25T04:45:38.461583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:22:43.697767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652749+0000","last_change":"2023-08-25T04:45:33.187260+0000","last_active":"2023-08-25T04:45:38.652749+0000","last_peered":"2023-08-25T04:45:38.652749+0000","last_clean":"2023-08-25T04:45:38.652749+0000","last_became_active":"2023-08-25T04:45:33.186900+0000","last_became_peered":"2023-08-25T04:45:33.186900+0000","last_unstale":"2023-08-25T04:45:38.652749+0000","last_undegraded":"2023-08-25T04:45:38.652749+0000","last_fullsized":"2023-08-25T04:45:38.652749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:15:30.486107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845968+0000","last_change":"2023-08-25T04:45:33.184990+0000","last_active":"2023-08-25T04:45:38.845968+0000","last_peered":"2023-08-25T04:45:38.845968+0000","last_clean":"2023-08-25T04:45:38.845968+0000","last_became_active":"2023-08-25T04:45:33.184741+0000","last_became_peered":"2023-08-25T04:45:33.184741+0000","last_unstale":"2023-08-25T04:45:38.845968+0000","last_undegraded":"2023-08-25T04:45:38.845968+0000","last_fullsized":"2023-08-25T04:45:38.845968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:15.434939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461899+0000","last_change":"2023-08-25T04:45:33.182357+0000","last_active":"2023-08-25T04:45:38.461899+0000","last_peered":"2023-08-25T04:45:38.461899+0000","last_clean":"2023-08-25T04:45:38.461899+0000","last_became_active":"2023-08-25T04:45:33.182046+0000","last_became_peered":"2023-08-25T04:45:33.182046+0000","last_unstale":"2023-08-25T04:45:38.461899+0000","last_undegraded":"2023-08-25T04:45:38.461899+0000","last_fullsized":"2023-08-25T04:45:38.461899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:23.439531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475830+0000","last_change":"2023-08-25T04:45:33.188333+0000","last_active":"2023-08-25T04:45:39.475830+0000","last_peered":"2023-08-25T04:45:39.475830+0000","last_clean":"2023-08-25T04:45:39.475830+0000","last_became_active":"2023-08-25T04:45:33.187968+0000","last_became_peered":"2023-08-25T04:45:33.187968+0000","last_unstale":"2023-08-25T04:45:39.475830+0000","last_undegraded":"2023-08-25T04:45:39.475830+0000","last_fullsized":"2023-08-25T04:45:39.475830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:22:29.864512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459977+0000","last_change":"2023-08-25T04:45:33.186253+0000","last_active":"2023-08-25T04:45:38.459977+0000","last_peered":"2023-08-25T04:45:38.459977+0000","last_clean":"2023-08-25T04:45:38.459977+0000","last_became_active":"2023-08-25T04:45:33.185966+0000","last_became_peered":"2023-08-25T04:45:33.185966+0000","last_unstale":"2023-08-25T04:45:38.459977+0000","last_undegraded":"2023-08-25T04:45:38.459977+0000","last_fullsized":"2023-08-25T04:45:38.459977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:10.645818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845570+0000","last_change":"2023-08-25T04:45:33.186028+0000","last_active":"2023-08-25T04:45:38.845570+0000","last_peered":"2023-08-25T04:45:38.845570+0000","last_clean":"2023-08-25T04:45:38.845570+0000","last_became_active":"2023-08-25T04:45:33.185568+0000","last_became_peered":"2023-08-25T04:45:33.185568+0000","last_unstale":"2023-08-25T04:45:38.845570+0000","last_undegraded":"2023-08-25T04:45:38.845570+0000","last_fullsized":"2023-08-25T04:45:38.845570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:05.092316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460526+0000","last_change":"2023-08-25T04:45:33.178499+0000","last_active":"2023-08-25T04:45:38.460526+0000","last_peered":"2023-08-25T04:45:38.460526+0000","last_clean":"2023-08-25T04:45:38.460526+0000","last_became_active":"2023-08-25T04:45:33.178145+0000","last_became_peered":"2023-08-25T04:45:33.178145+0000","last_unstale":"2023-08-25T04:45:38.460526+0000","last_undegraded":"2023-08-25T04:45:38.460526+0000","last_fullsized":"2023-08-25T04:45:38.460526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:50.758247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461421+0000","last_change":"2023-08-25T04:45:33.173857+0000","last_active":"2023-08-25T04:45:38.461421+0000","last_peered":"2023-08-25T04:45:38.461421+0000","last_clean":"2023-08-25T04:45:38.461421+0000","last_became_active":"2023-08-25T04:45:33.173577+0000","last_became_peered":"2023-08-25T04:45:33.173577+0000","last_unstale":"2023-08-25T04:45:38.461421+0000","last_undegraded":"2023-08-25T04:45:38.461421+0000","last_fullsized":"2023-08-25T04:45:38.461421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:45:23.452085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459669+0000","last_change":"2023-08-25T04:45:33.186989+0000","last_active":"2023-08-25T04:45:38.459669+0000","last_peered":"2023-08-25T04:45:38.459669+0000","last_clean":"2023-08-25T04:45:38.459669+0000","last_became_active":"2023-08-25T04:45:33.186701+0000","last_became_peered":"2023-08-25T04:45:33.186701+0000","last_unstale":"2023-08-25T04:45:38.459669+0000","last_undegraded":"2023-08-25T04:45:38.459669+0000","last_fullsized":"2023-08-25T04:45:38.459669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:19.431020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459722+0000","last_change":"2023-08-25T04:45:33.183696+0000","last_active":"2023-08-25T04:45:38.459722+0000","last_peered":"2023-08-25T04:45:38.459722+0000","last_clean":"2023-08-25T04:45:38.459722+0000","last_became_active":"2023-08-25T04:45:33.183381+0000","last_became_peered":"2023-08-25T04:45:33.183381+0000","last_unstale":"2023-08-25T04:45:38.459722+0000","last_undegraded":"2023-08-25T04:45:38.459722+0000","last_fullsized":"2023-08-25T04:45:38.459722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:36.669250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459977+0000","last_change":"2023-08-25T04:45:33.183979+0000","last_active":"2023-08-25T04:45:38.459977+0000","last_peered":"2023-08-25T04:45:38.459977+0000","last_clean":"2023-08-25T04:45:38.459977+0000","last_became_active":"2023-08-25T04:45:33.183700+0000","last_became_peered":"2023-08-25T04:45:33.183700+0000","last_unstale":"2023-08-25T04:45:38.459977+0000","last_undegraded":"2023-08-25T04:45:38.459977+0000","last_fullsized":"2023-08-25T04:45:38.459977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475604+0000","last_change":"2023-08-25T04:45:33.188668+0000","last_active":"2023-08-25T04:45:39.475604+0000","last_peered":"2023-08-25T04:45:39.475604+0000","last_clean":"2023-08-25T04:45:39.475604+0000","last_became_active":"2023-08-25T04:45:33.188447+0000","last_became_peered":"2023-08-25T04:45:33.188447+0000","last_unstale":"2023-08-25T04:45:39.475604+0000","last_undegraded":"2023-08-25T04:45:39.475604+0000","last_fullsized":"2023-08-25T04:45:39.475604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461770+0000","last_change":"2023-08-25T04:45:33.175887+0000","last_active":"2023-08-25T04:45:38.461770+0000","last_peered":"2023-08-25T04:45:38.461770+0000","last_clean":"2023-08-25T04:45:38.461770+0000","last_became_active":"2023-08-25T04:45:33.175585+0000","last_became_peered":"2023-08-25T04:45:33.175585+0000","last_unstale":"2023-08-25T04:45:38.461770+0000","last_undegraded":"2023-08-25T04:45:38.461770+0000","last_fullsized":"2023-08-25T04:45:38.461770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:37.935438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845602+0000","last_change":"2023-08-25T04:45:33.185875+0000","last_active":"2023-08-25T04:45:38.845602+0000","last_peered":"2023-08-25T04:45:38.845602+0000","last_clean":"2023-08-25T04:45:38.845602+0000","last_became_active":"2023-08-25T04:45:33.185200+0000","last_became_peered":"2023-08-25T04:45:33.185200+0000","last_unstale":"2023-08-25T04:45:38.845602+0000","last_undegraded":"2023-08-25T04:45:38.845602+0000","last_fullsized":"2023-08-25T04:45:38.845602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:30.597928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461261+0000","last_change":"2023-08-25T04:45:33.170738+0000","last_active":"2023-08-25T04:45:38.461261+0000","last_peered":"2023-08-25T04:45:38.461261+0000","last_clean":"2023-08-25T04:45:38.461261+0000","last_became_active":"2023-08-25T04:45:33.170445+0000","last_became_peered":"2023-08-25T04:45:33.170445+0000","last_unstale":"2023-08-25T04:45:38.461261+0000","last_undegraded":"2023-08-25T04:45:38.461261+0000","last_fullsized":"2023-08-25T04:45:38.461261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:42:18.697261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459973+0000","last_change":"2023-08-25T04:45:33.189985+0000","last_active":"2023-08-25T04:45:38.459973+0000","last_peered":"2023-08-25T04:45:38.459973+0000","last_clean":"2023-08-25T04:45:38.459973+0000","last_became_active":"2023-08-25T04:45:33.189741+0000","last_became_peered":"2023-08-25T04:45:33.189741+0000","last_unstale":"2023-08-25T04:45:38.459973+0000","last_undegraded":"2023-08-25T04:45:38.459973+0000","last_fullsized":"2023-08-25T04:45:38.459973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:54:14.813343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.462063+0000","last_change":"2023-08-25T04:45:33.190893+0000","last_active":"2023-08-25T04:45:38.462063+0000","last_peered":"2023-08-25T04:45:38.462063+0000","last_clean":"2023-08-25T04:45:38.462063+0000","last_became_active":"2023-08-25T04:45:33.190613+0000","last_became_peered":"2023-08-25T04:45:33.190613+0000","last_unstale":"2023-08-25T04:45:38.462063+0000","last_undegraded":"2023-08-25T04:45:38.462063+0000","last_fullsized":"2023-08-25T04:45:38.462063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:30:18.502488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476050+0000","last_change":"2023-08-25T04:45:33.184588+0000","last_active":"2023-08-25T04:45:39.476050+0000","last_peered":"2023-08-25T04:45:39.476050+0000","last_clean":"2023-08-25T04:45:39.476050+0000","last_became_active":"2023-08-25T04:45:33.184240+0000","last_became_peered":"2023-08-25T04:45:33.184240+0000","last_unstale":"2023-08-25T04:45:39.476050+0000","last_undegraded":"2023-08-25T04:45:39.476050+0000","last_fullsized":"2023-08-25T04:45:39.476050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:00.135600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845427+0000","last_change":"2023-08-25T04:45:33.187776+0000","last_active":"2023-08-25T04:45:38.845427+0000","last_peered":"2023-08-25T04:45:38.845427+0000","last_clean":"2023-08-25T04:45:38.845427+0000","last_became_active":"2023-08-25T04:45:33.187529+0000","last_became_peered":"2023-08-25T04:45:33.187529+0000","last_unstale":"2023-08-25T04:45:38.845427+0000","last_undegraded":"2023-08-25T04:45:38.845427+0000","last_fullsized":"2023-08-25T04:45:38.845427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475970+0000","last_change":"2023-08-25T04:45:33.182244+0000","last_active":"2023-08-25T04:45:39.475970+0000","last_peered":"2023-08-25T04:45:39.475970+0000","last_clean":"2023-08-25T04:45:39.475970+0000","last_became_active":"2023-08-25T04:45:33.181940+0000","last_became_peered":"2023-08-25T04:45:33.181940+0000","last_unstale":"2023-08-25T04:45:39.475970+0000","last_undegraded":"2023-08-25T04:45:39.475970+0000","last_fullsized":"2023-08-25T04:45:39.475970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:02.627838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475607+0000","last_change":"2023-08-25T04:45:33.184900+0000","last_active":"2023-08-25T04:45:39.475607+0000","last_peered":"2023-08-25T04:45:39.475607+0000","last_clean":"2023-08-25T04:45:39.475607+0000","last_became_active":"2023-08-25T04:45:33.184589+0000","last_became_peered":"2023-08-25T04:45:33.184589+0000","last_unstale":"2023-08-25T04:45:39.475607+0000","last_undegraded":"2023-08-25T04:45:39.475607+0000","last_fullsized":"2023-08-25T04:45:39.475607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:17:10.410580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122553+0000","last_change":"2023-08-25T04:45:33.191724+0000","last_active":"2023-08-25T04:45:39.122553+0000","last_peered":"2023-08-25T04:45:39.122553+0000","last_clean":"2023-08-25T04:45:39.122553+0000","last_became_active":"2023-08-25T04:45:33.191388+0000","last_became_peered":"2023-08-25T04:45:33.191388+0000","last_unstale":"2023-08-25T04:45:39.122553+0000","last_undegraded":"2023-08-25T04:45:39.122553+0000","last_fullsized":"2023-08-25T04:45:39.122553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:43.659333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122544+0000","last_change":"2023-08-25T04:45:33.168956+0000","last_active":"2023-08-25T04:45:39.122544+0000","last_peered":"2023-08-25T04:45:39.122544+0000","last_clean":"2023-08-25T04:45:39.122544+0000","last_became_active":"2023-08-25T04:45:33.168694+0000","last_became_peered":"2023-08-25T04:45:33.168694+0000","last_unstale":"2023-08-25T04:45:39.122544+0000","last_undegraded":"2023-08-25T04:45:39.122544+0000","last_fullsized":"2023-08-25T04:45:39.122544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:50.406447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460744+0000","last_change":"2023-08-25T04:45:33.185807+0000","last_active":"2023-08-25T04:45:38.460744+0000","last_peered":"2023-08-25T04:45:38.460744+0000","last_clean":"2023-08-25T04:45:38.460744+0000","last_became_active":"2023-08-25T04:45:33.185511+0000","last_became_peered":"2023-08-25T04:45:33.185511+0000","last_unstale":"2023-08-25T04:45:38.460744+0000","last_undegraded":"2023-08-25T04:45:38.460744+0000","last_fullsized":"2023-08-25T04:45:38.460744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.462370+0000","last_change":"2023-08-25T04:45:37.484174+0000","last_active":"2023-08-25T04:45:38.462370+0000","last_peered":"2023-08-25T04:45:38.462370+0000","last_clean":"2023-08-25T04:45:38.462370+0000","last_became_active":"2023-08-25T04:45:37.483785+0000","last_became_peered":"2023-08-25T04:45:37.483785+0000","last_unstale":"2023-08-25T04:45:38.462370+0000","last_undegraded":"2023-08-25T04:45:38.462370+0000","last_fullsized":"2023-08-25T04:45:38.462370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:09.116862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461690+0000","last_change":"2023-08-25T04:45:32.241316+0000","last_active":"2023-08-25T04:45:38.461690+0000","last_peered":"2023-08-25T04:45:38.461690+0000","last_clean":"2023-08-25T04:45:38.461690+0000","last_became_active":"2023-08-25T04:45:32.235835+0000","last_became_peered":"2023-08-25T04:45:32.235835+0000","last_unstale":"2023-08-25T04:45:38.461690+0000","last_undegraded":"2023-08-25T04:45:38.461690+0000","last_fullsized":"2023-08-25T04:45:38.461690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:23:28.852339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475699+0000","last_change":"2023-08-25T04:45:33.191163+0000","last_active":"2023-08-25T04:45:39.475699+0000","last_peered":"2023-08-25T04:45:39.475699+0000","last_clean":"2023-08-25T04:45:39.475699+0000","last_became_active":"2023-08-25T04:45:33.190820+0000","last_became_peered":"2023-08-25T04:45:33.190820+0000","last_unstale":"2023-08-25T04:45:39.475699+0000","last_undegraded":"2023-08-25T04:45:39.475699+0000","last_fullsized":"2023-08-25T04:45:39.475699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:47:58.777265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653134+0000","last_change":"2023-08-25T04:45:37.480700+0000","last_active":"2023-08-25T04:45:38.653134+0000","last_peered":"2023-08-25T04:45:38.653134+0000","last_clean":"2023-08-25T04:45:38.653134+0000","last_became_active":"2023-08-25T04:45:37.480204+0000","last_became_peered":"2023-08-25T04:45:37.480204+0000","last_unstale":"2023-08-25T04:45:38.653134+0000","last_undegraded":"2023-08-25T04:45:38.653134+0000","last_fullsized":"2023-08-25T04:45:38.653134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:59.030524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121571+0000","last_change":"2023-08-25T04:45:32.228380+0000","last_active":"2023-08-25T04:45:39.121571+0000","last_peered":"2023-08-25T04:45:39.121571+0000","last_clean":"2023-08-25T04:45:39.121571+0000","last_became_active":"2023-08-25T04:45:32.228067+0000","last_became_peered":"2023-08-25T04:45:32.228067+0000","last_unstale":"2023-08-25T04:45:39.121571+0000","last_undegraded":"2023-08-25T04:45:39.121571+0000","last_fullsized":"2023-08-25T04:45:39.121571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:52.789398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845784+0000","last_change":"2023-08-25T04:45:33.194235+0000","last_active":"2023-08-25T04:45:38.845784+0000","last_peered":"2023-08-25T04:45:38.845784+0000","last_clean":"2023-08-25T04:45:38.845784+0000","last_became_active":"2023-08-25T04:45:33.193947+0000","last_became_peered":"2023-08-25T04:45:33.193947+0000","last_unstale":"2023-08-25T04:45:38.845784+0000","last_undegraded":"2023-08-25T04:45:38.845784+0000","last_fullsized":"2023-08-25T04:45:38.845784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:00.160708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845934+0000","last_change":"2023-08-25T04:45:37.488780+0000","last_active":"2023-08-25T04:45:38.845934+0000","last_peered":"2023-08-25T04:45:38.845934+0000","last_clean":"2023-08-25T04:45:38.845934+0000","last_became_active":"2023-08-25T04:45:37.488413+0000","last_became_peered":"2023-08-25T04:45:37.488413+0000","last_unstale":"2023-08-25T04:45:38.845934+0000","last_undegraded":"2023-08-25T04:45:38.845934+0000","last_fullsized":"2023-08-25T04:45:38.845934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:38.928881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475447+0000","last_change":"2023-08-25T04:45:32.235379+0000","last_active":"2023-08-25T04:45:39.475447+0000","last_peered":"2023-08-25T04:45:39.475447+0000","last_clean":"2023-08-25T04:45:39.475447+0000","last_became_active":"2023-08-25T04:45:32.235070+0000","last_became_peered":"2023-08-25T04:45:32.235070+0000","last_unstale":"2023-08-25T04:45:39.475447+0000","last_undegraded":"2023-08-25T04:45:39.475447+0000","last_fullsized":"2023-08-25T04:45:39.475447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:34:26.267011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653235+0000","last_change":"2023-08-25T04:45:33.181190+0000","last_active":"2023-08-25T04:45:38.653235+0000","last_peered":"2023-08-25T04:45:38.653235+0000","last_clean":"2023-08-25T04:45:38.653235+0000","last_became_active":"2023-08-25T04:45:33.180891+0000","last_became_peered":"2023-08-25T04:45:33.180891+0000","last_unstale":"2023-08-25T04:45:38.653235+0000","last_undegraded":"2023-08-25T04:45:38.653235+0000","last_fullsized":"2023-08-25T04:45:38.653235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:16.907159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652536+0000","last_change":"2023-08-25T04:45:37.480980+0000","last_active":"2023-08-25T04:45:38.652536+0000","last_peered":"2023-08-25T04:45:38.652536+0000","last_clean":"2023-08-25T04:45:38.652536+0000","last_became_active":"2023-08-25T04:45:37.480357+0000","last_became_peered":"2023-08-25T04:45:37.480357+0000","last_unstale":"2023-08-25T04:45:38.652536+0000","last_undegraded":"2023-08-25T04:45:38.652536+0000","last_fullsized":"2023-08-25T04:45:38.652536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:01.442164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845694+0000","last_change":"2023-08-25T04:45:32.242639+0000","last_active":"2023-08-25T04:45:38.845694+0000","last_peered":"2023-08-25T04:45:38.845694+0000","last_clean":"2023-08-25T04:45:38.845694+0000","last_became_active":"2023-08-25T04:45:32.242393+0000","last_became_peered":"2023-08-25T04:45:32.242393+0000","last_unstale":"2023-08-25T04:45:38.845694+0000","last_undegraded":"2023-08-25T04:45:38.845694+0000","last_fullsized":"2023-08-25T04:45:38.845694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:29.089180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475389+0000","last_change":"2023-08-25T04:45:33.190455+0000","last_active":"2023-08-25T04:45:39.475389+0000","last_peered":"2023-08-25T04:45:39.475389+0000","last_clean":"2023-08-25T04:45:39.475389+0000","last_became_active":"2023-08-25T04:45:33.190204+0000","last_became_peered":"2023-08-25T04:45:33.190204+0000","last_unstale":"2023-08-25T04:45:39.475389+0000","last_undegraded":"2023-08-25T04:45:39.475389+0000","last_fullsized":"2023-08-25T04:45:39.475389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:41.739700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475477+0000","last_change":"2023-08-25T04:45:37.495023+0000","last_active":"2023-08-25T04:45:39.475477+0000","last_peered":"2023-08-25T04:45:39.475477+0000","last_clean":"2023-08-25T04:45:39.475477+0000","last_became_active":"2023-08-25T04:45:37.494694+0000","last_became_peered":"2023-08-25T04:45:37.494694+0000","last_unstale":"2023-08-25T04:45:39.475477+0000","last_undegraded":"2023-08-25T04:45:39.475477+0000","last_fullsized":"2023-08-25T04:45:39.475477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:34.327962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460645+0000","last_change":"2023-08-25T04:45:32.239824+0000","last_active":"2023-08-25T04:45:38.460645+0000","last_peered":"2023-08-25T04:45:38.460645+0000","last_clean":"2023-08-25T04:45:38.460645+0000","last_became_active":"2023-08-25T04:45:32.239533+0000","last_became_peered":"2023-08-25T04:45:32.239533+0000","last_unstale":"2023-08-25T04:45:38.460645+0000","last_undegraded":"2023-08-25T04:45:38.460645+0000","last_fullsized":"2023-08-25T04:45:38.460645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:50.517646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475245+0000","last_change":"2023-08-25T04:45:33.178438+0000","last_active":"2023-08-25T04:45:39.475245+0000","last_peered":"2023-08-25T04:45:39.475245+0000","last_clean":"2023-08-25T04:45:39.475245+0000","last_became_active":"2023-08-25T04:45:33.178111+0000","last_became_peered":"2023-08-25T04:45:33.178111+0000","last_unstale":"2023-08-25T04:45:39.475245+0000","last_undegraded":"2023-08-25T04:45:39.475245+0000","last_fullsized":"2023-08-25T04:45:39.475245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:18.567030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476115+0000","last_change":"2023-08-25T04:45:37.491477+0000","last_active":"2023-08-25T04:45:39.476115+0000","last_peered":"2023-08-25T04:45:39.476115+0000","last_clean":"2023-08-25T04:45:39.476115+0000","last_became_active":"2023-08-25T04:45:37.491133+0000","last_became_peered":"2023-08-25T04:45:37.491133+0000","last_unstale":"2023-08-25T04:45:39.476115+0000","last_undegraded":"2023-08-25T04:45:39.476115+0000","last_fullsized":"2023-08-25T04:45:39.476115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:43.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476334+0000","last_change":"2023-08-25T04:45:32.236418+0000","last_active":"2023-08-25T04:45:39.476334+0000","last_peered":"2023-08-25T04:45:39.476334+0000","last_clean":"2023-08-25T04:45:39.476334+0000","last_became_active":"2023-08-25T04:45:32.236098+0000","last_became_peered":"2023-08-25T04:45:32.236098+0000","last_unstale":"2023-08-25T04:45:39.476334+0000","last_undegraded":"2023-08-25T04:45:39.476334+0000","last_fullsized":"2023-08-25T04:45:39.476334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:20.718480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121637+0000","last_change":"2023-08-25T04:45:33.189838+0000","last_active":"2023-08-25T04:45:39.121637+0000","last_peered":"2023-08-25T04:45:39.121637+0000","last_clean":"2023-08-25T04:45:39.121637+0000","last_became_active":"2023-08-25T04:45:33.189477+0000","last_became_peered":"2023-08-25T04:45:33.189477+0000","last_unstale":"2023-08-25T04:45:39.121637+0000","last_undegraded":"2023-08-25T04:45:39.121637+0000","last_fullsized":"2023-08-25T04:45:39.121637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:55.379189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121928+0000","last_change":"2023-08-25T04:45:37.481651+0000","last_active":"2023-08-25T04:45:39.121928+0000","last_peered":"2023-08-25T04:45:39.121928+0000","last_clean":"2023-08-25T04:45:39.121928+0000","last_became_active":"2023-08-25T04:45:37.481302+0000","last_became_peered":"2023-08-25T04:45:37.481302+0000","last_unstale":"2023-08-25T04:45:39.121928+0000","last_undegraded":"2023-08-25T04:45:39.121928+0000","last_fullsized":"2023-08-25T04:45:39.121928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:35.137823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:48.636391+0000","last_change":"2023-08-25T04:45:32.239434+0000","last_active":"2023-08-25T04:45:48.636391+0000","last_peered":"2023-08-25T04:45:48.636391+0000","last_clean":"2023-08-25T04:45:48.636391+0000","last_became_active":"2023-08-25T04:45:32.239151+0000","last_became_peered":"2023-08-25T04:45:32.239151+0000","last_unstale":"2023-08-25T04:45:48.636391+0000","last_undegraded":"2023-08-25T04:45:48.636391+0000","last_fullsized":"2023-08-25T04:45:48.636391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:58.197133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461057+0000","last_change":"2023-08-25T04:45:33.180869+0000","last_active":"2023-08-25T04:45:38.461057+0000","last_peered":"2023-08-25T04:45:38.461057+0000","last_clean":"2023-08-25T04:45:38.461057+0000","last_became_active":"2023-08-25T04:45:33.180505+0000","last_became_peered":"2023-08-25T04:45:33.180505+0000","last_unstale":"2023-08-25T04:45:38.461057+0000","last_undegraded":"2023-08-25T04:45:38.461057+0000","last_fullsized":"2023-08-25T04:45:38.461057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:35:18.068007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461020+0000","last_change":"2023-08-25T04:45:37.486816+0000","last_active":"2023-08-25T04:45:38.461020+0000","last_peered":"2023-08-25T04:45:38.461020+0000","last_clean":"2023-08-25T04:45:38.461020+0000","last_became_active":"2023-08-25T04:45:37.486420+0000","last_became_peered":"2023-08-25T04:45:37.486420+0000","last_unstale":"2023-08-25T04:45:38.461020+0000","last_undegraded":"2023-08-25T04:45:38.461020+0000","last_fullsized":"2023-08-25T04:45:38.461020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:44.168940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475889+0000","last_change":"2023-08-25T04:45:32.238252+0000","last_active":"2023-08-25T04:45:39.475889+0000","last_peered":"2023-08-25T04:45:39.475889+0000","last_clean":"2023-08-25T04:45:39.475889+0000","last_became_active":"2023-08-25T04:45:32.237891+0000","last_became_peered":"2023-08-25T04:45:32.237891+0000","last_unstale":"2023-08-25T04:45:39.475889+0000","last_undegraded":"2023-08-25T04:45:39.475889+0000","last_fullsized":"2023-08-25T04:45:39.475889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:14.432494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475538+0000","last_change":"2023-08-25T04:45:33.191207+0000","last_active":"2023-08-25T04:45:39.475538+0000","last_peered":"2023-08-25T04:45:39.475538+0000","last_clean":"2023-08-25T04:45:39.475538+0000","last_became_active":"2023-08-25T04:45:33.190881+0000","last_became_peered":"2023-08-25T04:45:33.190881+0000","last_unstale":"2023-08-25T04:45:39.475538+0000","last_undegraded":"2023-08-25T04:45:39.475538+0000","last_fullsized":"2023-08-25T04:45:39.475538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:34.898702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475931+0000","last_change":"2023-08-25T04:45:37.481672+0000","last_active":"2023-08-25T04:45:39.475931+0000","last_peered":"2023-08-25T04:45:39.475931+0000","last_clean":"2023-08-25T04:45:39.475931+0000","last_became_active":"2023-08-25T04:45:37.481257+0000","last_became_peered":"2023-08-25T04:45:37.481257+0000","last_unstale":"2023-08-25T04:45:39.475931+0000","last_undegraded":"2023-08-25T04:45:39.475931+0000","last_fullsized":"2023-08-25T04:45:39.475931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:54:14.466417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845469+0000","last_change":"2023-08-25T04:45:32.239060+0000","last_active":"2023-08-25T04:45:38.845469+0000","last_peered":"2023-08-25T04:45:38.845469+0000","last_clean":"2023-08-25T04:45:38.845469+0000","last_became_active":"2023-08-25T04:45:32.237855+0000","last_became_peered":"2023-08-25T04:45:32.237855+0000","last_unstale":"2023-08-25T04:45:38.845469+0000","last_undegraded":"2023-08-25T04:45:38.845469+0000","last_fullsized":"2023-08-25T04:45:38.845469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:22.321053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460613+0000","last_change":"2023-08-25T04:45:33.179488+0000","last_active":"2023-08-25T04:45:38.460613+0000","last_peered":"2023-08-25T04:45:38.460613+0000","last_clean":"2023-08-25T04:45:38.460613+0000","last_became_active":"2023-08-25T04:45:33.179179+0000","last_became_peered":"2023-08-25T04:45:33.179179+0000","last_unstale":"2023-08-25T04:45:38.460613+0000","last_undegraded":"2023-08-25T04:45:38.460613+0000","last_fullsized":"2023-08-25T04:45:38.460613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:30.091625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476139+0000","last_change":"2023-08-25T04:45:37.490744+0000","last_active":"2023-08-25T04:45:39.476139+0000","last_peered":"2023-08-25T04:45:39.476139+0000","last_clean":"2023-08-25T04:45:39.476139+0000","last_became_active":"2023-08-25T04:45:37.490339+0000","last_became_peered":"2023-08-25T04:45:37.490339+0000","last_unstale":"2023-08-25T04:45:39.476139+0000","last_undegraded":"2023-08-25T04:45:39.476139+0000","last_fullsized":"2023-08-25T04:45:39.476139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:12.857847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475618+0000","last_change":"2023-08-25T04:45:32.237744+0000","last_active":"2023-08-25T04:45:39.475618+0000","last_peered":"2023-08-25T04:45:39.475618+0000","last_clean":"2023-08-25T04:45:39.475618+0000","last_became_active":"2023-08-25T04:45:32.237386+0000","last_became_peered":"2023-08-25T04:45:32.237386+0000","last_unstale":"2023-08-25T04:45:39.475618+0000","last_undegraded":"2023-08-25T04:45:39.475618+0000","last_fullsized":"2023-08-25T04:45:39.475618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:50.517646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.846029+0000","last_change":"2023-08-25T04:45:33.184947+0000","last_active":"2023-08-25T04:45:38.846029+0000","last_peered":"2023-08-25T04:45:38.846029+0000","last_clean":"2023-08-25T04:45:38.846029+0000","last_became_active":"2023-08-25T04:45:33.184665+0000","last_became_peered":"2023-08-25T04:45:33.184665+0000","last_unstale":"2023-08-25T04:45:38.846029+0000","last_undegraded":"2023-08-25T04:45:38.846029+0000","last_fullsized":"2023-08-25T04:45:38.846029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:00.135600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460244+0000","last_change":"2023-08-25T04:45:37.478006+0000","last_active":"2023-08-25T04:45:38.460244+0000","last_peered":"2023-08-25T04:45:38.460244+0000","last_clean":"2023-08-25T04:45:38.460244+0000","last_became_active":"2023-08-25T04:45:37.477688+0000","last_became_peered":"2023-08-25T04:45:37.477688+0000","last_unstale":"2023-08-25T04:45:38.460244+0000","last_undegraded":"2023-08-25T04:45:38.460244+0000","last_fullsized":"2023-08-25T04:45:38.460244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:50.054137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652522+0000","last_change":"2023-08-25T04:45:32.239091+0000","last_active":"2023-08-25T04:45:38.652522+0000","last_peered":"2023-08-25T04:45:38.652522+0000","last_clean":"2023-08-25T04:45:38.652522+0000","last_became_active":"2023-08-25T04:45:32.238782+0000","last_became_peered":"2023-08-25T04:45:32.238782+0000","last_unstale":"2023-08-25T04:45:38.652522+0000","last_undegraded":"2023-08-25T04:45:38.652522+0000","last_fullsized":"2023-08-25T04:45:38.652522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:42.259140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476306+0000","last_change":"2023-08-25T04:45:33.181564+0000","last_active":"2023-08-25T04:45:39.476306+0000","last_peered":"2023-08-25T04:45:39.476306+0000","last_clean":"2023-08-25T04:45:39.476306+0000","last_became_active":"2023-08-25T04:45:33.181312+0000","last_became_peered":"2023-08-25T04:45:33.181312+0000","last_unstale":"2023-08-25T04:45:39.476306+0000","last_undegraded":"2023-08-25T04:45:39.476306+0000","last_fullsized":"2023-08-25T04:45:39.476306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:37.480877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476370+0000","last_change":"2023-08-25T04:45:37.488909+0000","last_active":"2023-08-25T04:45:39.476370+0000","last_peered":"2023-08-25T04:45:39.476370+0000","last_clean":"2023-08-25T04:45:39.476370+0000","last_became_active":"2023-08-25T04:45:37.488338+0000","last_became_peered":"2023-08-25T04:45:37.488338+0000","last_unstale":"2023-08-25T04:45:39.476370+0000","last_undegraded":"2023-08-25T04:45:39.476370+0000","last_fullsized":"2023-08-25T04:45:39.476370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:30.680527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476509+0000","last_change":"2023-08-25T04:45:32.237964+0000","last_active":"2023-08-25T04:45:39.476509+0000","last_peered":"2023-08-25T04:45:39.476509+0000","last_clean":"2023-08-25T04:45:39.476509+0000","last_became_active":"2023-08-25T04:45:32.237542+0000","last_became_peered":"2023-08-25T04:45:32.237542+0000","last_unstale":"2023-08-25T04:45:39.476509+0000","last_undegraded":"2023-08-25T04:45:39.476509+0000","last_fullsized":"2023-08-25T04:45:39.476509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:31:55.456937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459530+0000","last_change":"2023-08-25T04:45:33.192515+0000","last_active":"2023-08-25T04:45:38.459530+0000","last_peered":"2023-08-25T04:45:38.459530+0000","last_clean":"2023-08-25T04:45:38.459530+0000","last_became_active":"2023-08-25T04:45:33.192143+0000","last_became_peered":"2023-08-25T04:45:33.192143+0000","last_unstale":"2023-08-25T04:45:38.459530+0000","last_undegraded":"2023-08-25T04:45:38.459530+0000","last_fullsized":"2023-08-25T04:45:38.459530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:30.901486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459477+0000","last_change":"2023-08-25T04:45:37.488063+0000","last_active":"2023-08-25T04:45:38.459477+0000","last_peered":"2023-08-25T04:45:38.459477+0000","last_clean":"2023-08-25T04:45:38.459477+0000","last_became_active":"2023-08-25T04:45:37.487757+0000","last_became_peered":"2023-08-25T04:45:37.487757+0000","last_unstale":"2023-08-25T04:45:38.459477+0000","last_undegraded":"2023-08-25T04:45:38.459477+0000","last_fullsized":"2023-08-25T04:45:38.459477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:09.769950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476402+0000","last_change":"2023-08-25T04:45:32.237033+0000","last_active":"2023-08-25T04:45:39.476402+0000","last_peered":"2023-08-25T04:45:39.476402+0000","last_clean":"2023-08-25T04:45:39.476402+0000","last_became_active":"2023-08-25T04:45:32.236722+0000","last_became_peered":"2023-08-25T04:45:32.236722+0000","last_unstale":"2023-08-25T04:45:39.476402+0000","last_undegraded":"2023-08-25T04:45:39.476402+0000","last_fullsized":"2023-08-25T04:45:39.476402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:40.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461087+0000","last_change":"2023-08-25T04:45:33.173339+0000","last_active":"2023-08-25T04:45:38.461087+0000","last_peered":"2023-08-25T04:45:38.461087+0000","last_clean":"2023-08-25T04:45:38.461087+0000","last_became_active":"2023-08-25T04:45:33.173001+0000","last_became_peered":"2023-08-25T04:45:33.173001+0000","last_unstale":"2023-08-25T04:45:38.461087+0000","last_undegraded":"2023-08-25T04:45:38.461087+0000","last_fullsized":"2023-08-25T04:45:38.461087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:40.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459839+0000","last_change":"2023-08-25T04:45:37.492765+0000","last_active":"2023-08-25T04:45:38.459839+0000","last_peered":"2023-08-25T04:45:38.459839+0000","last_clean":"2023-08-25T04:45:38.459839+0000","last_became_active":"2023-08-25T04:45:37.492429+0000","last_became_peered":"2023-08-25T04:45:37.492429+0000","last_unstale":"2023-08-25T04:45:38.459839+0000","last_undegraded":"2023-08-25T04:45:38.459839+0000","last_fullsized":"2023-08-25T04:45:38.459839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:19:28.095175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476148+0000","last_change":"2023-08-25T04:45:32.240462+0000","last_active":"2023-08-25T04:45:39.476148+0000","last_peered":"2023-08-25T04:45:39.476148+0000","last_clean":"2023-08-25T04:45:39.476148+0000","last_became_active":"2023-08-25T04:45:32.240196+0000","last_became_peered":"2023-08-25T04:45:32.240196+0000","last_unstale":"2023-08-25T04:45:39.476148+0000","last_undegraded":"2023-08-25T04:45:39.476148+0000","last_fullsized":"2023-08-25T04:45:39.476148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:17.564585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652550+0000","last_change":"2023-08-25T04:45:33.193608+0000","last_active":"2023-08-25T04:45:38.652550+0000","last_peered":"2023-08-25T04:45:38.652550+0000","last_clean":"2023-08-25T04:45:38.652550+0000","last_became_active":"2023-08-25T04:45:33.193118+0000","last_became_peered":"2023-08-25T04:45:33.193118+0000","last_unstale":"2023-08-25T04:45:38.652550+0000","last_undegraded":"2023-08-25T04:45:38.652550+0000","last_fullsized":"2023-08-25T04:45:38.652550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:32.968362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459765+0000","last_change":"2023-08-25T04:45:37.476345+0000","last_active":"2023-08-25T04:45:38.459765+0000","last_peered":"2023-08-25T04:45:38.459765+0000","last_clean":"2023-08-25T04:45:38.459765+0000","last_became_active":"2023-08-25T04:45:37.475874+0000","last_became_peered":"2023-08-25T04:45:37.475874+0000","last_unstale":"2023-08-25T04:45:38.459765+0000","last_undegraded":"2023-08-25T04:45:38.459765+0000","last_fullsized":"2023-08-25T04:45:38.459765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:00:54.571481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460487+0000","last_change":"2023-08-25T04:45:32.233694+0000","last_active":"2023-08-25T04:45:38.460487+0000","last_peered":"2023-08-25T04:45:38.460487+0000","last_clean":"2023-08-25T04:45:38.460487+0000","last_became_active":"2023-08-25T04:45:32.233412+0000","last_became_peered":"2023-08-25T04:45:32.233412+0000","last_unstale":"2023-08-25T04:45:38.460487+0000","last_undegraded":"2023-08-25T04:45:38.460487+0000","last_fullsized":"2023-08-25T04:45:38.460487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:29.595483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845836+0000","last_change":"2023-08-25T04:45:33.186227+0000","last_active":"2023-08-25T04:45:38.845836+0000","last_peered":"2023-08-25T04:45:38.845836+0000","last_clean":"2023-08-25T04:45:38.845836+0000","last_became_active":"2023-08-25T04:45:33.185317+0000","last_became_peered":"2023-08-25T04:45:33.185317+0000","last_unstale":"2023-08-25T04:45:38.845836+0000","last_undegraded":"2023-08-25T04:45:38.845836+0000","last_fullsized":"2023-08-25T04:45:38.845836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:39.932603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459653+0000","last_change":"2023-08-25T04:45:37.481516+0000","last_active":"2023-08-25T04:45:38.459653+0000","last_peered":"2023-08-25T04:45:38.459653+0000","last_clean":"2023-08-25T04:45:38.459653+0000","last_became_active":"2023-08-25T04:45:37.481121+0000","last_became_peered":"2023-08-25T04:45:37.481121+0000","last_unstale":"2023-08-25T04:45:38.459653+0000","last_undegraded":"2023-08-25T04:45:38.459653+0000","last_fullsized":"2023-08-25T04:45:38.459653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:26:41.512610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475607+0000","last_change":"2023-08-25T04:45:32.238750+0000","last_active":"2023-08-25T04:45:39.475607+0000","last_peered":"2023-08-25T04:45:39.475607+0000","last_clean":"2023-08-25T04:45:39.475607+0000","last_became_active":"2023-08-25T04:45:32.238446+0000","last_became_peered":"2023-08-25T04:45:32.238446+0000","last_unstale":"2023-08-25T04:45:39.475607+0000","last_undegraded":"2023-08-25T04:45:39.475607+0000","last_fullsized":"2023-08-25T04:45:39.475607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:09.729389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461964+0000","last_change":"2023-08-25T04:45:33.181796+0000","last_active":"2023-08-25T04:45:38.461964+0000","last_peered":"2023-08-25T04:45:38.461964+0000","last_clean":"2023-08-25T04:45:38.461964+0000","last_became_active":"2023-08-25T04:45:33.180064+0000","last_became_peered":"2023-08-25T04:45:33.180064+0000","last_unstale":"2023-08-25T04:45:38.461964+0000","last_undegraded":"2023-08-25T04:45:38.461964+0000","last_fullsized":"2023-08-25T04:45:38.461964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:00:02.188322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122491+0000","last_change":"2023-08-25T04:45:37.483736+0000","last_active":"2023-08-25T04:45:39.122491+0000","last_peered":"2023-08-25T04:45:39.122491+0000","last_clean":"2023-08-25T04:45:39.122491+0000","last_became_active":"2023-08-25T04:45:37.483361+0000","last_became_peered":"2023-08-25T04:45:37.483361+0000","last_unstale":"2023-08-25T04:45:39.122491+0000","last_undegraded":"2023-08-25T04:45:39.122491+0000","last_fullsized":"2023-08-25T04:45:39.122491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:19.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652579+0000","last_change":"2023-08-25T04:45:32.238540+0000","last_active":"2023-08-25T04:45:38.652579+0000","last_peered":"2023-08-25T04:45:38.652579+0000","last_clean":"2023-08-25T04:45:38.652579+0000","last_became_active":"2023-08-25T04:45:32.238265+0000","last_became_peered":"2023-08-25T04:45:32.238265+0000","last_unstale":"2023-08-25T04:45:38.652579+0000","last_undegraded":"2023-08-25T04:45:38.652579+0000","last_fullsized":"2023-08-25T04:45:38.652579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:29:01.273137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460742+0000","last_change":"2023-08-25T04:45:33.184042+0000","last_active":"2023-08-25T04:45:38.460742+0000","last_peered":"2023-08-25T04:45:38.460742+0000","last_clean":"2023-08-25T04:45:38.460742+0000","last_became_active":"2023-08-25T04:45:33.183680+0000","last_became_peered":"2023-08-25T04:45:33.183680+0000","last_unstale":"2023-08-25T04:45:38.460742+0000","last_undegraded":"2023-08-25T04:45:38.460742+0000","last_fullsized":"2023-08-25T04:45:38.460742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:41:39.595770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460726+0000","last_change":"2023-08-25T04:45:37.476840+0000","last_active":"2023-08-25T04:45:38.460726+0000","last_peered":"2023-08-25T04:45:38.460726+0000","last_clean":"2023-08-25T04:45:38.460726+0000","last_became_active":"2023-08-25T04:45:37.476291+0000","last_became_peered":"2023-08-25T04:45:37.476291+0000","last_unstale":"2023-08-25T04:45:38.460726+0000","last_undegraded":"2023-08-25T04:45:38.460726+0000","last_fullsized":"2023-08-25T04:45:38.460726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:45.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460720+0000","last_change":"2023-08-25T04:45:32.235065+0000","last_active":"2023-08-25T04:45:38.460720+0000","last_peered":"2023-08-25T04:45:38.460720+0000","last_clean":"2023-08-25T04:45:38.460720+0000","last_became_active":"2023-08-25T04:45:32.234777+0000","last_became_peered":"2023-08-25T04:45:32.234777+0000","last_unstale":"2023-08-25T04:45:38.460720+0000","last_undegraded":"2023-08-25T04:45:38.460720+0000","last_fullsized":"2023-08-25T04:45:38.460720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:01.625394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461475+0000","last_change":"2023-08-25T04:45:33.179314+0000","last_active":"2023-08-25T04:45:38.461475+0000","last_peered":"2023-08-25T04:45:38.461475+0000","last_clean":"2023-08-25T04:45:38.461475+0000","last_became_active":"2023-08-25T04:45:33.178995+0000","last_became_peered":"2023-08-25T04:45:33.178995+0000","last_unstale":"2023-08-25T04:45:38.461475+0000","last_undegraded":"2023-08-25T04:45:38.461475+0000","last_fullsized":"2023-08-25T04:45:38.461475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:48:01.925682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461005+0000","last_change":"2023-08-25T04:45:37.490254+0000","last_active":"2023-08-25T04:45:38.461005+0000","last_peered":"2023-08-25T04:45:38.461005+0000","last_clean":"2023-08-25T04:45:38.461005+0000","last_became_active":"2023-08-25T04:45:37.489836+0000","last_became_peered":"2023-08-25T04:45:37.489836+0000","last_unstale":"2023-08-25T04:45:38.461005+0000","last_undegraded":"2023-08-25T04:45:38.461005+0000","last_fullsized":"2023-08-25T04:45:38.461005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:41.717214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475327+0000","last_change":"2023-08-25T04:45:32.230980+0000","last_active":"2023-08-25T04:45:39.475327+0000","last_peered":"2023-08-25T04:45:39.475327+0000","last_clean":"2023-08-25T04:45:39.475327+0000","last_became_active":"2023-08-25T04:45:32.230712+0000","last_became_peered":"2023-08-25T04:45:32.230712+0000","last_unstale":"2023-08-25T04:45:39.475327+0000","last_undegraded":"2023-08-25T04:45:39.475327+0000","last_fullsized":"2023-08-25T04:45:39.475327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:20.718480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122672+0000","last_change":"2023-08-25T04:45:33.182453+0000","last_active":"2023-08-25T04:45:39.122672+0000","last_peered":"2023-08-25T04:45:39.122672+0000","last_clean":"2023-08-25T04:45:39.122672+0000","last_became_active":"2023-08-25T04:45:33.182169+0000","last_became_peered":"2023-08-25T04:45:33.182169+0000","last_unstale":"2023-08-25T04:45:39.122672+0000","last_undegraded":"2023-08-25T04:45:39.122672+0000","last_fullsized":"2023-08-25T04:45:39.122672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:30.597928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461232+0000","last_change":"2023-08-25T04:45:37.483595+0000","last_active":"2023-08-25T04:45:38.461232+0000","last_peered":"2023-08-25T04:45:38.461232+0000","last_clean":"2023-08-25T04:45:38.461232+0000","last_became_active":"2023-08-25T04:45:37.483087+0000","last_became_peered":"2023-08-25T04:45:37.483087+0000","last_unstale":"2023-08-25T04:45:38.461232+0000","last_undegraded":"2023-08-25T04:45:38.461232+0000","last_fullsized":"2023-08-25T04:45:38.461232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:11:09.671424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476157+0000","last_change":"2023-08-25T04:45:32.237401+0000","last_active":"2023-08-25T04:45:39.476157+0000","last_peered":"2023-08-25T04:45:39.476157+0000","last_clean":"2023-08-25T04:45:39.476157+0000","last_became_active":"2023-08-25T04:45:32.237147+0000","last_became_peered":"2023-08-25T04:45:32.237147+0000","last_unstale":"2023-08-25T04:45:39.476157+0000","last_undegraded":"2023-08-25T04:45:39.476157+0000","last_fullsized":"2023-08-25T04:45:39.476157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:20.177142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460896+0000","last_change":"2023-08-25T04:45:26.770775+0000","last_active":"2023-08-25T04:45:38.460896+0000","last_peered":"2023-08-25T04:45:38.460896+0000","last_clean":"2023-08-25T04:45:38.460896+0000","last_became_active":"2023-08-25T04:45:26.770447+0000","last_became_peered":"2023-08-25T04:45:26.770447+0000","last_unstale":"2023-08-25T04:45:38.460896+0000","last_undegraded":"2023-08-25T04:45:38.460896+0000","last_fullsized":"2023-08-25T04:45:38.460896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:02.164906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475251+0000","last_change":"2023-08-25T04:45:33.180113+0000","last_active":"2023-08-25T04:45:39.475251+0000","last_peered":"2023-08-25T04:45:39.475251+0000","last_clean":"2023-08-25T04:45:39.475251+0000","last_became_active":"2023-08-25T04:45:33.179859+0000","last_became_peered":"2023-08-25T04:45:33.179859+0000","last_unstale":"2023-08-25T04:45:39.475251+0000","last_undegraded":"2023-08-25T04:45:39.475251+0000","last_fullsized":"2023-08-25T04:45:39.475251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:26.444190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475239+0000","last_change":"2023-08-25T04:45:37.483731+0000","last_active":"2023-08-25T04:45:39.475239+0000","last_peered":"2023-08-25T04:45:39.475239+0000","last_clean":"2023-08-25T04:45:39.475239+0000","last_became_active":"2023-08-25T04:45:37.483367+0000","last_became_peered":"2023-08-25T04:45:37.483367+0000","last_unstale":"2023-08-25T04:45:39.475239+0000","last_undegraded":"2023-08-25T04:45:39.475239+0000","last_fullsized":"2023-08-25T04:45:39.475239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:04.371937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475657+0000","last_change":"2023-08-25T04:45:26.768222+0000","last_active":"2023-08-25T04:45:39.475657+0000","last_peered":"2023-08-25T04:45:39.475657+0000","last_clean":"2023-08-25T04:45:39.475657+0000","last_became_active":"2023-08-25T04:45:26.767875+0000","last_became_peered":"2023-08-25T04:45:26.767875+0000","last_unstale":"2023-08-25T04:45:39.475657+0000","last_undegraded":"2023-08-25T04:45:39.475657+0000","last_fullsized":"2023-08-25T04:45:39.475657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:31:22.454559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845648+0000","last_change":"2023-08-25T04:45:32.238276+0000","last_active":"2023-08-25T04:45:38.845648+0000","last_peered":"2023-08-25T04:45:38.845648+0000","last_clean":"2023-08-25T04:45:38.845648+0000","last_became_active":"2023-08-25T04:45:32.237881+0000","last_became_peered":"2023-08-25T04:45:32.237881+0000","last_unstale":"2023-08-25T04:45:38.845648+0000","last_undegraded":"2023-08-25T04:45:38.845648+0000","last_fullsized":"2023-08-25T04:45:38.845648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:49.755802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460946+0000","last_change":"2023-08-25T04:45:33.175073+0000","last_active":"2023-08-25T04:45:38.460946+0000","last_peered":"2023-08-25T04:45:38.460946+0000","last_clean":"2023-08-25T04:45:38.460946+0000","last_became_active":"2023-08-25T04:45:33.174739+0000","last_became_peered":"2023-08-25T04:45:33.174739+0000","last_unstale":"2023-08-25T04:45:38.460946+0000","last_undegraded":"2023-08-25T04:45:38.460946+0000","last_fullsized":"2023-08-25T04:45:38.460946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:21.179587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460451+0000","last_change":"2023-08-25T04:45:37.491239+0000","last_active":"2023-08-25T04:45:38.460451+0000","last_peered":"2023-08-25T04:45:38.460451+0000","last_clean":"2023-08-25T04:45:38.460451+0000","last_became_active":"2023-08-25T04:45:37.490902+0000","last_became_peered":"2023-08-25T04:45:37.490902+0000","last_unstale":"2023-08-25T04:45:38.460451+0000","last_undegraded":"2023-08-25T04:45:38.460451+0000","last_fullsized":"2023-08-25T04:45:38.460451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:27.559835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122041+0000","last_change":"2023-08-25T04:45:26.767948+0000","last_active":"2023-08-25T04:45:39.122041+0000","last_peered":"2023-08-25T04:45:39.122041+0000","last_clean":"2023-08-25T04:45:39.122041+0000","last_became_active":"2023-08-25T04:45:26.767496+0000","last_became_peered":"2023-08-25T04:45:26.767496+0000","last_unstale":"2023-08-25T04:45:39.122041+0000","last_undegraded":"2023-08-25T04:45:39.122041+0000","last_fullsized":"2023-08-25T04:45:39.122041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:13.795305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475898+0000","last_change":"2023-08-25T04:45:27.771979+0000","last_active":"2023-08-25T04:45:39.475898+0000","last_peered":"2023-08-25T04:45:39.475898+0000","last_clean":"2023-08-25T04:45:39.475898+0000","last_became_active":"2023-08-25T04:45:27.770968+0000","last_became_peered":"2023-08-25T04:45:27.770968+0000","last_unstale":"2023-08-25T04:45:39.475898+0000","last_undegraded":"2023-08-25T04:45:39.475898+0000","last_fullsized":"2023-08-25T04:45:39.475898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_clean_scrub_stamp":"2023-08-25T04:45:26.752521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:46.377207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845326+0000","last_change":"2023-08-25T04:45:32.242202+0000","last_active":"2023-08-25T04:45:38.845326+0000","last_peered":"2023-08-25T04:45:38.845326+0000","last_clean":"2023-08-25T04:45:38.845326+0000","last_became_active":"2023-08-25T04:45:32.241904+0000","last_became_peered":"2023-08-25T04:45:32.241904+0000","last_unstale":"2023-08-25T04:45:38.845326+0000","last_undegraded":"2023-08-25T04:45:38.845326+0000","last_fullsized":"2023-08-25T04:45:38.845326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:49.404002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845976+0000","last_change":"2023-08-25T04:45:33.187739+0000","last_active":"2023-08-25T04:45:38.845976+0000","last_peered":"2023-08-25T04:45:38.845976+0000","last_clean":"2023-08-25T04:45:38.845976+0000","last_became_active":"2023-08-25T04:45:33.186521+0000","last_became_peered":"2023-08-25T04:45:33.186521+0000","last_unstale":"2023-08-25T04:45:38.845976+0000","last_undegraded":"2023-08-25T04:45:38.845976+0000","last_fullsized":"2023-08-25T04:45:38.845976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:51.831184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460199+0000","last_change":"2023-08-25T04:45:37.488145+0000","last_active":"2023-08-25T04:45:38.460199+0000","last_peered":"2023-08-25T04:45:38.460199+0000","last_clean":"2023-08-25T04:45:38.460199+0000","last_became_active":"2023-08-25T04:45:37.487669+0000","last_became_peered":"2023-08-25T04:45:37.487669+0000","last_unstale":"2023-08-25T04:45:38.460199+0000","last_undegraded":"2023-08-25T04:45:38.460199+0000","last_fullsized":"2023-08-25T04:45:38.460199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:16.119177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475782+0000","last_change":"2023-08-25T04:45:26.807286+0000","last_active":"2023-08-25T04:45:39.475782+0000","last_peered":"2023-08-25T04:45:39.475782+0000","last_clean":"2023-08-25T04:45:39.475782+0000","last_became_active":"2023-08-25T04:45:26.806698+0000","last_became_peered":"2023-08-25T04:45:26.806698+0000","last_unstale":"2023-08-25T04:45:39.475782+0000","last_undegraded":"2023-08-25T04:45:39.475782+0000","last_fullsized":"2023-08-25T04:45:39.475782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:28.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121731+0000","last_change":"2023-08-25T04:45:32.233634+0000","last_active":"2023-08-25T04:45:39.121731+0000","last_peered":"2023-08-25T04:45:39.121731+0000","last_clean":"2023-08-25T04:45:39.121731+0000","last_became_active":"2023-08-25T04:45:32.233114+0000","last_became_peered":"2023-08-25T04:45:32.233114+0000","last_unstale":"2023-08-25T04:45:39.121731+0000","last_undegraded":"2023-08-25T04:45:39.121731+0000","last_fullsized":"2023-08-25T04:45:39.121731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:41:01.219246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122577+0000","last_change":"2023-08-25T04:45:33.176186+0000","last_active":"2023-08-25T04:45:39.122577+0000","last_peered":"2023-08-25T04:45:39.122577+0000","last_clean":"2023-08-25T04:45:39.122577+0000","last_became_active":"2023-08-25T04:45:33.175948+0000","last_became_peered":"2023-08-25T04:45:33.175948+0000","last_unstale":"2023-08-25T04:45:39.122577+0000","last_undegraded":"2023-08-25T04:45:39.122577+0000","last_fullsized":"2023-08-25T04:45:39.122577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:23.323498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.476087+0000","last_change":"2023-08-25T04:45:37.488913+0000","last_active":"2023-08-25T04:45:39.476087+0000","last_peered":"2023-08-25T04:45:39.476087+0000","last_clean":"2023-08-25T04:45:39.476087+0000","last_became_active":"2023-08-25T04:45:37.488517+0000","last_became_peered":"2023-08-25T04:45:37.488517+0000","last_unstale":"2023-08-25T04:45:39.476087+0000","last_undegraded":"2023-08-25T04:45:39.476087+0000","last_fullsized":"2023-08-25T04:45:39.476087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:56.688517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475596+0000","last_change":"2023-08-25T04:45:26.807096+0000","last_active":"2023-08-25T04:45:39.475596+0000","last_peered":"2023-08-25T04:45:39.475596+0000","last_clean":"2023-08-25T04:45:39.475596+0000","last_became_active":"2023-08-25T04:45:26.806713+0000","last_became_peered":"2023-08-25T04:45:26.806713+0000","last_unstale":"2023-08-25T04:45:39.475596+0000","last_undegraded":"2023-08-25T04:45:39.475596+0000","last_fullsized":"2023-08-25T04:45:39.475596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:35.196391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475423+0000","last_change":"2023-08-25T04:45:32.228181+0000","last_active":"2023-08-25T04:45:39.475423+0000","last_peered":"2023-08-25T04:45:39.475423+0000","last_clean":"2023-08-25T04:45:39.475423+0000","last_became_active":"2023-08-25T04:45:32.227866+0000","last_became_peered":"2023-08-25T04:45:32.227866+0000","last_unstale":"2023-08-25T04:45:39.475423+0000","last_undegraded":"2023-08-25T04:45:39.475423+0000","last_fullsized":"2023-08-25T04:45:39.475423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:11.034422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653005+0000","last_change":"2023-08-25T04:45:33.189112+0000","last_active":"2023-08-25T04:45:38.653005+0000","last_peered":"2023-08-25T04:45:38.653005+0000","last_clean":"2023-08-25T04:45:38.653005+0000","last_became_active":"2023-08-25T04:45:33.188826+0000","last_became_peered":"2023-08-25T04:45:33.188826+0000","last_unstale":"2023-08-25T04:45:38.653005+0000","last_undegraded":"2023-08-25T04:45:38.653005+0000","last_fullsized":"2023-08-25T04:45:38.653005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:37.230837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845808+0000","last_change":"2023-08-25T04:45:37.484004+0000","last_active":"2023-08-25T04:45:38.845808+0000","last_peered":"2023-08-25T04:45:38.845808+0000","last_clean":"2023-08-25T04:45:38.845808+0000","last_became_active":"2023-08-25T04:45:37.483640+0000","last_became_peered":"2023-08-25T04:45:37.483640+0000","last_unstale":"2023-08-25T04:45:38.845808+0000","last_undegraded":"2023-08-25T04:45:38.845808+0000","last_fullsized":"2023-08-25T04:45:38.845808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:55.756428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459530+0000","last_change":"2023-08-25T04:45:26.807065+0000","last_active":"2023-08-25T04:45:38.459530+0000","last_peered":"2023-08-25T04:45:38.459530+0000","last_clean":"2023-08-25T04:45:38.459530+0000","last_became_active":"2023-08-25T04:45:26.806737+0000","last_became_peered":"2023-08-25T04:45:26.806737+0000","last_unstale":"2023-08-25T04:45:38.459530+0000","last_undegraded":"2023-08-25T04:45:38.459530+0000","last_fullsized":"2023-08-25T04:45:38.459530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:11.279650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461215+0000","last_change":"2023-08-25T04:45:32.243699+0000","last_active":"2023-08-25T04:45:38.461215+0000","last_peered":"2023-08-25T04:45:38.461215+0000","last_clean":"2023-08-25T04:45:38.461215+0000","last_became_active":"2023-08-25T04:45:32.243274+0000","last_became_peered":"2023-08-25T04:45:32.243274+0000","last_unstale":"2023-08-25T04:45:38.461215+0000","last_undegraded":"2023-08-25T04:45:38.461215+0000","last_fullsized":"2023-08-25T04:45:38.461215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:24.791647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121774+0000","last_change":"2023-08-25T04:45:33.168891+0000","last_active":"2023-08-25T04:45:39.121774+0000","last_peered":"2023-08-25T04:45:39.121774+0000","last_clean":"2023-08-25T04:45:39.121774+0000","last_became_active":"2023-08-25T04:45:33.168678+0000","last_became_peered":"2023-08-25T04:45:33.168678+0000","last_unstale":"2023-08-25T04:45:39.121774+0000","last_undegraded":"2023-08-25T04:45:39.121774+0000","last_fullsized":"2023-08-25T04:45:39.121774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:33:22.522440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653080+0000","last_change":"2023-08-25T04:45:37.485021+0000","last_active":"2023-08-25T04:45:38.653080+0000","last_peered":"2023-08-25T04:45:38.653080+0000","last_clean":"2023-08-25T04:45:38.653080+0000","last_became_active":"2023-08-25T04:45:37.484610+0000","last_became_peered":"2023-08-25T04:45:37.484610+0000","last_unstale":"2023-08-25T04:45:38.653080+0000","last_undegraded":"2023-08-25T04:45:38.653080+0000","last_fullsized":"2023-08-25T04:45:38.653080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:10.974671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653028+0000","last_change":"2023-08-25T04:45:26.807090+0000","last_active":"2023-08-25T04:45:38.653028+0000","last_peered":"2023-08-25T04:45:38.653028+0000","last_clean":"2023-08-25T04:45:38.653028+0000","last_became_active":"2023-08-25T04:45:26.806685+0000","last_became_peered":"2023-08-25T04:45:26.806685+0000","last_unstale":"2023-08-25T04:45:38.653028+0000","last_undegraded":"2023-08-25T04:45:38.653028+0000","last_fullsized":"2023-08-25T04:45:38.653028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:15.681823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121905+0000","last_change":"2023-08-25T04:45:32.233460+0000","last_active":"2023-08-25T04:45:39.121905+0000","last_peered":"2023-08-25T04:45:39.121905+0000","last_clean":"2023-08-25T04:45:39.121905+0000","last_became_active":"2023-08-25T04:45:32.233102+0000","last_became_peered":"2023-08-25T04:45:32.233102+0000","last_unstale":"2023-08-25T04:45:39.121905+0000","last_undegraded":"2023-08-25T04:45:39.121905+0000","last_fullsized":"2023-08-25T04:45:39.121905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:32.845760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845981+0000","last_change":"2023-08-25T04:45:33.177772+0000","last_active":"2023-08-25T04:45:38.845981+0000","last_peered":"2023-08-25T04:45:38.845981+0000","last_clean":"2023-08-25T04:45:38.845981+0000","last_became_active":"2023-08-25T04:45:33.177547+0000","last_became_peered":"2023-08-25T04:45:33.177547+0000","last_unstale":"2023-08-25T04:45:38.845981+0000","last_undegraded":"2023-08-25T04:45:38.845981+0000","last_fullsized":"2023-08-25T04:45:38.845981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:52.452180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845774+0000","last_change":"2023-08-25T04:45:37.490313+0000","last_active":"2023-08-25T04:45:38.845774+0000","last_peered":"2023-08-25T04:45:38.845774+0000","last_clean":"2023-08-25T04:45:38.845774+0000","last_became_active":"2023-08-25T04:45:37.489828+0000","last_became_peered":"2023-08-25T04:45:37.489828+0000","last_unstale":"2023-08-25T04:45:38.845774+0000","last_undegraded":"2023-08-25T04:45:38.845774+0000","last_fullsized":"2023-08-25T04:45:38.845774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:45.889332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.653039+0000","last_change":"2023-08-25T04:45:26.768150+0000","last_active":"2023-08-25T04:45:38.653039+0000","last_peered":"2023-08-25T04:45:38.653039+0000","last_clean":"2023-08-25T04:45:38.653039+0000","last_became_active":"2023-08-25T04:45:26.767845+0000","last_became_peered":"2023-08-25T04:45:26.767845+0000","last_unstale":"2023-08-25T04:45:38.653039+0000","last_undegraded":"2023-08-25T04:45:38.653039+0000","last_fullsized":"2023-08-25T04:45:38.653039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:42.888555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460497+0000","last_change":"2023-08-25T04:45:32.235113+0000","last_active":"2023-08-25T04:45:38.460497+0000","last_peered":"2023-08-25T04:45:38.460497+0000","last_clean":"2023-08-25T04:45:38.460497+0000","last_became_active":"2023-08-25T04:45:32.234769+0000","last_became_peered":"2023-08-25T04:45:32.234769+0000","last_unstale":"2023-08-25T04:45:38.460497+0000","last_undegraded":"2023-08-25T04:45:38.460497+0000","last_fullsized":"2023-08-25T04:45:38.460497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:04.089871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121833+0000","last_change":"2023-08-25T04:45:33.176251+0000","last_active":"2023-08-25T04:45:39.121833+0000","last_peered":"2023-08-25T04:45:39.121833+0000","last_clean":"2023-08-25T04:45:39.121833+0000","last_became_active":"2023-08-25T04:45:33.175905+0000","last_became_peered":"2023-08-25T04:45:33.175905+0000","last_unstale":"2023-08-25T04:45:39.121833+0000","last_undegraded":"2023-08-25T04:45:39.121833+0000","last_fullsized":"2023-08-25T04:45:39.121833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:17.736254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122068+0000","last_change":"2023-08-25T04:45:37.490783+0000","last_active":"2023-08-25T04:45:39.122068+0000","last_peered":"2023-08-25T04:45:39.122068+0000","last_clean":"2023-08-25T04:45:39.122068+0000","last_became_active":"2023-08-25T04:45:37.490007+0000","last_became_peered":"2023-08-25T04:45:37.490007+0000","last_unstale":"2023-08-25T04:45:39.122068+0000","last_undegraded":"2023-08-25T04:45:39.122068+0000","last_fullsized":"2023-08-25T04:45:39.122068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:50.054137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845866+0000","last_change":"2023-08-25T04:45:32.242734+0000","last_active":"2023-08-25T04:45:38.845866+0000","last_peered":"2023-08-25T04:45:38.845866+0000","last_clean":"2023-08-25T04:45:38.845866+0000","last_became_active":"2023-08-25T04:45:32.241971+0000","last_became_peered":"2023-08-25T04:45:32.241971+0000","last_unstale":"2023-08-25T04:45:38.845866+0000","last_undegraded":"2023-08-25T04:45:38.845866+0000","last_fullsized":"2023-08-25T04:45:38.845866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:17:09.408135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.459937+0000","last_change":"2023-08-25T04:45:33.173345+0000","last_active":"2023-08-25T04:45:38.459937+0000","last_peered":"2023-08-25T04:45:38.459937+0000","last_clean":"2023-08-25T04:45:38.459937+0000","last_became_active":"2023-08-25T04:45:33.173020+0000","last_became_peered":"2023-08-25T04:45:33.173020+0000","last_unstale":"2023-08-25T04:45:38.459937+0000","last_undegraded":"2023-08-25T04:45:38.459937+0000","last_fullsized":"2023-08-25T04:45:38.459937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:25:18.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475713+0000","last_change":"2023-08-25T04:45:37.489214+0000","last_active":"2023-08-25T04:45:39.475713+0000","last_peered":"2023-08-25T04:45:39.475713+0000","last_clean":"2023-08-25T04:45:39.475713+0000","last_became_active":"2023-08-25T04:45:37.488142+0000","last_became_peered":"2023-08-25T04:45:37.488142+0000","last_unstale":"2023-08-25T04:45:39.475713+0000","last_undegraded":"2023-08-25T04:45:39.475713+0000","last_fullsized":"2023-08-25T04:45:39.475713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:44.168940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460273+0000","last_change":"2023-08-25T04:45:32.237652+0000","last_active":"2023-08-25T04:45:38.460273+0000","last_peered":"2023-08-25T04:45:38.460273+0000","last_clean":"2023-08-25T04:45:38.460273+0000","last_became_active":"2023-08-25T04:45:32.237377+0000","last_became_peered":"2023-08-25T04:45:32.237377+0000","last_unstale":"2023-08-25T04:45:38.460273+0000","last_undegraded":"2023-08-25T04:45:38.460273+0000","last_fullsized":"2023-08-25T04:45:38.460273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:49.404002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461705+0000","last_change":"2023-08-25T04:45:33.186012+0000","last_active":"2023-08-25T04:45:38.461705+0000","last_peered":"2023-08-25T04:45:38.461705+0000","last_clean":"2023-08-25T04:45:38.461705+0000","last_became_active":"2023-08-25T04:45:33.185728+0000","last_became_peered":"2023-08-25T04:45:33.185728+0000","last_unstale":"2023-08-25T04:45:38.461705+0000","last_undegraded":"2023-08-25T04:45:38.461705+0000","last_fullsized":"2023-08-25T04:45:38.461705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:13.906330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460189+0000","last_change":"2023-08-25T04:45:37.491674+0000","last_active":"2023-08-25T04:45:38.460189+0000","last_peered":"2023-08-25T04:45:38.460189+0000","last_clean":"2023-08-25T04:45:38.460189+0000","last_became_active":"2023-08-25T04:45:37.491231+0000","last_became_peered":"2023-08-25T04:45:37.491231+0000","last_unstale":"2023-08-25T04:45:38.460189+0000","last_undegraded":"2023-08-25T04:45:38.460189+0000","last_fullsized":"2023-08-25T04:45:38.460189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:38.084542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460262+0000","last_change":"2023-08-25T04:45:32.237694+0000","last_active":"2023-08-25T04:45:38.460262+0000","last_peered":"2023-08-25T04:45:38.460262+0000","last_clean":"2023-08-25T04:45:38.460262+0000","last_became_active":"2023-08-25T04:45:32.237349+0000","last_became_peered":"2023-08-25T04:45:32.237349+0000","last_unstale":"2023-08-25T04:45:38.460262+0000","last_undegraded":"2023-08-25T04:45:38.460262+0000","last_fullsized":"2023-08-25T04:45:38.460262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:19.249464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461404+0000","last_change":"2023-08-25T04:45:33.182578+0000","last_active":"2023-08-25T04:45:38.461404+0000","last_peered":"2023-08-25T04:45:38.461404+0000","last_clean":"2023-08-25T04:45:38.461404+0000","last_became_active":"2023-08-25T04:45:33.182247+0000","last_became_peered":"2023-08-25T04:45:33.182247+0000","last_unstale":"2023-08-25T04:45:38.461404+0000","last_undegraded":"2023-08-25T04:45:38.461404+0000","last_fullsized":"2023-08-25T04:45:38.461404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:07.921112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460509+0000","last_change":"2023-08-25T04:45:37.474385+0000","last_active":"2023-08-25T04:45:38.460509+0000","last_peered":"2023-08-25T04:45:38.460509+0000","last_clean":"2023-08-25T04:45:38.460509+0000","last_became_active":"2023-08-25T04:45:37.473906+0000","last_became_peered":"2023-08-25T04:45:37.473906+0000","last_unstale":"2023-08-25T04:45:38.460509+0000","last_undegraded":"2023-08-25T04:45:38.460509+0000","last_fullsized":"2023-08-25T04:45:38.460509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:54:14.466417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475836+0000","last_change":"2023-08-25T04:45:32.230006+0000","last_active":"2023-08-25T04:45:39.475836+0000","last_peered":"2023-08-25T04:45:39.475836+0000","last_clean":"2023-08-25T04:45:39.475836+0000","last_became_active":"2023-08-25T04:45:32.229669+0000","last_became_peered":"2023-08-25T04:45:32.229669+0000","last_unstale":"2023-08-25T04:45:39.475836+0000","last_undegraded":"2023-08-25T04:45:39.475836+0000","last_fullsized":"2023-08-25T04:45:39.475836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:05.707508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475400+0000","last_change":"2023-08-25T04:45:33.191243+0000","last_active":"2023-08-25T04:45:39.475400+0000","last_peered":"2023-08-25T04:45:39.475400+0000","last_clean":"2023-08-25T04:45:39.475400+0000","last_became_active":"2023-08-25T04:45:33.190978+0000","last_became_peered":"2023-08-25T04:45:33.190978+0000","last_unstale":"2023-08-25T04:45:39.475400+0000","last_undegraded":"2023-08-25T04:45:39.475400+0000","last_fullsized":"2023-08-25T04:45:39.475400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:31:56.459382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.122653+0000","last_change":"2023-08-25T04:45:37.480208+0000","last_active":"2023-08-25T04:45:39.122653+0000","last_peered":"2023-08-25T04:45:39.122653+0000","last_clean":"2023-08-25T04:45:39.122653+0000","last_became_active":"2023-08-25T04:45:37.479756+0000","last_became_peered":"2023-08-25T04:45:37.479756+0000","last_unstale":"2023-08-25T04:45:39.122653+0000","last_undegraded":"2023-08-25T04:45:39.122653+0000","last_fullsized":"2023-08-25T04:45:39.122653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:36.442835+0000","last_clean_scrub_stamp":"2023-08-25T04:45:36.442835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:09.328653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.845931+0000","last_change":"2023-08-25T04:45:32.242698+0000","last_active":"2023-08-25T04:45:38.845931+0000","last_peered":"2023-08-25T04:45:38.845931+0000","last_clean":"2023-08-25T04:45:38.845931+0000","last_became_active":"2023-08-25T04:45:32.242434+0000","last_became_peered":"2023-08-25T04:45:32.242434+0000","last_unstale":"2023-08-25T04:45:38.845931+0000","last_undegraded":"2023-08-25T04:45:38.845931+0000","last_fullsized":"2023-08-25T04:45:38.845931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:31.204053+0000","last_clean_scrub_stamp":"2023-08-25T04:45:31.204053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:22:28.862067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.460720+0000","last_change":"2023-08-25T04:45:33.178625+0000","last_active":"2023-08-25T04:45:38.460720+0000","last_peered":"2023-08-25T04:45:38.460720+0000","last_clean":"2023-08-25T04:45:38.460720+0000","last_became_active":"2023-08-25T04:45:33.178339+0000","last_became_peered":"2023-08-25T04:45:33.178339+0000","last_unstale":"2023-08-25T04:45:38.460720+0000","last_undegraded":"2023-08-25T04:45:38.460720+0000","last_fullsized":"2023-08-25T04:45:38.460720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:27.545798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.652789+0000","last_change":"2023-08-25T04:45:33.184848+0000","last_active":"2023-08-25T04:45:38.652789+0000","last_peered":"2023-08-25T04:45:38.652789+0000","last_clean":"2023-08-25T04:45:38.652789+0000","last_became_active":"2023-08-25T04:45:33.184561+0000","last_became_peered":"2023-08-25T04:45:33.184561+0000","last_unstale":"2023-08-25T04:45:38.652789+0000","last_undegraded":"2023-08-25T04:45:38.652789+0000","last_fullsized":"2023-08-25T04:45:38.652789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:51.096987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475832+0000","last_change":"2023-08-25T04:45:33.191054+0000","last_active":"2023-08-25T04:45:39.475832+0000","last_peered":"2023-08-25T04:45:39.475832+0000","last_clean":"2023-08-25T04:45:39.475832+0000","last_became_active":"2023-08-25T04:45:33.190791+0000","last_became_peered":"2023-08-25T04:45:33.190791+0000","last_unstale":"2023-08-25T04:45:39.475832+0000","last_undegraded":"2023-08-25T04:45:39.475832+0000","last_fullsized":"2023-08-25T04:45:39.475832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:11.510859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:38.461862+0000","last_change":"2023-08-25T04:45:33.189475+0000","last_active":"2023-08-25T04:45:38.461862+0000","last_peered":"2023-08-25T04:45:38.461862+0000","last_clean":"2023-08-25T04:45:38.461862+0000","last_became_active":"2023-08-25T04:45:33.189067+0000","last_became_peered":"2023-08-25T04:45:33.189067+0000","last_unstale":"2023-08-25T04:45:38.461862+0000","last_undegraded":"2023-08-25T04:45:38.461862+0000","last_fullsized":"2023-08-25T04:45:38.461862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:19.369230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.475668+0000","last_change":"2023-08-25T04:45:33.193380+0000","last_active":"2023-08-25T04:45:39.475668+0000","last_peered":"2023-08-25T04:45:39.475668+0000","last_clean":"2023-08-25T04:45:39.475668+0000","last_became_active":"2023-08-25T04:45:33.193083+0000","last_became_peered":"2023-08-25T04:45:33.193083+0000","last_unstale":"2023-08-25T04:45:39.475668+0000","last_undegraded":"2023-08-25T04:45:39.475668+0000","last_fullsized":"2023-08-25T04:45:39.475668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:19:48.510004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-25T04:45:39.121877+0000","last_change":"2023-08-25T04:45:33.180446+0000","last_active":"2023-08-25T04:45:39.121877+0000","last_peered":"2023-08-25T04:45:39.121877+0000","last_clean":"2023-08-25T04:45:39.121877+0000","last_became_active":"2023-08-25T04:45:33.179711+0000","last_became_peered":"2023-08-25T04:45:33.179711+0000","last_unstale":"2023-08-25T04:45:39.121877+0000","last_undegraded":"2023-08-25T04:45:39.121877+0000","last_fullsized":"2023-08-25T04:45:39.121877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:32.206498+0000","last_clean_scrub_stamp":"2023-08-25T04:45:32.206498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:10.645818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":704188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":700130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":109852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:46:05.155 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-25T04:46:05.155 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-25T04:46:05.156 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-25T04:46:05.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-25T04:46:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.381+0000 7f433e3ff700 1 Processor -- start 2023-08-25T04:46:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.381+0000 7f433e3ff700 1 -- start start 2023-08-25T04:46:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.382+0000 7f433e3ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f433815ce60 0x7f43380d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.382+0000 7f433e3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43380b8770 0x7f43380d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.382+0000 7f433e3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43380d1fe0 con 0x7f43380cda40 2023-08-25T04:46:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.382+0000 7f433e3ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43380d13d0 con 0x7f433815ce60 2023-08-25T04:46:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.382+0000 7f433e3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43380d16b0 con 0x7f43380b8770 2023-08-25T04:46:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.382+0000 7f433c99c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f43380cda40 0x7f43380b5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41712/0 (socket says 172.21.15.72:41712) 2023-08-25T04:46:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.382+0000 7f433c99c700 1 -- 172.21.15.72:0/4097407185 learned_addr learned my addr 172.21.15.72:0/4097407185 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.382+0000 7f4337fff700 1 --2- 172.21.15.72:0/4097407185 >> v2:172.21.15.137:3300/0 conn(0x7f433815ce60 0x7f43380d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.382+0000 7f43377fe700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43380b8770 0x7f43380d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.382+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770239947 0 0) 0x7f43380d1fe0 con 0x7f43380cda40 2023-08-25T04:46:05.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43200035b0 con 0x7f43380cda40 2023-08-25T04:46:05.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2488412720 0 0) 0x7f43200035b0 con 0x7f43380cda40 2023-08-25T04:46:05.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43380b8770 msgr2=0x7f43380d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:05.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43380b8770 0x7f43380d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 >> v2:172.21.15.137:3300/0 conn(0x7f433815ce60 msgr2=0x7f43380d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:05.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 --2- 172.21.15.72:0/4097407185 >> v2:172.21.15.137:3300/0 conn(0x7f433815ce60 0x7f43380d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43380d1990 con 0x7f43380cda40 2023-08-25T04:46:05.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f43300019f0 con 0x7f43380cda40 2023-08-25T04:46:05.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 >> v1:172.21.15.72:6789/0 conn(0x7f43380cda40 legacy=0x7f43380b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43380b8770 0x7f4320003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 0x7f4320004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4320004d90 0x7f4320005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380d13d0 con 0x7f4320003f80 2023-08-25T04:46:05.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380d16b0 con 0x7f4320004d90 2023-08-25T04:46:05.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432000ba60 con 0x7f43380b8770 2023-08-25T04:46:05.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f43377fe700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 0x7f4320004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f4337fff700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43380b8770 0x7f4320003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.383+0000 7f433c99c700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4320004d90 0x7f4320005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.384+0000 7f43377fe700 1 -- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43380b8770 msgr2=0x7f4320003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:05.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.384+0000 7f43377fe700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f43380b8770 0x7f4320003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.384+0000 7f43377fe700 1 -- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4320004d90 msgr2=0x7f4320005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:05.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.384+0000 7f43377fe700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4320004d90 0x7f4320005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.384+0000 7f43377fe700 1 -- 172.21.15.72:0/4097407185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200035b0 con 0x7f4320003f80 2023-08-25T04:46:05.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.384+0000 7f43377fe700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 0x7f4320004850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f432c009b90 tx=0x7f4320005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2831d80920f524 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:05.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.384+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c00e6c0 con 0x7f4320003f80 2023-08-25T04:46:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.384+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c00e820 con 0x7f4320003f80 2023-08-25T04:46:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.384+0000 7f4336ffd700 1 -- 172.21.15.72:0/4097407185 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c00eb90 con 0x7f4320003f80 2023-08-25T04:46:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.385+0000 7f433e3ff700 1 -- 172.21.15.72:0/4097407185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 msgr2=0x7f4320004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.385+0000 7f433e3ff700 1 --2- 172.21.15.72:0/4097407185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 0x7f4320004850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f432c009b90 tx=0x7f4320005880 comp rx=0 tx=0).stop 2023-08-25T04:46:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.385+0000 7f433c99c700 1 -- 172.21.15.72:0/4097407185 reap_dead start 2023-08-25T04:46:05.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.385+0000 7f433e3ff700 1 -- 172.21.15.72:0/4097407185 shutdown_connections 2023-08-25T04:46:05.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.385+0000 7f433e3ff700 1 -- 172.21.15.72:0/4097407185 >> 172.21.15.72:0/4097407185 conn(0x7f4338071e10 msgr2=0x7f4338072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:05.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.385+0000 7f433e3ff700 1 -- 172.21.15.72:0/4097407185 shutdown_connections 2023-08-25T04:46:05.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.385+0000 7f433e3ff700 1 -- 172.21.15.72:0/4097407185 wait complete. 2023-08-25T04:46:05.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.387+0000 7f433e3ff700 1 Processor -- start 2023-08-25T04:46:05.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.387+0000 7f433e3ff700 1 -- start start 2023-08-25T04:46:05.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f433e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 0x7f433815f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f433e3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43380c7100 0x7f43380cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f433e3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4338159370 0x7f43380d0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f433e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380c81a0 con 0x7f4320003f80 2023-08-25T04:46:05.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f433e3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380c7590 con 0x7f43380c7100 2023-08-25T04:46:05.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f433e3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43380c7870 con 0x7f4338159370 2023-08-25T04:46:05.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f4337fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 0x7f433815f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f4337fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 0x7f433815f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57902/0 (socket says 172.21.15.72:57902) 2023-08-25T04:46:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f4337fff700 1 -- 172.21.15.72:0/2450980093 learned_addr learned my addr 172.21.15.72:0/2450980093 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f43377fe700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43380c7100 0x7f43380cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f433c99c700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4338159370 0x7f43380d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f4337fff700 1 -- 172.21.15.72:0/2450980093 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4338159370 msgr2=0x7f43380d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f4337fff700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4338159370 0x7f43380d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f4337fff700 1 -- 172.21.15.72:0/2450980093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43380c7100 msgr2=0x7f43380cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f4337fff700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43380c7100 0x7f43380cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f4337fff700 1 -- 172.21.15.72:0/2450980093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43380c7b50 con 0x7f4320003f80 2023-08-25T04:46:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f43377fe700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43380c7100 0x7f43380cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.388+0000 7f433c99c700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4338159370 0x7f43380d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.389+0000 7f4337fff700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 0x7f433815f350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4328011aa0 tx=0x7f4328011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.389+0000 7f4334ff9700 1 -- 172.21.15.72:0/2450980093 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432800f9e0 con 0x7f4320003f80 2023-08-25T04:46:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.389+0000 7f4334ff9700 1 -- 172.21.15.72:0/2450980093 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432800fb40 con 0x7f4320003f80 2023-08-25T04:46:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.389+0000 7f4334ff9700 1 -- 172.21.15.72:0/2450980093 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328014440 con 0x7f4320003f80 2023-08-25T04:46:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.389+0000 7f433e3ff700 1 -- 172.21.15.72:0/2450980093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43380c7e30 con 0x7f4320003f80 2023-08-25T04:46:05.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.389+0000 7f433e3ff700 1 -- 172.21.15.72:0/2450980093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433815f890 con 0x7f4320003f80 2023-08-25T04:46:05.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.390+0000 7f433e3ff700 1 -- 172.21.15.72:0/2450980093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43380c8480 con 0x7f4320003f80 2023-08-25T04:46:05.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.391+0000 7f4334ff9700 1 -- 172.21.15.72:0/2450980093 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f43280145a0 con 0x7f4320003f80 2023-08-25T04:46:05.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.392+0000 7f4334ff9700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f432406a0e0 0x7f432406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.392+0000 7f4334ff9700 1 -- 172.21.15.72:0/2450980093 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4328089090 con 0x7f4320003f80 2023-08-25T04:46:05.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.392+0000 7f43377fe700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f432406a0e0 0x7f432406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.393+0000 7f43377fe700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f432406a0e0 0x7f432406c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f432c0090b0 tx=0x7f432c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:05.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.396+0000 7f4334ff9700 1 -- 172.21.15.72:0/2450980093 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4328054490 con 0x7f4320003f80 2023-08-25T04:46:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.635+0000 7f433e3ff700 1 -- 172.21.15.72:0/2450980093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f433804e620 con 0x7f4320003f80 2023-08-25T04:46:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.635+0000 7f4334ff9700 1 -- 172.21.15.72:0/2450980093 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f432805d080 con 0x7f4320003f80 2023-08-25T04:46:05.637 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:05.637 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-25T04:46:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 -- 172.21.15.72:0/2450980093 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f432406a0e0 msgr2=0x7f432406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f432406a0e0 0x7f432406c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f432c0090b0 tx=0x7f432c008030 comp rx=0 tx=0).stop 2023-08-25T04:46:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 -- 172.21.15.72:0/2450980093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 msgr2=0x7f433815f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 0x7f433815f350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4328011aa0 tx=0x7f4328011e60 comp rx=0 tx=0).stop 2023-08-25T04:46:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 -- 172.21.15.72:0/2450980093 shutdown_connections 2023-08-25T04:46:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f432406a0e0 0x7f432406c5a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4338159370 0x7f43380d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320003f80 0x7f433815f350 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 --2- 172.21.15.72:0/2450980093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43380c7100 0x7f43380cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 -- 172.21.15.72:0/2450980093 >> 172.21.15.72:0/2450980093 conn(0x7f4338071e10 msgr2=0x7f433815b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 -- 172.21.15.72:0/2450980093 shutdown_connections 2023-08-25T04:46:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.638+0000 7f433e3ff700 1 -- 172.21.15.72:0/2450980093 wait complete. 2023-08-25T04:46:05.657 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-25T04:46:05.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:05.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.853+0000 7f67a3fff700 1 Processor -- start 2023-08-25T04:46:05.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.853+0000 7f67a3fff700 1 -- start start 2023-08-25T04:46:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.854+0000 7f67a3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f679c070fa0 0x7f679c15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.854+0000 7f67a3fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f679c0adc00 0x7f679c15d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.854+0000 7f67a3fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679c0c44f0 con 0x7f679c159410 2023-08-25T04:46:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.854+0000 7f67a3fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679c0c40d0 con 0x7f679c070fa0 2023-08-25T04:46:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.854+0000 7f67a3fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679c0ae150 con 0x7f679c0adc00 2023-08-25T04:46:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.854+0000 7f67a1d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f679c159410 0x7f679c070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41728/0 (socket says 172.21.15.72:41728) 2023-08-25T04:46:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.854+0000 7f67a1d9b700 1 -- 172.21.15.72:0/4260215494 learned_addr learned my addr 172.21.15.72:0/4260215494 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.854+0000 7f67a159a700 1 --2- 172.21.15.72:0/4260215494 >> v2:172.21.15.72:3300/0 conn(0x7f679c070fa0 0x7f679c15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a259c700 1 --2- 172.21.15.72:0/4260215494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f679c0adc00 0x7f679c15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a0d99700 1 -- 172.21.15.72:0/4260215494 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019303435 0 0) 0x7f679c0c44f0 con 0x7f679c159410 2023-08-25T04:46:05.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a0d99700 1 -- 172.21.15.72:0/4260215494 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67880035b0 con 0x7f679c159410 2023-08-25T04:46:05.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a159a700 1 -- 172.21.15.72:0/4260215494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f679c0adc00 msgr2=0x7f679c15d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:05.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a159a700 1 --2- 172.21.15.72:0/4260215494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f679c0adc00 0x7f679c15d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a159a700 1 -- 172.21.15.72:0/4260215494 >> v1:172.21.15.72:6789/0 conn(0x7f679c159410 legacy=0x7f679c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a159a700 1 -- 172.21.15.72:0/4260215494 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c0c3a10 con 0x7f679c070fa0 2023-08-25T04:46:05.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a159a700 1 --2- 172.21.15.72:0/4260215494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c070fa0 0x7f679c15ce20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f678c009840 tx=0x7f678c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1c2dcbc99805e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:05.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a0d99700 1 -- 172.21.15.72:0/4260215494 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c011830 con 0x7f679c070fa0 2023-08-25T04:46:05.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a0d99700 1 -- 172.21.15.72:0/4260215494 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c011990 con 0x7f679c070fa0 2023-08-25T04:46:05.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.855+0000 7f67a0d99700 1 -- 172.21.15.72:0/4260215494 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c011d20 con 0x7f679c070fa0 2023-08-25T04:46:05.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.856+0000 7f67a3fff700 1 -- 172.21.15.72:0/4260215494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c070fa0 msgr2=0x7f679c15ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.856+0000 7f67a3fff700 1 --2- 172.21.15.72:0/4260215494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c070fa0 0x7f679c15ce20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f678c009840 tx=0x7f678c009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:05.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.856+0000 7f67a3fff700 1 -- 172.21.15.72:0/4260215494 shutdown_connections 2023-08-25T04:46:05.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.856+0000 7f67a3fff700 1 --2- 172.21.15.72:0/4260215494 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f679c0adc00 0x7f679c15d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.856+0000 7f67a3fff700 1 --2- 172.21.15.72:0/4260215494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c070fa0 0x7f679c15ce20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.856+0000 7f67a3fff700 1 -- 172.21.15.72:0/4260215494 >> 172.21.15.72:0/4260215494 conn(0x7f679c0ce990 msgr2=0x7f679c0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:05.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.856+0000 7f67a3fff700 1 -- 172.21.15.72:0/4260215494 shutdown_connections 2023-08-25T04:46:05.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.856+0000 7f67a3fff700 1 -- 172.21.15.72:0/4260215494 wait complete. 2023-08-25T04:46:05.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.858+0000 7f67a3fff700 1 Processor -- start 2023-08-25T04:46:05.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.858+0000 7f67a3fff700 1 -- start start 2023-08-25T04:46:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a3fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f679c070fa0 0x7f679c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a3fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f679c0adc00 0x7f679c152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c159410 0x7f679c1476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a3fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c153480 con 0x7f679c159410 2023-08-25T04:46:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a3fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c141b30 con 0x7f679c0adc00 2023-08-25T04:46:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a3fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679c1536d0 con 0x7f679c070fa0 2023-08-25T04:46:05.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c159410 0x7f679c1476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c159410 0x7f679c1476f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57906/0 (socket says 172.21.15.72:57906) 2023-08-25T04:46:05.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a259c700 1 -- 172.21.15.72:0/4121665515 learned_addr learned my addr 172.21.15.72:0/4121665515 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:05.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a1d9b700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f679c070fa0 0x7f679c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.859+0000 7f67a159a700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f679c0adc00 0x7f679c152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67a259c700 1 -- 172.21.15.72:0/4121665515 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f679c070fa0 msgr2=0x7f679c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67a259c700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f679c070fa0 0x7f679c1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67a259c700 1 -- 172.21.15.72:0/4121665515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f679c0adc00 msgr2=0x7f679c152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:05.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67a259c700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f679c0adc00 0x7f679c152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:05.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67a259c700 1 -- 172.21.15.72:0/4121665515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c0094a0 con 0x7f679c159410 2023-08-25T04:46:05.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67a159a700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f679c0adc00 0x7f679c152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:05.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67a259c700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c159410 0x7f679c1476f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6794007e70 tx=0x7f679400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:05.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67927fc700 1 -- 172.21.15.72:0/4121665515 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679400ee50 con 0x7f679c159410 2023-08-25T04:46:05.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67927fc700 1 -- 172.21.15.72:0/4121665515 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6794014420 con 0x7f679c159410 2023-08-25T04:46:05.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67a3fff700 1 -- 172.21.15.72:0/4121665515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679c1539b0 con 0x7f679c159410 2023-08-25T04:46:05.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67927fc700 1 -- 172.21.15.72:0/4121665515 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67940147d0 con 0x7f679c159410 2023-08-25T04:46:05.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.860+0000 7f67a3fff700 1 -- 172.21.15.72:0/4121665515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679c153f70 con 0x7f679c159410 2023-08-25T04:46:05.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.861+0000 7f67a3fff700 1 -- 172.21.15.72:0/4121665515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679c04e620 con 0x7f679c159410 2023-08-25T04:46:05.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.862+0000 7f67927fc700 1 -- 172.21.15.72:0/4121665515 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6794014930 con 0x7f679c159410 2023-08-25T04:46:05.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.863+0000 7f67927fc700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f678006a0e0 0x7f678006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:05.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.863+0000 7f67927fc700 1 -- 172.21.15.72:0/4121665515 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6794088fc0 con 0x7f679c159410 2023-08-25T04:46:05.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.863+0000 7f67a1d9b700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f678006a0e0 0x7f678006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:05.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.864+0000 7f67a1d9b700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f678006a0e0 0x7f678006c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67980011e0 tx=0x7f6798009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:05.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:05.867+0000 7f67927fc700 1 -- 172.21.15.72:0/4121665515 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f67940bb990 con 0x7f679c159410 2023-08-25T04:46:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.065+0000 7f67a3fff700 1 -- 172.21.15.72:0/4121665515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f679c071740 con 0x7f679c159410 2023-08-25T04:46:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.067+0000 7f67927fc700 1 -- 172.21.15.72:0/4121665515 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f6794057ee0 con 0x7f679c159410 2023-08-25T04:46:06.068 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:06.069 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.069+0000 7f67a3fff700 1 -- 172.21.15.72:0/4121665515 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f678006a0e0 msgr2=0x7f678006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.069+0000 7f67a3fff700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f678006a0e0 0x7f678006c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67980011e0 tx=0x7f6798009040 comp rx=0 tx=0).stop 2023-08-25T04:46:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.069+0000 7f67a3fff700 1 -- 172.21.15.72:0/4121665515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c159410 msgr2=0x7f679c1476f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.069+0000 7f67a3fff700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c159410 0x7f679c1476f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6794007e70 tx=0x7f679400e3c0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.070+0000 7f67a3fff700 1 -- 172.21.15.72:0/4121665515 shutdown_connections 2023-08-25T04:46:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.070+0000 7f67a3fff700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f678006a0e0 0x7f678006c5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.070+0000 7f67a3fff700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f679c159410 0x7f679c1476f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.070+0000 7f67a3fff700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f679c070fa0 0x7f679c1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.070+0000 7f67a3fff700 1 --2- 172.21.15.72:0/4121665515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f679c0adc00 0x7f679c152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.070+0000 7f67a3fff700 1 -- 172.21.15.72:0/4121665515 >> 172.21.15.72:0/4121665515 conn(0x7f679c0ce990 msgr2=0x7f679c0ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.070+0000 7f67a3fff700 1 -- 172.21.15.72:0/4121665515 shutdown_connections 2023-08-25T04:46:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.070+0000 7f67a3fff700 1 -- 172.21.15.72:0/4121665515 wait complete. 2023-08-25T04:46:06.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:06.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.287+0000 7f070e3ff700 1 Processor -- start 2023-08-25T04:46:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.287+0000 7f070e3ff700 1 -- start start 2023-08-25T04:46:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.288+0000 7f070e3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f070815d000 0x7f07080b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.288+0000 7f070e3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07080b6e90 con 0x7f07080d10c0 2023-08-25T04:46:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.288+0000 7f070e3ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070815d3e0 con 0x7f07080b4f10 2023-08-25T04:46:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.288+0000 7f070e3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07080b56f0 con 0x7f070815d000 2023-08-25T04:46:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.289+0000 7f0707fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f070815d000 0x7f07080b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.289+0000 7f07077fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f07080d10c0 0x7f07080b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41732/0 (socket says 172.21.15.72:41732) 2023-08-25T04:46:06.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.289+0000 7f07077fe700 1 -- 172.21.15.72:0/2146099297 learned_addr learned my addr 172.21.15.72:0/2146099297 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:06.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.289+0000 7f0707fff700 1 -- 172.21.15.72:0/2146099297 >> v1:172.21.15.137:6789/0 conn(0x7f07080b4f10 legacy=0x7f07080b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.289+0000 7f0707fff700 1 -- 172.21.15.72:0/2146099297 >> v1:172.21.15.72:6789/0 conn(0x7f07080d10c0 legacy=0x7f07080b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.289+0000 7f0707fff700 1 -- 172.21.15.72:0/2146099297 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07080b6280 con 0x7f070815d000 2023-08-25T04:46:06.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.289+0000 7f0707fff700 1 --2- 172.21.15.72:0/2146099297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f070815d000 0x7f07080b8600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009840 tx=0x7f06f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f04a80f597f5bc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:06.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.290+0000 7f0706ffd700 1 -- 172.21.15.72:0/2146099297 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8011830 con 0x7f070815d000 2023-08-25T04:46:06.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.290+0000 7f0706ffd700 1 -- 172.21.15.72:0/2146099297 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f8011990 con 0x7f070815d000 2023-08-25T04:46:06.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.290+0000 7f0706ffd700 1 -- 172.21.15.72:0/2146099297 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8011d20 con 0x7f070815d000 2023-08-25T04:46:06.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.290+0000 7f070e3ff700 1 -- 172.21.15.72:0/2146099297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f070815d000 msgr2=0x7f07080b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.290+0000 7f070e3ff700 1 --2- 172.21.15.72:0/2146099297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f070815d000 0x7f07080b8600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009840 tx=0x7f06f8009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:06.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.290+0000 7f070e3ff700 1 -- 172.21.15.72:0/2146099297 shutdown_connections 2023-08-25T04:46:06.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.290+0000 7f070e3ff700 1 --2- 172.21.15.72:0/2146099297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f070815d000 0x7f07080b8600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.290+0000 7f070e3ff700 1 -- 172.21.15.72:0/2146099297 >> 172.21.15.72:0/2146099297 conn(0x7f0708071e10 msgr2=0x7f0708072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:06.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.290+0000 7f070e3ff700 1 -- 172.21.15.72:0/2146099297 shutdown_connections 2023-08-25T04:46:06.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.290+0000 7f070e3ff700 1 -- 172.21.15.72:0/2146099297 wait complete. 2023-08-25T04:46:06.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.292+0000 7f070e3ff700 1 Processor -- start 2023-08-25T04:46:06.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.292+0000 7f070e3ff700 1 -- start start 2023-08-25T04:46:06.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.293+0000 7f070e3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07080b4f10 0x7f07081524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.293+0000 7f070e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07080d10c0 0x7f07080cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.293+0000 7f070e3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f070815d000 0x7f07080cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.293+0000 7f070e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07080ccc40 con 0x7f07080d10c0 2023-08-25T04:46:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.293+0000 7f070e3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07080c80e0 con 0x7f07080b4f10 2023-08-25T04:46:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.293+0000 7f070e3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07080c83c0 con 0x7f070815d000 2023-08-25T04:46:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.293+0000 7f07077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07080d10c0 0x7f07080cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.293+0000 7f07077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07080d10c0 0x7f07080cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57920/0 (socket says 172.21.15.72:57920) 2023-08-25T04:46:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.293+0000 7f07077fe700 1 -- 172.21.15.72:0/2659846142 learned_addr learned my addr 172.21.15.72:0/2659846142 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f0707fff700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07080b4f10 0x7f07081524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f070c99c700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f070815d000 0x7f07080cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f07077fe700 1 -- 172.21.15.72:0/2659846142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f070815d000 msgr2=0x7f07080cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f07077fe700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f070815d000 0x7f07080cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f07077fe700 1 -- 172.21.15.72:0/2659846142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07080b4f10 msgr2=0x7f07081524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f07077fe700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07080b4f10 0x7f07081524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f07077fe700 1 -- 172.21.15.72:0/2659846142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80094a0 con 0x7f07080d10c0 2023-08-25T04:46:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f0707fff700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07080b4f10 0x7f07081524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f07077fe700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07080d10c0 0x7f07080cc1c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c520 tx=0x7f06fc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f0704ff9700 1 -- 172.21.15.72:0/2659846142 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc005d70 con 0x7f07080d10c0 2023-08-25T04:46:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f0704ff9700 1 -- 172.21.15.72:0/2659846142 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc0070d0 con 0x7f07080d10c0 2023-08-25T04:46:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f0704ff9700 1 -- 172.21.15.72:0/2659846142 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc007440 con 0x7f07080d10c0 2023-08-25T04:46:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f070e3ff700 1 -- 172.21.15.72:0/2659846142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07080c86a0 con 0x7f07080d10c0 2023-08-25T04:46:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.294+0000 7f070e3ff700 1 -- 172.21.15.72:0/2659846142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070815e620 con 0x7f07080d10c0 2023-08-25T04:46:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.295+0000 7f070e3ff700 1 -- 172.21.15.72:0/2659846142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070806a2f0 con 0x7f07080d10c0 2023-08-25T04:46:06.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.296+0000 7f0704ff9700 1 -- 172.21.15.72:0/2659846142 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f06fc0075a0 con 0x7f07080d10c0 2023-08-25T04:46:06.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.297+0000 7f0704ff9700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f06f406a0e0 0x7f06f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.297+0000 7f0704ff9700 1 -- 172.21.15.72:0/2659846142 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06fc087bb0 con 0x7f07080d10c0 2023-08-25T04:46:06.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.297+0000 7f0707fff700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f06f406a0e0 0x7f06f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.298+0000 7f0707fff700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f06f406a0e0 0x7f06f406c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f06f80090b0 tx=0x7f06f801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:06.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.301+0000 7f0704ff9700 1 -- 172.21.15.72:0/2659846142 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f06fc0530f0 con 0x7f07080d10c0 2023-08-25T04:46:06.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.498+0000 7f070e3ff700 1 -- 172.21.15.72:0/2659846142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f070808a000 con 0x7f07080d10c0 2023-08-25T04:46:06.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.498+0000 7f0704ff9700 1 -- 172.21.15.72:0/2659846142 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06fc017020 con 0x7f07080d10c0 2023-08-25T04:46:06.499 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.500+0000 7f070e3ff700 1 -- 172.21.15.72:0/2659846142 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f06f406a0e0 msgr2=0x7f06f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.500+0000 7f070e3ff700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f06f406a0e0 0x7f06f406c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f06f80090b0 tx=0x7f06f801c040 comp rx=0 tx=0).stop 2023-08-25T04:46:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.500+0000 7f070e3ff700 1 -- 172.21.15.72:0/2659846142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07080d10c0 msgr2=0x7f07080cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.500+0000 7f070e3ff700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07080d10c0 0x7f07080cc1c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c520 tx=0x7f06fc00c8e0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.501+0000 7f070e3ff700 1 -- 172.21.15.72:0/2659846142 shutdown_connections 2023-08-25T04:46:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.501+0000 7f070e3ff700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f06f406a0e0 0x7f06f406c5a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.501+0000 7f070e3ff700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f070815d000 0x7f07080cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.501+0000 7f070e3ff700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07080b4f10 0x7f07081524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.501+0000 7f070e3ff700 1 --2- 172.21.15.72:0/2659846142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07080d10c0 0x7f07080cc1c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.501+0000 7f070e3ff700 1 -- 172.21.15.72:0/2659846142 >> 172.21.15.72:0/2659846142 conn(0x7f0708071e10 msgr2=0x7f07080b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.501+0000 7f070e3ff700 1 -- 172.21.15.72:0/2659846142 shutdown_connections 2023-08-25T04:46:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.501+0000 7f070e3ff700 1 -- 172.21.15.72:0/2659846142 wait complete. 2023-08-25T04:46:06.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.719+0000 7f39aefff700 1 Processor -- start 2023-08-25T04:46:06.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.719+0000 7f39aefff700 1 -- start start 2023-08-25T04:46:06.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.720+0000 7f39aefff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39a80d10c0 0x7f39a80b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.720+0000 7f39aefff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f39a80b4d40 0x7f39a80b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39aefff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a80b8d10 con 0x7f39a815d000 2023-08-25T04:46:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39aefff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80b56f0 con 0x7f39a80d10c0 2023-08-25T04:46:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39aefff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80b6e90 con 0x7f39a80b4d40 2023-08-25T04:46:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39a7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39a80d10c0 0x7f39a80b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39a7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39a80d10c0 0x7f39a80b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57922/0 (socket says 172.21.15.72:57922) 2023-08-25T04:46:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39a7fff700 1 -- 172.21.15.72:0/183938985 learned_addr learned my addr 172.21.15.72:0/183938985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39ad59c700 1 --2- 172.21.15.72:0/183938985 >> v2:172.21.15.137:3300/0 conn(0x7f39a80b4d40 0x7f39a80b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39a7fff700 1 -- 172.21.15.72:0/183938985 >> v2:172.21.15.137:3300/0 conn(0x7f39a80b4d40 msgr2=0x7f39a80b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39a7fff700 1 --2- 172.21.15.72:0/183938985 >> v2:172.21.15.137:3300/0 conn(0x7f39a80b4d40 0x7f39a80b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39a7fff700 1 -- 172.21.15.72:0/183938985 >> v1:172.21.15.137:6789/0 conn(0x7f39a815d000 legacy=0x7f39a80b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39a7fff700 1 -- 172.21.15.72:0/183938985 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80b5170 con 0x7f39a80d10c0 2023-08-25T04:46:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.721+0000 7f39a7fff700 1 --2- 172.21.15.72:0/183938985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a80d10c0 0x7f39a80b4800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f39a80c9c10 tx=0x7f3994009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6aad3ebd7d620d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39a77fe700 1 -- 172.21.15.72:0/183938985 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994011830 con 0x7f39a80d10c0 2023-08-25T04:46:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39a77fe700 1 -- 172.21.15.72:0/183938985 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3994011990 con 0x7f39a80d10c0 2023-08-25T04:46:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39a77fe700 1 -- 172.21.15.72:0/183938985 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994011d20 con 0x7f39a80d10c0 2023-08-25T04:46:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39aefff700 1 -- 172.21.15.72:0/183938985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a80d10c0 msgr2=0x7f39a80b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39aefff700 1 --2- 172.21.15.72:0/183938985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a80d10c0 0x7f39a80b4800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f39a80c9c10 tx=0x7f3994009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39aefff700 1 -- 172.21.15.72:0/183938985 shutdown_connections 2023-08-25T04:46:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39aefff700 1 --2- 172.21.15.72:0/183938985 >> v2:172.21.15.137:3300/0 conn(0x7f39a80b4d40 0x7f39a80b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39aefff700 1 --2- 172.21.15.72:0/183938985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a80d10c0 0x7f39a80b4800 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39aefff700 1 -- 172.21.15.72:0/183938985 >> 172.21.15.72:0/183938985 conn(0x7f39a8071e10 msgr2=0x7f39a8072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:06.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39aefff700 1 -- 172.21.15.72:0/183938985 shutdown_connections 2023-08-25T04:46:06.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.722+0000 7f39aefff700 1 -- 172.21.15.72:0/183938985 wait complete. 2023-08-25T04:46:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.724+0000 7f39aefff700 1 Processor -- start 2023-08-25T04:46:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.724+0000 7f39aefff700 1 -- start start 2023-08-25T04:46:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.725+0000 7f39aefff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39a80b4d40 0x7f39a8152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.725+0000 7f39aefff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a80d10c0 0x7f39a80aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.725+0000 7f39aefff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a815d000 0x7f39a814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.725+0000 7f39aefff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80aaa00 con 0x7f39a815d000 2023-08-25T04:46:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.725+0000 7f39aefff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80c8390 con 0x7f39a80d10c0 2023-08-25T04:46:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.725+0000 7f39aefff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80c7a60 con 0x7f39a80b4d40 2023-08-25T04:46:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.725+0000 7f39ad59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a815d000 0x7f39a814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.725+0000 7f39ad59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a815d000 0x7f39a814c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57932/0 (socket says 172.21.15.72:57932) 2023-08-25T04:46:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.725+0000 7f39ad59c700 1 -- 172.21.15.72:0/3106717086 learned_addr learned my addr 172.21.15.72:0/3106717086 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39a7fff700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a80d10c0 0x7f39a80aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39acd9b700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39a80b4d40 0x7f39a8152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39ad59c700 1 -- 172.21.15.72:0/3106717086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39a80b4d40 msgr2=0x7f39a8152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39ad59c700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39a80b4d40 0x7f39a8152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39ad59c700 1 -- 172.21.15.72:0/3106717086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a80d10c0 msgr2=0x7f39a80aa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39ad59c700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a80d10c0 0x7f39a80aa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39ad59c700 1 -- 172.21.15.72:0/3106717086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994009550 con 0x7f39a815d000 2023-08-25T04:46:06.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39a7fff700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a80d10c0 0x7f39a80aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:06.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39ad59c700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a815d000 0x7f39a814c9d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f39a000efc0 tx=0x7f39a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:06.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39a57fa700 1 -- 172.21.15.72:0/3106717086 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a000cd40 con 0x7f39a815d000 2023-08-25T04:46:06.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39a57fa700 1 -- 172.21.15.72:0/3106717086 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a000f040 con 0x7f39a815d000 2023-08-25T04:46:06.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39a57fa700 1 -- 172.21.15.72:0/3106717086 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00146c0 con 0x7f39a815d000 2023-08-25T04:46:06.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39aefff700 1 -- 172.21.15.72:0/3106717086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a80c7d40 con 0x7f39a815d000 2023-08-25T04:46:06.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.726+0000 7f39aefff700 1 -- 172.21.15.72:0/3106717086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a80aa6d0 con 0x7f39a815d000 2023-08-25T04:46:06.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.727+0000 7f39aefff700 1 -- 172.21.15.72:0/3106717086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a80c8520 con 0x7f39a815d000 2023-08-25T04:46:06.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.728+0000 7f39a57fa700 1 -- 172.21.15.72:0/3106717086 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f39a0014820 con 0x7f39a815d000 2023-08-25T04:46:06.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.729+0000 7f39a57fa700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f398c06a0e0 0x7f398c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:06.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.730+0000 7f39a57fa700 1 -- 172.21.15.72:0/3106717086 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f39a00892d0 con 0x7f39a815d000 2023-08-25T04:46:06.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.730+0000 7f39acd9b700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f398c06a0e0 0x7f398c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:06.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.730+0000 7f39acd9b700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f398c06a0e0 0x7f398c06c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f399c000f60 tx=0x7f399c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:06.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.733+0000 7f39a57fa700 1 -- 172.21.15.72:0/3106717086 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f39a00580c0 con 0x7f39a815d000 2023-08-25T04:46:06.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.930+0000 7f39aefff700 1 -- 172.21.15.72:0/3106717086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39a806a2f0 con 0x7f39a815d000 2023-08-25T04:46:06.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.930+0000 7f39a57fa700 1 -- 172.21.15.72:0/3106717086 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39a000cea0 con 0x7f39a815d000 2023-08-25T04:46:06.932 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:06.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 -- 172.21.15.72:0/3106717086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f398c06a0e0 msgr2=0x7f398c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f398c06a0e0 0x7f398c06c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f399c000f60 tx=0x7f399c009040 comp rx=0 tx=0).stop 2023-08-25T04:46:06.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 -- 172.21.15.72:0/3106717086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a815d000 msgr2=0x7f39a814c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:06.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a815d000 0x7f39a814c9d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f39a000efc0 tx=0x7f39a000c3a0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 -- 172.21.15.72:0/3106717086 shutdown_connections 2023-08-25T04:46:06.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f398c06a0e0 0x7f398c06c5a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a815d000 0x7f39a814c9d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39a80b4d40 0x7f39a8152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 --2- 172.21.15.72:0/3106717086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a80d10c0 0x7f39a80aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:06.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 -- 172.21.15.72:0/3106717086 >> 172.21.15.72:0/3106717086 conn(0x7f39a8071e10 msgr2=0x7f39a80b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:06.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 -- 172.21.15.72:0/3106717086 shutdown_connections 2023-08-25T04:46:06.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:06.933+0000 7f39aefff700 1 -- 172.21.15.72:0/3106717086 wait complete. 2023-08-25T04:46:06.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:07.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.149+0000 7f0a0f3ff700 1 Processor -- start 2023-08-25T04:46:07.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.149+0000 7f0a0f3ff700 1 -- start start 2023-08-25T04:46:07.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.150+0000 7f0a0f3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a080ce260 0x7f0a08167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.150+0000 7f0a0f3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a080d1580 con 0x7f0a080b8aa0 2023-08-25T04:46:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.150+0000 7f0a0f3ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0815d470 con 0x7f0a0815d090 2023-08-25T04:46:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.150+0000 7f0a0f3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a080b6ec0 con 0x7f0a080ce260 2023-08-25T04:46:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.151+0000 7f0a0d19b700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0a0815d090 0x7f0a080d0e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:41502/0 (socket says 172.21.15.72:41502) 2023-08-25T04:46:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.151+0000 7f0a0d19b700 1 -- 172.21.15.72:0/3888201499 learned_addr learned my addr 172.21.15.72:0/3888201499 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.151+0000 7f0a0c99a700 1 --1- 172.21.15.72:0/3888201499 >> v1:172.21.15.72:6789/0 conn(0x7f0a080b8aa0 0x7f0a080cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41742/0 (socket says 172.21.15.72:41742) 2023-08-25T04:46:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.151+0000 7f0a0d99c700 1 --2- 172.21.15.72:0/3888201499 >> v2:172.21.15.72:3300/0 conn(0x7f0a080ce260 0x7f0a08167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:07.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.151+0000 7f0a0d99c700 1 -- 172.21.15.72:0/3888201499 >> v1:172.21.15.137:6789/0 conn(0x7f0a0815d090 legacy=0x7f0a080d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.151+0000 7f0a0d99c700 1 -- 172.21.15.72:0/3888201499 >> v1:172.21.15.72:6789/0 conn(0x7f0a080b8aa0 legacy=0x7f0a080cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.151+0000 7f09fffff700 1 -- 172.21.15.72:0/3888201499 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612961988 0 0) 0x7f0a0815d470 con 0x7f0a0815d090 2023-08-25T04:46:07.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.151+0000 7f0a0d99c700 1 -- 172.21.15.72:0/3888201499 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a080d17e0 con 0x7f0a080ce260 2023-08-25T04:46:07.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.151+0000 7f0a0d99c700 1 --2- 172.21.15.72:0/3888201499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080ce260 0x7f0a08167ba0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009d90 tx=0x7f0a0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75b6d42c959a7a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:07.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.152+0000 7f09fffff700 1 -- 172.21.15.72:0/3888201499 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000e070 con 0x7f0a080ce260 2023-08-25T04:46:07.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.152+0000 7f09fffff700 1 -- 172.21.15.72:0/3888201499 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0000bad0 con 0x7f0a080ce260 2023-08-25T04:46:07.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.152+0000 7f09fffff700 1 -- 172.21.15.72:0/3888201499 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000be80 con 0x7f0a080ce260 2023-08-25T04:46:07.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.152+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/3888201499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080ce260 msgr2=0x7f0a08167ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.152+0000 7f0a0f3ff700 1 --2- 172.21.15.72:0/3888201499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080ce260 0x7f0a08167ba0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009d90 tx=0x7f0a0000b330 comp rx=0 tx=0).stop 2023-08-25T04:46:07.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.152+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/3888201499 shutdown_connections 2023-08-25T04:46:07.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.152+0000 7f0a0f3ff700 1 --2- 172.21.15.72:0/3888201499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080ce260 0x7f0a08167ba0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.152+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/3888201499 >> 172.21.15.72:0/3888201499 conn(0x7f0a08071e10 msgr2=0x7f0a08072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:07.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.152+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/3888201499 shutdown_connections 2023-08-25T04:46:07.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.152+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/3888201499 wait complete. 2023-08-25T04:46:07.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.154+0000 7f0a0f3ff700 1 Processor -- start 2023-08-25T04:46:07.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.154+0000 7f0a0f3ff700 1 -- start start 2023-08-25T04:46:07.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.155+0000 7f0a0f3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080b8aa0 0x7f0a081f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.155+0000 7f0a0f3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a080ce260 0x7f0a080b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.155+0000 7f0a0f3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a0815d090 0x7f0a0815f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.155+0000 7f0a0f3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081f32f0 con 0x7f0a080b8aa0 2023-08-25T04:46:07.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.155+0000 7f0a0f3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081f22e0 con 0x7f0a080ce260 2023-08-25T04:46:07.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.155+0000 7f0a0f3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080b5590 con 0x7f0a0815d090 2023-08-25T04:46:07.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.155+0000 7f0a0d19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080b8aa0 0x7f0a081f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:07.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.155+0000 7f0a0d19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080b8aa0 0x7f0a081f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57962/0 (socket says 172.21.15.72:57962) 2023-08-25T04:46:07.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.155+0000 7f0a0d19b700 1 -- 172.21.15.72:0/2457344502 learned_addr learned my addr 172.21.15.72:0/2457344502 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:07.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f0a0d19b700 1 -- 172.21.15.72:0/2457344502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a0815d090 msgr2=0x7f0a0815f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f0a0d19b700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a0815d090 0x7f0a0815f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f0a0d19b700 1 -- 172.21.15.72:0/2457344502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a080ce260 msgr2=0x7f0a080b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f0a0d19b700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a080ce260 0x7f0a080b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f0a0d19b700 1 -- 172.21.15.72:0/2457344502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00009a70 con 0x7f0a080b8aa0 2023-08-25T04:46:07.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f0a0d19b700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080b8aa0 0x7f0a081f1da0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400c520 tx=0x7f0a0400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:07.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f09fdffb700 1 -- 172.21.15.72:0/2457344502 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04004c80 con 0x7f0a080b8aa0 2023-08-25T04:46:07.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f09fdffb700 1 -- 172.21.15.72:0/2457344502 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a04004e20 con 0x7f0a080b8aa0 2023-08-25T04:46:07.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/2457344502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a081f2530 con 0x7f0a080b8aa0 2023-08-25T04:46:07.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f09fdffb700 1 -- 172.21.15.72:0/2457344502 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04007310 con 0x7f0a080b8aa0 2023-08-25T04:46:07.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.156+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/2457344502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a081f2af0 con 0x7f0a080b8aa0 2023-08-25T04:46:07.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.157+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/2457344502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0806a2f0 con 0x7f0a080b8aa0 2023-08-25T04:46:07.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.158+0000 7f09fdffb700 1 -- 172.21.15.72:0/2457344502 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0a04007470 con 0x7f0a080b8aa0 2023-08-25T04:46:07.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.159+0000 7f09fdffb700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f09ec06a0e0 0x7f09ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.159+0000 7f09fdffb700 1 -- 172.21.15.72:0/2457344502 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0a04088520 con 0x7f0a080b8aa0 2023-08-25T04:46:07.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.159+0000 7f0a0c99a700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f09ec06a0e0 0x7f09ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:07.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.160+0000 7f0a0c99a700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f09ec06a0e0 0x7f09ec06c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a08160430 tx=0x7f09f8007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:07.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.163+0000 7f09fdffb700 1 -- 172.21.15.72:0/2457344502 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0a04053920 con 0x7f0a080b8aa0 2023-08-25T04:46:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.359+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/2457344502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a0808a000 con 0x7f0a080b8aa0 2023-08-25T04:46:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.360+0000 7f09fdffb700 1 -- 172.21.15.72:0/2457344502 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a04056f40 con 0x7f0a080b8aa0 2023-08-25T04:46:07.361 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/2457344502 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f09ec06a0e0 msgr2=0x7f09ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f09ec06a0e0 0x7f09ec06c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a08160430 tx=0x7f09f8007a30 comp rx=0 tx=0).stop 2023-08-25T04:46:07.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/2457344502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080b8aa0 msgr2=0x7f0a081f1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080b8aa0 0x7f0a081f1da0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400c520 tx=0x7f0a0400c8e0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/2457344502 shutdown_connections 2023-08-25T04:46:07.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f09ec06a0e0 0x7f09ec06c5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a0815d090 0x7f0a0815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a080b8aa0 0x7f0a081f1da0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 --2- 172.21.15.72:0/2457344502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a080ce260 0x7f0a080b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/2457344502 >> 172.21.15.72:0/2457344502 conn(0x7f0a08071e10 msgr2=0x7f0a0815efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.362+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/2457344502 shutdown_connections 2023-08-25T04:46:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.363+0000 7f0a0f3ff700 1 -- 172.21.15.72:0/2457344502 wait complete. 2023-08-25T04:46:07.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.579+0000 7f53291ff700 1 Processor -- start 2023-08-25T04:46:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.579+0000 7f53291ff700 1 -- start start 2023-08-25T04:46:07.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.580+0000 7f53291ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f532415d000 0x7f53240b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.580+0000 7f53291ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53240d10c0 0x7f53240b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.580+0000 7f53291ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53240b6e90 con 0x7f53240b4d40 2023-08-25T04:46:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.580+0000 7f53291ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240b56f0 con 0x7f53240d10c0 2023-08-25T04:46:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.580+0000 7f53291ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240b5170 con 0x7f532415d000 2023-08-25T04:46:07.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.581+0000 7f532359e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f53240b4d40 0x7f5324160af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41746/0 (socket says 172.21.15.72:41746) 2023-08-25T04:46:07.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.581+0000 7f532359e700 1 -- 172.21.15.72:0/1393616345 learned_addr learned my addr 172.21.15.72:0/1393616345 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:07.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.581+0000 7f532259c700 1 --2- 172.21.15.72:0/1393616345 >> v2:172.21.15.72:3300/0 conn(0x7f53240d10c0 0x7f53240b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:07.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.581+0000 7f5322d9d700 1 --2- 172.21.15.72:0/1393616345 >> v2:172.21.15.137:3300/0 conn(0x7f532415d000 0x7f53240b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:07.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.581+0000 7f5321d9b700 1 -- 172.21.15.72:0/1393616345 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057743421 0 0) 0x7f53240b6e90 con 0x7f53240b4d40 2023-08-25T04:46:07.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.581+0000 7f5321d9b700 1 -- 172.21.15.72:0/1393616345 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f530c0035b0 con 0x7f53240b4d40 2023-08-25T04:46:07.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.581+0000 7f532259c700 1 -- 172.21.15.72:0/1393616345 >> v2:172.21.15.137:3300/0 conn(0x7f532415d000 msgr2=0x7f53240b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.581+0000 7f532259c700 1 --2- 172.21.15.72:0/1393616345 >> v2:172.21.15.137:3300/0 conn(0x7f532415d000 0x7f53240b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.581+0000 7f532259c700 1 -- 172.21.15.72:0/1393616345 >> v1:172.21.15.72:6789/0 conn(0x7f53240b4d40 legacy=0x7f5324160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.581+0000 7f532259c700 1 -- 172.21.15.72:0/1393616345 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532415d3e0 con 0x7f53240d10c0 2023-08-25T04:46:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f532259c700 1 --2- 172.21.15.72:0/1393616345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53240d10c0 0x7f53240b4800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f53240d08e0 tx=0x7f5318009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b96ac96940c257 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f5321d9b700 1 -- 172.21.15.72:0/1393616345 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318011830 con 0x7f53240d10c0 2023-08-25T04:46:07.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f5321d9b700 1 -- 172.21.15.72:0/1393616345 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5318011990 con 0x7f53240d10c0 2023-08-25T04:46:07.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f5321d9b700 1 -- 172.21.15.72:0/1393616345 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318011d20 con 0x7f53240d10c0 2023-08-25T04:46:07.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f53291ff700 1 -- 172.21.15.72:0/1393616345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53240d10c0 msgr2=0x7f53240b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f53291ff700 1 --2- 172.21.15.72:0/1393616345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53240d10c0 0x7f53240b4800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f53240d08e0 tx=0x7f5318009b20 comp rx=0 tx=0).stop 2023-08-25T04:46:07.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f53291ff700 1 -- 172.21.15.72:0/1393616345 shutdown_connections 2023-08-25T04:46:07.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f53291ff700 1 --2- 172.21.15.72:0/1393616345 >> v2:172.21.15.137:3300/0 conn(0x7f532415d000 0x7f53240b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f53291ff700 1 --2- 172.21.15.72:0/1393616345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53240d10c0 0x7f53240b4800 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f53291ff700 1 -- 172.21.15.72:0/1393616345 >> 172.21.15.72:0/1393616345 conn(0x7f5324071e10 msgr2=0x7f5324072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:07.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.582+0000 7f53291ff700 1 -- 172.21.15.72:0/1393616345 shutdown_connections 2023-08-25T04:46:07.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.583+0000 7f53291ff700 1 -- 172.21.15.72:0/1393616345 wait complete. 2023-08-25T04:46:07.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.584+0000 7f53291ff700 1 Processor -- start 2023-08-25T04:46:07.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.584+0000 7f53291ff700 1 -- start start 2023-08-25T04:46:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.585+0000 7f53291ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53240b4d40 0x7f53240c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.585+0000 7f53291ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53240d10c0 0x7f5324155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.585+0000 7f53291ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f532415d000 0x7f532415fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.585+0000 7f53291ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5324160490 con 0x7f532415d000 2023-08-25T04:46:07.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.585+0000 7f53291ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532415ff80 con 0x7f53240b4d40 2023-08-25T04:46:07.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.585+0000 7f53291ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53241534e0 con 0x7f53240d10c0 2023-08-25T04:46:07.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f532359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f532415d000 0x7f532415fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:07.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f532359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f532415d000 0x7f532415fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57990/0 (socket says 172.21.15.72:57990) 2023-08-25T04:46:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f532359e700 1 -- 172.21.15.72:0/3447414119 learned_addr learned my addr 172.21.15.72:0/3447414119 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f5322d9d700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53240b4d40 0x7f53240c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f532259c700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53240d10c0 0x7f5324155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f532359e700 1 -- 172.21.15.72:0/3447414119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53240d10c0 msgr2=0x7f5324155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f532359e700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53240d10c0 0x7f5324155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f532359e700 1 -- 172.21.15.72:0/3447414119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53240b4d40 msgr2=0x7f53240c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f532359e700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53240b4d40 0x7f53240c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f532359e700 1 -- 172.21.15.72:0/3447414119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53180094a0 con 0x7f532415d000 2023-08-25T04:46:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f532359e700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f532415d000 0x7f532415fa40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f531c00cb70 tx=0x7f531c00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.586+0000 7f530b7fe700 1 -- 172.21.15.72:0/3447414119 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00aa60 con 0x7f532415d000 2023-08-25T04:46:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.587+0000 7f530b7fe700 1 -- 172.21.15.72:0/3447414119 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00abc0 con 0x7f532415d000 2023-08-25T04:46:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.587+0000 7f53291ff700 1 -- 172.21.15.72:0/3447414119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53241601b0 con 0x7f532415d000 2023-08-25T04:46:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.587+0000 7f530b7fe700 1 -- 172.21.15.72:0/3447414119 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c012400 con 0x7f532415d000 2023-08-25T04:46:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.587+0000 7f53291ff700 1 -- 172.21.15.72:0/3447414119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5324153170 con 0x7f532415d000 2023-08-25T04:46:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.588+0000 7f53291ff700 1 -- 172.21.15.72:0/3447414119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5324152cf0 con 0x7f532415d000 2023-08-25T04:46:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.588+0000 7f530b7fe700 1 -- 172.21.15.72:0/3447414119 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f531c01b3b0 con 0x7f532415d000 2023-08-25T04:46:07.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.589+0000 7f530b7fe700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f531006a110 0x7f531006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:07.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.589+0000 7f530b7fe700 1 -- 172.21.15.72:0/3447414119 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f531c088500 con 0x7f532415d000 2023-08-25T04:46:07.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.590+0000 7f5322d9d700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f531006a110 0x7f531006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:07.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.590+0000 7f5322d9d700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f531006a110 0x7f531006c5d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5314009b40 tx=0x7f5314009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:07.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.594+0000 7f530b7fe700 1 -- 172.21.15.72:0/3447414119 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5324152cf0 con 0x7f532415d000 2023-08-25T04:46:07.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.790+0000 7f53291ff700 1 -- 172.21.15.72:0/3447414119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5324152cf0 con 0x7f532415d000 2023-08-25T04:46:07.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.790+0000 7f530b7fe700 1 -- 172.21.15.72:0/3447414119 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5324152cf0 con 0x7f532415d000 2023-08-25T04:46:07.794 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:07.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 -- 172.21.15.72:0/3447414119 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f531006a110 msgr2=0x7f531006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f531006a110 0x7f531006c5d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5314009b40 tx=0x7f5314009210 comp rx=0 tx=0).stop 2023-08-25T04:46:07.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 -- 172.21.15.72:0/3447414119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f532415d000 msgr2=0x7f532415fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:07.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f532415d000 0x7f532415fa40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f531c00cb70 tx=0x7f531c00ce80 comp rx=0 tx=0).stop 2023-08-25T04:46:07.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 -- 172.21.15.72:0/3447414119 shutdown_connections 2023-08-25T04:46:07.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f531006a110 0x7f531006c5d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f532415d000 0x7f532415fa40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53240b4d40 0x7f53240c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 --2- 172.21.15.72:0/3447414119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53240d10c0 0x7f5324155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 -- 172.21.15.72:0/3447414119 >> 172.21.15.72:0/3447414119 conn(0x7f5324071e10 msgr2=0x7f53240d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 -- 172.21.15.72:0/3447414119 shutdown_connections 2023-08-25T04:46:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:07.793+0000 7f53291ff700 1 -- 172.21.15.72:0/3447414119 wait complete. 2023-08-25T04:46:07.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:08.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.011+0000 7f377d1ff700 1 Processor -- start 2023-08-25T04:46:08.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.012+0000 7f377d1ff700 1 -- start start 2023-08-25T04:46:08.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f377d1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3778150ac0 0x7f377815def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f377d1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3778150ea0 0x7f37780cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f377d1ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f377815e430 0x7f37780cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f377d1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37780af490 con 0x7f3778150ea0 2023-08-25T04:46:08.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f377d1ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377815d7c0 con 0x7f377815e430 2023-08-25T04:46:08.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f377d1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37780aebf0 con 0x7f3778150ac0 2023-08-25T04:46:08.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f376ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3778150ea0 0x7f37780cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f376ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3778150ea0 0x7f37780cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57994/0 (socket says 172.21.15.72:57994) 2023-08-25T04:46:08.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f376ffff700 1 -- 172.21.15.72:0/3140695476 learned_addr learned my addr 172.21.15.72:0/3140695476 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:08.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f3776d9d700 1 --2- 172.21.15.72:0/3140695476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3778150ac0 0x7f377815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.013+0000 7f377759e700 1 --2- 172.21.15.72:0/3140695476 >> v2:172.21.15.137:3300/0 conn(0x7f377815e430 0x7f37780cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f376ffff700 1 -- 172.21.15.72:0/3140695476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3778150ac0 msgr2=0x7f377815def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:08.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f376ffff700 1 --2- 172.21.15.72:0/3140695476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3778150ac0 0x7f377815def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f376ffff700 1 -- 172.21.15.72:0/3140695476 >> v2:172.21.15.137:3300/0 conn(0x7f377815e430 msgr2=0x7f37780cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:08.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f376ffff700 1 --2- 172.21.15.72:0/3140695476 >> v2:172.21.15.137:3300/0 conn(0x7f377815e430 0x7f37780cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f376ffff700 1 -- 172.21.15.72:0/3140695476 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780aeed0 con 0x7f3778150ea0 2023-08-25T04:46:08.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f3776d9d700 1 --2- 172.21.15.72:0/3140695476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3778150ac0 0x7f377815def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:08.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f377759e700 1 --2- 172.21.15.72:0/3140695476 >> v2:172.21.15.137:3300/0 conn(0x7f377815e430 0x7f37780cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:08.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f376ffff700 1 --2- 172.21.15.72:0/3140695476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 0x7f37780cb650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f377815b320 tx=0x7f3760009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d060536387e2e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:08.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f377659c700 1 -- 172.21.15.72:0/3140695476 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000b870 con 0x7f3778150ea0 2023-08-25T04:46:08.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f377659c700 1 -- 172.21.15.72:0/3140695476 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376000b9d0 con 0x7f3778150ea0 2023-08-25T04:46:08.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.014+0000 7f377659c700 1 -- 172.21.15.72:0/3140695476 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000bd60 con 0x7f3778150ea0 2023-08-25T04:46:08.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.015+0000 7f377d1ff700 1 -- 172.21.15.72:0/3140695476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 msgr2=0x7f37780cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.015+0000 7f377d1ff700 1 --2- 172.21.15.72:0/3140695476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 0x7f37780cb650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f377815b320 tx=0x7f3760009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.015+0000 7f377d1ff700 1 -- 172.21.15.72:0/3140695476 shutdown_connections 2023-08-25T04:46:08.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.015+0000 7f377d1ff700 1 --2- 172.21.15.72:0/3140695476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3778150ac0 0x7f377815def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.015+0000 7f377d1ff700 1 --2- 172.21.15.72:0/3140695476 >> v2:172.21.15.137:3300/0 conn(0x7f377815e430 0x7f37780cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.015+0000 7f377d1ff700 1 --2- 172.21.15.72:0/3140695476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 0x7f37780cb650 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.015+0000 7f377d1ff700 1 -- 172.21.15.72:0/3140695476 >> 172.21.15.72:0/3140695476 conn(0x7f377806a710 msgr2=0x7f377806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:08.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.015+0000 7f377d1ff700 1 -- 172.21.15.72:0/3140695476 shutdown_connections 2023-08-25T04:46:08.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.015+0000 7f377d1ff700 1 -- 172.21.15.72:0/3140695476 wait complete. 2023-08-25T04:46:08.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.017+0000 7f377d1ff700 1 Processor -- start 2023-08-25T04:46:08.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.017+0000 7f377d1ff700 1 -- start start 2023-08-25T04:46:08.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.018+0000 7f377d1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3778150ac0 0x7f37780b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.018+0000 7f377d1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 0x7f377815bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.018+0000 7f377d1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f377815e430 0x7f3778153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.018+0000 7f377d1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3778147660 con 0x7f3778150ea0 2023-08-25T04:46:08.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.018+0000 7f377d1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780ce310 con 0x7f3778150ac0 2023-08-25T04:46:08.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f377d1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3778152fa0 con 0x7f377815e430 2023-08-25T04:46:08.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f376ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 0x7f377815bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f376ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 0x7f377815bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58008/0 (socket says 172.21.15.72:58008) 2023-08-25T04:46:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f376ffff700 1 -- 172.21.15.72:0/2178881301 learned_addr learned my addr 172.21.15.72:0/2178881301 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f3776d9d700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3778150ac0 0x7f37780b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f377759e700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f377815e430 0x7f3778153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f376ffff700 1 -- 172.21.15.72:0/2178881301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f377815e430 msgr2=0x7f3778153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f376ffff700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f377815e430 0x7f3778153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f376ffff700 1 -- 172.21.15.72:0/2178881301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3778150ac0 msgr2=0x7f37780b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f376ffff700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3778150ac0 0x7f37780b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f376ffff700 1 -- 172.21.15.72:0/2178881301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760009550 con 0x7f3778150ea0 2023-08-25T04:46:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.019+0000 7f376ffff700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 0x7f377815bb60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3760013000 tx=0x7f3760004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.020+0000 7f376f7fe700 1 -- 172.21.15.72:0/2178881301 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760004310 con 0x7f3778150ea0 2023-08-25T04:46:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.020+0000 7f376f7fe700 1 -- 172.21.15.72:0/2178881301 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376001f070 con 0x7f3778150ea0 2023-08-25T04:46:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.020+0000 7f377d1ff700 1 -- 172.21.15.72:0/2178881301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3778151560 con 0x7f3778150ea0 2023-08-25T04:46:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.020+0000 7f376f7fe700 1 -- 172.21.15.72:0/2178881301 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600036a0 con 0x7f3778150ea0 2023-08-25T04:46:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.020+0000 7f377d1ff700 1 -- 172.21.15.72:0/2178881301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3778152c30 con 0x7f3778150ea0 2023-08-25T04:46:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.021+0000 7f377d1ff700 1 -- 172.21.15.72:0/2178881301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3778153110 con 0x7f3778150ea0 2023-08-25T04:46:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.022+0000 7f376f7fe700 1 -- 172.21.15.72:0/2178881301 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3760021030 con 0x7f3778150ea0 2023-08-25T04:46:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.023+0000 7f376f7fe700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f375806a110 0x7f375806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.023+0000 7f376f7fe700 1 -- 172.21.15.72:0/2178881301 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3760089c60 con 0x7f3778150ea0 2023-08-25T04:46:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.023+0000 7f3776d9d700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f375806a110 0x7f375806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.024+0000 7f3776d9d700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f375806a110 0x7f375806c5d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3768006fd0 tx=0x7f3768008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.028+0000 7f376f7fe700 1 -- 172.21.15.72:0/2178881301 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f37600550f0 con 0x7f3778150ea0 2023-08-25T04:46:08.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.225+0000 7f377d1ff700 1 -- 172.21.15.72:0/2178881301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3778072320 con 0x7f3778150ea0 2023-08-25T04:46:08.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.226+0000 7f376f7fe700 1 -- 172.21.15.72:0/2178881301 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3760015020 con 0x7f3778150ea0 2023-08-25T04:46:08.227 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 -- 172.21.15.72:0/2178881301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f375806a110 msgr2=0x7f375806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f375806a110 0x7f375806c5d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3768006fd0 tx=0x7f3768008040 comp rx=0 tx=0).stop 2023-08-25T04:46:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 -- 172.21.15.72:0/2178881301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 msgr2=0x7f377815bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 0x7f377815bb60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3760013000 tx=0x7f3760004750 comp rx=0 tx=0).stop 2023-08-25T04:46:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 -- 172.21.15.72:0/2178881301 shutdown_connections 2023-08-25T04:46:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f375806a110 0x7f375806c5d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f377815e430 0x7f3778153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3778150ac0 0x7f37780b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 --2- 172.21.15.72:0/2178881301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3778150ea0 0x7f377815bb60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 -- 172.21.15.72:0/2178881301 >> 172.21.15.72:0/2178881301 conn(0x7f377806a710 msgr2=0x7f37780cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 -- 172.21.15.72:0/2178881301 shutdown_connections 2023-08-25T04:46:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.228+0000 7f377d1ff700 1 -- 172.21.15.72:0/2178881301 wait complete. 2023-08-25T04:46:08.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:46:08.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.446+0000 7f14dd7ff700 1 Processor -- start 2023-08-25T04:46:08.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.446+0000 7f14dd7ff700 1 -- start start 2023-08-25T04:46:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.447+0000 7f14dd7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14d80b47c0 0x7f14d80b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.447+0000 7f14dd7ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f14d815d130 0x7f14d80d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.447+0000 7f14dd7ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d80b50e0 con 0x7f14d80b86b0 2023-08-25T04:46:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.447+0000 7f14dd7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d80b6db0 con 0x7f14d80b47c0 2023-08-25T04:46:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.447+0000 7f14dd7ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d80d1780 con 0x7f14d815d130 2023-08-25T04:46:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.447+0000 7f14d6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14d80b47c0 0x7f14d80b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.447+0000 7f14d6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14d80b47c0 0x7f14d80b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58010/0 (socket says 172.21.15.72:58010) 2023-08-25T04:46:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.447+0000 7f14d6ffd700 1 -- 172.21.15.72:0/1945191471 learned_addr learned my addr 172.21.15.72:0/1945191471 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.448+0000 7f14cffff700 1 --2- 172.21.15.72:0/1945191471 >> v2:172.21.15.137:3300/0 conn(0x7f14d815d130 0x7f14d80d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.448+0000 7f14d6ffd700 1 -- 172.21.15.72:0/1945191471 >> v2:172.21.15.137:3300/0 conn(0x7f14d815d130 msgr2=0x7f14d80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:08.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.448+0000 7f14d6ffd700 1 --2- 172.21.15.72:0/1945191471 >> v2:172.21.15.137:3300/0 conn(0x7f14d815d130 0x7f14d80d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.448+0000 7f14d6ffd700 1 -- 172.21.15.72:0/1945191471 >> v1:172.21.15.137:6789/0 conn(0x7f14d80b86b0 legacy=0x7f14d806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:08.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.448+0000 7f14d6ffd700 1 -- 172.21.15.72:0/1945191471 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80d1a60 con 0x7f14d80b47c0 2023-08-25T04:46:08.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.448+0000 7f14d6ffd700 1 --2- 172.21.15.72:0/1945191471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b47c0 0x7f14d80b4ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f14d80c9d30 tx=0x7f14c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8501d69a65a522 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:08.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.448+0000 7f14d67fc700 1 -- 172.21.15.72:0/1945191471 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8004230 con 0x7f14d80b47c0 2023-08-25T04:46:08.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.448+0000 7f14d67fc700 1 -- 172.21.15.72:0/1945191471 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8004390 con 0x7f14d80b47c0 2023-08-25T04:46:08.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.448+0000 7f14d67fc700 1 -- 172.21.15.72:0/1945191471 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c80036a0 con 0x7f14d80b47c0 2023-08-25T04:46:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.449+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1945191471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b47c0 msgr2=0x7f14d80b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.449+0000 7f14dd7ff700 1 --2- 172.21.15.72:0/1945191471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b47c0 0x7f14d80b4ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f14d80c9d30 tx=0x7f14c8009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.449+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1945191471 shutdown_connections 2023-08-25T04:46:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.449+0000 7f14dd7ff700 1 --2- 172.21.15.72:0/1945191471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b47c0 0x7f14d80b4ba0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.449+0000 7f14dd7ff700 1 --2- 172.21.15.72:0/1945191471 >> v2:172.21.15.137:3300/0 conn(0x7f14d815d130 0x7f14d80d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.449+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1945191471 >> 172.21.15.72:0/1945191471 conn(0x7f14d8072050 msgr2=0x7f14d80d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:08.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.449+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1945191471 shutdown_connections 2023-08-25T04:46:08.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.449+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1945191471 wait complete. 2023-08-25T04:46:08.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.451+0000 7f14dd7ff700 1 Processor -- start 2023-08-25T04:46:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.451+0000 7f14dd7ff700 1 -- start start 2023-08-25T04:46:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14dd7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14d80b47c0 0x7f14d81f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14dd7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b86b0 0x7f14d80cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14dd7ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14d815d130 0x7f14d80c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14dd7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80cbfa0 con 0x7f14d80b86b0 2023-08-25T04:46:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14dd7ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80ccd90 con 0x7f14d815d130 2023-08-25T04:46:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14dd7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80ca4e0 con 0x7f14d80b47c0 2023-08-25T04:46:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b86b0 0x7f14d80cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b86b0 0x7f14d80cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58026/0 (socket says 172.21.15.72:58026) 2023-08-25T04:46:08.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14cffff700 1 -- 172.21.15.72:0/1856128289 learned_addr learned my addr 172.21.15.72:0/1856128289 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:08.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14d6ffd700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14d80b47c0 0x7f14d81f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14d77fe700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14d815d130 0x7f14d80c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14cffff700 1 -- 172.21.15.72:0/1856128289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14d80b47c0 msgr2=0x7f14d81f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14cffff700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14d80b47c0 0x7f14d81f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14cffff700 1 -- 172.21.15.72:0/1856128289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14d815d130 msgr2=0x7f14d80c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14cffff700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14d815d130 0x7f14d80c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.452+0000 7f14cffff700 1 -- 172.21.15.72:0/1856128289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8009550 con 0x7f14d80b86b0 2023-08-25T04:46:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.453+0000 7f14cffff700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b86b0 0x7f14d80cba60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f14c000e810 tx=0x7f14c000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:08.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.453+0000 7f14cf7fe700 1 -- 172.21.15.72:0/1856128289 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c000c070 con 0x7f14d80b86b0 2023-08-25T04:46:08.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.453+0000 7f14cf7fe700 1 -- 172.21.15.72:0/1856128289 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c0013610 con 0x7f14d80b86b0 2023-08-25T04:46:08.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.453+0000 7f14cf7fe700 1 -- 172.21.15.72:0/1856128289 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c00139c0 con 0x7f14d80b86b0 2023-08-25T04:46:08.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.453+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1856128289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d80cc180 con 0x7f14d80b86b0 2023-08-25T04:46:08.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.453+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1856128289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d80cc740 con 0x7f14d80b86b0 2023-08-25T04:46:08.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.454+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1856128289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d804e620 con 0x7f14d80b86b0 2023-08-25T04:46:08.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.455+0000 7f14cf7fe700 1 -- 172.21.15.72:0/1856128289 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f14c0013b20 con 0x7f14d80b86b0 2023-08-25T04:46:08.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.456+0000 7f14cf7fe700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14b806a0e0 0x7f14b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.456+0000 7f14cf7fe700 1 -- 172.21.15.72:0/1856128289 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f14c00885c0 con 0x7f14d80b86b0 2023-08-25T04:46:08.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.456+0000 7f14d6ffd700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14b806a0e0 0x7f14b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.457+0000 7f14d6ffd700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14b806a0e0 0x7f14b806c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009130 tx=0x7f14c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:08.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.460+0000 7f14cf7fe700 1 -- 172.21.15.72:0/1856128289 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f14c0053930 con 0x7f14d80b86b0 2023-08-25T04:46:08.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.701+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1856128289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14d80b7a10 con 0x7f14d80b86b0 2023-08-25T04:46:08.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.701+0000 7f14cf7fe700 1 -- 172.21.15.72:0/1856128289 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f14c0056f50 con 0x7f14d80b86b0 2023-08-25T04:46:08.702 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:08.703 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:45:32.715423+0000","modified":"2023-08-25T04:45:57.525662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:46:08.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1856128289 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14b806a0e0 msgr2=0x7f14b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14b806a0e0 0x7f14b806c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009130 tx=0x7f14c8008030 comp rx=0 tx=0).stop 2023-08-25T04:46:08.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1856128289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b86b0 msgr2=0x7f14d80cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b86b0 0x7f14d80cba60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f14c000e810 tx=0x7f14c000eb20 comp rx=0 tx=0).stop 2023-08-25T04:46:08.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1856128289 shutdown_connections 2023-08-25T04:46:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14b806a0e0 0x7f14b806c5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14d815d130 0x7f14d80c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14d80b47c0 0x7f14d81f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 --2- 172.21.15.72:0/1856128289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14d80b86b0 0x7f14d80cba60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1856128289 >> 172.21.15.72:0/1856128289 conn(0x7f14d8072050 msgr2=0x7f14d80b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1856128289 shutdown_connections 2023-08-25T04:46:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.704+0000 7f14dd7ff700 1 -- 172.21.15.72:0/1856128289 wait complete. 2023-08-25T04:46:08.707 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-08-25T04:46:08.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:08.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.917+0000 7fa6ff1ff700 1 Processor -- start 2023-08-25T04:46:08.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.917+0000 7fa6ff1ff700 1 -- start start 2023-08-25T04:46:08.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.918+0000 7fa6ff1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b47c0 0x7fa6f80b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.918+0000 7fa6ff1ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa6f815d130 0x7fa6f80d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.918+0000 7fa6ff1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6f80b86b0 0x7fa6f806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.918+0000 7fa6ff1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f80b50e0 con 0x7fa6f80b86b0 2023-08-25T04:46:08.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.918+0000 7fa6ff1ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f80d1780 con 0x7fa6f815d130 2023-08-25T04:46:08.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.918+0000 7fa6ff1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80d1a60 con 0x7fa6f80b47c0 2023-08-25T04:46:08.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fd79c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6f80b86b0 0x7fa6f806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fd79c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6f80b86b0 0x7fa6f806b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58036/0 (socket says 172.21.15.72:58036) 2023-08-25T04:46:08.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fd79c700 1 -- 172.21.15.72:0/339120561 learned_addr learned my addr 172.21.15.72:0/339120561 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:08.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fcf9b700 1 --2- 172.21.15.72:0/339120561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b47c0 0x7fa6f80b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6f7fff700 1 --2- 172.21.15.72:0/339120561 >> v2:172.21.15.137:3300/0 conn(0x7fa6f815d130 0x7fa6f80d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fd79c700 1 -- 172.21.15.72:0/339120561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b47c0 msgr2=0x7fa6f80b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:08.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fd79c700 1 --2- 172.21.15.72:0/339120561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b47c0 0x7fa6f80b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fd79c700 1 -- 172.21.15.72:0/339120561 >> v2:172.21.15.137:3300/0 conn(0x7fa6f815d130 msgr2=0x7fa6f80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fd79c700 1 --2- 172.21.15.72:0/339120561 >> v2:172.21.15.137:3300/0 conn(0x7fa6f815d130 0x7fa6f80d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fd79c700 1 -- 172.21.15.72:0/339120561 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f80d1d40 con 0x7fa6f80b86b0 2023-08-25T04:46:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fcf9b700 1 --2- 172.21.15.72:0/339120561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b47c0 0x7fa6f80b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6f7fff700 1 --2- 172.21.15.72:0/339120561 >> v2:172.21.15.137:3300/0 conn(0x7fa6f815d130 0x7fa6f80d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.919+0000 7fa6fd79c700 1 --2- 172.21.15.72:0/339120561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f80b86b0 0x7fa6f806b7e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa6f806c8b0 tx=0x7fa6f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e257faee759b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6f77fe700 1 -- 172.21.15.72:0/339120561 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f000e070 con 0x7fa6f80b86b0 2023-08-25T04:46:08.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6f77fe700 1 -- 172.21.15.72:0/339120561 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f000b9c0 con 0x7fa6f80b86b0 2023-08-25T04:46:08.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6f77fe700 1 -- 172.21.15.72:0/339120561 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f000bd70 con 0x7fa6f80b86b0 2023-08-25T04:46:08.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/339120561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f80b86b0 msgr2=0x7fa6f806b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6ff1ff700 1 --2- 172.21.15.72:0/339120561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f80b86b0 0x7fa6f806b7e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa6f806c8b0 tx=0x7fa6f000b330 comp rx=0 tx=0).stop 2023-08-25T04:46:08.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/339120561 shutdown_connections 2023-08-25T04:46:08.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6ff1ff700 1 --2- 172.21.15.72:0/339120561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b47c0 0x7fa6f80b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6ff1ff700 1 --2- 172.21.15.72:0/339120561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f80b86b0 0x7fa6f806b7e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6ff1ff700 1 --2- 172.21.15.72:0/339120561 >> v2:172.21.15.137:3300/0 conn(0x7fa6f815d130 0x7fa6f80d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/339120561 >> 172.21.15.72:0/339120561 conn(0x7fa6f8072050 msgr2=0x7fa6f80d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:08.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/339120561 shutdown_connections 2023-08-25T04:46:08.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.920+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/339120561 wait complete. 2023-08-25T04:46:08.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.923+0000 7fa6ff1ff700 1 Processor -- start 2023-08-25T04:46:08.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.923+0000 7fa6ff1ff700 1 -- start start 2023-08-25T04:46:08.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.924+0000 7fa6ff1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f80b47c0 0x7fa6f81f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.924+0000 7fa6ff1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b86b0 0x7fa6f80ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.924+0000 7fa6ff1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815d130 0x7fa6f80c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.924+0000 7fa6ff1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80cc7d0 con 0x7fa6f815d130 2023-08-25T04:46:08.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.924+0000 7fa6ff1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8142dd0 con 0x7fa6f80b47c0 2023-08-25T04:46:08.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.924+0000 7fa6ff1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80cc110 con 0x7fa6f80b86b0 2023-08-25T04:46:08.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.924+0000 7fa6fd79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815d130 0x7fa6f80c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6fd79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815d130 0x7fa6f80c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58044/0 (socket says 172.21.15.72:58044) 2023-08-25T04:46:08.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6fcf9b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f80b47c0 0x7fa6f81f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6fd79c700 1 -- 172.21.15.72:0/2103114078 learned_addr learned my addr 172.21.15.72:0/2103114078 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:08.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6f7fff700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b86b0 0x7fa6f80ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6fd79c700 1 -- 172.21.15.72:0/2103114078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b86b0 msgr2=0x7fa6f80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6fd79c700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b86b0 0x7fa6f80ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6fd79c700 1 -- 172.21.15.72:0/2103114078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f80b47c0 msgr2=0x7fa6f81f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:08.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6fd79c700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f80b47c0 0x7fa6f81f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:08.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6fd79c700 1 -- 172.21.15.72:0/2103114078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f0009b30 con 0x7fa6f815d130 2023-08-25T04:46:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6fd79c700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815d130 0x7fa6f80c9d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0012000 tx=0x7fa6f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6f57fa700 1 -- 172.21.15.72:0/2103114078 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00099b0 con 0x7fa6f815d130 2023-08-25T04:46:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6f57fa700 1 -- 172.21.15.72:0/2103114078 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f0004250 con 0x7fa6f815d130 2023-08-25T04:46:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6f57fa700 1 -- 172.21.15.72:0/2103114078 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0004600 con 0x7fa6f815d130 2023-08-25T04:46:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.925+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/2103114078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f80cc3f0 con 0x7fa6f815d130 2023-08-25T04:46:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.926+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/2103114078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f80ca2c0 con 0x7fa6f815d130 2023-08-25T04:46:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.927+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/2103114078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f80cc910 con 0x7fa6f815d130 2023-08-25T04:46:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.927+0000 7fa6f57fa700 1 -- 172.21.15.72:0/2103114078 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa6f0004760 con 0x7fa6f815d130 2023-08-25T04:46:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.928+0000 7fa6f57fa700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6dc06a0e0 0x7fa6dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:08.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.929+0000 7fa6f57fa700 1 -- 172.21.15.72:0/2103114078 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa6f0089d10 con 0x7fa6f815d130 2023-08-25T04:46:08.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.929+0000 7fa6fcf9b700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6dc06a0e0 0x7fa6dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:08.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.929+0000 7fa6fcf9b700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6dc06a0e0 0x7fa6dc06c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec006f10 tx=0x7fa6ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:08.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:08.932+0000 7fa6f57fa700 1 -- 172.21.15.72:0/2103114078 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa6f80cc910 con 0x7fa6f815d130 2023-08-25T04:46:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.128+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/2103114078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6f80cc910 con 0x7fa6f815d130 2023-08-25T04:46:09.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.130+0000 7fa6f57fa700 1 -- 172.21.15.72:0/2103114078 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7fa6f80cc910 con 0x7fa6f815d130 2023-08-25T04:46:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:09.131 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:09.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/2103114078 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6dc06a0e0 msgr2=0x7fa6dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6dc06a0e0 0x7fa6dc06c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec006f10 tx=0x7fa6ec008040 comp rx=0 tx=0).stop 2023-08-25T04:46:09.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/2103114078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815d130 msgr2=0x7fa6f80c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815d130 0x7fa6f80c9d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0012000 tx=0x7fa6f0004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/2103114078 shutdown_connections 2023-08-25T04:46:09.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6dc06a0e0 0x7fa6dc06c5a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815d130 0x7fa6f80c9d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f80b47c0 0x7fa6f81f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 --2- 172.21.15.72:0/2103114078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6f80b86b0 0x7fa6f80ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/2103114078 >> 172.21.15.72:0/2103114078 conn(0x7fa6f8072050 msgr2=0x7fa6f815a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:09.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/2103114078 shutdown_connections 2023-08-25T04:46:09.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.132+0000 7fa6ff1ff700 1 -- 172.21.15.72:0/2103114078 wait complete. 2023-08-25T04:46:09.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:09.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:09.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.350+0000 7fcec0bff700 1 Processor -- start 2023-08-25T04:46:09.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.350+0000 7fcec0bff700 1 -- start start 2023-08-25T04:46:09.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.351+0000 7fcec0bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcebc15d090 0x7fcebc0d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.351+0000 7fcec0bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc0b8aa0 0x7fcebc0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.351+0000 7fcec0bff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc0ce4b0 con 0x7fcebc0ce090 2023-08-25T04:46:09.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.351+0000 7fcec0bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc15d470 con 0x7fcebc15d090 2023-08-25T04:46:09.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.351+0000 7fcec0bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0b6ec0 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.351+0000 7fceba59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcebc15d090 0x7fcebc0d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.352+0000 7fceba59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcebc15d090 0x7fcebc0d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58048/0 (socket says 172.21.15.72:58048) 2023-08-25T04:46:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.352+0000 7fceba59c700 1 -- 172.21.15.72:0/2835970806 learned_addr learned my addr 172.21.15.72:0/2835970806 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.352+0000 7fceb9d9b700 1 --2- 172.21.15.72:0/2835970806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc0b8aa0 0x7fcebc0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.352+0000 7fceba59c700 1 -- 172.21.15.72:0/2835970806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc0b8aa0 msgr2=0x7fcebc0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.352+0000 7fceba59c700 1 --2- 172.21.15.72:0/2835970806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc0b8aa0 0x7fcebc0cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.352+0000 7fceba59c700 1 -- 172.21.15.72:0/2835970806 >> v1:172.21.15.137:6789/0 conn(0x7fcebc0ce090 legacy=0x7fcebc0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.352+0000 7fceba59c700 1 -- 172.21.15.72:0/2835970806 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0d17e0 con 0x7fcebc15d090 2023-08-25T04:46:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.352+0000 7fceba59c700 1 --2- 172.21.15.72:0/2835970806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc15d090 0x7fcebc0d0e70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fceac0098f0 tx=0x7fceac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ab718b8caa8e2b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.352+0000 7fceb959a700 1 -- 172.21.15.72:0/2835970806 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac011830 con 0x7fcebc15d090 2023-08-25T04:46:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.353+0000 7fceb959a700 1 -- 172.21.15.72:0/2835970806 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac011990 con 0x7fcebc15d090 2023-08-25T04:46:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.353+0000 7fceb959a700 1 -- 172.21.15.72:0/2835970806 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac011d20 con 0x7fcebc15d090 2023-08-25T04:46:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.353+0000 7fcec0bff700 1 -- 172.21.15.72:0/2835970806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc15d090 msgr2=0x7fcebc0d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.353+0000 7fcec0bff700 1 --2- 172.21.15.72:0/2835970806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc15d090 0x7fcebc0d0e70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fceac0098f0 tx=0x7fceac009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.353+0000 7fcec0bff700 1 -- 172.21.15.72:0/2835970806 shutdown_connections 2023-08-25T04:46:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.353+0000 7fcec0bff700 1 --2- 172.21.15.72:0/2835970806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc15d090 0x7fcebc0d0e70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.353+0000 7fcec0bff700 1 --2- 172.21.15.72:0/2835970806 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc0b8aa0 0x7fcebc0cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.353+0000 7fcec0bff700 1 -- 172.21.15.72:0/2835970806 >> 172.21.15.72:0/2835970806 conn(0x7fcebc071e10 msgr2=0x7fcebc072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:09.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.353+0000 7fcec0bff700 1 -- 172.21.15.72:0/2835970806 shutdown_connections 2023-08-25T04:46:09.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.353+0000 7fcec0bff700 1 -- 172.21.15.72:0/2835970806 wait complete. 2023-08-25T04:46:09.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.355+0000 7fcec0bff700 1 Processor -- start 2023-08-25T04:46:09.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.355+0000 7fcec0bff700 1 -- start start 2023-08-25T04:46:09.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fcec0bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0b8aa0 0x7fcebc150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fcec0bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcebc0ce090 0x7fcebc0b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fcec0bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc15d090 0x7fcebc15d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fcec0bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0cb710 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fcec0bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc15dfb0 con 0x7fcebc0ce090 2023-08-25T04:46:09.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fcec0bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc15e290 con 0x7fcebc15d090 2023-08-25T04:46:09.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fceba59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0b8aa0 0x7fcebc150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fceba59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0b8aa0 0x7fcebc150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58052/0 (socket says 172.21.15.72:58052) 2023-08-25T04:46:09.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fceba59c700 1 -- 172.21.15.72:0/2725711324 learned_addr learned my addr 172.21.15.72:0/2725711324 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:09.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fceb9d9b700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcebc0ce090 0x7fcebc0b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.356+0000 7fcebad9d700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc15d090 0x7fcebc15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fceba59c700 1 -- 172.21.15.72:0/2725711324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc15d090 msgr2=0x7fcebc15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fceba59c700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc15d090 0x7fcebc15d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fceba59c700 1 -- 172.21.15.72:0/2725711324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcebc0ce090 msgr2=0x7fcebc0b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fceba59c700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcebc0ce090 0x7fcebc0b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fceba59c700 1 -- 172.21.15.72:0/2725711324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac009550 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fcebad9d700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc15d090 0x7fcebc15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:09.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fceb9d9b700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcebc0ce090 0x7fcebc0b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:09.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fceba59c700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0b8aa0 0x7fcebc150c90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fceac000c00 tx=0x7fceac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:09.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fceaaffd700 1 -- 172.21.15.72:0/2725711324 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac004570 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fceaaffd700 1 -- 172.21.15.72:0/2725711324 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac01f070 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fcec0bff700 1 -- 172.21.15.72:0/2725711324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc15e570 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fceaaffd700 1 -- 172.21.15.72:0/2725711324 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0038c0 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.357+0000 7fcec0bff700 1 -- 172.21.15.72:0/2725711324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc15db80 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.358+0000 7fcec0bff700 1 -- 172.21.15.72:0/2725711324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc06a2f0 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.359+0000 7fceaaffd700 1 -- 172.21.15.72:0/2725711324 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fceac021030 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.360+0000 7fceaaffd700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fce9c06a0b0 0x7fce9c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.360+0000 7fceaaffd700 1 -- 172.21.15.72:0/2725711324 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fceac089c70 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.360+0000 7fceb9d9b700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fce9c06a0b0 0x7fce9c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.361+0000 7fceb9d9b700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fce9c06a0b0 0x7fce9c06c570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcebc1511d0 tx=0x7fceb0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:09.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.364+0000 7fceaaffd700 1 -- 172.21.15.72:0/2725711324 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fceac055200 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.564+0000 7fcec0bff700 1 -- 172.21.15.72:0/2725711324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcebc0c6690 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.564+0000 7fceaaffd700 1 -- 172.21.15.72:0/2725711324 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fceac0150a0 con 0x7fcebc0b8aa0 2023-08-25T04:46:09.566 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:09.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 -- 172.21.15.72:0/2725711324 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fce9c06a0b0 msgr2=0x7fce9c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fce9c06a0b0 0x7fce9c06c570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcebc1511d0 tx=0x7fceb0008040 comp rx=0 tx=0).stop 2023-08-25T04:46:09.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 -- 172.21.15.72:0/2725711324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0b8aa0 msgr2=0x7fcebc150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0b8aa0 0x7fcebc150c90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fceac000c00 tx=0x7fceac004750 comp rx=0 tx=0).stop 2023-08-25T04:46:09.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 -- 172.21.15.72:0/2725711324 shutdown_connections 2023-08-25T04:46:09.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fce9c06a0b0 0x7fce9c06c570 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcebc15d090 0x7fcebc15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0b8aa0 0x7fcebc150c90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 --2- 172.21.15.72:0/2725711324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcebc0ce090 0x7fcebc0b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 -- 172.21.15.72:0/2725711324 >> 172.21.15.72:0/2725711324 conn(0x7fcebc071e10 msgr2=0x7fcebc0b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:09.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 -- 172.21.15.72:0/2725711324 shutdown_connections 2023-08-25T04:46:09.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.567+0000 7fcec0bff700 1 -- 172.21.15.72:0/2725711324 wait complete. 2023-08-25T04:46:09.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.786+0000 7f10a4dff700 1 Processor -- start 2023-08-25T04:46:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.787+0000 7f10a4dff700 1 -- start start 2023-08-25T04:46:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f10a4dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10a015d090 0x7f10a00d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f10a4dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10a00b8aa0 0x7f10a00cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f10a4dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10a00ce090 0x7f10a00b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f10a4dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a00ce4b0 con 0x7f10a015d090 2023-08-25T04:46:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f10a4dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a015d470 con 0x7f10a00ce090 2023-08-25T04:46:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f10a4dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00d17e0 con 0x7f10a00b8aa0 2023-08-25T04:46:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f109e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10a015d090 0x7f10a00d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f109e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10a015d090 0x7f10a00d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58062/0 (socket says 172.21.15.72:58062) 2023-08-25T04:46:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f109e59c700 1 -- 172.21.15.72:0/3573994990 learned_addr learned my addr 172.21.15.72:0/3573994990 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f1097fff700 1 --2- 172.21.15.72:0/3573994990 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10a00b8aa0 0x7f10a00cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f109ed9d700 1 --2- 172.21.15.72:0/3573994990 >> v2:172.21.15.137:3300/0 conn(0x7f10a00ce090 0x7f10a00b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f109e59c700 1 -- 172.21.15.72:0/3573994990 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10a00b8aa0 msgr2=0x7f10a00cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f109e59c700 1 --2- 172.21.15.72:0/3573994990 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10a00b8aa0 0x7f10a00cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f109e59c700 1 -- 172.21.15.72:0/3573994990 >> v2:172.21.15.137:3300/0 conn(0x7f10a00ce090 msgr2=0x7f10a00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f109e59c700 1 --2- 172.21.15.72:0/3573994990 >> v2:172.21.15.137:3300/0 conn(0x7f10a00ce090 0x7f10a00b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.788+0000 7f109e59c700 1 -- 172.21.15.72:0/3573994990 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00d1ac0 con 0x7f10a015d090 2023-08-25T04:46:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.789+0000 7f109e59c700 1 --2- 172.21.15.72:0/3573994990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a015d090 0x7f10a00d0e70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f10a0072990 tx=0x7f1090009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3aef92d9a19a8dd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.789+0000 7f109dd9b700 1 -- 172.21.15.72:0/3573994990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109000b870 con 0x7f10a015d090 2023-08-25T04:46:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.789+0000 7f109dd9b700 1 -- 172.21.15.72:0/3573994990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109000b9d0 con 0x7f10a015d090 2023-08-25T04:46:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.789+0000 7f109dd9b700 1 -- 172.21.15.72:0/3573994990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109000bd60 con 0x7f10a015d090 2023-08-25T04:46:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.789+0000 7f10a4dff700 1 -- 172.21.15.72:0/3573994990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a015d090 msgr2=0x7f10a00d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.789+0000 7f10a4dff700 1 --2- 172.21.15.72:0/3573994990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a015d090 0x7f10a00d0e70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f10a0072990 tx=0x7f1090009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.790+0000 7f10a4dff700 1 -- 172.21.15.72:0/3573994990 shutdown_connections 2023-08-25T04:46:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.790+0000 7f10a4dff700 1 --2- 172.21.15.72:0/3573994990 >> v2:172.21.15.137:3300/0 conn(0x7f10a00ce090 0x7f10a00b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.790+0000 7f10a4dff700 1 --2- 172.21.15.72:0/3573994990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a015d090 0x7f10a00d0e70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.790+0000 7f10a4dff700 1 --2- 172.21.15.72:0/3573994990 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10a00b8aa0 0x7f10a00cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.790+0000 7f10a4dff700 1 -- 172.21.15.72:0/3573994990 >> 172.21.15.72:0/3573994990 conn(0x7f10a0071e10 msgr2=0x7f10a0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.790+0000 7f10a4dff700 1 -- 172.21.15.72:0/3573994990 shutdown_connections 2023-08-25T04:46:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.790+0000 7f10a4dff700 1 -- 172.21.15.72:0/3573994990 wait complete. 2023-08-25T04:46:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.791+0000 7f10a4dff700 1 Processor -- start 2023-08-25T04:46:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.792+0000 7f10a4dff700 1 -- start start 2023-08-25T04:46:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.792+0000 7f10a4dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a00b8aa0 0x7f10a0150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.792+0000 7f10a4dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10a00ce090 0x7f10a015f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.792+0000 7f10a4dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a015d090 0x7f10a00cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.792+0000 7f10a4dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a015e680 con 0x7f10a00b8aa0 2023-08-25T04:46:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.792+0000 7f10a4dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00b2e40 con 0x7f10a015d090 2023-08-25T04:46:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.792+0000 7f10a4dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a015f740 con 0x7f10a00ce090 2023-08-25T04:46:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a00b8aa0 0x7f10a0150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a00b8aa0 0x7f10a0150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58064/0 (socket says 172.21.15.72:58064) 2023-08-25T04:46:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109e59c700 1 -- 172.21.15.72:0/4074940374 learned_addr learned my addr 172.21.15.72:0/4074940374 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f1097fff700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10a00ce090 0x7f10a015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109ed9d700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a015d090 0x7f10a00cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109e59c700 1 -- 172.21.15.72:0/4074940374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10a00ce090 msgr2=0x7f10a015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109e59c700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10a00ce090 0x7f10a015f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109e59c700 1 -- 172.21.15.72:0/4074940374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a015d090 msgr2=0x7f10a00cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109e59c700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a015d090 0x7f10a00cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109e59c700 1 -- 172.21.15.72:0/4074940374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090009550 con 0x7f10a00b8aa0 2023-08-25T04:46:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109ed9d700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a015d090 0x7f10a00cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.793+0000 7f109e59c700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a00b8aa0 0x7f10a0150e40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f10a00d3ae0 tx=0x7f1090004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.794+0000 7f1096ffd700 1 -- 172.21.15.72:0/4074940374 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090004480 con 0x7f10a00b8aa0 2023-08-25T04:46:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.794+0000 7f1096ffd700 1 -- 172.21.15.72:0/4074940374 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10900045e0 con 0x7f10a00b8aa0 2023-08-25T04:46:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.794+0000 7f1096ffd700 1 -- 172.21.15.72:0/4074940374 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10900038c0 con 0x7f10a00b8aa0 2023-08-25T04:46:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.794+0000 7f10a4dff700 1 -- 172.21.15.72:0/4074940374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a015e3a0 con 0x7f10a00b8aa0 2023-08-25T04:46:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.794+0000 7f10a4dff700 1 -- 172.21.15.72:0/4074940374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a00b2ad0 con 0x7f10a00b8aa0 2023-08-25T04:46:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.795+0000 7f10a4dff700 1 -- 172.21.15.72:0/4074940374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a006a2f0 con 0x7f10a00b8aa0 2023-08-25T04:46:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.796+0000 7f1096ffd700 1 -- 172.21.15.72:0/4074940374 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1090021070 con 0x7f10a00b8aa0 2023-08-25T04:46:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.797+0000 7f1096ffd700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108006a0e0 0x7f108006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.797+0000 7f1096ffd700 1 -- 172.21.15.72:0/4074940374 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1090089f30 con 0x7f10a00b8aa0 2023-08-25T04:46:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.797+0000 7f1097fff700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108006a0e0 0x7f108006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.797+0000 7f1097fff700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108006a0e0 0x7f108006c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10a0151af0 tx=0x7f1088008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.801+0000 7f1096ffd700 1 -- 172.21.15.72:0/4074940374 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1090055320 con 0x7f10a00b8aa0 2023-08-25T04:46:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.998+0000 7f10a4dff700 1 -- 172.21.15.72:0/4074940374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10a008a000 con 0x7f10a00b8aa0 2023-08-25T04:46:10.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:09.999+0000 7f1096ffd700 1 -- 172.21.15.72:0/4074940374 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10900290a0 con 0x7f10a00b8aa0 2023-08-25T04:46:10.002 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:10.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 -- 172.21.15.72:0/4074940374 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108006a0e0 msgr2=0x7f108006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108006a0e0 0x7f108006c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10a0151af0 tx=0x7f1088008040 comp rx=0 tx=0).stop 2023-08-25T04:46:10.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 -- 172.21.15.72:0/4074940374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a00b8aa0 msgr2=0x7f10a0150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a00b8aa0 0x7f10a0150e40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f10a00d3ae0 tx=0x7f1090004750 comp rx=0 tx=0).stop 2023-08-25T04:46:10.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 -- 172.21.15.72:0/4074940374 shutdown_connections 2023-08-25T04:46:10.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108006a0e0 0x7f108006c5a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a015d090 0x7f10a00cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10a00b8aa0 0x7f10a0150e40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 --2- 172.21.15.72:0/4074940374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10a00ce090 0x7f10a015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 -- 172.21.15.72:0/4074940374 >> 172.21.15.72:0/4074940374 conn(0x7f10a0071e10 msgr2=0x7f10a00c68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 -- 172.21.15.72:0/4074940374 shutdown_connections 2023-08-25T04:46:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.001+0000 7f10a4dff700 1 -- 172.21.15.72:0/4074940374 wait complete. 2023-08-25T04:46:10.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:10.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.219+0000 7f34783ff700 1 Processor -- start 2023-08-25T04:46:10.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.219+0000 7f34783ff700 1 -- start start 2023-08-25T04:46:10.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.220+0000 7f34783ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f34700ade30 0x7f34700ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.220+0000 7f34783ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34700710a0 0x7f34700c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.220+0000 7f34783ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34700ae750 con 0x7f347015da20 2023-08-25T04:46:10.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.220+0000 7f34783ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34700ae9d0 con 0x7f34700ade30 2023-08-25T04:46:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.220+0000 7f34783ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3470159d70 con 0x7f34700710a0 2023-08-25T04:46:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.221+0000 7f347599a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f347015da20 0x7f3470070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41750/0 (socket says 172.21.15.72:41750) 2023-08-25T04:46:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.221+0000 7f347599a700 1 -- 172.21.15.72:0/669878807 learned_addr learned my addr 172.21.15.72:0/669878807 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.221+0000 7f347619b700 1 --2- 172.21.15.72:0/669878807 >> v2:172.21.15.137:3300/0 conn(0x7f34700ade30 0x7f34700ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.221+0000 7f347699c700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34700710a0 0x7f34700c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.221+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997652997 0 0) 0x7f34700ae750 con 0x7f347015da20 2023-08-25T04:46:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.221+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f345c0035b0 con 0x7f347015da20 2023-08-25T04:46:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.221+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2640815130 0 0) 0x7f345c0035b0 con 0x7f347015da20 2023-08-25T04:46:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.221+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34700710a0 msgr2=0x7f34700c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.221+0000 7f3475199700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34700710a0 0x7f34700c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 >> v2:172.21.15.137:3300/0 conn(0x7f34700ade30 msgr2=0x7f34700ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 --2- 172.21.15.72:0/669878807 >> v2:172.21.15.137:3300/0 conn(0x7f34700ade30 0x7f34700ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347015a050 con 0x7f347015da20 2023-08-25T04:46:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f3460001670 con 0x7f347015da20 2023-08-25T04:46:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 >> v1:172.21.15.72:6789/0 conn(0x7f347015da20 legacy=0x7f3470070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34700710a0 0x7f345c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f345c003fd0 0x7f345c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f345c004d90 0x7f345c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34700ae9d0 con 0x7f345c004d90 2023-08-25T04:46:10.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3470159d70 con 0x7f345c003fd0 2023-08-25T04:46:10.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c00ba10 con 0x7f34700710a0 2023-08-25T04:46:10.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f347619b700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34700710a0 0x7f345c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f347599a700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f345c003fd0 0x7f345c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f347699c700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f345c004d90 0x7f345c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f347699c700 1 -- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34700710a0 msgr2=0x7f345c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:10.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f347699c700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34700710a0 0x7f345c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f347699c700 1 -- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f345c003fd0 msgr2=0x7f345c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:10.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f347699c700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f345c003fd0 0x7f345c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.222+0000 7f347699c700 1 -- 172.21.15.72:0/669878807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c0035b0 con 0x7f345c004d90 2023-08-25T04:46:10.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.223+0000 7f347699c700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f345c004d90 0x7f345c005210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3468009f90 tx=0x7f345c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0582c9bb853cd3c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:10.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.223+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346800ec30 con 0x7f345c004d90 2023-08-25T04:46:10.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.223+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346800f040 con 0x7f345c004d90 2023-08-25T04:46:10.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.223+0000 7f3475199700 1 -- 172.21.15.72:0/669878807 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468014480 con 0x7f345c004d90 2023-08-25T04:46:10.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.223+0000 7f34783ff700 1 -- 172.21.15.72:0/669878807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f345c004d90 msgr2=0x7f345c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.223+0000 7f34783ff700 1 --2- 172.21.15.72:0/669878807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f345c004d90 0x7f345c005210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3468009f90 tx=0x7f345c005880 comp rx=0 tx=0).stop 2023-08-25T04:46:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.223+0000 7f347699c700 1 -- 172.21.15.72:0/669878807 reap_dead start 2023-08-25T04:46:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.223+0000 7f34783ff700 1 -- 172.21.15.72:0/669878807 shutdown_connections 2023-08-25T04:46:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.223+0000 7f34783ff700 1 -- 172.21.15.72:0/669878807 >> 172.21.15.72:0/669878807 conn(0x7f347006a710 msgr2=0x7f347006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.224+0000 7f34783ff700 1 -- 172.21.15.72:0/669878807 shutdown_connections 2023-08-25T04:46:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.224+0000 7f34783ff700 1 -- 172.21.15.72:0/669878807 wait complete. 2023-08-25T04:46:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.225+0000 7f34783ff700 1 Processor -- start 2023-08-25T04:46:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.225+0000 7f34783ff700 1 -- start start 2023-08-25T04:46:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.226+0000 7f34783ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f345c004d90 0x7f34700c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.226+0000 7f34783ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700c3d10 0x7f347014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.226+0000 7f34783ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f347014fc10 0x7f347014f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.226+0000 7f34783ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347014cbd0 con 0x7f34700c3d10 2023-08-25T04:46:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.226+0000 7f34783ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347014bfc0 con 0x7f345c004d90 2023-08-25T04:46:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.226+0000 7f34783ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347014c2a0 con 0x7f347014fc10 2023-08-25T04:46:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347599a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700c3d10 0x7f347014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347599a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700c3d10 0x7f347014efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58084/0 (socket says 172.21.15.72:58084) 2023-08-25T04:46:10.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347599a700 1 -- 172.21.15.72:0/890864531 learned_addr learned my addr 172.21.15.72:0/890864531 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347619b700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f345c004d90 0x7f34700c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347699c700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f347014fc10 0x7f347014f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347599a700 1 -- 172.21.15.72:0/890864531 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f347014fc10 msgr2=0x7f347014f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347599a700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f347014fc10 0x7f347014f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347599a700 1 -- 172.21.15.72:0/890864531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f345c004d90 msgr2=0x7f34700c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347599a700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f345c004d90 0x7f34700c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347599a700 1 -- 172.21.15.72:0/890864531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347014c580 con 0x7f34700c3d10 2023-08-25T04:46:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347619b700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f345c004d90 0x7f34700c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f347599a700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700c3d10 0x7f347014efc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3460007fd0 tx=0x7f34600075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f3466ffd700 1 -- 172.21.15.72:0/890864531 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34600077d0 con 0x7f34700c3d10 2023-08-25T04:46:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f3466ffd700 1 -- 172.21.15.72:0/890864531 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346000f8d0 con 0x7f34700c3d10 2023-08-25T04:46:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f34783ff700 1 -- 172.21.15.72:0/890864531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347014c860 con 0x7f34700c3d10 2023-08-25T04:46:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.227+0000 7f3466ffd700 1 -- 172.21.15.72:0/890864531 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346000fcc0 con 0x7f34700c3d10 2023-08-25T04:46:10.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.228+0000 7f34783ff700 1 -- 172.21.15.72:0/890864531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34700b3000 con 0x7f34700c3d10 2023-08-25T04:46:10.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.228+0000 7f34783ff700 1 -- 172.21.15.72:0/890864531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34701428c0 con 0x7f34700c3d10 2023-08-25T04:46:10.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.229+0000 7f3466ffd700 1 -- 172.21.15.72:0/890864531 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f346001d460 con 0x7f34700c3d10 2023-08-25T04:46:10.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.230+0000 7f3466ffd700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f345406a0e0 0x7f345406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.230+0000 7f3466ffd700 1 -- 172.21.15.72:0/890864531 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3460088950 con 0x7f34700c3d10 2023-08-25T04:46:10.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.231+0000 7f347619b700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f345406a0e0 0x7f345406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.231+0000 7f347619b700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f345406a0e0 0x7f345406c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f347014a960 tx=0x7f346c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:10.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.235+0000 7f3466ffd700 1 -- 172.21.15.72:0/890864531 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3460053d40 con 0x7f34700c3d10 2023-08-25T04:46:10.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.433+0000 7f34783ff700 1 -- 172.21.15.72:0/890864531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3470066cc0 con 0x7f34700c3d10 2023-08-25T04:46:10.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.433+0000 7f3466ffd700 1 -- 172.21.15.72:0/890864531 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3460057360 con 0x7f34700c3d10 2023-08-25T04:46:10.435 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:10.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 -- 172.21.15.72:0/890864531 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f345406a0e0 msgr2=0x7f345406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f345406a0e0 0x7f345406c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f347014a960 tx=0x7f346c008040 comp rx=0 tx=0).stop 2023-08-25T04:46:10.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 -- 172.21.15.72:0/890864531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700c3d10 msgr2=0x7f347014efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700c3d10 0x7f347014efc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3460007fd0 tx=0x7f34600075f0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 -- 172.21.15.72:0/890864531 shutdown_connections 2023-08-25T04:46:10.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f345406a0e0 0x7f345406c5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f347014fc10 0x7f347014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f345c004d90 0x7f34700c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 --2- 172.21.15.72:0/890864531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700c3d10 0x7f347014efc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 -- 172.21.15.72:0/890864531 >> 172.21.15.72:0/890864531 conn(0x7f347006a710 msgr2=0x7f347015b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:10.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 -- 172.21.15.72:0/890864531 shutdown_connections 2023-08-25T04:46:10.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.436+0000 7f34783ff700 1 -- 172.21.15.72:0/890864531 wait complete. 2023-08-25T04:46:10.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:10.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.653+0000 7f7828fff700 1 Processor -- start 2023-08-25T04:46:10.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.653+0000 7f7828fff700 1 -- start start 2023-08-25T04:46:10.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7828fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f782406fe90 0x7f78240b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7828fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78240b28c0 0x7f78240cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7828fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78240ca640 con 0x7f782406a2f0 2023-08-25T04:46:10.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7828fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78240b2cd0 con 0x7f78240b28c0 2023-08-25T04:46:10.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7828fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78240ca920 con 0x7f782406fe90 2023-08-25T04:46:10.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7822d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78240b28c0 0x7f78240cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7822d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78240b28c0 0x7f78240cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58092/0 (socket says 172.21.15.72:58092) 2023-08-25T04:46:10.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7822d9d700 1 -- 172.21.15.72:0/187099048 learned_addr learned my addr 172.21.15.72:0/187099048 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:10.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f781bfff700 1 --2- 172.21.15.72:0/187099048 >> v2:172.21.15.137:3300/0 conn(0x7f782406fe90 0x7f78240b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7822d9d700 1 -- 172.21.15.72:0/187099048 >> v2:172.21.15.137:3300/0 conn(0x7f782406fe90 msgr2=0x7f78240b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:10.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7822d9d700 1 --2- 172.21.15.72:0/187099048 >> v2:172.21.15.137:3300/0 conn(0x7f782406fe90 0x7f78240b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7822d9d700 1 -- 172.21.15.72:0/187099048 >> v1:172.21.15.137:6789/0 conn(0x7f782406a2f0 legacy=0x7f782406a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f7822d9d700 1 -- 172.21.15.72:0/187099048 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78240cac00 con 0x7f78240b28c0 2023-08-25T04:46:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.655+0000 7f781bfff700 1 --2- 172.21.15.72:0/187099048 >> v2:172.21.15.137:3300/0 conn(0x7f782406fe90 0x7f78240b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.656+0000 7f7822d9d700 1 --2- 172.21.15.72:0/187099048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78240b28c0 0x7f78240cb400 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78240c6ad0 tx=0x7f781c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca23005b57500b22 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.656+0000 7f7821d9b700 1 -- 172.21.15.72:0/187099048 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c00e070 con 0x7f78240b28c0 2023-08-25T04:46:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.656+0000 7f7821d9b700 1 -- 172.21.15.72:0/187099048 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c00b9c0 con 0x7f78240b28c0 2023-08-25T04:46:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.656+0000 7f7821d9b700 1 -- 172.21.15.72:0/187099048 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c00bd70 con 0x7f78240b28c0 2023-08-25T04:46:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.656+0000 7f7828fff700 1 -- 172.21.15.72:0/187099048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78240b28c0 msgr2=0x7f78240cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.656+0000 7f7828fff700 1 --2- 172.21.15.72:0/187099048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78240b28c0 0x7f78240cb400 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78240c6ad0 tx=0x7f781c00b330 comp rx=0 tx=0).stop 2023-08-25T04:46:10.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.656+0000 7f7828fff700 1 -- 172.21.15.72:0/187099048 shutdown_connections 2023-08-25T04:46:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.656+0000 7f7828fff700 1 --2- 172.21.15.72:0/187099048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78240b28c0 0x7f78240cb400 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.656+0000 7f7828fff700 1 --2- 172.21.15.72:0/187099048 >> v2:172.21.15.137:3300/0 conn(0x7f782406fe90 0x7f78240b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.656+0000 7f7828fff700 1 -- 172.21.15.72:0/187099048 >> 172.21.15.72:0/187099048 conn(0x7f782406daa0 msgr2=0x7f782406de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.657+0000 7f7828fff700 1 -- 172.21.15.72:0/187099048 shutdown_connections 2023-08-25T04:46:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.657+0000 7f7828fff700 1 -- 172.21.15.72:0/187099048 wait complete. 2023-08-25T04:46:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.658+0000 7f7828fff700 1 Processor -- start 2023-08-25T04:46:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.658+0000 7f7828fff700 1 -- start start 2023-08-25T04:46:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.659+0000 7f7828fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f782406a2f0 0x7f78240c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.659+0000 7f7828fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782406fe90 0x7f7824152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.659+0000 7f7828fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78240b28c0 0x7f7824153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.659+0000 7f7828fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78240c6b40 con 0x7f782406fe90 2023-08-25T04:46:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.659+0000 7f7828fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78240c6e00 con 0x7f78240b28c0 2023-08-25T04:46:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.659+0000 7f7828fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78240c70e0 con 0x7f782406a2f0 2023-08-25T04:46:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.659+0000 7f781bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782406fe90 0x7f7824152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782406fe90 0x7f7824152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58102/0 (socket says 172.21.15.72:58102) 2023-08-25T04:46:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781bfff700 1 -- 172.21.15.72:0/4107689667 learned_addr learned my addr 172.21.15.72:0/4107689667 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f7822d9d700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78240b28c0 0x7f7824153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f782259c700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f782406a2f0 0x7f78240c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781bfff700 1 -- 172.21.15.72:0/4107689667 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f782406a2f0 msgr2=0x7f78240c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781bfff700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f782406a2f0 0x7f78240c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781bfff700 1 -- 172.21.15.72:0/4107689667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78240b28c0 msgr2=0x7f7824153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781bfff700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78240b28c0 0x7f7824153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781bfff700 1 -- 172.21.15.72:0/4107689667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c009b30 con 0x7f782406fe90 2023-08-25T04:46:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f782259c700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f782406a2f0 0x7f78240c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781bfff700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782406fe90 0x7f7824152d20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f780c00e7e0 tx=0x7f780c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:10.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781affd700 1 -- 172.21.15.72:0/4107689667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c004230 con 0x7f782406fe90 2023-08-25T04:46:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781affd700 1 -- 172.21.15.72:0/4107689667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c004390 con 0x7f782406fe90 2023-08-25T04:46:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f781affd700 1 -- 172.21.15.72:0/4107689667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c0036a0 con 0x7f782406fe90 2023-08-25T04:46:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.660+0000 7f7828fff700 1 -- 172.21.15.72:0/4107689667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78240c73c0 con 0x7f782406fe90 2023-08-25T04:46:10.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.661+0000 7f7828fff700 1 -- 172.21.15.72:0/4107689667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78240c7bc0 con 0x7f782406fe90 2023-08-25T04:46:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.662+0000 7f7828fff700 1 -- 172.21.15.72:0/4107689667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78240c78e0 con 0x7f782406fe90 2023-08-25T04:46:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.663+0000 7f781affd700 1 -- 172.21.15.72:0/4107689667 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f780c003800 con 0x7f782406fe90 2023-08-25T04:46:10.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.663+0000 7f781affd700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f780406a0e0 0x7f780406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:10.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.663+0000 7f781affd700 1 -- 172.21.15.72:0/4107689667 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f780c088340 con 0x7f782406fe90 2023-08-25T04:46:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.664+0000 7f782259c700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f780406a0e0 0x7f780406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.664+0000 7f782259c700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f780406a0e0 0x7f780406c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7814000f60 tx=0x7f7814009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.668+0000 7f781affd700 1 -- 172.21.15.72:0/4107689667 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f78240c78e0 con 0x7f782406fe90 2023-08-25T04:46:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.862+0000 7f7828fff700 1 -- 172.21.15.72:0/4107689667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78240c78e0 con 0x7f782406fe90 2023-08-25T04:46:10.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.863+0000 7f781affd700 1 -- 172.21.15.72:0/4107689667 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78240c78e0 con 0x7f782406fe90 2023-08-25T04:46:10.864 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:10.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 -- 172.21.15.72:0/4107689667 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f780406a0e0 msgr2=0x7f780406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f780406a0e0 0x7f780406c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7814000f60 tx=0x7f7814009040 comp rx=0 tx=0).stop 2023-08-25T04:46:10.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 -- 172.21.15.72:0/4107689667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782406fe90 msgr2=0x7f7824152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:10.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782406fe90 0x7f7824152d20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f780c00e7e0 tx=0x7f780c00eba0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 -- 172.21.15.72:0/4107689667 shutdown_connections 2023-08-25T04:46:10.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f780406a0e0 0x7f780406c5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78240b28c0 0x7f7824153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f782406a2f0 0x7f78240c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 --2- 172.21.15.72:0/4107689667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782406fe90 0x7f7824152d20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:10.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 -- 172.21.15.72:0/4107689667 >> 172.21.15.72:0/4107689667 conn(0x7f782406daa0 msgr2=0x7f782406a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:10.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 -- 172.21.15.72:0/4107689667 shutdown_connections 2023-08-25T04:46:10.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:10.865+0000 7f7828fff700 1 -- 172.21.15.72:0/4107689667 wait complete. 2023-08-25T04:46:10.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.089+0000 7f5fc83ff700 1 Processor -- start 2023-08-25T04:46:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.090+0000 7f5fc83ff700 1 -- start start 2023-08-25T04:46:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc83ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d10c0 0x7f5fc00b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc83ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5fc00b4d40 0x7f5fc00b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc83ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc00b8d10 con 0x7f5fc015d000 2023-08-25T04:46:11.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc83ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc00b56f0 con 0x7f5fc00b4d40 2023-08-25T04:46:11.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc83ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00b5190 con 0x7f5fc00d10c0 2023-08-25T04:46:11.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc699c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5fc00b4d40 0x7f5fc00b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc699c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5fc00b4d40 0x7f5fc00b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58112/0 (socket says 172.21.15.72:58112) 2023-08-25T04:46:11.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc699c700 1 -- 172.21.15.72:0/2869471176 learned_addr learned my addr 172.21.15.72:0/2869471176 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:11.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc599a700 1 --2- 172.21.15.72:0/2869471176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d10c0 0x7f5fc00b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc699c700 1 -- 172.21.15.72:0/2869471176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d10c0 msgr2=0x7f5fc00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:11.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc699c700 1 --2- 172.21.15.72:0/2869471176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d10c0 0x7f5fc00b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc699c700 1 -- 172.21.15.72:0/2869471176 >> v1:172.21.15.137:6789/0 conn(0x7f5fc015d000 legacy=0x7f5fc00b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc699c700 1 -- 172.21.15.72:0/2869471176 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00b6e90 con 0x7f5fc00b4d40 2023-08-25T04:46:11.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.091+0000 7f5fc599a700 1 --2- 172.21.15.72:0/2869471176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d10c0 0x7f5fc00b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.092+0000 7f5fc699c700 1 --2- 172.21.15.72:0/2869471176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc00b4d40 0x7f5fc00b7320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009e50 tx=0x7f5fb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3582a4bbd2108c88 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.092+0000 7f5fc5199700 1 -- 172.21.15.72:0/2869471176 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800e070 con 0x7f5fc00b4d40 2023-08-25T04:46:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.092+0000 7f5fc5199700 1 -- 172.21.15.72:0/2869471176 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb800b9c0 con 0x7f5fc00b4d40 2023-08-25T04:46:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.092+0000 7f5fc5199700 1 -- 172.21.15.72:0/2869471176 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800bd70 con 0x7f5fc00b4d40 2023-08-25T04:46:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.092+0000 7f5fc83ff700 1 -- 172.21.15.72:0/2869471176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc00b4d40 msgr2=0x7f5fc00b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.092+0000 7f5fc83ff700 1 --2- 172.21.15.72:0/2869471176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc00b4d40 0x7f5fc00b7320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009e50 tx=0x7f5fb800b330 comp rx=0 tx=0).stop 2023-08-25T04:46:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.093+0000 7f5fc83ff700 1 -- 172.21.15.72:0/2869471176 shutdown_connections 2023-08-25T04:46:11.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.093+0000 7f5fc83ff700 1 --2- 172.21.15.72:0/2869471176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc00b4d40 0x7f5fc00b7320 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.093+0000 7f5fc83ff700 1 --2- 172.21.15.72:0/2869471176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00d10c0 0x7f5fc00b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.093+0000 7f5fc83ff700 1 -- 172.21.15.72:0/2869471176 >> 172.21.15.72:0/2869471176 conn(0x7f5fc0071e10 msgr2=0x7f5fc0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:11.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.093+0000 7f5fc83ff700 1 -- 172.21.15.72:0/2869471176 shutdown_connections 2023-08-25T04:46:11.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.093+0000 7f5fc83ff700 1 -- 172.21.15.72:0/2869471176 wait complete. 2023-08-25T04:46:11.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.094+0000 7f5fc83ff700 1 Processor -- start 2023-08-25T04:46:11.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.095+0000 7f5fc83ff700 1 -- start start 2023-08-25T04:46:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.095+0000 7f5fc83ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00b4d40 0x7f5fc0158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.095+0000 7f5fc83ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fc00d10c0 0x7f5fc00c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc83ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc015d000 0x7f5fc00c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc83ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00caea0 con 0x7f5fc015d000 2023-08-25T04:46:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc83ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00a9a60 con 0x7f5fc00d10c0 2023-08-25T04:46:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc83ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00c9240 con 0x7f5fc00b4d40 2023-08-25T04:46:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc015d000 0x7f5fc00c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc619b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00b4d40 0x7f5fc0158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc015d000 0x7f5fc00c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58128/0 (socket says 172.21.15.72:58128) 2023-08-25T04:46:11.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc699c700 1 -- 172.21.15.72:0/3311414956 learned_addr learned my addr 172.21.15.72:0/3311414956 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:11.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc599a700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fc00d10c0 0x7f5fc00c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc699c700 1 -- 172.21.15.72:0/3311414956 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00b4d40 msgr2=0x7f5fc0158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc699c700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00b4d40 0x7f5fc0158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc699c700 1 -- 172.21.15.72:0/3311414956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fc00d10c0 msgr2=0x7f5fc00c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc699c700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fc00d10c0 0x7f5fc00c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc699c700 1 -- 172.21.15.72:0/3311414956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb8009b30 con 0x7f5fc015d000 2023-08-25T04:46:11.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.096+0000 7f5fc699c700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc015d000 0x7f5fc00c6db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00d3ae0 tx=0x7f5fb8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:11.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.097+0000 7f5fb6ffd700 1 -- 172.21.15.72:0/3311414956 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8004800 con 0x7f5fc015d000 2023-08-25T04:46:11.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.097+0000 7f5fb6ffd700 1 -- 172.21.15.72:0/3311414956 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb8004960 con 0x7f5fc015d000 2023-08-25T04:46:11.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.097+0000 7f5fb6ffd700 1 -- 172.21.15.72:0/3311414956 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb801c680 con 0x7f5fc015d000 2023-08-25T04:46:11.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.097+0000 7f5fc83ff700 1 -- 172.21.15.72:0/3311414956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc00c9520 con 0x7f5fc015d000 2023-08-25T04:46:11.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.097+0000 7f5fc83ff700 1 -- 172.21.15.72:0/3311414956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc00cb390 con 0x7f5fc015d000 2023-08-25T04:46:11.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.098+0000 7f5fc83ff700 1 -- 172.21.15.72:0/3311414956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc00c9740 con 0x7f5fc015d000 2023-08-25T04:46:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.099+0000 7f5fb6ffd700 1 -- 172.21.15.72:0/3311414956 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5fb801c7e0 con 0x7f5fc015d000 2023-08-25T04:46:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.099+0000 7f5fb6ffd700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5fa406a0e0 0x7f5fa406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.100+0000 7f5fb6ffd700 1 -- 172.21.15.72:0/3311414956 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5fb808a480 con 0x7f5fc015d000 2023-08-25T04:46:11.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.100+0000 7f5fc619b700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5fa406a0e0 0x7f5fa406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.100+0000 7f5fc619b700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5fa406a0e0 0x7f5fa406c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc007fd0 tx=0x7f5fbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:11.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.104+0000 7f5fb6ffd700 1 -- 172.21.15.72:0/3311414956 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5fb8055870 con 0x7f5fc015d000 2023-08-25T04:46:11.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.299+0000 7f5fc83ff700 1 -- 172.21.15.72:0/3311414956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5fc006a2f0 con 0x7f5fc015d000 2023-08-25T04:46:11.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.300+0000 7f5fb6ffd700 1 -- 172.21.15.72:0/3311414956 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5fb8058e90 con 0x7f5fc015d000 2023-08-25T04:46:11.301 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:11.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 -- 172.21.15.72:0/3311414956 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5fa406a0e0 msgr2=0x7f5fa406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5fa406a0e0 0x7f5fa406c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc007fd0 tx=0x7f5fbc009040 comp rx=0 tx=0).stop 2023-08-25T04:46:11.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 -- 172.21.15.72:0/3311414956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc015d000 msgr2=0x7f5fc00c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc015d000 0x7f5fc00c6db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00d3ae0 tx=0x7f5fb8004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 -- 172.21.15.72:0/3311414956 shutdown_connections 2023-08-25T04:46:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5fa406a0e0 0x7f5fa406c5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc015d000 0x7f5fc00c6db0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5fc00b4d40 0x7f5fc0158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 --2- 172.21.15.72:0/3311414956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5fc00d10c0 0x7f5fc00c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 -- 172.21.15.72:0/3311414956 >> 172.21.15.72:0/3311414956 conn(0x7f5fc0071e10 msgr2=0x7f5fc00b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 -- 172.21.15.72:0/3311414956 shutdown_connections 2023-08-25T04:46:11.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.302+0000 7f5fc83ff700 1 -- 172.21.15.72:0/3311414956 wait complete. 2023-08-25T04:46:11.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:46:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.519+0000 7f5e43fff700 1 Processor -- start 2023-08-25T04:46:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.519+0000 7f5e43fff700 1 -- start start 2023-08-25T04:46:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.520+0000 7f5e43fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c0cdc70 0x7f5e3c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e43fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e3c06cfd0 0x7f5e3c06d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e43fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c15d8c0 con 0x7f5e3c15d460 2023-08-25T04:46:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e43fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3c06d9a0 con 0x7f5e3c06cfd0 2023-08-25T04:46:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e43fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0cc530 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e4159a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e3c15d460 0x7f5e3c070fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41758/0 (socket says 172.21.15.72:41758) 2023-08-25T04:46:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e4159a700 1 -- 172.21.15.72:0/932592036 learned_addr learned my addr 172.21.15.72:0/932592036 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e4259c700 1 --2- 172.21.15.72:0/932592036 >> v2:172.21.15.72:3300/0 conn(0x7f5e3c06cfd0 0x7f5e3c06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e41d9b700 1 --2- 172.21.15.72:0/932592036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c0cdc70 0x7f5e3c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e4259c700 1 -- 172.21.15.72:0/932592036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c0cdc70 msgr2=0x7f5e3c0ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e4259c700 1 --2- 172.21.15.72:0/932592036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c0cdc70 0x7f5e3c0ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e4259c700 1 -- 172.21.15.72:0/932592036 >> v1:172.21.15.72:6789/0 conn(0x7f5e3c15d460 legacy=0x7f5e3c070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e4259c700 1 -- 172.21.15.72:0/932592036 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c15db20 con 0x7f5e3c06cfd0 2023-08-25T04:46:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.521+0000 7f5e40d99700 1 -- 172.21.15.72:0/932592036 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130507244 0 0) 0x7f5e3c15d8c0 con 0x7f5e3c15d460 2023-08-25T04:46:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.522+0000 7f5e4259c700 1 --2- 172.21.15.72:0/932592036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c06cfd0 0x7f5e3c06d460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009d90 tx=0x7f5e3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b587a7a9e4053c89 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.522+0000 7f5e40d99700 1 -- 172.21.15.72:0/932592036 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400e070 con 0x7f5e3c06cfd0 2023-08-25T04:46:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.522+0000 7f5e40d99700 1 -- 172.21.15.72:0/932592036 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400bbd0 con 0x7f5e3c06cfd0 2023-08-25T04:46:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.522+0000 7f5e40d99700 1 -- 172.21.15.72:0/932592036 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34012430 con 0x7f5e3c06cfd0 2023-08-25T04:46:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.522+0000 7f5e43fff700 1 -- 172.21.15.72:0/932592036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c06cfd0 msgr2=0x7f5e3c06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.522+0000 7f5e43fff700 1 --2- 172.21.15.72:0/932592036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c06cfd0 0x7f5e3c06d460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009d90 tx=0x7f5e3400b330 comp rx=0 tx=0).stop 2023-08-25T04:46:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.523+0000 7f5e43fff700 1 -- 172.21.15.72:0/932592036 shutdown_connections 2023-08-25T04:46:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.523+0000 7f5e43fff700 1 --2- 172.21.15.72:0/932592036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c06cfd0 0x7f5e3c06d460 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.523+0000 7f5e43fff700 1 --2- 172.21.15.72:0/932592036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c0cdc70 0x7f5e3c0ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.523+0000 7f5e43fff700 1 -- 172.21.15.72:0/932592036 >> 172.21.15.72:0/932592036 conn(0x7f5e3c06a2f0 msgr2=0x7f5e3c06a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.523+0000 7f5e43fff700 1 -- 172.21.15.72:0/932592036 shutdown_connections 2023-08-25T04:46:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.523+0000 7f5e43fff700 1 -- 172.21.15.72:0/932592036 wait complete. 2023-08-25T04:46:11.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.524+0000 7f5e43fff700 1 Processor -- start 2023-08-25T04:46:11.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.525+0000 7f5e43fff700 1 -- start start 2023-08-25T04:46:11.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.525+0000 7f5e43fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c06cfd0 0x7f5e3c0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.525+0000 7f5e43fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0cdc70 0x7f5e3c14de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.525+0000 7f5e43fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c15d460 0x7f5e3c0ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.525+0000 7f5e43fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0b35f0 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.525+0000 7f5e43fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c14e360 con 0x7f5e3c15d460 2023-08-25T04:46:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.525+0000 7f5e43fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0ae860 con 0x7f5e3c06cfd0 2023-08-25T04:46:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e4159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0cdc70 0x7f5e3c14de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e4159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0cdc70 0x7f5e3c14de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58142/0 (socket says 172.21.15.72:58142) 2023-08-25T04:46:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e4159a700 1 -- 172.21.15.72:0/2801757697 learned_addr learned my addr 172.21.15.72:0/2801757697 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e4259c700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c15d460 0x7f5e3c0ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e41d9b700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c06cfd0 0x7f5e3c0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e4159a700 1 -- 172.21.15.72:0/2801757697 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c06cfd0 msgr2=0x7f5e3c0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e4159a700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c06cfd0 0x7f5e3c0b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e4159a700 1 -- 172.21.15.72:0/2801757697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c15d460 msgr2=0x7f5e3c0ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e4159a700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c15d460 0x7f5e3c0ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e4159a700 1 -- 172.21.15.72:0/2801757697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009a70 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.526+0000 7f5e4159a700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0cdc70 0x7f5e3c14de20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00c520 tx=0x7f5e2c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.527+0000 7f5e327fc700 1 -- 172.21.15.72:0/2801757697 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c004c80 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.527+0000 7f5e327fc700 1 -- 172.21.15.72:0/2801757697 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c004de0 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.527+0000 7f5e43fff700 1 -- 172.21.15.72:0/2801757697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c0ad280 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.527+0000 7f5e327fc700 1 -- 172.21.15.72:0/2801757697 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0072d0 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.527+0000 7f5e43fff700 1 -- 172.21.15.72:0/2801757697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c0ad840 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.528+0000 7f5e43fff700 1 -- 172.21.15.72:0/2801757697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c04e620 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.529+0000 7f5e327fc700 1 -- 172.21.15.72:0/2801757697 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5e2c007430 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.530+0000 7f5e327fc700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2006a0e0 0x7f5e2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:11.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.530+0000 7f5e327fc700 1 -- 172.21.15.72:0/2801757697 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e2c0884e0 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.530+0000 7f5e41d9b700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2006a0e0 0x7f5e2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:11.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.530+0000 7f5e41d9b700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2006a0e0 0x7f5e2006c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009930 tx=0x7f5e38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:11.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.534+0000 7f5e327fc700 1 -- 172.21.15.72:0/2801757697 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5e2c0538d0 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.779+0000 7f5e43fff700 1 -- 172.21.15.72:0/2801757697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e3c0cc000 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.779+0000 7f5e327fc700 1 -- 172.21.15.72:0/2801757697 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f5e2c056ef0 con 0x7f5e3c0cdc70 2023-08-25T04:46:11.781 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:11.781 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:45:32.715423+0000","modified":"2023-08-25T04:45:57.525662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:46:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 -- 172.21.15.72:0/2801757697 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2006a0e0 msgr2=0x7f5e2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2006a0e0 0x7f5e2006c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009930 tx=0x7f5e38008040 comp rx=0 tx=0).stop 2023-08-25T04:46:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 -- 172.21.15.72:0/2801757697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0cdc70 msgr2=0x7f5e3c14de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0cdc70 0x7f5e3c14de20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00c520 tx=0x7f5e2c00c8e0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 -- 172.21.15.72:0/2801757697 shutdown_connections 2023-08-25T04:46:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2006a0e0 0x7f5e2006c5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c15d460 0x7f5e3c0ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c06cfd0 0x7f5e3c0b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 --2- 172.21.15.72:0/2801757697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0cdc70 0x7f5e3c14de20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 -- 172.21.15.72:0/2801757697 >> 172.21.15.72:0/2801757697 conn(0x7f5e3c06a2f0 msgr2=0x7f5e3c0c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 -- 172.21.15.72:0/2801757697 shutdown_connections 2023-08-25T04:46:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:11.782+0000 7f5e43fff700 1 -- 172.21.15.72:0/2801757697 wait complete. 2023-08-25T04:46:11.787 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-08-25T04:46:11.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.000+0000 7f8475fff700 1 Processor -- start 2023-08-25T04:46:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.000+0000 7f8475fff700 1 -- start start 2023-08-25T04:46:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.001+0000 7f8475fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f84700cda40 0x7f84700cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.001+0000 7f8475fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700d1fe0 con 0x7f84700d0df0 2023-08-25T04:46:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.001+0000 7f8475fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700d13d0 con 0x7f847015ce60 2023-08-25T04:46:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.001+0000 7f8475fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84700d2b80 con 0x7f84700cda40 2023-08-25T04:46:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.001+0000 7f846effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f84700d0df0 0x7f84700d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41762/0 (socket says 172.21.15.72:41762) 2023-08-25T04:46:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.001+0000 7f846effd700 1 -- 172.21.15.72:0/1879095011 learned_addr learned my addr 172.21.15.72:0/1879095011 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846ffff700 1 --2- 172.21.15.72:0/1879095011 >> v2:172.21.15.137:3300/0 conn(0x7f84700cda40 0x7f84700cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148562970 0 0) 0x7f84700d1fe0 con 0x7f84700d0df0 2023-08-25T04:46:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84580035b0 con 0x7f84700d0df0 2023-08-25T04:46:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021773848 0 0) 0x7f84700d13d0 con 0x7f847015ce60 2023-08-25T04:46:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84700d1fe0 con 0x7f847015ce60 2023-08-25T04:46:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2181373216 0 0) 0x7f84580035b0 con 0x7f84700d0df0 2023-08-25T04:46:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 >> v2:172.21.15.137:3300/0 conn(0x7f84700cda40 msgr2=0x7f84700cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 --2- 172.21.15.72:0/1879095011 >> v2:172.21.15.137:3300/0 conn(0x7f84700cda40 0x7f84700cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 >> v1:172.21.15.137:6789/0 conn(0x7f847015ce60 legacy=0x7f84700b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84700d16b0 con 0x7f84700d0df0 2023-08-25T04:46:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f8464001670 con 0x7f84700d0df0 2023-08-25T04:46:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 >> v1:172.21.15.72:6789/0 conn(0x7f84700d0df0 legacy=0x7f84700d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8458003b90 0x7f8458003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8458004850 0x7f8458004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8458005280 0x7f845800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845800c1b0 con 0x7f8458004850 2023-08-25T04:46:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845800c320 con 0x7f8458005280 2023-08-25T04:46:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.002+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845800c4e0 con 0x7f8458003b90 2023-08-25T04:46:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846effd700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8458004850 0x7f8458004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846ffff700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8458005280 0x7f845800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846f7fe700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8458003b90 0x7f8458003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846ffff700 1 -- 172.21.15.72:0/1879095011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8458003b90 msgr2=0x7f8458003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846ffff700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8458003b90 0x7f8458003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846ffff700 1 -- 172.21.15.72:0/1879095011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8458004850 msgr2=0x7f8458004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846ffff700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8458004850 0x7f8458004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846ffff700 1 -- 172.21.15.72:0/1879095011 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84580035b0 con 0x7f8458005280 2023-08-25T04:46:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846effd700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8458004850 0x7f8458004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846ffff700 1 -- 172.21.15.72:0/1879095011 reap_dead start 2023-08-25T04:46:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846ffff700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8458005280 0x7f845800ba10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8468009fc0 tx=0x7f8458005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14e539a557003d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.003+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468003a20 con 0x7f8458005280 2023-08-25T04:46:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.004+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846800f040 con 0x7f8458005280 2023-08-25T04:46:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.004+0000 7f846e7fc700 1 -- 172.21.15.72:0/1879095011 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468003de0 con 0x7f8458005280 2023-08-25T04:46:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.004+0000 7f8475fff700 1 -- 172.21.15.72:0/1879095011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8458005280 msgr2=0x7f845800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.004+0000 7f8475fff700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8458005280 0x7f845800ba10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8468009fc0 tx=0x7f8458005880 comp rx=0 tx=0).stop 2023-08-25T04:46:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.004+0000 7f8475fff700 1 -- 172.21.15.72:0/1879095011 shutdown_connections 2023-08-25T04:46:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.004+0000 7f8475fff700 1 --2- 172.21.15.72:0/1879095011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8458005280 0x7f845800ba10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.004+0000 7f8475fff700 1 -- 172.21.15.72:0/1879095011 >> 172.21.15.72:0/1879095011 conn(0x7f8470071e10 msgr2=0x7f8470072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:12.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.004+0000 7f8475fff700 1 -- 172.21.15.72:0/1879095011 shutdown_connections 2023-08-25T04:46:12.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.004+0000 7f8475fff700 1 -- 172.21.15.72:0/1879095011 wait complete. 2023-08-25T04:46:12.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.007+0000 7f8475fff700 1 Processor -- start 2023-08-25T04:46:12.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.007+0000 7f8475fff700 1 -- start start 2023-08-25T04:46:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.008+0000 7f8475fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8458005280 0x7f8470150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.008+0000 7f8475fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84700c85a0 0x7f84700c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.008+0000 7f8475fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84700b34a0 0x7f84700b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.008+0000 7f8475fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8470159730 con 0x7f84700b34a0 2023-08-25T04:46:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.008+0000 7f8475fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84700b3e60 con 0x7f84700c85a0 2023-08-25T04:46:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.008+0000 7f8475fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84700c9fe0 con 0x7f8458005280 2023-08-25T04:46:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.008+0000 7f846ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84700b34a0 0x7f84700b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.008+0000 7f846ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84700b34a0 0x7f84700b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58170/0 (socket says 172.21.15.72:58170) 2023-08-25T04:46:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.008+0000 7f846ffff700 1 -- 172.21.15.72:0/2050671958 learned_addr learned my addr 172.21.15.72:0/2050671958 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f846f7fe700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8458005280 0x7f8470150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f846effd700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84700c85a0 0x7f84700c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f846ffff700 1 -- 172.21.15.72:0/2050671958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8458005280 msgr2=0x7f8470150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f846ffff700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8458005280 0x7f8470150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f846ffff700 1 -- 172.21.15.72:0/2050671958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84700c85a0 msgr2=0x7f84700c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f846ffff700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84700c85a0 0x7f84700c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f846ffff700 1 -- 172.21.15.72:0/2050671958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84700ca2c0 con 0x7f84700b34a0 2023-08-25T04:46:12.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f846effd700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84700c85a0 0x7f84700c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:12.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f846f7fe700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8458005280 0x7f8470150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:12.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f846ffff700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84700b34a0 0x7f84700b3920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f84700d08c0 tx=0x7f8468009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:12.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f8457fff700 1 -- 172.21.15.72:0/2050671958 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468004230 con 0x7f84700b34a0 2023-08-25T04:46:12.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f8457fff700 1 -- 172.21.15.72:0/2050671958 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468004390 con 0x7f84700b34a0 2023-08-25T04:46:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f8475fff700 1 -- 172.21.15.72:0/2050671958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84700ca5a0 con 0x7f84700b34a0 2023-08-25T04:46:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.009+0000 7f8457fff700 1 -- 172.21.15.72:0/2050671958 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468004540 con 0x7f84700b34a0 2023-08-25T04:46:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.010+0000 7f8475fff700 1 -- 172.21.15.72:0/2050671958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84700cab60 con 0x7f84700b34a0 2023-08-25T04:46:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.010+0000 7f8475fff700 1 -- 172.21.15.72:0/2050671958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84700c9da0 con 0x7f84700b34a0 2023-08-25T04:46:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.011+0000 7f8457fff700 1 -- 172.21.15.72:0/2050671958 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f84680046a0 con 0x7f84700b34a0 2023-08-25T04:46:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.012+0000 7f8457fff700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f845c06a0e0 0x7f845c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.012+0000 7f8457fff700 1 -- 172.21.15.72:0/2050671958 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8468089db0 con 0x7f84700b34a0 2023-08-25T04:46:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.012+0000 7f846f7fe700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f845c06a0e0 0x7f845c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.013+0000 7f846f7fe700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f845c06a0e0 0x7f845c06c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84600010e0 tx=0x7f8460009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:12.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.017+0000 7f8457fff700 1 -- 172.21.15.72:0/2050671958 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f84700c9da0 con 0x7f84700b34a0 2023-08-25T04:46:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.213+0000 7f8475fff700 1 -- 172.21.15.72:0/2050671958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84700c9da0 con 0x7f84700b34a0 2023-08-25T04:46:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.215+0000 7f8457fff700 1 -- 172.21.15.72:0/2050671958 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20062 (secure 0 0 0) 0x7f84700c9da0 con 0x7f84700b34a0 2023-08-25T04:46:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:12.216 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:45:37.969777+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:12.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 -- 172.21.15.72:0/2050671958 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f845c06a0e0 msgr2=0x7f845c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f845c06a0e0 0x7f845c06c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84600010e0 tx=0x7f8460009040 comp rx=0 tx=0).stop 2023-08-25T04:46:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 -- 172.21.15.72:0/2050671958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84700b34a0 msgr2=0x7f84700b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84700b34a0 0x7f84700b3920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f84700d08c0 tx=0x7f8468009750 comp rx=0 tx=0).stop 2023-08-25T04:46:12.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 -- 172.21.15.72:0/2050671958 shutdown_connections 2023-08-25T04:46:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f845c06a0e0 0x7f845c06c5a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84700b34a0 0x7f84700b3920 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8458005280 0x7f8470150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 --2- 172.21.15.72:0/2050671958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84700c85a0 0x7f84700c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 -- 172.21.15.72:0/2050671958 >> 172.21.15.72:0/2050671958 conn(0x7f8470071e10 msgr2=0x7f84700cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:12.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 -- 172.21.15.72:0/2050671958 shutdown_connections 2023-08-25T04:46:12.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.217+0000 7f8475fff700 1 -- 172.21.15.72:0/2050671958 wait complete. 2023-08-25T04:46:12.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:46:12.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.434+0000 7f25903ff700 1 Processor -- start 2023-08-25T04:46:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.434+0000 7f25903ff700 1 -- start start 2023-08-25T04:46:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.435+0000 7f25903ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25880d0df0 0x7f25880d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.435+0000 7f25903ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25880d1fe0 con 0x7f258815ce60 2023-08-25T04:46:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.435+0000 7f25903ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25880d13d0 con 0x7f25880cda40 2023-08-25T04:46:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.435+0000 7f25903ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25880d16b0 con 0x7f25880d0df0 2023-08-25T04:46:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.436+0000 7f258d99a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25880d0df0 0x7f25880d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.436+0000 7f258e19b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f258815ce60 0x7f25880b8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41768/0 (socket says 172.21.15.72:41768) 2023-08-25T04:46:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.436+0000 7f258e19b700 1 -- 172.21.15.72:0/4147053351 learned_addr learned my addr 172.21.15.72:0/4147053351 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:12.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.436+0000 7f258d99a700 1 -- 172.21.15.72:0/4147053351 >> v1:172.21.15.137:6789/0 conn(0x7f25880cda40 legacy=0x7f25880b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:12.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.436+0000 7f258d99a700 1 -- 172.21.15.72:0/4147053351 >> v1:172.21.15.72:6789/0 conn(0x7f258815ce60 legacy=0x7f25880b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.436+0000 7f258d99a700 1 -- 172.21.15.72:0/4147053351 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25880d1990 con 0x7f25880d0df0 2023-08-25T04:46:12.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.436+0000 7f258d199700 1 -- 172.21.15.72:0/4147053351 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244904994 0 0) 0x7f25880d1fe0 con 0x7f258815ce60 2023-08-25T04:46:12.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.436+0000 7f258d99a700 1 --2- 172.21.15.72:0/4147053351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25880d0df0 0x7f25880d2470 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2578009840 tx=0x7f2578009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d056380fd79fcad1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:12.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.437+0000 7f258d199700 1 -- 172.21.15.72:0/4147053351 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578004230 con 0x7f25880d0df0 2023-08-25T04:46:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.437+0000 7f258d199700 1 -- 172.21.15.72:0/4147053351 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2578004390 con 0x7f25880d0df0 2023-08-25T04:46:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.437+0000 7f258d199700 1 -- 172.21.15.72:0/4147053351 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25780036a0 con 0x7f25880d0df0 2023-08-25T04:46:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.437+0000 7f25903ff700 1 -- 172.21.15.72:0/4147053351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25880d0df0 msgr2=0x7f25880d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.437+0000 7f25903ff700 1 --2- 172.21.15.72:0/4147053351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25880d0df0 0x7f25880d2470 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2578009840 tx=0x7f2578009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.437+0000 7f25903ff700 1 -- 172.21.15.72:0/4147053351 shutdown_connections 2023-08-25T04:46:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.437+0000 7f25903ff700 1 --2- 172.21.15.72:0/4147053351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25880d0df0 0x7f25880d2470 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.437+0000 7f25903ff700 1 -- 172.21.15.72:0/4147053351 >> 172.21.15.72:0/4147053351 conn(0x7f2588071e10 msgr2=0x7f2588072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.437+0000 7f25903ff700 1 -- 172.21.15.72:0/4147053351 shutdown_connections 2023-08-25T04:46:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.438+0000 7f25903ff700 1 -- 172.21.15.72:0/4147053351 wait complete. 2023-08-25T04:46:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.439+0000 7f25903ff700 1 Processor -- start 2023-08-25T04:46:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.440+0000 7f25903ff700 1 -- start start 2023-08-25T04:46:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f25903ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25880cda40 0x7f2588153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f25903ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25880d0df0 0x7f25880cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f25903ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f258815ce60 0x7f25880cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f25903ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25880caf30 con 0x7f258815ce60 2023-08-25T04:46:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f25903ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258815e840 con 0x7f25880d0df0 2023-08-25T04:46:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f25903ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258815eb20 con 0x7f25880cda40 2023-08-25T04:46:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f258e99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f258815ce60 0x7f25880cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f258e19b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25880cda40 0x7f2588153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f258e99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f258815ce60 0x7f25880cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58176/0 (socket says 172.21.15.72:58176) 2023-08-25T04:46:12.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f258e99c700 1 -- 172.21.15.72:0/2476284808 learned_addr learned my addr 172.21.15.72:0/2476284808 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:12.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f258d99a700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25880d0df0 0x7f25880cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f258e99c700 1 -- 172.21.15.72:0/2476284808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25880cda40 msgr2=0x7f2588153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f258e99c700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25880cda40 0x7f2588153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f258e99c700 1 -- 172.21.15.72:0/2476284808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25880d0df0 msgr2=0x7f25880cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f258e99c700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25880d0df0 0x7f25880cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.441+0000 7f258e99c700 1 -- 172.21.15.72:0/2476284808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25780094a0 con 0x7f258815ce60 2023-08-25T04:46:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.442+0000 7f258e99c700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f258815ce60 0x7f25880cc9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f258000b970 tx=0x7f258000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.442+0000 7f257effd700 1 -- 172.21.15.72:0/2476284808 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258000d860 con 0x7f258815ce60 2023-08-25T04:46:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.442+0000 7f257effd700 1 -- 172.21.15.72:0/2476284808 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258000d9c0 con 0x7f258815ce60 2023-08-25T04:46:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.442+0000 7f25903ff700 1 -- 172.21.15.72:0/2476284808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258815ee00 con 0x7f258815ce60 2023-08-25T04:46:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.442+0000 7f257effd700 1 -- 172.21.15.72:0/2476284808 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258000dd70 con 0x7f258815ce60 2023-08-25T04:46:12.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.442+0000 7f25903ff700 1 -- 172.21.15.72:0/2476284808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25881543a0 con 0x7f258815ce60 2023-08-25T04:46:12.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.443+0000 7f25903ff700 1 -- 172.21.15.72:0/2476284808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258804e620 con 0x7f258815ce60 2023-08-25T04:46:12.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.444+0000 7f257effd700 1 -- 172.21.15.72:0/2476284808 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f258000e430 con 0x7f258815ce60 2023-08-25T04:46:12.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.445+0000 7f257effd700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f256c06a0e0 0x7f256c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:12.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.445+0000 7f257effd700 1 -- 172.21.15.72:0/2476284808 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2580088960 con 0x7f258815ce60 2023-08-25T04:46:12.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.445+0000 7f258e19b700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f256c06a0e0 0x7f256c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:12.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.446+0000 7f258e19b700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f256c06a0e0 0x7f256c06c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2584007fd0 tx=0x7f2584007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:12.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.450+0000 7f257effd700 1 -- 172.21.15.72:0/2476284808 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2580053d50 con 0x7f258815ce60 2023-08-25T04:46:12.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.689+0000 7f25903ff700 1 -- 172.21.15.72:0/2476284808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25880b45d0 con 0x7f258815ce60 2023-08-25T04:46:12.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.690+0000 7f257effd700 1 -- 172.21.15.72:0/2476284808 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f2580057370 con 0x7f258815ce60 2023-08-25T04:46:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:12.693 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:45:32.715423+0000","modified":"2023-08-25T04:45:57.525662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:46:12.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 -- 172.21.15.72:0/2476284808 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f256c06a0e0 msgr2=0x7f256c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f256c06a0e0 0x7f256c06c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2584007fd0 tx=0x7f2584007de0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 -- 172.21.15.72:0/2476284808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f258815ce60 msgr2=0x7f25880cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:12.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f258815ce60 0x7f25880cc9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f258000b970 tx=0x7f258000bc80 comp rx=0 tx=0).stop 2023-08-25T04:46:12.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 -- 172.21.15.72:0/2476284808 shutdown_connections 2023-08-25T04:46:12.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f256c06a0e0 0x7f256c06c5a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f258815ce60 0x7f25880cc9d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25880cda40 0x7f2588153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 --2- 172.21.15.72:0/2476284808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25880d0df0 0x7f25880cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 -- 172.21.15.72:0/2476284808 >> 172.21.15.72:0/2476284808 conn(0x7f2588071e10 msgr2=0x7f25880b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 -- 172.21.15.72:0/2476284808 shutdown_connections 2023-08-25T04:46:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:12.692+0000 7f25903ff700 1 -- 172.21.15.72:0/2476284808 wait complete. 2023-08-25T04:46:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-08-25T04:46:13.117 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:45:32.715423+0000', 'modified': '2023-08-25T04:45:57.525662+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6834/1278273500', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6832', 'nonce': 1278273500}, {'type': 'v1', 'addr': '172.21.15.137:6834', 'nonce': 1278273500}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:46:13.118 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:46:13.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-25T04:46:13.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.319+0000 7f09337ff700 1 Processor -- start 2023-08-25T04:46:13.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.319+0000 7f09337ff700 1 -- start start 2023-08-25T04:46:13.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.321+0000 7f09337ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 0x7f092c0b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.321+0000 7f09337ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c0b8d30 con 0x7f092c0b4c80 2023-08-25T04:46:13.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.321+0000 7f09337ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c0b7650 con 0x7f092c0b4800 2023-08-25T04:46:13.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.321+0000 7f09337ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c0b7930 con 0x7f092c160710 2023-08-25T04:46:13.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.321+0000 7f0931d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f092c0b4c80 0x7f092c0d17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37278/0 (socket says 172.21.15.72:37278) 2023-08-25T04:46:13.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.321+0000 7f0931d9c700 1 -- 172.21.15.72:0/3225035306 learned_addr learned my addr 172.21.15.72:0/3225035306 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:13.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.321+0000 7f093159b700 1 --2- 172.21.15.72:0/3225035306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 0x7f092c0b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.321+0000 7f0923fff700 1 -- 172.21.15.72:0/3225035306 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265249828 0 0) 0x7f092c0b8d30 con 0x7f092c0b4c80 2023-08-25T04:46:13.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.321+0000 7f0923fff700 1 -- 172.21.15.72:0/3225035306 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09180035b0 con 0x7f092c0b4c80 2023-08-25T04:46:13.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.322+0000 7f0923fff700 1 -- 172.21.15.72:0/3225035306 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693514442 0 0) 0x7f092c0b7650 con 0x7f092c0b4800 2023-08-25T04:46:13.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.322+0000 7f093159b700 1 -- 172.21.15.72:0/3225035306 >> v1:172.21.15.137:6789/0 conn(0x7f092c0b4800 legacy=0x7f092c0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.322+0000 7f093159b700 1 -- 172.21.15.72:0/3225035306 >> v1:172.21.15.72:6789/0 conn(0x7f092c0b4c80 legacy=0x7f092c0d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.322+0000 7f093159b700 1 -- 172.21.15.72:0/3225035306 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c0b7c10 con 0x7f092c160710 2023-08-25T04:46:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.322+0000 7f093159b700 1 --2- 172.21.15.72:0/3225035306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 0x7f092c0b87f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0928009870 tx=0x7f0928009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5355c020f81bc89e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.322+0000 7f0923fff700 1 -- 172.21.15.72:0/3225035306 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928011830 con 0x7f092c160710 2023-08-25T04:46:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.322+0000 7f0923fff700 1 -- 172.21.15.72:0/3225035306 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0928011990 con 0x7f092c160710 2023-08-25T04:46:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.322+0000 7f0923fff700 1 -- 172.21.15.72:0/3225035306 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928011d00 con 0x7f092c160710 2023-08-25T04:46:13.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.323+0000 7f09337ff700 1 -- 172.21.15.72:0/3225035306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 msgr2=0x7f092c0b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.323+0000 7f09337ff700 1 --2- 172.21.15.72:0/3225035306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 0x7f092c0b87f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0928009870 tx=0x7f0928009b80 comp rx=0 tx=0).stop 2023-08-25T04:46:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.323+0000 7f09337ff700 1 -- 172.21.15.72:0/3225035306 shutdown_connections 2023-08-25T04:46:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.323+0000 7f09337ff700 1 --2- 172.21.15.72:0/3225035306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 0x7f092c0b87f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.323+0000 7f09337ff700 1 -- 172.21.15.72:0/3225035306 >> 172.21.15.72:0/3225035306 conn(0x7f092c071e40 msgr2=0x7f092c072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.323+0000 7f09337ff700 1 -- 172.21.15.72:0/3225035306 shutdown_connections 2023-08-25T04:46:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.323+0000 7f09337ff700 1 -- 172.21.15.72:0/3225035306 wait complete. 2023-08-25T04:46:13.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.325+0000 7f09337ff700 1 Processor -- start 2023-08-25T04:46:13.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.325+0000 7f09337ff700 1 -- start start 2023-08-25T04:46:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.326+0000 7f09337ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f092c0b4800 0x7f092c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.326+0000 7f09337ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f092c0b4c80 0x7f092c1f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.326+0000 7f09337ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 0x7f092c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.326+0000 7f09337ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c0cc0a0 con 0x7f092c0b4800 2023-08-25T04:46:13.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.326+0000 7f09337ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c1f37e0 con 0x7f092c0b4c80 2023-08-25T04:46:13.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.326+0000 7f09337ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c0cb770 con 0x7f092c160710 2023-08-25T04:46:13.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.326+0000 7f093159b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f092c0b4800 0x7f092c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.326+0000 7f093159b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f092c0b4800 0x7f092c0cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44788/0 (socket says 172.21.15.72:44788) 2023-08-25T04:46:13.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.326+0000 7f093159b700 1 -- 172.21.15.72:0/1447168192 learned_addr learned my addr 172.21.15.72:0/1447168192 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:13.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.327+0000 7f0931d9c700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 0x7f092c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.327+0000 7f0930d9a700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f092c0b4c80 0x7f092c1f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.327+0000 7f093159b700 1 -- 172.21.15.72:0/1447168192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 msgr2=0x7f092c1534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.327+0000 7f093159b700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 0x7f092c1534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.327+0000 7f093159b700 1 -- 172.21.15.72:0/1447168192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f092c0b4c80 msgr2=0x7f092c1f32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.327+0000 7f093159b700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f092c0b4c80 0x7f092c1f32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.327+0000 7f093159b700 1 -- 172.21.15.72:0/1447168192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09280094a0 con 0x7f092c0b4800 2023-08-25T04:46:13.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.327+0000 7f093159b700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f092c0b4800 0x7f092c0cae10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f09280090b0 tx=0x7f0928004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:13.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.327+0000 7f0921ffb700 1 -- 172.21.15.72:0/1447168192 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928004450 con 0x7f092c0b4800 2023-08-25T04:46:13.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.327+0000 7f0921ffb700 1 -- 172.21.15.72:0/1447168192 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092801e070 con 0x7f092c0b4800 2023-08-25T04:46:13.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.328+0000 7f09337ff700 1 -- 172.21.15.72:0/1447168192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c0cba50 con 0x7f092c0b4800 2023-08-25T04:46:13.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.328+0000 7f0921ffb700 1 -- 172.21.15.72:0/1447168192 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09280038e0 con 0x7f092c0b4800 2023-08-25T04:46:13.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.328+0000 7f09337ff700 1 -- 172.21.15.72:0/1447168192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c0cb3f0 con 0x7f092c0b4800 2023-08-25T04:46:13.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.329+0000 7f0921ffb700 1 -- 172.21.15.72:0/1447168192 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0928003a40 con 0x7f092c0b4800 2023-08-25T04:46:13.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.330+0000 7f0921ffb700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f091006a0e0 0x7f091006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.330+0000 7f0921ffb700 1 -- 172.21.15.72:0/1447168192 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f09280895e0 con 0x7f092c0b4800 2023-08-25T04:46:13.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.331+0000 7f0930d9a700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f091006a0e0 0x7f091006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.331+0000 7f0930d9a700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f091006a0e0 0x7f091006c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f092c153f40 tx=0x7f091c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:13.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.333+0000 7f094708bb80 1 Processor -- start 2023-08-25T04:46:13.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.333+0000 7f094708bb80 1 -- start start 2023-08-25T04:46:13.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f094708bb80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b34ee00 0x561a9b34f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f094708bb80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 0x561a9b3248d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f094708bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b360820 0x561a9b324e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f094708bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9b27d5e0 con 0x561a9b360820 2023-08-25T04:46:13.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f094708bb80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9b27ad40 con 0x561a9b34ee00 2023-08-25T04:46:13.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f094708bb80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a9b276630 con 0x561a9b34c760 2023-08-25T04:46:13.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f0930d9a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 0x561a9b3248d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f0931d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b360820 0x561a9b324e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f093159b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b34ee00 0x561a9b34f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f0930d9a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 0x561a9b3248d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:58890/0 (socket says 172.21.15.72:58890) 2023-08-25T04:46:13.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f0930d9a700 1 -- 172.21.15.72:0/111588384 learned_addr learned my addr 172.21.15.72:0/111588384 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:13.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f0930d9a700 1 -- 172.21.15.72:0/111588384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b34ee00 msgr2=0x561a9b34f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:13.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f0930d9a700 1 --2- 172.21.15.72:0/111588384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b34ee00 0x561a9b34f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f0930d9a700 1 -- 172.21.15.72:0/111588384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b360820 msgr2=0x561a9b324e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:13.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f0930d9a700 1 --2- 172.21.15.72:0/111588384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b360820 0x561a9b324e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f0930d9a700 1 -- 172.21.15.72:0/111588384 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a9b1550a0 con 0x561a9b34c760 2023-08-25T04:46:13.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f093159b700 1 --2- 172.21.15.72:0/111588384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b34ee00 0x561a9b34f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:13.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.334+0000 7f0931d9c700 1 --2- 172.21.15.72:0/111588384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b360820 0x561a9b324e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:13.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.335+0000 7f0930d9a700 1 --2- 172.21.15.72:0/111588384 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 0x561a9b3248d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f091c00f800 tx=0x7f091c012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4afebd7e089b940 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:13.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.335+0000 7f0916ffd700 1 -- 172.21.15.72:0/111588384 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00fed0 con 0x561a9b34c760 2023-08-25T04:46:13.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.335+0000 7f0916ffd700 1 -- 172.21.15.72:0/111588384 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c014450 con 0x561a9b34c760 2023-08-25T04:46:13.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.335+0000 7f0916ffd700 1 -- 172.21.15.72:0/111588384 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0147e0 con 0x561a9b34c760 2023-08-25T04:46:13.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.335+0000 7f094708bb80 1 -- 172.21.15.72:0/111588384 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 msgr2=0x561a9b3248d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.335+0000 7f094708bb80 1 --2- 172.21.15.72:0/111588384 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 0x561a9b3248d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f091c00f800 tx=0x7f091c012000 comp rx=0 tx=0).stop 2023-08-25T04:46:13.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.336+0000 7f094708bb80 1 -- 172.21.15.72:0/111588384 shutdown_connections 2023-08-25T04:46:13.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.336+0000 7f094708bb80 1 --2- 172.21.15.72:0/111588384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b360820 0x561a9b324e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.336+0000 7f094708bb80 1 --2- 172.21.15.72:0/111588384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b34ee00 0x561a9b34f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.336+0000 7f094708bb80 1 --2- 172.21.15.72:0/111588384 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 0x561a9b3248d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.336+0000 7f094708bb80 1 -- 172.21.15.72:0/111588384 >> 172.21.15.72:0/111588384 conn(0x561a9b298b90 msgr2=0x561a9b322c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:13.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.336+0000 7f094708bb80 1 -- 172.21.15.72:0/111588384 shutdown_connections 2023-08-25T04:46:13.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.336+0000 7f094708bb80 1 -- 172.21.15.72:0/111588384 wait complete. 2023-08-25T04:46:13.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.336+0000 7f094708bb80 1 -- start start 2023-08-25T04:46:13.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.337+0000 7f094708bb80 1 Processor -- start 2023-08-25T04:46:13.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f094708bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b3631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f094708bb80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34ee00 0x561a9b363720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f094708bb80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b346eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f094708bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9b232750 con 0x561a9b34c760 2023-08-25T04:46:13.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f094708bb80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9b218ab0 con 0x561a9b360820 2023-08-25T04:46:13.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f094708bb80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a9b069390 con 0x561a9b34ee00 2023-08-25T04:46:13.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f094708bb80 10 client.0 _ll_register_callbacks cb 0x561a9b212400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:46:13.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f093159b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b3631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f0930d9a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34ee00 0x561a9b363720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f093159b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b3631e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44804/0 (socket says 172.21.15.72:44804) 2023-08-25T04:46:13.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f093159b700 1 -- 172.21.15.72:0/669824119 learned_addr learned my addr 172.21.15.72:0/669824119 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:13.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f0931d9c700 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b346eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f093159b700 1 -- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34ee00 msgr2=0x561a9b363720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:13.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f093159b700 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34ee00 0x561a9b363720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f093159b700 1 -- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 msgr2=0x561a9b346eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:13.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f093159b700 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b346eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f093159b700 1 -- 172.21.15.72:0/669824119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c0cb3f0 con 0x561a9b34c760 2023-08-25T04:46:13.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.338+0000 7f0931d9c700 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b346eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:13.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f093159b700 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b3631e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0928054c30 tx=0x7f092802cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3192e0807d575ccb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:13.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f090bfff700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-25T04:46:13.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f090bfff700 1 -- 172.21.15.72:0/669824119 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092805c4f0 con 0x561a9b34c760 2023-08-25T04:46:13.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f090bfff700 1 -- 172.21.15.72:0/669824119 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0928060440 con 0x561a9b34c760 2023-08-25T04:46:13.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f094708bb80 1 -- 172.21.15.72:0/669824119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a9b14dc00 con 0x561a9b34c760 2023-08-25T04:46:13.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f090bfff700 1 -- 172.21.15.72:0/669824119 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0928054e40 con 0x561a9b34c760 2023-08-25T04:46:13.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f094708bb80 10 client.4863 fetch_fsmap learned FSMap version 9 2023-08-25T04:46:13.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f094708bb80 1 -- 172.21.15.72:0/669824119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7f09180035b0 con 0x561a9b34c760 2023-08-25T04:46:13.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f090bfff700 1 -- 172.21.15.72:0/669824119 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561a9b14dc00 con 0x561a9b34c760 2023-08-25T04:46:13.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f090bfff700 1 -- 172.21.15.72:0/669824119 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f0928087250 con 0x561a9b34c760 2023-08-25T04:46:13.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f094708bb80 10 client.4863 fetch_fsmap finished waiting for FSMap version 9 2023-08-25T04:46:13.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f094708bb80 10 client.4863 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-25T04:46:13.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f094708bb80 20 client.4863 populate_metadata read hostname 'smithi072' 2023-08-25T04:46:13.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f094708bb80 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x561a9b360c90 0x561a9b368810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f094708bb80 4 client.4863 mds_command: new command op to 4297 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:46:13.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.339+0000 7f094708bb80 1 -- 172.21.15.72:0/669824119 --> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a9b2f3530 con 0x561a9b360c90 2023-08-25T04:46:13.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.340+0000 7f0930d9a700 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x561a9b360c90 0x561a9b368810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.340+0000 7f0930d9a700 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x561a9b360c90 0x561a9b368810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e05cec9267eed07a server_cookie=9482043af5c1cdee in_seq=0 out_seq=0 2023-08-25T04:46:13.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.340+0000 7f090bfff700 10 client.4863 ms_handle_connect on v2:172.21.15.137:6832/1278273500 2023-08-25T04:46:13.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f090bfff700 1 -- 172.21.15.72:0/669824119 <== mds.0 v2:172.21.15.137:6832/1278273500 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561a9b2f3530 con 0x561a9b360c90 2023-08-25T04:46:13.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f090bfff700 10 client.4863 handle_command_reply: tid=0 2023-08-25T04:46:13.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f094708bb80 1 client.4863 shutdown 2023-08-25T04:46:13.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f094708bb80 1 -- 172.21.15.72:0/669824119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 msgr2=0x561a9b3631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f094708bb80 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b3631e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0928054c30 tx=0x7f092802cee0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f094708bb80 1 -- 172.21.15.72:0/669824119 shutdown_connections 2023-08-25T04:46:13.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f094708bb80 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b346eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f094708bb80 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x561a9b360c90 0x561a9b368810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f094708bb80 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b3631e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f094708bb80 1 --2- 172.21.15.72:0/669824119 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34ee00 0x561a9b363720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f094708bb80 1 -- 172.21.15.72:0/669824119 >> 172.21.15.72:0/669824119 conn(0x561a9b298b90 msgr2=0x561a9b343cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.341+0000 7f090bfff700 0 client.4863 ms_handle_reset on v2:172.21.15.137:6832/1278273500 2023-08-25T04:46:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.342+0000 7f094708bb80 1 -- 172.21.15.72:0/669824119 shutdown_connections 2023-08-25T04:46:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.342+0000 7f094708bb80 1 -- 172.21.15.72:0/669824119 wait complete. 2023-08-25T04:46:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.342+0000 7f094708bb80 20 client.4863 trim_cache size 0 max 16384 2023-08-25T04:46:13.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.360+0000 7f094708bb80 1 Processor -- start 2023-08-25T04:46:13.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.360+0000 7f094708bb80 1 -- start start 2023-08-25T04:46:13.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.360+0000 7f094708bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b344370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.360+0000 7f094708bb80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34ee00 0x561a9b344dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f094708bb80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b365f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f094708bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9b3673f0 con 0x561a9b34c760 2023-08-25T04:46:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f094708bb80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9b382730 con 0x561a9b360820 2023-08-25T04:46:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f094708bb80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a9b2f9ea0 con 0x561a9b34ee00 2023-08-25T04:46:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f093159b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b344370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f093159b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b344370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44812/0 (socket says 172.21.15.72:44812) 2023-08-25T04:46:13.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f093159b700 1 -- 172.21.15.72:0/1367442335 learned_addr learned my addr 172.21.15.72:0/1367442335 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:13.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f0930d9a700 1 --2- 172.21.15.72:0/1367442335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34ee00 0x561a9b344dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f0931d9c700 1 --2- 172.21.15.72:0/1367442335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b365f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f093159b700 1 -- 172.21.15.72:0/1367442335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34ee00 msgr2=0x561a9b344dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:13.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f093159b700 1 --2- 172.21.15.72:0/1367442335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34ee00 0x561a9b344dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f093159b700 1 -- 172.21.15.72:0/1367442335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 msgr2=0x561a9b365f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f093159b700 1 --2- 172.21.15.72:0/1367442335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b365f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f093159b700 1 -- 172.21.15.72:0/1367442335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c001d00 con 0x561a9b34c760 2023-08-25T04:46:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.361+0000 7f093159b700 1 --2- 172.21.15.72:0/1367442335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b344370 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f09280586c0 tx=0x7f092806d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87b9f7ef65dd851 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f09177fe700 1 -- 172.21.15.72:0/1367442335 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092802cee0 con 0x561a9b34c760 2023-08-25T04:46:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f09177fe700 1 -- 172.21.15.72:0/1367442335 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0928060440 con 0x561a9b34c760 2023-08-25T04:46:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f09177fe700 1 -- 172.21.15.72:0/1367442335 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928054e40 con 0x561a9b34c760 2023-08-25T04:46:13.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f094708bb80 1 -- 172.21.15.72:0/1367442335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 msgr2=0x561a9b344370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f094708bb80 1 --2- 172.21.15.72:0/1367442335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b344370 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f09280586c0 tx=0x7f092806d000 comp rx=0 tx=0).stop 2023-08-25T04:46:13.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f094708bb80 1 -- 172.21.15.72:0/1367442335 shutdown_connections 2023-08-25T04:46:13.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f094708bb80 1 --2- 172.21.15.72:0/1367442335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b365f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f094708bb80 1 --2- 172.21.15.72:0/1367442335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34c760 0x561a9b344370 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f094708bb80 1 --2- 172.21.15.72:0/1367442335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34ee00 0x561a9b344dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f094708bb80 1 -- 172.21.15.72:0/1367442335 >> 172.21.15.72:0/1367442335 conn(0x561a9b298b90 msgr2=0x561a9b3203a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:13.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f094708bb80 1 -- 172.21.15.72:0/1367442335 shutdown_connections 2023-08-25T04:46:13.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.362+0000 7f094708bb80 1 -- 172.21.15.72:0/1367442335 wait complete. 2023-08-25T04:46:13.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.363+0000 7f094708bb80 1 -- start start 2023-08-25T04:46:13.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.363+0000 7f094708bb80 1 Processor -- start 2023-08-25T04:46:13.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f094708bb80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 0x561a9b323e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f094708bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34ee00 0x561a9b3189a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f094708bb80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b318ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f094708bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9b3b7f40 con 0x561a9b34ee00 2023-08-25T04:46:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f094708bb80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9b366940 con 0x561a9b360820 2023-08-25T04:46:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f094708bb80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a9b3b7a70 con 0x561a9b34c760 2023-08-25T04:46:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f094708bb80 10 client.0 _ll_register_callbacks cb 0x561a9b212400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:46:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f0930d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34ee00 0x561a9b3189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f0930d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34ee00 0x561a9b3189a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44824/0 (socket says 172.21.15.72:44824) 2023-08-25T04:46:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f0930d9a700 1 -- 172.21.15.72:0/3836959997 learned_addr learned my addr 172.21.15.72:0/3836959997 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f093159b700 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 0x561a9b323e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.364+0000 7f0931d9c700 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b318ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f0930d9a700 1 -- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 msgr2=0x561a9b323e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f0930d9a700 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 0x561a9b323e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f0930d9a700 1 -- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 msgr2=0x561a9b318ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f0930d9a700 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b318ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f0930d9a700 1 -- 172.21.15.72:0/3836959997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09180035b0 con 0x561a9b34ee00 2023-08-25T04:46:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f0930d9a700 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34ee00 0x561a9b3189a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f091c000f60 tx=0x7f091c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f8ee5d99ef1acb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f090bfff700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-25T04:46:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f090bfff700 1 -- 172.21.15.72:0/3836959997 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c030040 con 0x561a9b34ee00 2023-08-25T04:46:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f090bfff700 1 -- 172.21.15.72:0/3836959997 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f091c01c040 con 0x561a9b34ee00 2023-08-25T04:46:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f094708bb80 1 -- 172.21.15.72:0/3836959997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f091c014450 con 0x561a9b34ee00 2023-08-25T04:46:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f090bfff700 1 -- 172.21.15.72:0/3836959997 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f091c0146f0 con 0x561a9b34ee00 2023-08-25T04:46:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f094708bb80 10 client.4869 fetch_fsmap learned FSMap version 9 2023-08-25T04:46:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.365+0000 7f094708bb80 1 -- 172.21.15.72:0/3836959997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x561a9b23ab10 con 0x561a9b34ee00 2023-08-25T04:46:13.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.366+0000 7f090bfff700 1 -- 172.21.15.72:0/3836959997 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c014450 con 0x561a9b34ee00 2023-08-25T04:46:13.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.366+0000 7f090bfff700 1 -- 172.21.15.72:0/3836959997 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f091c014a80 con 0x561a9b34ee00 2023-08-25T04:46:13.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.366+0000 7f094708bb80 10 client.4869 fetch_fsmap finished waiting for FSMap version 9 2023-08-25T04:46:13.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.366+0000 7f094708bb80 10 client.4869 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-25T04:46:13.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.366+0000 7f094708bb80 20 client.4869 populate_metadata read hostname 'smithi072' 2023-08-25T04:46:13.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.366+0000 7f094708bb80 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x561a9b37b5a0 0x561a9b37b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:13.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.366+0000 7f094708bb80 4 client.4869 mds_command: new command op to 4297 tid=0[{"prefix": "status"}] 2023-08-25T04:46:13.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.366+0000 7f094708bb80 1 -- 172.21.15.72:0/3836959997 --> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561a9b26f770 con 0x561a9b37b5a0 2023-08-25T04:46:13.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.366+0000 7f093159b700 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x561a9b37b5a0 0x561a9b37b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:13.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f093159b700 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x561a9b37b5a0 0x561a9b37b980 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=946df28e2ae92ad7 server_cookie=25f3b495addb5df1 in_seq=0 out_seq=0 2023-08-25T04:46:13.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f090bfff700 10 client.4869 ms_handle_connect on v2:172.21.15.137:6832/1278273500 2023-08-25T04:46:13.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f090bfff700 1 -- 172.21.15.72:0/3836959997 <== mds.0 v2:172.21.15.137:6832/1278273500 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x561a9b26f770 con 0x561a9b37b5a0 2023-08-25T04:46:13.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f090bfff700 10 client.4869 handle_command_reply: tid=0 2023-08-25T04:46:13.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 client.4869 shutdown 2023-08-25T04:46:13.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 -- 172.21.15.72:0/3836959997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34ee00 msgr2=0x561a9b3189a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34ee00 0x561a9b3189a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f091c000f60 tx=0x7f091c001080 comp rx=0 tx=0).stop 2023-08-25T04:46:13.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 -- 172.21.15.72:0/3836959997 shutdown_connections 2023-08-25T04:46:13.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a9b360820 0x561a9b318ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x561a9b34c760 0x561a9b323e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.137:6832/1278273500,v1:172.21.15.137:6834/1278273500] conn(0x561a9b37b5a0 0x561a9b37b980 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 --2- 172.21.15.72:0/3836959997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561a9b34ee00 0x561a9b3189a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f090bfff700 0 client.4869 ms_handle_reset on v2:172.21.15.137:6832/1278273500 2023-08-25T04:46:13.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 -- 172.21.15.72:0/3836959997 >> 172.21.15.72:0/3836959997 conn(0x561a9b298b90 msgr2=0x561a9b342ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:13.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 -- 172.21.15.72:0/3836959997 shutdown_connections 2023-08-25T04:46:13.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 1 -- 172.21.15.72:0/3836959997 wait complete. 2023-08-25T04:46:13.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.367+0000 7f094708bb80 20 client.4869 trim_cache size 0 max 16384 2023-08-25T04:46:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-25T04:46:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "48882d5a-36fb-4a1e-9265-02d65750e322", 2023-08-25T04:46:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-25T04:46:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4297, 2023-08-25T04:46:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-25T04:46:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-25T04:46:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-25T04:46:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 39.932712412000001, 2023-08-25T04:46:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 9, 2023-08-25T04:46:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 25, 2023-08-25T04:46:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 25, 2023-08-25T04:46:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 46.223560081000002 2023-08-25T04:46:13.384 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-25T04:46:13.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 -- 172.21.15.72:0/1447168192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f091006a0e0 msgr2=0x7f091006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f091006a0e0 0x7f091006c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f092c153f40 tx=0x7f091c009040 comp rx=0 tx=0).stop 2023-08-25T04:46:13.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 -- 172.21.15.72:0/1447168192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f092c0b4800 msgr2=0x7f092c0cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:13.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f092c0b4800 0x7f092c0cae10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f09280090b0 tx=0x7f0928004750 comp rx=0 tx=0).stop 2023-08-25T04:46:13.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 -- 172.21.15.72:0/1447168192 shutdown_connections 2023-08-25T04:46:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f091006a0e0 0x7f091006c5a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f092c160710 0x7f092c1534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f092c0b4800 0x7f092c0cae10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 --2- 172.21.15.72:0/1447168192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f092c0b4c80 0x7f092c1f32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:13.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 -- 172.21.15.72:0/1447168192 >> 172.21.15.72:0/1447168192 conn(0x7f092c071e40 msgr2=0x7f092c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:13.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 -- 172.21.15.72:0/1447168192 shutdown_connections 2023-08-25T04:46:13.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:13.368+0000 7f09337ff700 1 -- 172.21.15.72:0/1447168192 wait complete. 2023-08-25T04:46:13.388 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-08-25T04:46:13.402 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-08-25T04:46:13.403 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-25T04:46:13.403 INFO:tasks.ceph_fuse:client.0 config is {} 2023-08-25T04:46:13.403 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:46:13.403 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:46:13.403 INFO:tasks.ceph_fuse:client.2 config is {} 2023-08-25T04:46:13.404 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:46:13.404 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-25T04:46:13.404 INFO:tasks.ceph_fuse:client.1 config is {} 2023-08-25T04:46:13.404 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:46:13.404 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-25T04:46:13.405 INFO:tasks.ceph_fuse:client.3 config is {} 2023-08-25T04:46:13.405 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:46:13.405 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-25T04:46:13.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:13.406 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2023-08-25T04:46:13.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:13.457 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2023-08-25T04:46:13.573 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2023-08-25T04:46:13.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:46:13.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:13.575 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-25T04:46:13.625 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-08-25T04:46:13.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:13.626 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-25T04:46:13.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:13.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-08-25T04:46:13.800 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-08-25T04:46:13.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:46:14.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.002+0000 7fb3a81ff700 1 Processor -- start 2023-08-25T04:46:14.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.003+0000 7fb3a81ff700 1 -- start start 2023-08-25T04:46:14.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.004+0000 7fb3a81ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3a006e590 0x7fb3a006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:14.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.004+0000 7fb3a81ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 0x7fb3a00c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.004+0000 7fb3a81ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a00c48e0 con 0x7fb3a015ac50 2023-08-25T04:46:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.004+0000 7fb3a81ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a006d4f0 con 0x7fb3a006e590 2023-08-25T04:46:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.004+0000 7fb3a81ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a006d7d0 con 0x7fb3a00c3f40 2023-08-25T04:46:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.004+0000 7fb3a579a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3a006e590 0x7fb3a006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.004+0000 7fb3a5f9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb3a015ac50 0x7fb3a00addd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37294/0 (socket says 172.21.15.72:37294) 2023-08-25T04:46:14.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.004+0000 7fb3a5f9b700 1 -- 172.21.15.72:0/2678977825 learned_addr learned my addr 172.21.15.72:0/2678977825 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:14.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.004+0000 7fb3a679c700 1 --2- 172.21.15.72:0/2678977825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 0x7fb3a00c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:14.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.005+0000 7fb3a579a700 1 -- 172.21.15.72:0/2678977825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 msgr2=0x7fb3a00c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:14.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.005+0000 7fb3a579a700 1 --2- 172.21.15.72:0/2678977825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 0x7fb3a00c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:14.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.005+0000 7fb3a579a700 1 -- 172.21.15.72:0/2678977825 >> v1:172.21.15.72:6789/0 conn(0x7fb3a015ac50 legacy=0x7fb3a00addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.005+0000 7fb3a579a700 1 -- 172.21.15.72:0/2678977825 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a006dab0 con 0x7fb3a006e590 2023-08-25T04:46:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.005+0000 7fb3a679c700 1 --2- 172.21.15.72:0/2678977825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 0x7fb3a00c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.005+0000 7fb3a579a700 1 --2- 172.21.15.72:0/2678977825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 0x7fb3a006cf10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb390009840 tx=0x7fb390009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5339e967312e88bd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:14.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.005+0000 7fb3a4f99700 1 -- 172.21.15.72:0/2678977825 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390011830 con 0x7fb3a006e590 2023-08-25T04:46:14.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.005+0000 7fb3a4f99700 1 -- 172.21.15.72:0/2678977825 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb390011990 con 0x7fb3a006e590 2023-08-25T04:46:14.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.005+0000 7fb3a4f99700 1 -- 172.21.15.72:0/2678977825 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390011d20 con 0x7fb3a006e590 2023-08-25T04:46:14.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.006+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2678977825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 msgr2=0x7fb3a006cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:14.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.006+0000 7fb3a81ff700 1 --2- 172.21.15.72:0/2678977825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 0x7fb3a006cf10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb390009840 tx=0x7fb390009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:14.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.006+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2678977825 shutdown_connections 2023-08-25T04:46:14.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.006+0000 7fb3a81ff700 1 --2- 172.21.15.72:0/2678977825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 0x7fb3a00c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.006+0000 7fb3a81ff700 1 --2- 172.21.15.72:0/2678977825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 0x7fb3a006cf10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.006+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2678977825 >> 172.21.15.72:0/2678977825 conn(0x7fb3a00ce990 msgr2=0x7fb3a00ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.006+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2678977825 shutdown_connections 2023-08-25T04:46:14.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.006+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2678977825 wait complete. 2023-08-25T04:46:14.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.008+0000 7fb3a81ff700 1 Processor -- start 2023-08-25T04:46:14.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.008+0000 7fb3a81ff700 1 -- start start 2023-08-25T04:46:14.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a81ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 0x7fb3a01473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:14.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a81ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 0x7fb3a015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:14.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a81ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a015ac50 0x7fb3a00b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:14.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a81ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a015b810 con 0x7fb3a006e590 2023-08-25T04:46:14.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a81ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a015baf0 con 0x7fb3a015ac50 2023-08-25T04:46:14.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a81ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a015bdd0 con 0x7fb3a00c3f40 2023-08-25T04:46:14.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a5f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 0x7fb3a01473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:14.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a5f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 0x7fb3a01473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44848/0 (socket says 172.21.15.72:44848) 2023-08-25T04:46:14.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a5f9b700 1 -- 172.21.15.72:0/2889779356 learned_addr learned my addr 172.21.15.72:0/2889779356 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:14.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a679c700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a015ac50 0x7fb3a00b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:14.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.009+0000 7fb3a579a700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 0x7fb3a015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:14.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3a5f9b700 1 -- 172.21.15.72:0/2889779356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 msgr2=0x7fb3a015d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:14.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3a5f9b700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 0x7fb3a015d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:14.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3a5f9b700 1 -- 172.21.15.72:0/2889779356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a015ac50 msgr2=0x7fb3a00b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:14.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3a5f9b700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a015ac50 0x7fb3a00b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:14.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3a5f9b700 1 -- 172.21.15.72:0/2889779356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3900094a0 con 0x7fb3a006e590 2023-08-25T04:46:14.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3a5f9b700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 0x7fb3a01473b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00c520 tx=0x7fb39c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:14.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3967fc700 1 -- 172.21.15.72:0/2889779356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c005d70 con 0x7fb3a006e590 2023-08-25T04:46:14.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3967fc700 1 -- 172.21.15.72:0/2889779356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c0070d0 con 0x7fb3a006e590 2023-08-25T04:46:14.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3967fc700 1 -- 172.21.15.72:0/2889779356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c007440 con 0x7fb3a006e590 2023-08-25T04:46:14.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2889779356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a015c0b0 con 0x7fb3a006e590 2023-08-25T04:46:14.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.010+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2889779356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a01478f0 con 0x7fb3a006e590 2023-08-25T04:46:14.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.011+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2889779356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a015c5d0 con 0x7fb3a006e590 2023-08-25T04:46:14.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.012+0000 7fb3967fc700 1 -- 172.21.15.72:0/2889779356 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb39c0075a0 con 0x7fb3a006e590 2023-08-25T04:46:14.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.013+0000 7fb3967fc700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb38406a0e0 0x7fb38406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:14.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.013+0000 7fb3967fc700 1 -- 172.21.15.72:0/2889779356 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb39c087a20 con 0x7fb3a006e590 2023-08-25T04:46:14.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.013+0000 7fb3a579a700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb38406a0e0 0x7fb38406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:14.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.014+0000 7fb3a579a700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb38406a0e0 0x7fb38406c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3900090b0 tx=0x7fb39001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:14.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.017+0000 7fb3967fc700 1 -- 172.21.15.72:0/2889779356 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb39c052f60 con 0x7fb3a006e590 2023-08-25T04:46:14.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.262+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2889779356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb3a00c6450 con 0x7fb3a006e590 2023-08-25T04:46:14.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.262+0000 7fb3967fc700 1 -- 172.21.15.72:0/2889779356 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb39c056580 con 0x7fb3a006e590 2023-08-25T04:46:14.263 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-25T04:46:14.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.264+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2889779356 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb38406a0e0 msgr2=0x7fb38406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:14.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.264+0000 7fb3a81ff700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb38406a0e0 0x7fb38406c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3900090b0 tx=0x7fb39001c040 comp rx=0 tx=0).stop 2023-08-25T04:46:14.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.264+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2889779356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 msgr2=0x7fb3a01473b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:14.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.264+0000 7fb3a81ff700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 0x7fb3a01473b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00c520 tx=0x7fb39c00c830 comp rx=0 tx=0).stop 2023-08-25T04:46:14.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.265+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2889779356 shutdown_connections 2023-08-25T04:46:14.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.265+0000 7fb3a81ff700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb38406a0e0 0x7fb38406c5a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:14.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.265+0000 7fb3a81ff700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a015ac50 0x7fb3a00b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:14.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.265+0000 7fb3a81ff700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3a006e590 0x7fb3a01473b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:14.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.265+0000 7fb3a81ff700 1 --2- 172.21.15.72:0/2889779356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb3a00c3f40 0x7fb3a015d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:14.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.265+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2889779356 >> 172.21.15.72:0/2889779356 conn(0x7fb3a00ce990 msgr2=0x7fb3a0070890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:14.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.265+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2889779356 shutdown_connections 2023-08-25T04:46:14.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:14.265+0000 7fb3a81ff700 1 -- 172.21.15.72:0/2889779356 wait complete. 2023-08-25T04:46:14.284 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:46:14.284 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:46:14.284 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-25T04:46:14.284 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:46:14.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:46:14.285 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:46:14.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:46:14.285 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:46:14.285 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:46:14.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:14.286 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-25T04:46:14.332 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:46:14.332 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:46:14.332 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:46:14.332 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:14.332 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-25T04:46:14.333 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:14.333 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:14.333 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:14.333 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-25T04:46:14.333 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:14.333 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:14.333 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-25T04:46:14.334 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:14.334 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:14.335 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:46:14.335 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:14.335 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-25T04:46:14.335 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42193sec preferred_lft 42193sec 2023-08-25T04:46:14.335 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-25T04:46:14.335 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:14.336 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-25T04:46:14.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:14.337 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:46:14.338 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:46:14.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-08-25T04:46:14.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-08-25T04:46:14.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-08-25T04:46:14.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-25T04:46:14.339 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:46:14.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:14.576 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:46:14.646 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-25T04:46:14.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:14.649 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-25T04:46:14.699 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-25T04:46:14.699 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:46:14.699 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T04:46:14.699 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T04:46:14.699 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:46:14.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:14.700 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:46:14.700 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:46:14.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T04:46:14.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T04:46:14.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T04:46:14.701 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:46:14.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:14.870 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-25T04:46:14.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:14.919 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-08-25T04:46:14.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:14.967 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:46:14.967 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:46:14.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:46:14.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-25T04:46:14.968 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:46:15.148 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-25T04:46:15.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:15.149 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:46:15.149 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:46:15.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-25T04:46:15.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-25T04:46:15.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-25T04:46:15.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-25T04:46:15.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-25T04:46:15.150 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:46:15.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:15.396 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:46:15.396 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:46:15.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-25T04:46:15.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-08-25T04:46:15.397 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:46:15.567 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-25T04:46:15.568 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:46:15.568 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:46:15.614 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:46:15.615 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:46:15.615 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:46:15.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-08-25T04:46:15.817 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:46:15.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:46:15.886 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:46:15.888 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:46:15.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:15.890 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-08-25T04:46:15.936 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-25T04:46:15.936 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-08-25T04:46:15.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-08-25T04:46:16.054 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:46:16.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:46:16.122 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:46:16.125 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:46:16.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:16.126 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-08-25T04:46:16.151 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2023-08-25T04:46:16.149+0000 7fd8c77ea5c0 -1 init, newargv = 0x56303de9f1d0 newargc=15 2023-08-25T04:46:16.151 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[127112]: starting ceph client 2023-08-25T04:46:16.159 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[127112]: starting fuse 2023-08-25T04:46:16.175 INFO:teuthology.orchestra.run.smithi072.stdout:43 2023-08-25T04:46:16.175 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-08-25T04:46:16.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2023-08-25T04:46:16.176 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-08-25T04:46:16.177 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-08-25T04:46:16.177 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-08-25T04:46:16.177 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-08-25T04:46:16.178 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:46:16.180 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-08-25T04:46:16.180 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-25T04:46:16.181 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-08-25T04:46:16.182 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-25T04:46:16.182 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:46:16.183 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-08-25T04:46:16.183 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-08-25T04:46:16.184 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-08-25T04:46:16.184 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-08-25T04:46:16.184 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:46:16.185 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-08-25T04:46:16.185 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-25T04:46:16.185 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-25T04:46:16.185 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-25T04:46:16.186 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-08-25T04:46:16.186 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-08-25T04:46:16.186 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-08-25T04:46:16.186 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-25T04:46:16.187 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:46:16.187 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2023-08-25T04:46:16.187 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-08-25T04:46:16.356 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.127112.asok 2023-08-25T04:46:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-25T04:46:16.369 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.127112.asok 2023-08-25T04:46:16.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:16.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.127112.asok status 2023-08-25T04:46:16.594 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-25T04:46:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-08-25T04:46:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "ba6b39e4f4f77fb95c747099b53db0467d435f56", 2023-08-25T04:46:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev)", 2023-08-25T04:46:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2023-08-25T04:46:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-08-25T04:46:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-25T04:46:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "127112", 2023-08-25T04:46:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-08-25T04:46:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:46:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-08-25T04:46:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-08-25T04:46:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4625, 2023-08-25T04:46:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-08-25T04:46:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-08-25T04:46:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-08-25T04:46:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4625 2023-08-25T04:46:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:46:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-08-25T04:46:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-08-25T04:46:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:0", 2023-08-25T04:46:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1222733964 2023-08-25T04:46:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:46:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:46:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-08-25T04:46:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-08-25T04:46:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:0", 2023-08-25T04:46:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1222733964 2023-08-25T04:46:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:46:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4625 172.21.15.72:0/1222733964", 2023-08-25T04:46:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "172.21.15.72:0/1222733964", 2023-08-25T04:46:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-08-25T04:46:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 9, 2023-08-25T04:46:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 25, 2023-08-25T04:46:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-08-25T04:46:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-08-25T04:46:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-08-25T04:46:16.599 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-25T04:46:16.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:46:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.805+0000 7fe7643ff700 1 Processor -- start 2023-08-25T04:46:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.805+0000 7fe7643ff700 1 -- start start 2023-08-25T04:46:16.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe7643ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe75c159b90 0x7fe75c0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:16.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe7643ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe75c0b0ab0 0x7fe75c0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:16.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe7643ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0ce1f0 0x7fe75c0c3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:16.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe7643ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c0c48f0 con 0x7fe75c159b90 2023-08-25T04:46:16.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe7643ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c0c5470 con 0x7fe75c0b0ab0 2023-08-25T04:46:16.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe7643ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c159f70 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76219b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe75c159b90 0x7fe75c0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76219b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe75c159b90 0x7fe75c0b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44862/0 (socket says 172.21.15.72:44862) 2023-08-25T04:46:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76219b700 1 -- 172.21.15.72:0/1387881788 learned_addr learned my addr 172.21.15.72:0/1387881788 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76199a700 1 --2- 172.21.15.72:0/1387881788 >> v2:172.21.15.137:3300/0 conn(0x7fe75c0b0ab0 0x7fe75c0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:16.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76299c700 1 --2- 172.21.15.72:0/1387881788 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0ce1f0 0x7fe75c0c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:16.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76219b700 1 -- 172.21.15.72:0/1387881788 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0ce1f0 msgr2=0x7fe75c0c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76219b700 1 --2- 172.21.15.72:0/1387881788 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0ce1f0 0x7fe75c0c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76219b700 1 -- 172.21.15.72:0/1387881788 >> v2:172.21.15.137:3300/0 conn(0x7fe75c0b0ab0 msgr2=0x7fe75c0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76219b700 1 --2- 172.21.15.72:0/1387881788 >> v2:172.21.15.137:3300/0 conn(0x7fe75c0b0ab0 0x7fe75c0cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76219b700 1 -- 172.21.15.72:0/1387881788 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c0c4b40 con 0x7fe75c159b90 2023-08-25T04:46:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.807+0000 7fe76299c700 1 --2- 172.21.15.72:0/1387881788 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0ce1f0 0x7fe75c0c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.808+0000 7fe76219b700 1 --2- 172.21.15.72:0/1387881788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c159b90 0x7fe75c0b0570 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0c53e0 tx=0x7fe758009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438bc5740c73c21 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.808+0000 7fe761199700 1 -- 172.21.15.72:0/1387881788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758011830 con 0x7fe75c159b90 2023-08-25T04:46:16.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.808+0000 7fe761199700 1 -- 172.21.15.72:0/1387881788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758011990 con 0x7fe75c159b90 2023-08-25T04:46:16.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.808+0000 7fe761199700 1 -- 172.21.15.72:0/1387881788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758011d20 con 0x7fe75c159b90 2023-08-25T04:46:16.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.808+0000 7fe7643ff700 1 -- 172.21.15.72:0/1387881788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c159b90 msgr2=0x7fe75c0b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:16.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.808+0000 7fe7643ff700 1 --2- 172.21.15.72:0/1387881788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c159b90 0x7fe75c0b0570 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0c53e0 tx=0x7fe758009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:16.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.809+0000 7fe7643ff700 1 -- 172.21.15.72:0/1387881788 shutdown_connections 2023-08-25T04:46:16.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.809+0000 7fe7643ff700 1 --2- 172.21.15.72:0/1387881788 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0ce1f0 0x7fe75c0c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:16.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.809+0000 7fe7643ff700 1 --2- 172.21.15.72:0/1387881788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c159b90 0x7fe75c0b0570 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:16.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.809+0000 7fe7643ff700 1 --2- 172.21.15.72:0/1387881788 >> v2:172.21.15.137:3300/0 conn(0x7fe75c0b0ab0 0x7fe75c0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:16.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.809+0000 7fe7643ff700 1 -- 172.21.15.72:0/1387881788 >> 172.21.15.72:0/1387881788 conn(0x7fe75c0ce990 msgr2=0x7fe75c0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:16.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.809+0000 7fe7643ff700 1 -- 172.21.15.72:0/1387881788 shutdown_connections 2023-08-25T04:46:16.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.809+0000 7fe7643ff700 1 -- 172.21.15.72:0/1387881788 wait complete. 2023-08-25T04:46:16.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.810+0000 7fe7643ff700 1 Processor -- start 2023-08-25T04:46:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.810+0000 7fe7643ff700 1 -- start start 2023-08-25T04:46:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.811+0000 7fe7643ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0b0ab0 0x7fe75c150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.811+0000 7fe7643ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c0ce1f0 0x7fe75c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.811+0000 7fe7643ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c159b90 0x7fe75c15be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.811+0000 7fe7643ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c15a140 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.811+0000 7fe7643ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c141710 con 0x7fe75c159b90 2023-08-25T04:46:16.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.811+0000 7fe7643ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c15ca60 con 0x7fe75c0b0ab0 2023-08-25T04:46:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c0ce1f0 0x7fe75c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c0ce1f0 0x7fe75c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44876/0 (socket says 172.21.15.72:44876) 2023-08-25T04:46:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76199a700 1 -- 172.21.15.72:0/694802951 learned_addr learned my addr 172.21.15.72:0/694802951 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76219b700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0b0ab0 0x7fe75c150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76299c700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c159b90 0x7fe75c15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76199a700 1 -- 172.21.15.72:0/694802951 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0b0ab0 msgr2=0x7fe75c150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:16.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76199a700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0b0ab0 0x7fe75c150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76199a700 1 -- 172.21.15.72:0/694802951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c159b90 msgr2=0x7fe75c15be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76199a700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c159b90 0x7fe75c15be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76199a700 1 -- 172.21.15.72:0/694802951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe758009550 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76299c700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c159b90 0x7fe75c15be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe76199a700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c0ce1f0 0x7fe75c15ab00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00e960 tx=0x7fe74c00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe752ffd700 1 -- 172.21.15.72:0/694802951 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c009690 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe752ffd700 1 -- 172.21.15.72:0/694802951 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00c850 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe752ffd700 1 -- 172.21.15.72:0/694802951 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00cbc0 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.812+0000 7fe7643ff700 1 -- 172.21.15.72:0/694802951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c15cd40 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.813+0000 7fe7643ff700 1 -- 172.21.15.72:0/694802951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c15a600 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.814+0000 7fe7643ff700 1 -- 172.21.15.72:0/694802951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c04e620 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.815+0000 7fe752ffd700 1 -- 172.21.15.72:0/694802951 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe74c00cd20 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.816+0000 7fe752ffd700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe74006a0e0 0x7fe74006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:16.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.816+0000 7fe752ffd700 1 -- 172.21.15.72:0/694802951 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe74c0888f0 con 0x7fe75c0ce1f0 2023-08-25T04:46:16.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.816+0000 7fe76219b700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe74006a0e0 0x7fe74006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:16.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.817+0000 7fe76219b700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe74006a0e0 0x7fe74006c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe758014040 tx=0x7fe758008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:16.820+0000 7fe752ffd700 1 -- 172.21.15.72:0/694802951 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe74c057770 con 0x7fe75c0ce1f0 2023-08-25T04:46:17.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.061+0000 7fe7643ff700 1 -- 172.21.15.72:0/694802951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe75c1589c0 con 0x7fe75c0ce1f0 2023-08-25T04:46:17.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.062+0000 7fe752ffd700 1 -- 172.21.15.72:0/694802951 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe74c057300 con 0x7fe75c0ce1f0 2023-08-25T04:46:17.063 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-25T04:46:17.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 -- 172.21.15.72:0/694802951 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe74006a0e0 msgr2=0x7fe74006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:17.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe74006a0e0 0x7fe74006c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe758014040 tx=0x7fe758008030 comp rx=0 tx=0).stop 2023-08-25T04:46:17.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 -- 172.21.15.72:0/694802951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c0ce1f0 msgr2=0x7fe75c15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:17.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c0ce1f0 0x7fe75c15ab00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00e960 tx=0x7fe74c00ed20 comp rx=0 tx=0).stop 2023-08-25T04:46:17.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 -- 172.21.15.72:0/694802951 shutdown_connections 2023-08-25T04:46:17.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe74006a0e0 0x7fe74006c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:17.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c159b90 0x7fe75c15be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:17.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe75c0b0ab0 0x7fe75c150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:17.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 --2- 172.21.15.72:0/694802951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75c0ce1f0 0x7fe75c15ab00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:17.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 -- 172.21.15.72:0/694802951 >> 172.21.15.72:0/694802951 conn(0x7fe75c0ce990 msgr2=0x7fe75c071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:17.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 -- 172.21.15.72:0/694802951 shutdown_connections 2023-08-25T04:46:17.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:17.064+0000 7fe7643ff700 1 -- 172.21.15.72:0/694802951 wait complete. 2023-08-25T04:46:17.083 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:46:17.084 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:46:17.084 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-25T04:46:17.085 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-25T04:46:17.085 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-25T04:46:17.085 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:46:17.086 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:46:17.086 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:46:17.087 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-25T04:46:17.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:17.088 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-25T04:46:17.136 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:46:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:46:17.136 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:46:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-25T04:46:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.137 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:17.137 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-25T04:46:17.137 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-25T04:46:17.138 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:17.138 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:46:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:17.138 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-25T04:46:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42191sec preferred_lft 42191sec 2023-08-25T04:46:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-25T04:46:17.139 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.140 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:46:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 62:26:50:09:39:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:46:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.140 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::cc22:7ff:fe4c:6173/64 scope link 2023-08-25T04:46:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.141 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:46:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 62:26:50:09:39:ae brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:46:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::6026:50ff:fe09:39ae/64 scope link tentative 2023-08-25T04:46:17.141 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:17.142 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:46:17.245 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-25T04:46:17.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:17.247 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-25T04:46:17.296 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-25T04:46:17.297 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:46:17.297 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T04:46:17.297 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T04:46:17.297 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:46:17.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:17.299 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:46:17.300 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:46:17.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T04:46:17.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T04:46:17.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T04:46:17.301 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:46:17.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:17.470 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-25T04:46:17.520 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:46:17.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:17.521 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-08-25T04:46:17.567 INFO:teuthology.orchestra.run.smithi072.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-25T04:46:17.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:17.569 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:46:17.569 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:46:17.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:46:17.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-25T04:46:17.570 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:46:17.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:17.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-25T04:46:17.831 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:46:17.832 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:46:17.832 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:46:17.832 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.832 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-25T04:46:17.832 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.832 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:46:17.833 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:dd:b7:07:78:a2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:46:17.833 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:46:17.833 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.833 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0dd:b7ff:fe07:78a2/64 scope link 2023-08-25T04:46:17.833 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:17.835 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-25T04:46:17.907 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:46:17.907 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:46:17.908 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:46:17.908 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.908 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-25T04:46:17.908 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.908 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:46:17.908 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:dd:b7:07:78:a2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:46:17.908 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:46:17.909 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.909 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0dd:b7ff:fe07:78a2/64 scope link 2023-08-25T04:46:17.909 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:17.911 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-25T04:46:17.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:17.911 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:46:17.912 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:46:17.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-25T04:46:17.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-25T04:46:17.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-25T04:46:17.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-25T04:46:17.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-25T04:46:17.913 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:46:18.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:18.179 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:46:18.180 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:46:18.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.1 up 2023-08-25T04:46:18.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.1 master ceph-brx 2023-08-25T04:46:18.180 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:46:18.356 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-08-25T04:46:18.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:46:18.357 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-25T04:46:18.404 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-25T04:46:18.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:46:18.405 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-25T04:46:18.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-08-25T04:46:18.603 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:46:18.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:46:18.673 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:46:18.675 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:46:18.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:18.676 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-08-25T04:46:18.723 INFO:teuthology.orchestra.run.smithi072.stdout:43 2023-08-25T04:46:18.723 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-08-25T04:46:18.723 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-08-25T04:46:18.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-08-25T04:46:18.840 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:46:18.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:46:18.910 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:46:18.912 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:46:18.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:18.914 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-08-25T04:46:18.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi072.stderr:2023-08-25T04:46:18.935+0000 7f600ff335c0 -1 init, newargv = 0x55c3b641c430 newargc=15 2023-08-25T04:46:18.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi072.stderr:ceph-fuse[127835]: starting ceph client 2023-08-25T04:46:18.944 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi072.stderr:ceph-fuse[127835]: starting fuse 2023-08-25T04:46:18.962 INFO:teuthology.orchestra.run.smithi072.stdout:43 2023-08-25T04:46:18.963 INFO:teuthology.orchestra.run.smithi072.stdout:45 2023-08-25T04:46:18.963 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 45] 2023-08-25T04:46:18.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2023-08-25T04:46:18.964 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-08-25T04:46:18.964 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-08-25T04:46:18.964 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-08-25T04:46:18.964 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-08-25T04:46:18.965 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:46:18.965 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-08-25T04:46:18.965 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-08-25T04:46:18.965 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-08-25T04:46:18.966 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-08-25T04:46:18.966 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:46:18.966 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-08-25T04:46:18.966 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-08-25T04:46:18.967 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-08-25T04:46:18.967 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-08-25T04:46:18.967 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:46:18.967 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-08-25T04:46:18.968 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-25T04:46:18.968 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-25T04:46:18.968 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-25T04:46:18.968 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-08-25T04:46:18.969 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-08-25T04:46:18.969 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-08-25T04:46:18.969 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-25T04:46:18.970 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:46:18.970 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.2")) 2023-08-25T04:46:18.970 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-08-25T04:46:19.144 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.2.127835.asok 2023-08-25T04:46:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-25T04:46:19.157 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.127835.asok 2023-08-25T04:46:19.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:19.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.127835.asok status 2023-08-25T04:46:19.382 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-25T04:46:19.382 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-08-25T04:46:19.383 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "ba6b39e4f4f77fb95c747099b53db0467d435f56", 2023-08-25T04:46:19.383 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev)", 2023-08-25T04:46:19.383 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "2", 2023-08-25T04:46:19.383 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-08-25T04:46:19.384 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-08-25T04:46:19.384 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "127835", 2023-08-25T04:46:19.384 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-08-25T04:46:19.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:46:19.384 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-08-25T04:46:19.384 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-08-25T04:46:19.384 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4852, 2023-08-25T04:46:19.385 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-08-25T04:46:19.385 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-08-25T04:46:19.385 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-08-25T04:46:19.385 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4852 2023-08-25T04:46:19.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:46:19.385 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-08-25T04:46:19.385 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-08-25T04:46:19.385 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.2:0", 2023-08-25T04:46:19.386 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 3624687562 2023-08-25T04:46:19.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:46:19.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:46:19.386 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-08-25T04:46:19.386 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-08-25T04:46:19.386 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.2:0", 2023-08-25T04:46:19.386 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 3624687562 2023-08-25T04:46:19.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:46:19.387 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4852 192.168.0.2:0/3624687562", 2023-08-25T04:46:19.387 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.2:0/3624687562", 2023-08-25T04:46:19.387 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-08-25T04:46:19.387 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 9, 2023-08-25T04:46:19.387 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 25, 2023-08-25T04:46:19.387 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-08-25T04:46:19.387 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-08-25T04:46:19.387 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-08-25T04:46:19.388 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-25T04:46:19.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:46:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.590+0000 7fa7a73ff700 1 Processor -- start 2023-08-25T04:46:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.590+0000 7fa7a73ff700 1 -- start start 2023-08-25T04:46:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.591+0000 7fa7a73ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 0x7fa7a006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.591+0000 7fa7a73ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a006d4f0 con 0x7fa7a015ac50 2023-08-25T04:46:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.591+0000 7fa7a73ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a006d7d0 con 0x7fa7a006e590 2023-08-25T04:46:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.591+0000 7fa7a73ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a006dab0 con 0x7fa7a00c4650 2023-08-25T04:46:19.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.591+0000 7fa7a519b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa7a015ac50 0x7fa7a00addd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37298/0 (socket says 172.21.15.72:37298) 2023-08-25T04:46:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.591+0000 7fa7a519b700 1 -- 172.21.15.72:0/1655770848 learned_addr learned my addr 172.21.15.72:0/1655770848 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.592+0000 7fa7a599c700 1 --2- 172.21.15.72:0/1655770848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 0x7fa7a006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.592+0000 7fa797fff700 1 -- 172.21.15.72:0/1655770848 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992198497 0 0) 0x7fa7a006d4f0 con 0x7fa7a015ac50 2023-08-25T04:46:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.592+0000 7fa797fff700 1 -- 172.21.15.72:0/1655770848 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa78c0035b0 con 0x7fa7a015ac50 2023-08-25T04:46:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.592+0000 7fa797fff700 1 -- 172.21.15.72:0/1655770848 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944041152 0 0) 0x7fa7a006d7d0 con 0x7fa7a006e590 2023-08-25T04:46:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.592+0000 7fa797fff700 1 -- 172.21.15.72:0/1655770848 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a006d4f0 con 0x7fa7a006e590 2023-08-25T04:46:19.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.592+0000 7fa7a599c700 1 -- 172.21.15.72:0/1655770848 >> v1:172.21.15.137:6789/0 conn(0x7fa7a006e590 legacy=0x7fa7a00c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.592+0000 7fa7a599c700 1 -- 172.21.15.72:0/1655770848 >> v1:172.21.15.72:6789/0 conn(0x7fa7a015ac50 legacy=0x7fa7a00addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.592+0000 7fa7a599c700 1 -- 172.21.15.72:0/1655770848 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a006dd90 con 0x7fa7a00c4650 2023-08-25T04:46:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.592+0000 7fa7a599c700 1 --2- 172.21.15.72:0/1655770848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 0x7fa7a006cf10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa798009dc0 tx=0x7fa79800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed901cf0ea7b767b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.593+0000 7fa797fff700 1 -- 172.21.15.72:0/1655770848 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800e070 con 0x7fa7a00c4650 2023-08-25T04:46:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.593+0000 7fa797fff700 1 -- 172.21.15.72:0/1655770848 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79800bb20 con 0x7fa7a00c4650 2023-08-25T04:46:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.593+0000 7fa797fff700 1 -- 172.21.15.72:0/1655770848 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798012430 con 0x7fa7a00c4650 2023-08-25T04:46:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.593+0000 7fa7a73ff700 1 -- 172.21.15.72:0/1655770848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 msgr2=0x7fa7a006cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.593+0000 7fa7a73ff700 1 --2- 172.21.15.72:0/1655770848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 0x7fa7a006cf10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa798009dc0 tx=0x7fa79800b330 comp rx=0 tx=0).stop 2023-08-25T04:46:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.593+0000 7fa7a73ff700 1 -- 172.21.15.72:0/1655770848 shutdown_connections 2023-08-25T04:46:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.593+0000 7fa7a73ff700 1 --2- 172.21.15.72:0/1655770848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 0x7fa7a006cf10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.593+0000 7fa7a73ff700 1 -- 172.21.15.72:0/1655770848 >> 172.21.15.72:0/1655770848 conn(0x7fa7a00ce990 msgr2=0x7fa7a00ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.593+0000 7fa7a73ff700 1 -- 172.21.15.72:0/1655770848 shutdown_connections 2023-08-25T04:46:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.593+0000 7fa7a73ff700 1 -- 172.21.15.72:0/1655770848 wait complete. 2023-08-25T04:46:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.595+0000 7fa7a73ff700 1 Processor -- start 2023-08-25T04:46:19.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.595+0000 7fa7a73ff700 1 -- start start 2023-08-25T04:46:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.596+0000 7fa7a73ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7a006e590 0x7fa7a014c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:19.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.596+0000 7fa7a73ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 0x7fa7a014cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:19.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.596+0000 7fa7a73ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a015ac50 0x7fa7a014d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:19.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.596+0000 7fa7a73ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a014d960 con 0x7fa7a015ac50 2023-08-25T04:46:19.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.596+0000 7fa7a73ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a00ce0c0 con 0x7fa7a006e590 2023-08-25T04:46:19.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.596+0000 7fa7a73ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a015b5e0 con 0x7fa7a00c4650 2023-08-25T04:46:19.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a599c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a015ac50 0x7fa7a014d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:19.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a599c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a015ac50 0x7fa7a014d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44892/0 (socket says 172.21.15.72:44892) 2023-08-25T04:46:19.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a599c700 1 -- 172.21.15.72:0/2467227605 learned_addr learned my addr 172.21.15.72:0/2467227605 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:19.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a519b700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7a006e590 0x7fa7a014c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:19.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a499a700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 0x7fa7a014cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:19.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a599c700 1 -- 172.21.15.72:0/2467227605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 msgr2=0x7fa7a014cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a599c700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 0x7fa7a014cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a599c700 1 -- 172.21.15.72:0/2467227605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7a006e590 msgr2=0x7fa7a014c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a599c700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7a006e590 0x7fa7a014c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a599c700 1 -- 172.21.15.72:0/2467227605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798009a70 con 0x7fa7a015ac50 2023-08-25T04:46:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a599c700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a015ac50 0x7fa7a014d1d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00cf7d0 tx=0x7fa798004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa795ffb700 1 -- 172.21.15.72:0/2467227605 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798012430 con 0x7fa7a015ac50 2023-08-25T04:46:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa795ffb700 1 -- 172.21.15.72:0/2467227605 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798020070 con 0x7fa7a015ac50 2023-08-25T04:46:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa795ffb700 1 -- 172.21.15.72:0/2467227605 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798004280 con 0x7fa7a015ac50 2023-08-25T04:46:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.597+0000 7fa7a73ff700 1 -- 172.21.15.72:0/2467227605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a015be80 con 0x7fa7a015ac50 2023-08-25T04:46:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.598+0000 7fa7a73ff700 1 -- 172.21.15.72:0/2467227605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a00ce310 con 0x7fa7a015ac50 2023-08-25T04:46:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.598+0000 7fa7a73ff700 1 -- 172.21.15.72:0/2467227605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a004e620 con 0x7fa7a015ac50 2023-08-25T04:46:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.599+0000 7fa795ffb700 1 -- 172.21.15.72:0/2467227605 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7980043e0 con 0x7fa7a015ac50 2023-08-25T04:46:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.600+0000 7fa795ffb700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa78406a0e0 0x7fa78406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.600+0000 7fa795ffb700 1 -- 172.21.15.72:0/2467227605 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa798022070 con 0x7fa7a015ac50 2023-08-25T04:46:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.601+0000 7fa7a519b700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa78406a0e0 0x7fa78406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.601+0000 7fa7a519b700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa78406a0e0 0x7fa78406c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa79c000f60 tx=0x7fa79c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.605+0000 7fa795ffb700 1 -- 172.21.15.72:0/2467227605 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa7980558f0 con 0x7fa7a015ac50 2023-08-25T04:46:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.843+0000 7fa7a73ff700 1 -- 172.21.15.72:0/2467227605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa7a015e5b0 con 0x7fa7a015ac50 2023-08-25T04:46:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.844+0000 7fa795ffb700 1 -- 172.21.15.72:0/2467227605 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa798058f10 con 0x7fa7a015ac50 2023-08-25T04:46:19.845 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-25T04:46:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 -- 172.21.15.72:0/2467227605 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa78406a0e0 msgr2=0x7fa78406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa78406a0e0 0x7fa78406c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa79c000f60 tx=0x7fa79c009040 comp rx=0 tx=0).stop 2023-08-25T04:46:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 -- 172.21.15.72:0/2467227605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a015ac50 msgr2=0x7fa7a014d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a015ac50 0x7fa7a014d1d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00cf7d0 tx=0x7fa798004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 -- 172.21.15.72:0/2467227605 shutdown_connections 2023-08-25T04:46:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa78406a0e0 0x7fa78406c5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a015ac50 0x7fa7a014d1d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7a006e590 0x7fa7a014c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 --2- 172.21.15.72:0/2467227605 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7a00c4650 0x7fa7a014cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 -- 172.21.15.72:0/2467227605 >> 172.21.15.72:0/2467227605 conn(0x7fa7a00ce990 msgr2=0x7fa7a0159d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 -- 172.21.15.72:0/2467227605 shutdown_connections 2023-08-25T04:46:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:19.846+0000 7fa7a73ff700 1 -- 172.21.15.72:0/2467227605 wait complete. 2023-08-25T04:46:19.864 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:46:19.865 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:46:19.865 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2023-08-25T04:46:19.865 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-25T04:46:19.865 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-25T04:46:19.866 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:46:19.866 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:46:19.866 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:46:19.866 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-25T04:46:19.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:19.867 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2023-08-25T04:46:19.919 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:46:19.919 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:46:19.919 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:46:19.919 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:19.920 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2023-08-25T04:46:19.920 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:19.920 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:19.920 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:19.920 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2023-08-25T04:46:19.920 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:19.920 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:19.920 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2023-08-25T04:46:19.921 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:19.921 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:19.921 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:46:19.921 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:19.921 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-25T04:46:19.921 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42147sec preferred_lft 42147sec 2023-08-25T04:46:19.921 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2023-08-25T04:46:19.922 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:19.922 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-25T04:46:19.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:19.923 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2023-08-25T04:46:19.924 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2023-08-25T04:46:19.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add name ceph-brx type bridge 2023-08-25T04:46:19.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr flush dev ceph-brx 2023-08-25T04:46:19.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set ceph-brx up 2023-08-25T04:46:19.925 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-25T04:46:19.925 DEBUG:teuthology.orchestra.run.smithi137:> ') 2023-08-25T04:46:20.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:20.365 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:46:20.472 INFO:teuthology.orchestra.run.smithi137.stdout:1 2023-08-25T04:46:20.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:20.475 DEBUG:teuthology.orchestra.run.smithi137:> route 2023-08-25T04:46:20.548 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2023-08-25T04:46:20.549 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:46:20.549 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T04:46:20.549 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T04:46:20.549 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:46:20.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:20.551 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2023-08-25T04:46:20.551 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2023-08-25T04:46:20.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T04:46:20.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T04:46:20.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T04:46:20.552 DEBUG:teuthology.orchestra.run.smithi137:> ') 2023-08-25T04:46:21.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:21.255 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2023-08-25T04:46:21.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:21.303 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2023-08-25T04:46:21.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:21.350 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2023-08-25T04:46:21.350 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2023-08-25T04:46:21.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-25T04:46:21.351 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-25T04:46:21.351 DEBUG:teuthology.orchestra.run.smithi137:> ') 2023-08-25T04:46:21.532 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-25T04:46:21.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:21.533 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2023-08-25T04:46:21.533 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2023-08-25T04:46:21.533 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-25T04:46:21.533 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-25T04:46:21.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-25T04:46:21.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-25T04:46:21.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-25T04:46:21.535 DEBUG:teuthology.orchestra.run.smithi137:> ') 2023-08-25T04:46:21.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:21.810 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2023-08-25T04:46:21.810 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2023-08-25T04:46:21.810 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2023-08-25T04:46:21.811 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.0 master ceph-brx 2023-08-25T04:46:21.811 DEBUG:teuthology.orchestra.run.smithi137:> ') 2023-08-25T04:46:21.982 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-08-25T04:46:21.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:46:21.983 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-25T04:46:22.029 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-25T04:46:22.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:46:22.029 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-25T04:46:22.114 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2023-08-25T04:46:22.225 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:46:22.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:46:22.295 INFO:teuthology.orchestra.run.smithi137.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:46:22.298 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:46:22.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:22.299 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2023-08-25T04:46:22.345 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-25T04:46:22.346 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-08-25T04:46:22.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2023-08-25T04:46:22.421 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:46:22.422 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:46:22.492 INFO:teuthology.orchestra.run.smithi137.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:46:22.494 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:46:22.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:22.495 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2023-08-25T04:46:22.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi137.stderr:2023-08-25T04:46:22.518+0000 7f6c1f3805c0 -1 init, newargv = 0x55ab0d5ea4c0 newargc=15 2023-08-25T04:46:22.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi137.stderr:ceph-fuse[121596]: starting ceph client 2023-08-25T04:46:22.529 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi137.stderr:ceph-fuse[121596]: starting fuse 2023-08-25T04:46:22.545 INFO:teuthology.orchestra.run.smithi137.stdout:43 2023-08-25T04:46:22.545 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-08-25T04:46:22.546 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2023-08-25T04:46:22.546 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2023-08-25T04:46:22.546 DEBUG:teuthology.orchestra.run.smithi137:> import re 2023-08-25T04:46:22.546 DEBUG:teuthology.orchestra.run.smithi137:> import os 2023-08-25T04:46:22.547 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2023-08-25T04:46:22.547 DEBUG:teuthology.orchestra.run.smithi137:> 2023-08-25T04:46:22.547 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2023-08-25T04:46:22.547 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-08-25T04:46:22.548 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2023-08-25T04:46:22.548 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-08-25T04:46:22.548 DEBUG:teuthology.orchestra.run.smithi137:> 2023-08-25T04:46:22.549 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2023-08-25T04:46:22.549 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2023-08-25T04:46:22.549 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2023-08-25T04:46:22.549 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2023-08-25T04:46:22.550 DEBUG:teuthology.orchestra.run.smithi137:> 2023-08-25T04:46:22.550 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2023-08-25T04:46:22.550 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-25T04:46:22.550 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-25T04:46:22.551 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-25T04:46:22.551 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2023-08-25T04:46:22.551 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2023-08-25T04:46:22.551 DEBUG:teuthology.orchestra.run.smithi137:> return f 2023-08-25T04:46:22.552 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-25T04:46:22.552 DEBUG:teuthology.orchestra.run.smithi137:> 2023-08-25T04:46:22.552 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.1")) 2023-08-25T04:46:22.553 DEBUG:teuthology.orchestra.run.smithi137:> ' 2023-08-25T04:46:22.729 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.1.121596.asok 2023-08-25T04:46:22.733 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:46:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-25T04:46:22.743 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.121596.asok 2023-08-25T04:46:22.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:22.744 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.121596.asok status 2023-08-25T04:46:22.968 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2023-08-25T04:46:22.969 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2023-08-25T04:46:22.969 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "ba6b39e4f4f77fb95c747099b53db0467d435f56", 2023-08-25T04:46:22.969 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev)", 2023-08-25T04:46:22.969 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "1", 2023-08-25T04:46:22.970 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2023-08-25T04:46:22.970 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-08-25T04:46:22.970 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "121596", 2023-08-25T04:46:22.970 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2023-08-25T04:46:22.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2023-08-25T04:46:22.970 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2023-08-25T04:46:22.971 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2023-08-25T04:46:22.971 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4864, 2023-08-25T04:46:22.971 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2023-08-25T04:46:22.971 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2023-08-25T04:46:22.971 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2023-08-25T04:46:22.971 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 4864 2023-08-25T04:46:22.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2023-08-25T04:46:22.972 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2023-08-25T04:46:22.972 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2023-08-25T04:46:22.972 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2023-08-25T04:46:22.972 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 693440091 2023-08-25T04:46:22.972 INFO:teuthology.orchestra.run.smithi137.stdout: } 2023-08-25T04:46:22.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2023-08-25T04:46:22.973 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2023-08-25T04:46:22.973 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2023-08-25T04:46:22.973 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.1:0", 2023-08-25T04:46:22.973 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 693440091 2023-08-25T04:46:22.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2023-08-25T04:46:22.974 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.4864 192.168.0.1:0/693440091", 2023-08-25T04:46:22.974 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.1:0/693440091", 2023-08-25T04:46:22.974 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2023-08-25T04:46:22.974 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 9, 2023-08-25T04:46:22.974 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 27, 2023-08-25T04:46:22.974 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2023-08-25T04:46:22.975 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2023-08-25T04:46:22.975 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2023-08-25T04:46:22.975 INFO:teuthology.orchestra.run.smithi137.stdout:} 2023-08-25T04:46:22.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:46:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.187+0000 7efe32dff700 1 Processor -- start 2023-08-25T04:46:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.188+0000 7efe32dff700 1 -- start start 2023-08-25T04:46:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.189+0000 7efe32dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe2c15ce60 0x7efe2c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.189+0000 7efe32dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efe2c0b8770 0x7efe2c0d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.189+0000 7efe32dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c0d1fe0 con 0x7efe2c0cda40 2023-08-25T04:46:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.189+0000 7efe32dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c0d13d0 con 0x7efe2c15ce60 2023-08-25T04:46:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.189+0000 7efe32dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c0d16b0 con 0x7efe2c0b8770 2023-08-25T04:46:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.189+0000 7efe30b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe2c15ce60 0x7efe2c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.189+0000 7efe30b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe2c15ce60 0x7efe2c0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43532/0 (socket says 172.21.15.72:43532) 2023-08-25T04:46:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.189+0000 7efe30b9b700 1 -- 172.21.15.72:0/2326663444 learned_addr learned my addr 172.21.15.72:0/2326663444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.189+0000 7efe2bfff700 1 --2- 172.21.15.72:0/2326663444 >> v2:172.21.15.137:3300/0 conn(0x7efe2c0b8770 0x7efe2c0d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.190+0000 7efe30b9b700 1 -- 172.21.15.72:0/2326663444 >> v2:172.21.15.137:3300/0 conn(0x7efe2c0b8770 msgr2=0x7efe2c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.190+0000 7efe30b9b700 1 --2- 172.21.15.72:0/2326663444 >> v2:172.21.15.137:3300/0 conn(0x7efe2c0b8770 0x7efe2c0d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.190+0000 7efe30b9b700 1 -- 172.21.15.72:0/2326663444 >> v1:172.21.15.137:6789/0 conn(0x7efe2c0cda40 legacy=0x7efe2c0b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.190+0000 7efe30b9b700 1 -- 172.21.15.72:0/2326663444 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0d1990 con 0x7efe2c15ce60 2023-08-25T04:46:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.190+0000 7efe30b9b700 1 --2- 172.21.15.72:0/2326663444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe2c15ce60 0x7efe2c0d0df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efe2c08c250 tx=0x7efe20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6f0648344fa9b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.190+0000 7efe2b7fe700 1 -- 172.21.15.72:0/2326663444 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20011830 con 0x7efe2c15ce60 2023-08-25T04:46:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.190+0000 7efe2b7fe700 1 -- 172.21.15.72:0/2326663444 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe20011990 con 0x7efe2c15ce60 2023-08-25T04:46:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.190+0000 7efe2b7fe700 1 -- 172.21.15.72:0/2326663444 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20011d20 con 0x7efe2c15ce60 2023-08-25T04:46:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.191+0000 7efe32dff700 1 -- 172.21.15.72:0/2326663444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe2c15ce60 msgr2=0x7efe2c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.191+0000 7efe32dff700 1 --2- 172.21.15.72:0/2326663444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe2c15ce60 0x7efe2c0d0df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efe2c08c250 tx=0x7efe20009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.191+0000 7efe32dff700 1 -- 172.21.15.72:0/2326663444 shutdown_connections 2023-08-25T04:46:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.191+0000 7efe32dff700 1 --2- 172.21.15.72:0/2326663444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe2c15ce60 0x7efe2c0d0df0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.191+0000 7efe32dff700 1 --2- 172.21.15.72:0/2326663444 >> v2:172.21.15.137:3300/0 conn(0x7efe2c0b8770 0x7efe2c0d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.191+0000 7efe32dff700 1 -- 172.21.15.72:0/2326663444 >> 172.21.15.72:0/2326663444 conn(0x7efe2c071e10 msgr2=0x7efe2c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.191+0000 7efe32dff700 1 -- 172.21.15.72:0/2326663444 shutdown_connections 2023-08-25T04:46:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.191+0000 7efe32dff700 1 -- 172.21.15.72:0/2326663444 wait complete. 2023-08-25T04:46:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.192+0000 7efe32dff700 1 Processor -- start 2023-08-25T04:46:23.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.193+0000 7efe32dff700 1 -- start start 2023-08-25T04:46:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.193+0000 7efe32dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe2c0b8770 0x7efe2c0c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe32dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2c0cda40 0x7efe2c154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:23.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe32dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe2c15ce60 0x7efe2c0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe32dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c153fa0 con 0x7efe2c15ce60 2023-08-25T04:46:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe32dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0c8c10 con 0x7efe2c0cda40 2023-08-25T04:46:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe32dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c153390 con 0x7efe2c0b8770 2023-08-25T04:46:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe2bfff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2c0cda40 0x7efe2c154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:23.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe30b9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe2c0b8770 0x7efe2c0c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe3139c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe2c15ce60 0x7efe2c0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe2bfff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2c0cda40 0x7efe2c154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:37394/0 (socket says 172.21.15.72:37394) 2023-08-25T04:46:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe2bfff700 1 -- 172.21.15.72:0/2048244986 learned_addr learned my addr 172.21.15.72:0/2048244986 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe30b9b700 1 -- 172.21.15.72:0/2048244986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2c0cda40 msgr2=0x7efe2c154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:23.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe30b9b700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2c0cda40 0x7efe2c154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe30b9b700 1 -- 172.21.15.72:0/2048244986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe2c15ce60 msgr2=0x7efe2c0cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe30b9b700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe2c15ce60 0x7efe2c0cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe30b9b700 1 -- 172.21.15.72:0/2048244986 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20009550 con 0x7efe2c0b8770 2023-08-25T04:46:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.194+0000 7efe3139c700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe2c15ce60 0x7efe2c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.195+0000 7efe30b9b700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe2c0b8770 0x7efe2c0c86d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe20016000 tx=0x7efe20004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:23.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.195+0000 7efe297fa700 1 -- 172.21.15.72:0/2048244986 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20004510 con 0x7efe2c0b8770 2023-08-25T04:46:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.195+0000 7efe297fa700 1 -- 172.21.15.72:0/2048244986 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2001e070 con 0x7efe2c0b8770 2023-08-25T04:46:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.195+0000 7efe32dff700 1 -- 172.21.15.72:0/2048244986 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c153670 con 0x7efe2c0b8770 2023-08-25T04:46:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.195+0000 7efe297fa700 1 -- 172.21.15.72:0/2048244986 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe200038e0 con 0x7efe2c0b8770 2023-08-25T04:46:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.195+0000 7efe32dff700 1 -- 172.21.15.72:0/2048244986 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c153c30 con 0x7efe2c0b8770 2023-08-25T04:46:23.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.196+0000 7efe32dff700 1 -- 172.21.15.72:0/2048244986 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c154280 con 0x7efe2c0b8770 2023-08-25T04:46:23.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.197+0000 7efe297fa700 1 -- 172.21.15.72:0/2048244986 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efe20003a40 con 0x7efe2c0b8770 2023-08-25T04:46:23.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.198+0000 7efe297fa700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efe1006a0e0 0x7efe1006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.198+0000 7efe297fa700 1 -- 172.21.15.72:0/2048244986 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efe200895e0 con 0x7efe2c0b8770 2023-08-25T04:46:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.199+0000 7efe2bfff700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efe1006a0e0 0x7efe1006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.199+0000 7efe2bfff700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efe1006a0e0 0x7efe1006c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe2c15f6f0 tx=0x7efe18009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:23.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.203+0000 7efe297fa700 1 -- 172.21.15.72:0/2048244986 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efe20054990 con 0x7efe2c0b8770 2023-08-25T04:46:23.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.442+0000 7efe32dff700 1 -- 172.21.15.72:0/2048244986 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efe2c04e620 con 0x7efe2c0b8770 2023-08-25T04:46:23.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.443+0000 7efe297fa700 1 -- 172.21.15.72:0/2048244986 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7efe20057fb0 con 0x7efe2c0b8770 2023-08-25T04:46:23.444 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-25T04:46:23.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.445+0000 7efe32dff700 1 -- 172.21.15.72:0/2048244986 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efe1006a0e0 msgr2=0x7efe1006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.445+0000 7efe32dff700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efe1006a0e0 0x7efe1006c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe2c15f6f0 tx=0x7efe18009210 comp rx=0 tx=0).stop 2023-08-25T04:46:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.445+0000 7efe32dff700 1 -- 172.21.15.72:0/2048244986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe2c0b8770 msgr2=0x7efe2c0c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.445+0000 7efe32dff700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe2c0b8770 0x7efe2c0c86d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe20016000 tx=0x7efe20004750 comp rx=0 tx=0).stop 2023-08-25T04:46:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.445+0000 7efe32dff700 1 -- 172.21.15.72:0/2048244986 shutdown_connections 2023-08-25T04:46:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.445+0000 7efe32dff700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efe1006a0e0 0x7efe1006c5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.445+0000 7efe32dff700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe2c15ce60 0x7efe2c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.445+0000 7efe32dff700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe2c0b8770 0x7efe2c0c86d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.445+0000 7efe32dff700 1 --2- 172.21.15.72:0/2048244986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe2c0cda40 0x7efe2c154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.445+0000 7efe32dff700 1 -- 172.21.15.72:0/2048244986 >> 172.21.15.72:0/2048244986 conn(0x7efe2c071e10 msgr2=0x7efe2c15c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.446+0000 7efe32dff700 1 -- 172.21.15.72:0/2048244986 shutdown_connections 2023-08-25T04:46:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:23.446+0000 7efe32dff700 1 -- 172.21.15.72:0/2048244986 wait complete. 2023-08-25T04:46:23.464 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:46:23.464 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:46:23.464 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2023-08-25T04:46:23.465 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-25T04:46:23.465 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-25T04:46:23.465 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:46:23.466 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:46:23.466 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:46:23.466 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-25T04:46:23.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:23.467 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2023-08-25T04:46:23.515 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:46:23.515 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:46:23.515 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:46:23.516 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:23.516 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2023-08-25T04:46:23.516 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:23.516 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:23.516 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:23.516 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2023-08-25T04:46:23.516 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:23.517 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:23.517 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2023-08-25T04:46:23.517 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:46:23.517 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:23.517 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:46:23.517 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:23.517 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-25T04:46:23.518 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42143sec preferred_lft 42143sec 2023-08-25T04:46:23.518 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2023-08-25T04:46:23.518 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:23.518 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:46:23.518 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 8a:eb:fd:d7:6d:31 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:46:23.518 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:46:23.518 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:23.519 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::5ce1:aaff:fed7:eba1/64 scope link 2023-08-25T04:46:23.519 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:23.519 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:46:23.519 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 8a:eb:fd:d7:6d:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-25T04:46:23.519 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::88eb:fdff:fed7:6d31/64 scope link tentative 2023-08-25T04:46:23.520 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:23.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:23.521 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:46:23.589 INFO:teuthology.orchestra.run.smithi137.stdout:1 2023-08-25T04:46:23.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:23.592 DEBUG:teuthology.orchestra.run.smithi137:> route 2023-08-25T04:46:23.641 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2023-08-25T04:46:23.641 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:46:23.641 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T04:46:23.642 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T04:46:23.642 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:46:23.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:23.643 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2023-08-25T04:46:23.644 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2023-08-25T04:46:23.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T04:46:23.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T04:46:23.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T04:46:23.645 DEBUG:teuthology.orchestra.run.smithi137:> ') 2023-08-25T04:46:23.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:23.814 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2023-08-25T04:46:23.860 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-25T04:46:23.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:23.862 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2023-08-25T04:46:23.907 INFO:teuthology.orchestra.run.smithi137.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-25T04:46:23.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:23.909 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2023-08-25T04:46:23.909 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2023-08-25T04:46:23.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-25T04:46:23.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-25T04:46:23.910 DEBUG:teuthology.orchestra.run.smithi137:> ') 2023-08-25T04:46:24.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:24.052 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-25T04:46:24.122 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:46:24.123 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:46:24.123 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:46:24.123 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:24.123 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2023-08-25T04:46:24.123 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:24.123 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:46:24.124 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 76:01:bd:19:00:9b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:46:24.124 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:46:24.124 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:24.124 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::7401:bdff:fe19:9b/64 scope link 2023-08-25T04:46:24.124 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:24.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:24.126 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-25T04:46:24.198 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:46:24.198 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:46:24.199 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:46:24.199 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:24.199 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2023-08-25T04:46:24.199 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:24.199 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:46:24.200 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 76:01:bd:19:00:9b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:46:24.200 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:46:24.201 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:24.201 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::7401:bdff:fe19:9b/64 scope link 2023-08-25T04:46:24.201 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:46:24.203 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-25T04:46:24.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:24.204 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2023-08-25T04:46:24.204 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2023-08-25T04:46:24.205 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-25T04:46:24.205 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-25T04:46:24.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-25T04:46:24.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-25T04:46:24.207 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-25T04:46:24.207 DEBUG:teuthology.orchestra.run.smithi137:> ') 2023-08-25T04:46:24.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:24.460 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec bash -c ' 2023-08-25T04:46:24.461 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2023-08-25T04:46:24.461 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.1 up 2023-08-25T04:46:24.461 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.1 master ceph-brx 2023-08-25T04:46:24.462 DEBUG:teuthology.orchestra.run.smithi137:> ') 2023-08-25T04:46:24.635 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-08-25T04:46:24.635 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:46:24.635 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-25T04:46:24.682 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-25T04:46:24.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:46:24.682 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-25T04:46:24.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2023-08-25T04:46:24.878 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:46:24.879 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:46:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:46:24.949 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:46:24.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:24.951 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2023-08-25T04:46:24.999 INFO:teuthology.orchestra.run.smithi137.stdout:43 2023-08-25T04:46:24.999 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-08-25T04:46:25.000 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-08-25T04:46:25.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2023-08-25T04:46:25.076 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:46:25.077 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:46:25.147 INFO:teuthology.orchestra.run.smithi137.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:46:25.149 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:46:25.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:25.150 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2023-08-25T04:46:25.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi137.stderr:2023-08-25T04:46:25.172+0000 7f49c498a5c0 -1 init, newargv = 0x55bc3baba210 newargc=15 2023-08-25T04:46:25.173 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi137.stderr:ceph-fuse[122270]: starting ceph client 2023-08-25T04:46:25.182 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi137.stderr:ceph-fuse[122270]: starting fuse 2023-08-25T04:46:25.201 INFO:teuthology.orchestra.run.smithi137.stdout:43 2023-08-25T04:46:25.201 INFO:teuthology.orchestra.run.smithi137.stdout:45 2023-08-25T04:46:25.201 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 45] 2023-08-25T04:46:25.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2023-08-25T04:46:25.202 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2023-08-25T04:46:25.202 DEBUG:teuthology.orchestra.run.smithi137:> import re 2023-08-25T04:46:25.202 DEBUG:teuthology.orchestra.run.smithi137:> import os 2023-08-25T04:46:25.203 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2023-08-25T04:46:25.203 DEBUG:teuthology.orchestra.run.smithi137:> 2023-08-25T04:46:25.203 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2023-08-25T04:46:25.203 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-08-25T04:46:25.204 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2023-08-25T04:46:25.204 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-08-25T04:46:25.204 DEBUG:teuthology.orchestra.run.smithi137:> 2023-08-25T04:46:25.204 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2023-08-25T04:46:25.205 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2023-08-25T04:46:25.205 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2023-08-25T04:46:25.205 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2023-08-25T04:46:25.205 DEBUG:teuthology.orchestra.run.smithi137:> 2023-08-25T04:46:25.205 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2023-08-25T04:46:25.206 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-25T04:46:25.206 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-25T04:46:25.206 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-25T04:46:25.206 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2023-08-25T04:46:25.207 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2023-08-25T04:46:25.207 DEBUG:teuthology.orchestra.run.smithi137:> return f 2023-08-25T04:46:25.207 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-25T04:46:25.207 DEBUG:teuthology.orchestra.run.smithi137:> 2023-08-25T04:46:25.207 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.3")) 2023-08-25T04:46:25.208 DEBUG:teuthology.orchestra.run.smithi137:> ' 2023-08-25T04:46:25.381 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.3.122270.asok 2023-08-25T04:46:25.385 INFO:teuthology.orchestra.run.smithi137.stderr:2023-08-25T04:46:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-25T04:46:25.394 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.122270.asok 2023-08-25T04:46:25.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:25.395 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.122270.asok status 2023-08-25T04:46:25.623 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2023-08-25T04:46:25.624 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2023-08-25T04:46:25.624 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "ba6b39e4f4f77fb95c747099b53db0467d435f56", 2023-08-25T04:46:25.624 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev)", 2023-08-25T04:46:25.624 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "3", 2023-08-25T04:46:25.624 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2023-08-25T04:46:25.624 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-08-25T04:46:25.624 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "122270", 2023-08-25T04:46:25.625 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2023-08-25T04:46:25.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2023-08-25T04:46:25.625 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2023-08-25T04:46:25.625 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2023-08-25T04:46:25.625 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4882, 2023-08-25T04:46:25.625 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2023-08-25T04:46:25.625 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2023-08-25T04:46:25.625 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2023-08-25T04:46:25.626 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 4882 2023-08-25T04:46:25.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2023-08-25T04:46:25.626 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2023-08-25T04:46:25.626 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2023-08-25T04:46:25.626 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.2:0", 2023-08-25T04:46:25.627 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 3828066051 2023-08-25T04:46:25.627 INFO:teuthology.orchestra.run.smithi137.stdout: } 2023-08-25T04:46:25.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2023-08-25T04:46:25.627 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2023-08-25T04:46:25.627 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2023-08-25T04:46:25.627 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "192.168.0.2:0", 2023-08-25T04:46:25.628 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 3828066051 2023-08-25T04:46:25.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2023-08-25T04:46:25.628 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.4882 192.168.0.2:0/3828066051", 2023-08-25T04:46:25.628 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "192.168.0.2:0/3828066051", 2023-08-25T04:46:25.628 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2023-08-25T04:46:25.628 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 9, 2023-08-25T04:46:25.628 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 27, 2023-08-25T04:46:25.629 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2023-08-25T04:46:25.629 INFO:teuthology.orchestra.run.smithi137.stdout: "blocklisted": false, 2023-08-25T04:46:25.629 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2023-08-25T04:46:25.629 INFO:teuthology.orchestra.run.smithi137.stdout:} 2023-08-25T04:46:25.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:25.638 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-08-25T04:46:25.639 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-25T04:46:25.692 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-08-25T04:46:25.692 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-25T04:46:25.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:25.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:46:25.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:25.766 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-08-25T04:46:25.766 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.2 2023-08-25T04:46:25.814 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-08-25T04:46:25.815 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-08-25T04:46:25.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:25.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-25T04:46:25.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:25.927 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2023-08-25T04:46:25.927 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.1 2023-08-25T04:46:25.975 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2023-08-25T04:46:25.976 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-08-25T04:46:25.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:25.976 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-25T04:46:26.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:26.047 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2023-08-25T04:46:26.047 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.3 2023-08-25T04:46:26.094 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2023-08-25T04:46:26.094 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-08-25T04:46:26.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:26.095 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-25T04:46:26.203 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-25T04:46:26.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:26.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.458+0000 7f0aab7ff700 1 Processor -- start 2023-08-25T04:46:26.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.458+0000 7f0aab7ff700 1 -- start start 2023-08-25T04:46:26.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aab7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa4159b90 0x7f0aa40b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aab7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0aa40b0ab0 0x7f0aa40cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aab7ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0aa40ce1f0 0x7f0aa40c3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aab7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa40c48f0 con 0x7f0aa40b0ab0 2023-08-25T04:46:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aab7ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa40c5470 con 0x7f0aa40ce1f0 2023-08-25T04:46:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aab7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa4159f70 con 0x7f0aa4159b90 2023-08-25T04:46:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aa8d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0aa40b0ab0 0x7f0aa40cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aa8d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0aa40b0ab0 0x7f0aa40cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43558/0 (socket says 172.21.15.72:43558) 2023-08-25T04:46:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aa8d9a700 1 -- 172.21.15.72:0/237137190 learned_addr learned my addr 172.21.15.72:0/237137190 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aa959b700 1 --2- 172.21.15.72:0/237137190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa4159b90 0x7f0aa40b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aa9d9c700 1 --2- 172.21.15.72:0/237137190 >> v2:172.21.15.137:3300/0 conn(0x7f0aa40ce1f0 0x7f0aa40c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aa8d9a700 1 -- 172.21.15.72:0/237137190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa4159b90 msgr2=0x7f0aa40b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aa8d9a700 1 --2- 172.21.15.72:0/237137190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa4159b90 0x7f0aa40b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aa8d9a700 1 -- 172.21.15.72:0/237137190 >> v2:172.21.15.137:3300/0 conn(0x7f0aa40ce1f0 msgr2=0x7f0aa40c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aa8d9a700 1 --2- 172.21.15.72:0/237137190 >> v2:172.21.15.137:3300/0 conn(0x7f0aa40ce1f0 0x7f0aa40c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.460+0000 7f0aa8d9a700 1 -- 172.21.15.72:0/237137190 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa40c4b40 con 0x7f0aa40b0ab0 2023-08-25T04:46:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.461+0000 7f0aa959b700 1 --2- 172.21.15.72:0/237137190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa4159b90 0x7f0aa40b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.461+0000 7f0aa8d9a700 1 --2- 172.21.15.72:0/237137190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa40b0ab0 0x7f0aa40cdcb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0aa406e750 tx=0x7f0a94009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d6add4d505595f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.461+0000 7f0a9bfff700 1 -- 172.21.15.72:0/237137190 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94011830 con 0x7f0aa40b0ab0 2023-08-25T04:46:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.461+0000 7f0a9bfff700 1 -- 172.21.15.72:0/237137190 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a94011990 con 0x7f0aa40b0ab0 2023-08-25T04:46:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.461+0000 7f0a9bfff700 1 -- 172.21.15.72:0/237137190 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94011d20 con 0x7f0aa40b0ab0 2023-08-25T04:46:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.461+0000 7f0aab7ff700 1 -- 172.21.15.72:0/237137190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa40b0ab0 msgr2=0x7f0aa40cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.461+0000 7f0aab7ff700 1 --2- 172.21.15.72:0/237137190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa40b0ab0 0x7f0aa40cdcb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0aa406e750 tx=0x7f0a94009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.462+0000 7f0aab7ff700 1 -- 172.21.15.72:0/237137190 shutdown_connections 2023-08-25T04:46:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.462+0000 7f0aab7ff700 1 --2- 172.21.15.72:0/237137190 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa4159b90 0x7f0aa40b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.462+0000 7f0aab7ff700 1 --2- 172.21.15.72:0/237137190 >> v2:172.21.15.137:3300/0 conn(0x7f0aa40ce1f0 0x7f0aa40c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.462+0000 7f0aab7ff700 1 --2- 172.21.15.72:0/237137190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa40b0ab0 0x7f0aa40cdcb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.462+0000 7f0aab7ff700 1 -- 172.21.15.72:0/237137190 >> 172.21.15.72:0/237137190 conn(0x7f0aa40ce990 msgr2=0x7f0aa40ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.462+0000 7f0aab7ff700 1 -- 172.21.15.72:0/237137190 shutdown_connections 2023-08-25T04:46:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.462+0000 7f0aab7ff700 1 -- 172.21.15.72:0/237137190 wait complete. 2023-08-25T04:46:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.463+0000 7f0aab7ff700 1 Processor -- start 2023-08-25T04:46:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.464+0000 7f0aab7ff700 1 -- start start 2023-08-25T04:46:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.464+0000 7f0aab7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa40b0ab0 0x7f0aa415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aab7ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa40ce1f0 0x7f0aa40c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aab7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa4159b90 0x7f0aa41f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aab7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa415b190 con 0x7f0aa4159b90 2023-08-25T04:46:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aab7ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa413bfd0 con 0x7f0aa40ce1f0 2023-08-25T04:46:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aab7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa415b3e0 con 0x7f0aa40b0ab0 2023-08-25T04:46:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa9d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa4159b90 0x7f0aa41f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa9d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa4159b90 0x7f0aa41f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43570/0 (socket says 172.21.15.72:43570) 2023-08-25T04:46:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa9d9c700 1 -- 172.21.15.72:0/2739975037 learned_addr learned my addr 172.21.15.72:0/2739975037 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa8d9a700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa40ce1f0 0x7f0aa40c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa959b700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa40b0ab0 0x7f0aa415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa9d9c700 1 -- 172.21.15.72:0/2739975037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa40b0ab0 msgr2=0x7f0aa415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa9d9c700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa40b0ab0 0x7f0aa415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa9d9c700 1 -- 172.21.15.72:0/2739975037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa40ce1f0 msgr2=0x7f0aa40c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa9d9c700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa40ce1f0 0x7f0aa40c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa9d9c700 1 -- 172.21.15.72:0/2739975037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94009550 con 0x7f0aa4159b90 2023-08-25T04:46:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa959b700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa40b0ab0 0x7f0aa415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.465+0000 7f0aa9d9c700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa4159b90 0x7f0aa41f5710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00eed0 tx=0x7f0a9c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.466+0000 7f0a99ffb700 1 -- 172.21.15.72:0/2739975037 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c010040 con 0x7f0aa4159b90 2023-08-25T04:46:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.466+0000 7f0a99ffb700 1 -- 172.21.15.72:0/2739975037 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c00bd30 con 0x7f0aa4159b90 2023-08-25T04:46:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.466+0000 7f0aab7ff700 1 -- 172.21.15.72:0/2739975037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa415b6c0 con 0x7f0aa4159b90 2023-08-25T04:46:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.466+0000 7f0a99ffb700 1 -- 172.21.15.72:0/2739975037 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00bea0 con 0x7f0aa4159b90 2023-08-25T04:46:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.466+0000 7f0aab7ff700 1 -- 172.21.15.72:0/2739975037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa415bc80 con 0x7f0aa4159b90 2023-08-25T04:46:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.467+0000 7f0aab7ff700 1 -- 172.21.15.72:0/2739975037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa404e620 con 0x7f0aa4159b90 2023-08-25T04:46:26.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.468+0000 7f0a99ffb700 1 -- 172.21.15.72:0/2739975037 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0a9c014620 con 0x7f0aa4159b90 2023-08-25T04:46:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.469+0000 7f0a99ffb700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0a8806a0e0 0x7f0a8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.469+0000 7f0a99ffb700 1 -- 172.21.15.72:0/2739975037 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0a9c088d60 con 0x7f0aa4159b90 2023-08-25T04:46:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.469+0000 7f0aa959b700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0a8806a0e0 0x7f0a8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.470+0000 7f0aa959b700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0a8806a0e0 0x7f0a8806c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000c960 tx=0x7f0aa0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.473+0000 7f0a99ffb700 1 -- 172.21.15.72:0/2739975037 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0a9c054110 con 0x7f0aa4159b90 2023-08-25T04:46:26.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.670+0000 7f0aab7ff700 1 -- 172.21.15.72:0/2739975037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0aa4157b60 con 0x7f0aa4159b90 2023-08-25T04:46:26.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.672+0000 7f0a99ffb700 1 -- 172.21.15.72:0/2739975037 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f0a9c018090 con 0x7f0aa4159b90 2023-08-25T04:46:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:26.674 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:26.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 -- 172.21.15.72:0/2739975037 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0a8806a0e0 msgr2=0x7f0a8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:26.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0a8806a0e0 0x7f0a8806c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000c960 tx=0x7f0aa0008040 comp rx=0 tx=0).stop 2023-08-25T04:46:26.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 -- 172.21.15.72:0/2739975037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa4159b90 msgr2=0x7f0aa41f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:26.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa4159b90 0x7f0aa41f5710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00eed0 tx=0x7f0a9c00b390 comp rx=0 tx=0).stop 2023-08-25T04:46:26.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 -- 172.21.15.72:0/2739975037 shutdown_connections 2023-08-25T04:46:26.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0a8806a0e0 0x7f0a8806c5a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa4159b90 0x7f0aa41f5710 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0aa40b0ab0 0x7f0aa415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 --2- 172.21.15.72:0/2739975037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0aa40ce1f0 0x7f0aa40c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 -- 172.21.15.72:0/2739975037 >> 172.21.15.72:0/2739975037 conn(0x7f0aa40ce990 msgr2=0x7f0aa4158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:26.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 -- 172.21.15.72:0/2739975037 shutdown_connections 2023-08-25T04:46:26.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.674+0000 7f0aab7ff700 1 -- 172.21.15.72:0/2739975037 wait complete. 2023-08-25T04:46:26.694 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:26.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:26.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.894+0000 7fd301dff700 1 Processor -- start 2023-08-25T04:46:26.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.894+0000 7fd301dff700 1 -- start start 2023-08-25T04:46:26.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.895+0000 7fd301dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2fc06c330 0x7fd2fc0cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.895+0000 7fd301dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc0cba40 con 0x7fd2fc0c71b0 2023-08-25T04:46:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.895+0000 7fd301dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc0d04f0 con 0x7fd2fc06b7a0 2023-08-25T04:46:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.895+0000 7fd301dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc0d0210 con 0x7fd2fc06c330 2023-08-25T04:46:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.896+0000 7fd2fbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2fc06c330 0x7fd2fc0cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.896+0000 7fd2fb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd2fc0c71b0 0x7fd2fc0cf9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35630/0 (socket says 172.21.15.72:35630) 2023-08-25T04:46:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.896+0000 7fd2fb7fe700 1 -- 172.21.15.72:0/3460707838 learned_addr learned my addr 172.21.15.72:0/3460707838 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.896+0000 7fd2fbfff700 1 -- 172.21.15.72:0/3460707838 >> v1:172.21.15.137:6789/0 conn(0x7fd2fc06b7a0 legacy=0x7fd2fc06bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.896+0000 7fd2fbfff700 1 -- 172.21.15.72:0/3460707838 >> v1:172.21.15.72:6789/0 conn(0x7fd2fc0c71b0 legacy=0x7fd2fc0cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.896+0000 7fd2fbfff700 1 -- 172.21.15.72:0/3460707838 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc0cb3f0 con 0x7fd2fc06c330 2023-08-25T04:46:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.896+0000 7fd2fa7fc700 1 -- 172.21.15.72:0/3460707838 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699093905 0 0) 0x7fd2fc0cba40 con 0x7fd2fc0c71b0 2023-08-25T04:46:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.896+0000 7fd2fbfff700 1 --2- 172.21.15.72:0/3460707838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 0x7fd2fc0cbed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009d90 tx=0x7fd2f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4a8fd07f29ef2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.897+0000 7fd2fa7fc700 1 -- 172.21.15.72:0/3460707838 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400e070 con 0x7fd2fc06c330 2023-08-25T04:46:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.897+0000 7fd2fa7fc700 1 -- 172.21.15.72:0/3460707838 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f400bb90 con 0x7fd2fc06c330 2023-08-25T04:46:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.897+0000 7fd2fa7fc700 1 -- 172.21.15.72:0/3460707838 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4003a20 con 0x7fd2fc06c330 2023-08-25T04:46:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.897+0000 7fd301dff700 1 -- 172.21.15.72:0/3460707838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 msgr2=0x7fd2fc0cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:26.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.897+0000 7fd301dff700 1 --2- 172.21.15.72:0/3460707838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 0x7fd2fc0cbed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009d90 tx=0x7fd2f400b330 comp rx=0 tx=0).stop 2023-08-25T04:46:26.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.897+0000 7fd301dff700 1 -- 172.21.15.72:0/3460707838 shutdown_connections 2023-08-25T04:46:26.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.897+0000 7fd301dff700 1 --2- 172.21.15.72:0/3460707838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 0x7fd2fc0cbed0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.897+0000 7fd301dff700 1 -- 172.21.15.72:0/3460707838 >> 172.21.15.72:0/3460707838 conn(0x7fd2fc0d0c70 msgr2=0x7fd2fc0d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:26.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.897+0000 7fd301dff700 1 -- 172.21.15.72:0/3460707838 shutdown_connections 2023-08-25T04:46:26.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.897+0000 7fd301dff700 1 -- 172.21.15.72:0/3460707838 wait complete. 2023-08-25T04:46:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.899+0000 7fd301dff700 1 Processor -- start 2023-08-25T04:46:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.899+0000 7fd301dff700 1 -- start start 2023-08-25T04:46:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.900+0000 7fd301dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2fc06b7a0 0x7fd2fc1f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.900+0000 7fd301dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 0x7fd2fc0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.900+0000 7fd301dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2fc0c71b0 0x7fd2fc15b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.900+0000 7fd301dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0b6ad0 con 0x7fd2fc06c330 2023-08-25T04:46:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.900+0000 7fd301dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0c8ac0 con 0x7fd2fc0c71b0 2023-08-25T04:46:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.900+0000 7fd301dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc15a580 con 0x7fd2fc06b7a0 2023-08-25T04:46:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.900+0000 7fd2faffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 0x7fd2fc0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.900+0000 7fd2faffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 0x7fd2fc0c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43598/0 (socket says 172.21.15.72:43598) 2023-08-25T04:46:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.900+0000 7fd2faffd700 1 -- 172.21.15.72:0/3576912332 learned_addr learned my addr 172.21.15.72:0/3576912332 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2fb7fe700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2fc06b7a0 0x7fd2fc1f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2fbfff700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2fc0c71b0 0x7fd2fc15b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2faffd700 1 -- 172.21.15.72:0/3576912332 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2fc06b7a0 msgr2=0x7fd2fc1f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:26.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2faffd700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2fc06b7a0 0x7fd2fc1f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2faffd700 1 -- 172.21.15.72:0/3576912332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2fc0c71b0 msgr2=0x7fd2fc15b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:26.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2faffd700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2fc0c71b0 0x7fd2fc15b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:26.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2faffd700 1 -- 172.21.15.72:0/3576912332 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4009a70 con 0x7fd2fc06c330 2023-08-25T04:46:26.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2fbfff700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2fc0c71b0 0x7fd2fc15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:26.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2faffd700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 0x7fd2fc0c7d40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000c4d0 tx=0x7fd2f000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:26.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2e3fff700 1 -- 172.21.15.72:0/3576912332 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0011790 con 0x7fd2fc06c330 2023-08-25T04:46:26.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2e3fff700 1 -- 172.21.15.72:0/3576912332 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f00118f0 con 0x7fd2fc06c330 2023-08-25T04:46:26.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd2e3fff700 1 -- 172.21.15.72:0/3576912332 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0011ca0 con 0x7fd2fc06c330 2023-08-25T04:46:26.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.901+0000 7fd301dff700 1 -- 172.21.15.72:0/3576912332 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc15a860 con 0x7fd2fc06c330 2023-08-25T04:46:26.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.902+0000 7fd301dff700 1 -- 172.21.15.72:0/3576912332 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc0c8750 con 0x7fd2fc06c330 2023-08-25T04:46:26.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.903+0000 7fd301dff700 1 -- 172.21.15.72:0/3576912332 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc15ad80 con 0x7fd2fc06c330 2023-08-25T04:46:26.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.903+0000 7fd2e3fff700 1 -- 172.21.15.72:0/3576912332 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd2f001c460 con 0x7fd2fc06c330 2023-08-25T04:46:26.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.905+0000 7fd2e3fff700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2e806a0e0 0x7fd2e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:26.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.905+0000 7fd2e3fff700 1 -- 172.21.15.72:0/3576912332 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd2f0088790 con 0x7fd2fc06c330 2023-08-25T04:46:26.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.905+0000 7fd2fb7fe700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2e806a0e0 0x7fd2e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:26.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.906+0000 7fd2fb7fe700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2e806a0e0 0x7fd2e806c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec000f60 tx=0x7fd2ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:26.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:26.909+0000 7fd2e3fff700 1 -- 172.21.15.72:0/3576912332 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd2fc15ad80 con 0x7fd2fc06c330 2023-08-25T04:46:27.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.112+0000 7fd301dff700 1 -- 172.21.15.72:0/3576912332 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd2fc15ad80 con 0x7fd2fc06c330 2023-08-25T04:46:27.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.112+0000 7fd2e3fff700 1 -- 172.21.15.72:0/3576912332 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2fc15ad80 con 0x7fd2fc06c330 2023-08-25T04:46:27.114 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:27.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 -- 172.21.15.72:0/3576912332 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2e806a0e0 msgr2=0x7fd2e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2e806a0e0 0x7fd2e806c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec000f60 tx=0x7fd2ec009040 comp rx=0 tx=0).stop 2023-08-25T04:46:27.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 -- 172.21.15.72:0/3576912332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 msgr2=0x7fd2fc0c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 0x7fd2fc0c7d40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000c4d0 tx=0x7fd2f000c890 comp rx=0 tx=0).stop 2023-08-25T04:46:27.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 -- 172.21.15.72:0/3576912332 shutdown_connections 2023-08-25T04:46:27.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2e806a0e0 0x7fd2e806c5a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2fc0c71b0 0x7fd2fc15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2fc06b7a0 0x7fd2fc1f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 --2- 172.21.15.72:0/3576912332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2fc06c330 0x7fd2fc0c7d40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 -- 172.21.15.72:0/3576912332 >> 172.21.15.72:0/3576912332 conn(0x7fd2fc0d0c70 msgr2=0x7fd2fc0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:27.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 -- 172.21.15.72:0/3576912332 shutdown_connections 2023-08-25T04:46:27.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.115+0000 7fd301dff700 1 -- 172.21.15.72:0/3576912332 wait complete. 2023-08-25T04:46:27.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.332+0000 7f8ff5fff700 1 Processor -- start 2023-08-25T04:46:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.333+0000 7f8ff5fff700 1 -- start start 2023-08-25T04:46:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.334+0000 7f8ff5fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ff00b2810 0x7f8ff00b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.334+0000 7f8ff5fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff00b4300 con 0x7f8ff00add40 2023-08-25T04:46:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.334+0000 7f8ff5fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff00b3260 con 0x7f8ff00cb650 2023-08-25T04:46:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.334+0000 7f8ff5fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff00b3540 con 0x7f8ff00b2810 2023-08-25T04:46:27.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.334+0000 7f8feffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8ff00add40 0x7f8ff00ae190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35644/0 (socket says 172.21.15.72:35644) 2023-08-25T04:46:27.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.334+0000 7f8feffff700 1 -- 172.21.15.72:0/3911129763 learned_addr learned my addr 172.21.15.72:0/3911129763 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:27.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.334+0000 7f8fe7fff700 1 --2- 172.21.15.72:0/3911129763 >> v2:172.21.15.72:3300/0 conn(0x7f8ff00b2810 0x7f8ff00b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.334+0000 7f8feeffd700 1 -- 172.21.15.72:0/3911129763 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786279798 0 0) 0x7f8ff00b4300 con 0x7f8ff00add40 2023-08-25T04:46:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.334+0000 7f8feeffd700 1 -- 172.21.15.72:0/3911129763 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fdc0035b0 con 0x7f8ff00add40 2023-08-25T04:46:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.335+0000 7f8fe7fff700 1 -- 172.21.15.72:0/3911129763 >> v1:172.21.15.137:6789/0 conn(0x7f8ff00cb650 legacy=0x7f8ff00cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.335+0000 7f8fe7fff700 1 -- 172.21.15.72:0/3911129763 >> v1:172.21.15.72:6789/0 conn(0x7f8ff00add40 legacy=0x7f8ff00ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.335+0000 7f8fe7fff700 1 -- 172.21.15.72:0/3911129763 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00b3820 con 0x7f8ff00b2810 2023-08-25T04:46:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.335+0000 7f8fe7fff700 1 --2- 172.21.15.72:0/3911129763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 0x7f8ff00b2c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009840 tx=0x7f8fd8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0896e8b3b4dc70a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.335+0000 7f8feeffd700 1 -- 172.21.15.72:0/3911129763 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8011830 con 0x7f8ff00b2810 2023-08-25T04:46:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.335+0000 7f8feeffd700 1 -- 172.21.15.72:0/3911129763 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd8011990 con 0x7f8ff00b2810 2023-08-25T04:46:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.335+0000 7f8feeffd700 1 -- 172.21.15.72:0/3911129763 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8011d20 con 0x7f8ff00b2810 2023-08-25T04:46:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.335+0000 7f8ff5fff700 1 -- 172.21.15.72:0/3911129763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 msgr2=0x7f8ff00b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.335+0000 7f8ff5fff700 1 --2- 172.21.15.72:0/3911129763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 0x7f8ff00b2c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009840 tx=0x7f8fd8009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.336+0000 7f8ff5fff700 1 -- 172.21.15.72:0/3911129763 shutdown_connections 2023-08-25T04:46:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.336+0000 7f8ff5fff700 1 --2- 172.21.15.72:0/3911129763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 0x7f8ff00b2c70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.336+0000 7f8ff5fff700 1 -- 172.21.15.72:0/3911129763 >> 172.21.15.72:0/3911129763 conn(0x7f8ff006a710 msgr2=0x7f8ff006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.336+0000 7f8ff5fff700 1 -- 172.21.15.72:0/3911129763 shutdown_connections 2023-08-25T04:46:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.336+0000 7f8ff5fff700 1 -- 172.21.15.72:0/3911129763 wait complete. 2023-08-25T04:46:27.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.337+0000 7f8ff5fff700 1 Processor -- start 2023-08-25T04:46:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.338+0000 7f8ff5fff700 1 -- start start 2023-08-25T04:46:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.338+0000 7f8ff5fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff00add40 0x7f8ff01f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.338+0000 7f8ff5fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 0x7f8ff00cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.338+0000 7f8ff5fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff00cb650 0x7f8ff0153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.338+0000 7f8ff5fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff01f0820 con 0x7f8ff00b2810 2023-08-25T04:46:27.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.338+0000 7f8ff5fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff015b500 con 0x7f8ff00add40 2023-08-25T04:46:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.338+0000 7f8ff5fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff015b220 con 0x7f8ff00cb650 2023-08-25T04:46:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8fe7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 0x7f8ff00cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8fe7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 0x7f8ff00cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43616/0 (socket says 172.21.15.72:43616) 2023-08-25T04:46:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8fe7fff700 1 -- 172.21.15.72:0/1397872448 learned_addr learned my addr 172.21.15.72:0/1397872448 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8fef7fe700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff00add40 0x7f8ff01f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8feffff700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff00cb650 0x7f8ff0153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8fe7fff700 1 -- 172.21.15.72:0/1397872448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff00cb650 msgr2=0x7f8ff0153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8fe7fff700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff00cb650 0x7f8ff0153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8fe7fff700 1 -- 172.21.15.72:0/1397872448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff00add40 msgr2=0x7f8ff01f0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8fe7fff700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff00add40 0x7f8ff01f0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8fe7fff700 1 -- 172.21.15.72:0/1397872448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80094a0 con 0x7f8ff00b2810 2023-08-25T04:46:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.339+0000 7f8fe7fff700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 0x7f8ff00cc7c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009fd0 tx=0x7f8fd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:27.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.340+0000 7f8fecff9700 1 -- 172.21.15.72:0/1397872448 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80038a0 con 0x7f8ff00b2810 2023-08-25T04:46:27.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.340+0000 7f8fecff9700 1 -- 172.21.15.72:0/1397872448 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd801f070 con 0x7f8ff00b2810 2023-08-25T04:46:27.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.340+0000 7f8ff5fff700 1 -- 172.21.15.72:0/1397872448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff01f01d0 con 0x7f8ff00b2810 2023-08-25T04:46:27.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.340+0000 7f8fecff9700 1 -- 172.21.15.72:0/1397872448 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8003c40 con 0x7f8ff00b2810 2023-08-25T04:46:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.340+0000 7f8ff5fff700 1 -- 172.21.15.72:0/1397872448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff015aeb0 con 0x7f8ff00b2810 2023-08-25T04:46:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.341+0000 7f8ff5fff700 1 -- 172.21.15.72:0/1397872448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff0072320 con 0x7f8ff00b2810 2023-08-25T04:46:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.342+0000 7f8fecff9700 1 -- 172.21.15.72:0/1397872448 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8fd8026480 con 0x7f8ff00b2810 2023-08-25T04:46:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.343+0000 7f8fecff9700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8fd006a0e0 0x7f8fd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.343+0000 7f8fecff9700 1 -- 172.21.15.72:0/1397872448 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8fd8021070 con 0x7f8ff00b2810 2023-08-25T04:46:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.343+0000 7f8fef7fe700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8fd006a0e0 0x7f8fd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.343+0000 7f8fef7fe700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8fd006a0e0 0x7f8fd006c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0000f60 tx=0x7f8fe0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.347+0000 7f8fecff9700 1 -- 172.21.15.72:0/1397872448 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8fd8055620 con 0x7f8ff00b2810 2023-08-25T04:46:27.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.546+0000 7f8ff5fff700 1 -- 172.21.15.72:0/1397872448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ff00744f0 con 0x7f8ff00b2810 2023-08-25T04:46:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.547+0000 7f8fecff9700 1 -- 172.21.15.72:0/1397872448 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fd80150a0 con 0x7f8ff00b2810 2023-08-25T04:46:27.548 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:27.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 -- 172.21.15.72:0/1397872448 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8fd006a0e0 msgr2=0x7f8fd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8fd006a0e0 0x7f8fd006c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0000f60 tx=0x7f8fe0009040 comp rx=0 tx=0).stop 2023-08-25T04:46:27.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 -- 172.21.15.72:0/1397872448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 msgr2=0x7f8ff00cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 0x7f8ff00cc7c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009fd0 tx=0x7f8fd8004750 comp rx=0 tx=0).stop 2023-08-25T04:46:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 -- 172.21.15.72:0/1397872448 shutdown_connections 2023-08-25T04:46:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8fd006a0e0 0x7f8fd006c5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ff00cb650 0x7f8ff0153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ff00add40 0x7f8ff01f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 --2- 172.21.15.72:0/1397872448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00b2810 0x7f8ff00cc7c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 -- 172.21.15.72:0/1397872448 >> 172.21.15.72:0/1397872448 conn(0x7f8ff006a710 msgr2=0x7f8ff006aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.549+0000 7f8ff5fff700 1 -- 172.21.15.72:0/1397872448 shutdown_connections 2023-08-25T04:46:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.550+0000 7f8ff5fff700 1 -- 172.21.15.72:0/1397872448 wait complete. 2023-08-25T04:46:27.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:27.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.768+0000 7fd39d9ff700 1 Processor -- start 2023-08-25T04:46:27.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.769+0000 7fd39d9ff700 1 -- start start 2023-08-25T04:46:27.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.770+0000 7fd39d9ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd39815d120 0x7fd3980cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.770+0000 7fd39d9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3980b5f10 con 0x7fd3980b8700 2023-08-25T04:46:27.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.770+0000 7fd39d9ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd398161330 con 0x7fd39815cd40 2023-08-25T04:46:27.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.770+0000 7fd39d9ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd398161610 con 0x7fd39815d120 2023-08-25T04:46:27.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.770+0000 7fd3977fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd3980b8700 0x7fd3980d1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35656/0 (socket says 172.21.15.72:35656) 2023-08-25T04:46:27.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.770+0000 7fd3977fe700 1 -- 172.21.15.72:0/1214268063 learned_addr learned my addr 172.21.15.72:0/1214268063 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:27.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.770+0000 7fd38ffff700 1 --2- 172.21.15.72:0/1214268063 >> v2:172.21.15.137:3300/0 conn(0x7fd39815d120 0x7fd3980cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258851486 0 0) 0x7fd3980b5f10 con 0x7fd3980b8700 2023-08-25T04:46:27.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3840035b0 con 0x7fd3980b8700 2023-08-25T04:46:27.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 431371391 0 0) 0x7fd3840035b0 con 0x7fd3980b8700 2023-08-25T04:46:27.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 >> v2:172.21.15.137:3300/0 conn(0x7fd39815d120 msgr2=0x7fd3980cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:27.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 --2- 172.21.15.72:0/1214268063 >> v2:172.21.15.137:3300/0 conn(0x7fd39815d120 0x7fd3980cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 >> v1:172.21.15.137:6789/0 conn(0x7fd39815cd40 legacy=0x7fd398160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3981618f0 con 0x7fd3980b8700 2023-08-25T04:46:27.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fd3900019f0 con 0x7fd3980b8700 2023-08-25T04:46:27.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 >> v1:172.21.15.72:6789/0 conn(0x7fd3980b8700 legacy=0x7fd3980d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd384003a00 0x7fd384003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd3840048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3840050d0 0x7fd38400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd398161610 con 0x7fd384004400 2023-08-25T04:46:27.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38400c030 con 0x7fd3840050d0 2023-08-25T04:46:27.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38400c1f0 con 0x7fd384003a00 2023-08-25T04:46:27.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd38ffff700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd3840048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd3977fe700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3840050d0 0x7fd38400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.771+0000 7fd396ffd700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd384003a00 0x7fd384003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd38ffff700 1 -- 172.21.15.72:0/1214268063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd384003a00 msgr2=0x7fd384003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:27.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd38ffff700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd384003a00 0x7fd384003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd38ffff700 1 -- 172.21.15.72:0/1214268063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3840050d0 msgr2=0x7fd38400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:27.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd38ffff700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3840050d0 0x7fd38400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd38ffff700 1 -- 172.21.15.72:0/1214268063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3840035b0 con 0x7fd384004400 2023-08-25T04:46:27.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd3977fe700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3840050d0 0x7fd38400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:27.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd3977fe700 1 -- 172.21.15.72:0/1214268063 reap_dead start 2023-08-25T04:46:27.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd38ffff700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd3840048d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd380009b30 tx=0x7fd384005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefdc45770d74f13 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:27.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000e6c0 con 0x7fd384004400 2023-08-25T04:46:27.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38000e820 con 0x7fd384004400 2023-08-25T04:46:27.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.772+0000 7fd3967fc700 1 -- 172.21.15.72:0/1214268063 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000eb90 con 0x7fd384004400 2023-08-25T04:46:27.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.773+0000 7fd39d9ff700 1 -- 172.21.15.72:0/1214268063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 msgr2=0x7fd3840048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.773+0000 7fd39d9ff700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd3840048d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd380009b30 tx=0x7fd384005880 comp rx=0 tx=0).stop 2023-08-25T04:46:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.773+0000 7fd39d9ff700 1 -- 172.21.15.72:0/1214268063 shutdown_connections 2023-08-25T04:46:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.773+0000 7fd39d9ff700 1 --2- 172.21.15.72:0/1214268063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd3840048d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.773+0000 7fd39d9ff700 1 -- 172.21.15.72:0/1214268063 >> 172.21.15.72:0/1214268063 conn(0x7fd39806b960 msgr2=0x7fd39806bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.773+0000 7fd39d9ff700 1 -- 172.21.15.72:0/1214268063 shutdown_connections 2023-08-25T04:46:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.773+0000 7fd39d9ff700 1 -- 172.21.15.72:0/1214268063 wait complete. 2023-08-25T04:46:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.775+0000 7fd39d9ff700 1 Processor -- start 2023-08-25T04:46:27.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.775+0000 7fd39d9ff700 1 -- start start 2023-08-25T04:46:27.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd39d9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd39814ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd39d9ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd39815f040 0x7fd3980c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd39d9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd39815f4c0 0x7fd3980c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd39d9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39815ffe0 con 0x7fd384004400 2023-08-25T04:46:27.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd39d9ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c67d0 con 0x7fd39815f040 2023-08-25T04:46:27.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd39d9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39814b0d0 con 0x7fd39815f4c0 2023-08-25T04:46:27.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd396ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd39814ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd396ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd39814ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43630/0 (socket says 172.21.15.72:43630) 2023-08-25T04:46:27.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd396ffd700 1 -- 172.21.15.72:0/3522247014 learned_addr learned my addr 172.21.15.72:0/3522247014 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:27.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd3977fe700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd39815f4c0 0x7fd3980c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd38ffff700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd39815f040 0x7fd3980c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd396ffd700 1 -- 172.21.15.72:0/3522247014 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd39815f4c0 msgr2=0x7fd3980c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd396ffd700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd39815f4c0 0x7fd3980c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd396ffd700 1 -- 172.21.15.72:0/3522247014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd39815f040 msgr2=0x7fd3980c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd396ffd700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd39815f040 0x7fd3980c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd396ffd700 1 -- 172.21.15.72:0/3522247014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980cb380 con 0x7fd384004400 2023-08-25T04:46:27.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd38ffff700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd39815f040 0x7fd3980c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:27.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.776+0000 7fd396ffd700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd39814ab90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd38800e810 tx=0x7fd38800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:27.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.777+0000 7fd394ff9700 1 -- 172.21.15.72:0/3522247014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880052e0 con 0x7fd384004400 2023-08-25T04:46:27.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.777+0000 7fd394ff9700 1 -- 172.21.15.72:0/3522247014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd388005460 con 0x7fd384004400 2023-08-25T04:46:27.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.777+0000 7fd39d9ff700 1 -- 172.21.15.72:0/3522247014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39815fa20 con 0x7fd384004400 2023-08-25T04:46:27.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.777+0000 7fd394ff9700 1 -- 172.21.15.72:0/3522247014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388006aa0 con 0x7fd384004400 2023-08-25T04:46:27.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.777+0000 7fd39d9ff700 1 -- 172.21.15.72:0/3522247014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3980cb620 con 0x7fd384004400 2023-08-25T04:46:27.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.778+0000 7fd39d9ff700 1 -- 172.21.15.72:0/3522247014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd398161330 con 0x7fd384004400 2023-08-25T04:46:27.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.779+0000 7fd394ff9700 1 -- 172.21.15.72:0/3522247014 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd388006c00 con 0x7fd384004400 2023-08-25T04:46:27.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.780+0000 7fd394ff9700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd37806a0e0 0x7fd37806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:27.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.780+0000 7fd394ff9700 1 -- 172.21.15.72:0/3522247014 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd388088090 con 0x7fd384004400 2023-08-25T04:46:27.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.780+0000 7fd38ffff700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd37806a0e0 0x7fd37806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:27.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.781+0000 7fd38ffff700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd37806a0e0 0x7fd37806c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3981605e0 tx=0x7fd38001e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:27.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.785+0000 7fd394ff9700 1 -- 172.21.15.72:0/3522247014 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd388053460 con 0x7fd384004400 2023-08-25T04:46:27.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.982+0000 7fd39d9ff700 1 -- 172.21.15.72:0/3522247014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3980d10c0 con 0x7fd384004400 2023-08-25T04:46:27.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.982+0000 7fd394ff9700 1 -- 172.21.15.72:0/3522247014 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd388056a80 con 0x7fd384004400 2023-08-25T04:46:27.984 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:27.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 -- 172.21.15.72:0/3522247014 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd37806a0e0 msgr2=0x7fd37806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd37806a0e0 0x7fd37806c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3981605e0 tx=0x7fd38001e040 comp rx=0 tx=0).stop 2023-08-25T04:46:27.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 -- 172.21.15.72:0/3522247014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 msgr2=0x7fd39814ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:27.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd39814ab90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd38800e810 tx=0x7fd38800ebd0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 -- 172.21.15.72:0/3522247014 shutdown_connections 2023-08-25T04:46:27.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd37806a0e0 0x7fd37806c5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd39815f4c0 0x7fd3980c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd384004400 0x7fd39814ab90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 --2- 172.21.15.72:0/3522247014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd39815f040 0x7fd3980c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 -- 172.21.15.72:0/3522247014 >> 172.21.15.72:0/3522247014 conn(0x7fd39806b960 msgr2=0x7fd3980b60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:27.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 -- 172.21.15.72:0/3522247014 shutdown_connections 2023-08-25T04:46:27.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:27.985+0000 7fd39d9ff700 1 -- 172.21.15.72:0/3522247014 wait complete. 2023-08-25T04:46:28.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:28.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.201+0000 7f4867fff700 1 Processor -- start 2023-08-25T04:46:28.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.202+0000 7f4867fff700 1 -- start start 2023-08-25T04:46:28.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.203+0000 7f4867fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48600b2810 0x7f48600b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.203+0000 7f4867fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600add40 0x7f48600ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.203+0000 7f4867fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48600b4300 con 0x7f48600cb650 2023-08-25T04:46:28.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.203+0000 7f4867fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600b3260 con 0x7f48600b2810 2023-08-25T04:46:28.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.203+0000 7f4867fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600b3540 con 0x7f48600add40 2023-08-25T04:46:28.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.203+0000 7f486659c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600add40 0x7f48600ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.203+0000 7f486559a700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48600b2810 0x7f48600b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.203+0000 7f486659c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600add40 0x7f48600ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:57962/0 (socket says 172.21.15.72:57962) 2023-08-25T04:46:28.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.203+0000 7f486659c700 1 -- 172.21.15.72:0/3479704270 learned_addr learned my addr 172.21.15.72:0/3479704270 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:28.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.204+0000 7f486659c700 1 -- 172.21.15.72:0/3479704270 >> v2:172.21.15.137:3300/0 conn(0x7f48600b2810 msgr2=0x7f48600b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:28.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.204+0000 7f486659c700 1 --2- 172.21.15.72:0/3479704270 >> v2:172.21.15.137:3300/0 conn(0x7f48600b2810 0x7f48600b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.204+0000 7f486659c700 1 -- 172.21.15.72:0/3479704270 >> v1:172.21.15.137:6789/0 conn(0x7f48600cb650 legacy=0x7f48600cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.204+0000 7f486659c700 1 -- 172.21.15.72:0/3479704270 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600b3820 con 0x7f48600add40 2023-08-25T04:46:28.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.204+0000 7f486559a700 1 --2- 172.21.15.72:0/3479704270 >> v2:172.21.15.137:3300/0 conn(0x7f48600b2810 0x7f48600b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:28.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.204+0000 7f486659c700 1 --2- 172.21.15.72:0/3479704270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600add40 0x7f48600ae1d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4858009e50 tx=0x7f485800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd74ce2389429049 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:28.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4864d99700 1 -- 172.21.15.72:0/3479704270 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800e070 con 0x7f48600add40 2023-08-25T04:46:28.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4864d99700 1 -- 172.21.15.72:0/3479704270 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485800b910 con 0x7f48600add40 2023-08-25T04:46:28.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4864d99700 1 -- 172.21.15.72:0/3479704270 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800bcc0 con 0x7f48600add40 2023-08-25T04:46:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4867fff700 1 -- 172.21.15.72:0/3479704270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600add40 msgr2=0x7f48600ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4867fff700 1 --2- 172.21.15.72:0/3479704270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600add40 0x7f48600ae1d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4858009e50 tx=0x7f485800b330 comp rx=0 tx=0).stop 2023-08-25T04:46:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4867fff700 1 -- 172.21.15.72:0/3479704270 shutdown_connections 2023-08-25T04:46:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4867fff700 1 --2- 172.21.15.72:0/3479704270 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600add40 0x7f48600ae1d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4867fff700 1 --2- 172.21.15.72:0/3479704270 >> v2:172.21.15.137:3300/0 conn(0x7f48600b2810 0x7f48600b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4867fff700 1 -- 172.21.15.72:0/3479704270 >> 172.21.15.72:0/3479704270 conn(0x7f486006a710 msgr2=0x7f486006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:28.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4867fff700 1 -- 172.21.15.72:0/3479704270 shutdown_connections 2023-08-25T04:46:28.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.205+0000 7f4867fff700 1 -- 172.21.15.72:0/3479704270 wait complete. 2023-08-25T04:46:28.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.207+0000 7f4867fff700 1 Processor -- start 2023-08-25T04:46:28.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.207+0000 7f4867fff700 1 -- start start 2023-08-25T04:46:28.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f4867fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48600add40 0x7f4860148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f4867fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48600b2810 0x7f48600c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f4867fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600cb650 0x7f48600af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f4867fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4860148650 con 0x7f48600add40 2023-08-25T04:46:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f4867fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600c7290 con 0x7f48600b2810 2023-08-25T04:46:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f4867fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600c7570 con 0x7f48600cb650 2023-08-25T04:46:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f4865d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48600add40 0x7f4860148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f4865d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48600add40 0x7f4860148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43634/0 (socket says 172.21.15.72:43634) 2023-08-25T04:46:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f4865d9b700 1 -- 172.21.15.72:0/4182697779 learned_addr learned my addr 172.21.15.72:0/4182697779 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f486559a700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48600b2810 0x7f48600c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.208+0000 7f486659c700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600cb650 0x7f48600af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f4865d9b700 1 -- 172.21.15.72:0/4182697779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600cb650 msgr2=0x7f48600af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f4865d9b700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600cb650 0x7f48600af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f4865d9b700 1 -- 172.21.15.72:0/4182697779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48600b2810 msgr2=0x7f48600c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f4865d9b700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48600b2810 0x7f48600c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f4865d9b700 1 -- 172.21.15.72:0/4182697779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500094a0 con 0x7f48600add40 2023-08-25T04:46:28.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f4865d9b700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48600add40 0x7f4860148110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f485c00c450 tx=0x7f485c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:28.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f48567fc700 1 -- 172.21.15.72:0/4182697779 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0052d0 con 0x7f48600add40 2023-08-25T04:46:28.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f48567fc700 1 -- 172.21.15.72:0/4182697779 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c005430 con 0x7f48600add40 2023-08-25T04:46:28.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f4867fff700 1 -- 172.21.15.72:0/4182697779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4858009b30 con 0x7f48600add40 2023-08-25T04:46:28.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f48567fc700 1 -- 172.21.15.72:0/4182697779 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0038c0 con 0x7f48600add40 2023-08-25T04:46:28.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.209+0000 7f4867fff700 1 -- 172.21.15.72:0/4182697779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48600c7b30 con 0x7f48600add40 2023-08-25T04:46:28.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.210+0000 7f4867fff700 1 -- 172.21.15.72:0/4182697779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4860072320 con 0x7f48600add40 2023-08-25T04:46:28.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.211+0000 7f48567fc700 1 -- 172.21.15.72:0/4182697779 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f485c003a20 con 0x7f48600add40 2023-08-25T04:46:28.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.212+0000 7f48567fc700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f484406a0e0 0x7f484406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.212+0000 7f48567fc700 1 -- 172.21.15.72:0/4182697779 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f485c087c80 con 0x7f48600add40 2023-08-25T04:46:28.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.212+0000 7f486559a700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f484406a0e0 0x7f484406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.213+0000 7f486559a700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f484406a0e0 0x7f484406c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4860159750 tx=0x7f4850009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:28.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.217+0000 7f48567fc700 1 -- 172.21.15.72:0/4182697779 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f485c052f10 con 0x7f48600add40 2023-08-25T04:46:28.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.413+0000 7f4867fff700 1 -- 172.21.15.72:0/4182697779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48600b0ae0 con 0x7f48600add40 2023-08-25T04:46:28.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.414+0000 7f48567fc700 1 -- 172.21.15.72:0/4182697779 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f485c017020 con 0x7f48600add40 2023-08-25T04:46:28.415 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:28.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 -- 172.21.15.72:0/4182697779 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f484406a0e0 msgr2=0x7f484406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f484406a0e0 0x7f484406c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4860159750 tx=0x7f4850009210 comp rx=0 tx=0).stop 2023-08-25T04:46:28.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 -- 172.21.15.72:0/4182697779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48600add40 msgr2=0x7f4860148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48600add40 0x7f4860148110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f485c00c450 tx=0x7f485c00c760 comp rx=0 tx=0).stop 2023-08-25T04:46:28.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 -- 172.21.15.72:0/4182697779 shutdown_connections 2023-08-25T04:46:28.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f484406a0e0 0x7f484406c5a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f48600cb650 0x7f48600af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48600add40 0x7f4860148110 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 --2- 172.21.15.72:0/4182697779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48600b2810 0x7f48600c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 -- 172.21.15.72:0/4182697779 >> 172.21.15.72:0/4182697779 conn(0x7f486006a710 msgr2=0x7f48600c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:28.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 -- 172.21.15.72:0/4182697779 shutdown_connections 2023-08-25T04:46:28.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.416+0000 7f4867fff700 1 -- 172.21.15.72:0/4182697779 wait complete. 2023-08-25T04:46:28.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:28.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.633+0000 7f40135ff700 1 Processor -- start 2023-08-25T04:46:28.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.633+0000 7f40135ff700 1 -- start start 2023-08-25T04:46:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.634+0000 7f40135ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f400c0ade30 0x7f400c0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.634+0000 7f40135ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f400c15da20 0x7f400c070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.634+0000 7f40135ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400c0ca020 con 0x7f400c070ed0 2023-08-25T04:46:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.634+0000 7f40135ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c071360 con 0x7f400c15da20 2023-08-25T04:46:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.634+0000 7f40135ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0ae750 con 0x7f400c0ade30 2023-08-25T04:46:28.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.635+0000 7f4010b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f400c15da20 0x7f400c070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.635+0000 7f4010b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f400c15da20 0x7f400c070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43648/0 (socket says 172.21.15.72:43648) 2023-08-25T04:46:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.635+0000 7f4010b9a700 1 -- 172.21.15.72:0/1988521125 learned_addr learned my addr 172.21.15.72:0/1988521125 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.635+0000 7f401139b700 1 --2- 172.21.15.72:0/1988521125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f400c0ade30 0x7f400c0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.635+0000 7f4010b9a700 1 -- 172.21.15.72:0/1988521125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f400c0ade30 msgr2=0x7f400c0ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:28.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.635+0000 7f4010b9a700 1 --2- 172.21.15.72:0/1988521125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f400c0ade30 0x7f400c0ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.635+0000 7f4010b9a700 1 -- 172.21.15.72:0/1988521125 >> v1:172.21.15.137:6789/0 conn(0x7f400c070ed0 legacy=0x7f400c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.635+0000 7f4010b9a700 1 -- 172.21.15.72:0/1988521125 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c0ae9d0 con 0x7f400c15da20 2023-08-25T04:46:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.635+0000 7f4010b9a700 1 --2- 172.21.15.72:0/1988521125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 0x7f400c070990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0098f0 tx=0x7f3ffc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143bc954f14f07fa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f4003fff700 1 -- 172.21.15.72:0/1988521125 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc00b8a0 con 0x7f400c15da20 2023-08-25T04:46:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f4003fff700 1 -- 172.21.15.72:0/1988521125 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc00ba00 con 0x7f400c15da20 2023-08-25T04:46:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f4003fff700 1 -- 172.21.15.72:0/1988521125 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc00bd90 con 0x7f400c15da20 2023-08-25T04:46:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f40135ff700 1 -- 172.21.15.72:0/1988521125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 msgr2=0x7f400c070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f40135ff700 1 --2- 172.21.15.72:0/1988521125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 0x7f400c070990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0098f0 tx=0x7f3ffc009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f40135ff700 1 -- 172.21.15.72:0/1988521125 shutdown_connections 2023-08-25T04:46:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f40135ff700 1 --2- 172.21.15.72:0/1988521125 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f400c0ade30 0x7f400c0ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f40135ff700 1 --2- 172.21.15.72:0/1988521125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 0x7f400c070990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f40135ff700 1 -- 172.21.15.72:0/1988521125 >> 172.21.15.72:0/1988521125 conn(0x7f400c06a710 msgr2=0x7f400c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f40135ff700 1 -- 172.21.15.72:0/1988521125 shutdown_connections 2023-08-25T04:46:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.636+0000 7f40135ff700 1 -- 172.21.15.72:0/1988521125 wait complete. 2023-08-25T04:46:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.638+0000 7f40135ff700 1 Processor -- start 2023-08-25T04:46:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.638+0000 7f40135ff700 1 -- start start 2023-08-25T04:46:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f40135ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f400c070ed0 0x7f400c0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f40135ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400c0ade30 0x7f400c159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f40135ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 0x7f400c150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f40135ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c159a50 con 0x7f400c15da20 2023-08-25T04:46:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f40135ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c164190 con 0x7f400c0ade30 2023-08-25T04:46:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f40135ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c159540 con 0x7f400c070ed0 2023-08-25T04:46:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f4011b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 0x7f400c150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f4011b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 0x7f400c150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43652/0 (socket says 172.21.15.72:43652) 2023-08-25T04:46:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f4011b9c700 1 -- 172.21.15.72:0/76442684 learned_addr learned my addr 172.21.15.72:0/76442684 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f401139b700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f400c070ed0 0x7f400c0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.639+0000 7f4010b9a700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400c0ade30 0x7f400c159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f4011b9c700 1 -- 172.21.15.72:0/76442684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f400c070ed0 msgr2=0x7f400c0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f4011b9c700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f400c070ed0 0x7f400c0b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f4011b9c700 1 -- 172.21.15.72:0/76442684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400c0ade30 msgr2=0x7f400c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f4011b9c700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400c0ade30 0x7f400c159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f4011b9c700 1 -- 172.21.15.72:0/76442684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc009550 con 0x7f400c15da20 2023-08-25T04:46:28.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f4010b9a700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400c0ade30 0x7f400c159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:28.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f4011b9c700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 0x7f400c150120 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f400400cc80 tx=0x7f400400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:28.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f4001ffb700 1 -- 172.21.15.72:0/76442684 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004003c00 con 0x7f400c15da20 2023-08-25T04:46:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f4001ffb700 1 -- 172.21.15.72:0/76442684 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004003d60 con 0x7f400c15da20 2023-08-25T04:46:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f4001ffb700 1 -- 172.21.15.72:0/76442684 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400ab50 con 0x7f400c15da20 2023-08-25T04:46:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f40135ff700 1 -- 172.21.15.72:0/76442684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400c0ad2a0 con 0x7f400c15da20 2023-08-25T04:46:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.640+0000 7f40135ff700 1 -- 172.21.15.72:0/76442684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c0ac7c0 con 0x7f400c15da20 2023-08-25T04:46:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.641+0000 7f40135ff700 1 -- 172.21.15.72:0/76442684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400c072320 con 0x7f400c15da20 2023-08-25T04:46:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.642+0000 7f4001ffb700 1 -- 172.21.15.72:0/76442684 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f400400acb0 con 0x7f400c15da20 2023-08-25T04:46:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.643+0000 7f4001ffb700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3ff006a0e0 0x7f3ff006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.643+0000 7f4001ffb700 1 -- 172.21.15.72:0/76442684 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4004088990 con 0x7f400c15da20 2023-08-25T04:46:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.643+0000 7f401139b700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3ff006a0e0 0x7f3ff006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.644+0000 7f401139b700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3ff006a0e0 0x7f3ff006c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40080099d0 tx=0x7f4008008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.647+0000 7f4001ffb700 1 -- 172.21.15.72:0/76442684 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4004053cb0 con 0x7f400c15da20 2023-08-25T04:46:28.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.845+0000 7f40135ff700 1 -- 172.21.15.72:0/76442684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f400c163f70 con 0x7f400c15da20 2023-08-25T04:46:28.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.846+0000 7f4001ffb700 1 -- 172.21.15.72:0/76442684 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f40040572d0 con 0x7f400c15da20 2023-08-25T04:46:28.847 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:28.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.848+0000 7f40135ff700 1 -- 172.21.15.72:0/76442684 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3ff006a0e0 msgr2=0x7f3ff006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.848+0000 7f40135ff700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3ff006a0e0 0x7f3ff006c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40080099d0 tx=0x7f4008008040 comp rx=0 tx=0).stop 2023-08-25T04:46:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.848+0000 7f40135ff700 1 -- 172.21.15.72:0/76442684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 msgr2=0x7f400c150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.848+0000 7f40135ff700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 0x7f400c150120 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f400400cc80 tx=0x7f400400cf90 comp rx=0 tx=0).stop 2023-08-25T04:46:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.848+0000 7f40135ff700 1 -- 172.21.15.72:0/76442684 shutdown_connections 2023-08-25T04:46:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.848+0000 7f40135ff700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3ff006a0e0 0x7f3ff006c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.848+0000 7f40135ff700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400c15da20 0x7f400c150120 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.848+0000 7f40135ff700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f400c070ed0 0x7f400c0b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.848+0000 7f40135ff700 1 --2- 172.21.15.72:0/76442684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400c0ade30 0x7f400c159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.848+0000 7f40135ff700 1 -- 172.21.15.72:0/76442684 >> 172.21.15.72:0/76442684 conn(0x7f400c06a710 msgr2=0x7f400c06aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.849+0000 7f40135ff700 1 -- 172.21.15.72:0/76442684 shutdown_connections 2023-08-25T04:46:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:28.849+0000 7f40135ff700 1 -- 172.21.15.72:0/76442684 wait complete. 2023-08-25T04:46:28.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:29.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.064+0000 7f0b691ff700 1 Processor -- start 2023-08-25T04:46:29.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.064+0000 7f0b691ff700 1 -- start start 2023-08-25T04:46:29.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.065+0000 7f0b691ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0b640cf970 0x7f0b640cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.065+0000 7f0b691ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b640cbd60 0x7f0b640cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.065+0000 7f0b691ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b640cb2a0 con 0x7f0b6415d240 2023-08-25T04:46:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.065+0000 7f0b691ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640cfe80 con 0x7f0b640cbd60 2023-08-25T04:46:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.065+0000 7f0b691ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640d0160 con 0x7f0b640cf970 2023-08-25T04:46:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.065+0000 7f0b62d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0b6415d240 0x7f0b640cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35672/0 (socket says 172.21.15.72:35672) 2023-08-25T04:46:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.065+0000 7f0b62d9d700 1 -- 172.21.15.72:0/1355994676 learned_addr learned my addr 172.21.15.72:0/1355994676 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.065+0000 7f0b6359e700 1 --2- 172.21.15.72:0/1355994676 >> v2:172.21.15.72:3300/0 conn(0x7f0b640cbd60 0x7f0b640cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.065+0000 7f0b6259c700 1 --2- 172.21.15.72:0/1355994676 >> v2:172.21.15.137:3300/0 conn(0x7f0b640cf970 0x7f0b640cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.066+0000 7f0b61d9b700 1 -- 172.21.15.72:0/1355994676 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912828054 0 0) 0x7f0b640cb2a0 con 0x7f0b6415d240 2023-08-25T04:46:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.066+0000 7f0b61d9b700 1 -- 172.21.15.72:0/1355994676 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b4c0035b0 con 0x7f0b6415d240 2023-08-25T04:46:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.066+0000 7f0b6359e700 1 -- 172.21.15.72:0/1355994676 >> v2:172.21.15.137:3300/0 conn(0x7f0b640cf970 msgr2=0x7f0b640cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.066+0000 7f0b6359e700 1 --2- 172.21.15.72:0/1355994676 >> v2:172.21.15.137:3300/0 conn(0x7f0b640cf970 0x7f0b640cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.066+0000 7f0b6359e700 1 -- 172.21.15.72:0/1355994676 >> v1:172.21.15.72:6789/0 conn(0x7f0b6415d240 legacy=0x7f0b640cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.066+0000 7f0b6359e700 1 -- 172.21.15.72:0/1355994676 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640cb560 con 0x7f0b640cbd60 2023-08-25T04:46:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.066+0000 7f0b6359e700 1 --2- 172.21.15.72:0/1355994676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 0x7f0b640cc1f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0b6409eb60 tx=0x7f0b5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab126df3e19a6133 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:29.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.066+0000 7f0b61d9b700 1 -- 172.21.15.72:0/1355994676 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c00e070 con 0x7f0b640cbd60 2023-08-25T04:46:29.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.066+0000 7f0b61d9b700 1 -- 172.21.15.72:0/1355994676 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c00bb20 con 0x7f0b640cbd60 2023-08-25T04:46:29.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.066+0000 7f0b61d9b700 1 -- 172.21.15.72:0/1355994676 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c012430 con 0x7f0b640cbd60 2023-08-25T04:46:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.067+0000 7f0b691ff700 1 -- 172.21.15.72:0/1355994676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 msgr2=0x7f0b640cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.067+0000 7f0b691ff700 1 --2- 172.21.15.72:0/1355994676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 0x7f0b640cc1f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0b6409eb60 tx=0x7f0b5c00b330 comp rx=0 tx=0).stop 2023-08-25T04:46:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.067+0000 7f0b691ff700 1 -- 172.21.15.72:0/1355994676 shutdown_connections 2023-08-25T04:46:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.067+0000 7f0b691ff700 1 --2- 172.21.15.72:0/1355994676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 0x7f0b640cc1f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.067+0000 7f0b691ff700 1 --2- 172.21.15.72:0/1355994676 >> v2:172.21.15.137:3300/0 conn(0x7f0b640cf970 0x7f0b640cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.067+0000 7f0b691ff700 1 -- 172.21.15.72:0/1355994676 >> 172.21.15.72:0/1355994676 conn(0x7f0b640d0c50 msgr2=0x7f0b640d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.067+0000 7f0b691ff700 1 -- 172.21.15.72:0/1355994676 shutdown_connections 2023-08-25T04:46:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.067+0000 7f0b691ff700 1 -- 172.21.15.72:0/1355994676 wait complete. 2023-08-25T04:46:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.069+0000 7f0b691ff700 1 Processor -- start 2023-08-25T04:46:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.069+0000 7f0b691ff700 1 -- start start 2023-08-25T04:46:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b691ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 0x7f0b640ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b691ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b640cf970 0x7f0b640c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b691ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b6415d240 0x7f0b6406f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b691ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640caa80 con 0x7f0b640cbd60 2023-08-25T04:46:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b691ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640b3ae0 con 0x7f0b640cf970 2023-08-25T04:46:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b691ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640b3dc0 con 0x7f0b6415d240 2023-08-25T04:46:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b62d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 0x7f0b640ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b62d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 0x7f0b640ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43668/0 (socket says 172.21.15.72:43668) 2023-08-25T04:46:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b62d9d700 1 -- 172.21.15.72:0/3264385086 learned_addr learned my addr 172.21.15.72:0/3264385086 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b6259c700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b640cf970 0x7f0b640c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b6359e700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b6415d240 0x7f0b6406f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b62d9d700 1 -- 172.21.15.72:0/3264385086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b6415d240 msgr2=0x7f0b6406f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b62d9d700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b6415d240 0x7f0b6406f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b62d9d700 1 -- 172.21.15.72:0/3264385086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b640cf970 msgr2=0x7f0b640c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b62d9d700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b640cf970 0x7f0b640c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b62d9d700 1 -- 172.21.15.72:0/3264385086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c009a70 con 0x7f0b640cbd60 2023-08-25T04:46:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.070+0000 7f0b6259c700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b640cf970 0x7f0b640c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:29.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.071+0000 7f0b62d9d700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 0x7f0b640ca430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b54001eb0 tx=0x7f0b5400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:29.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.071+0000 7f0b4b7fe700 1 -- 172.21.15.72:0/3264385086 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54005d70 con 0x7f0b640cbd60 2023-08-25T04:46:29.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.071+0000 7f0b4b7fe700 1 -- 172.21.15.72:0/3264385086 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b540070d0 con 0x7f0b640cbd60 2023-08-25T04:46:29.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.071+0000 7f0b4b7fe700 1 -- 172.21.15.72:0/3264385086 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54007460 con 0x7f0b640cbd60 2023-08-25T04:46:29.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.071+0000 7f0b691ff700 1 -- 172.21.15.72:0/3264385086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b640b40a0 con 0x7f0b640cbd60 2023-08-25T04:46:29.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.071+0000 7f0b691ff700 1 -- 172.21.15.72:0/3264385086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b640c83f0 con 0x7f0b640cbd60 2023-08-25T04:46:29.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.072+0000 7f0b691ff700 1 -- 172.21.15.72:0/3264385086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b640b45c0 con 0x7f0b640cbd60 2023-08-25T04:46:29.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.073+0000 7f0b4b7fe700 1 -- 172.21.15.72:0/3264385086 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b540075c0 con 0x7f0b640cbd60 2023-08-25T04:46:29.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.074+0000 7f0b4b7fe700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0b5006a0e0 0x7f0b5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.074+0000 7f0b4b7fe700 1 -- 172.21.15.72:0/3264385086 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0b54087df0 con 0x7f0b640cbd60 2023-08-25T04:46:29.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.074+0000 7f0b6259c700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0b5006a0e0 0x7f0b5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.074+0000 7f0b6259c700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0b5006a0e0 0x7f0b5006c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0b640c75c0 tx=0x7f0b58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:29.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.078+0000 7f0b4b7fe700 1 -- 172.21.15.72:0/3264385086 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0b640b45c0 con 0x7f0b640cbd60 2023-08-25T04:46:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.282+0000 7f0b691ff700 1 -- 172.21.15.72:0/3264385086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b6406ea20 con 0x7f0b640cbd60 2023-08-25T04:46:29.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.283+0000 7f0b4b7fe700 1 -- 172.21.15.72:0/3264385086 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f0b540531b0 con 0x7f0b640cbd60 2023-08-25T04:46:29.285 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:29.285 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:29.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.285+0000 7f0b691ff700 1 -- 172.21.15.72:0/3264385086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0b5006a0e0 msgr2=0x7f0b5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.285+0000 7f0b691ff700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0b5006a0e0 0x7f0b5006c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0b640c75c0 tx=0x7f0b58008040 comp rx=0 tx=0).stop 2023-08-25T04:46:29.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.285+0000 7f0b691ff700 1 -- 172.21.15.72:0/3264385086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 msgr2=0x7f0b640ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.285+0000 7f0b691ff700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 0x7f0b640ca430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b54001eb0 tx=0x7f0b5400c860 comp rx=0 tx=0).stop 2023-08-25T04:46:29.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.285+0000 7f0b691ff700 1 -- 172.21.15.72:0/3264385086 shutdown_connections 2023-08-25T04:46:29.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.285+0000 7f0b691ff700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0b5006a0e0 0x7f0b5006c5a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.285+0000 7f0b691ff700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b6415d240 0x7f0b6406f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.285+0000 7f0b691ff700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b640cbd60 0x7f0b640ca430 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.285+0000 7f0b691ff700 1 --2- 172.21.15.72:0/3264385086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b640cf970 0x7f0b640c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.285+0000 7f0b691ff700 1 -- 172.21.15.72:0/3264385086 >> 172.21.15.72:0/3264385086 conn(0x7f0b640d0c50 msgr2=0x7f0b6415c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:29.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.286+0000 7f0b691ff700 1 -- 172.21.15.72:0/3264385086 shutdown_connections 2023-08-25T04:46:29.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.286+0000 7f0b691ff700 1 -- 172.21.15.72:0/3264385086 wait complete. 2023-08-25T04:46:29.305 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:29.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:29.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.503+0000 7fda61dff700 1 Processor -- start 2023-08-25T04:46:29.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.503+0000 7fda61dff700 1 -- start start 2023-08-25T04:46:29.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda61dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda5c0b4f10 0x7fda5c167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda61dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c0b8d10 con 0x7fda5c0d10c0 2023-08-25T04:46:29.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda61dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c0b6e90 con 0x7fda5c15d000 2023-08-25T04:46:29.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda61dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c0b56f0 con 0x7fda5c0b4f10 2023-08-25T04:46:29.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda53fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda5c0d10c0 0x7fda5c0b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35674/0 (socket says 172.21.15.72:35674) 2023-08-25T04:46:29.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda53fff700 1 -- 172.21.15.72:0/2208319077 learned_addr learned my addr 172.21.15.72:0/2208319077 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:29.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda5bfff700 1 --2- 172.21.15.72:0/2208319077 >> v2:172.21.15.72:3300/0 conn(0x7fda5c0b4f10 0x7fda5c167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda5affd700 1 -- 172.21.15.72:0/2208319077 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603052507 0 0) 0x7fda5c0b8d10 con 0x7fda5c0d10c0 2023-08-25T04:46:29.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda5affd700 1 -- 172.21.15.72:0/2208319077 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda480035b0 con 0x7fda5c0d10c0 2023-08-25T04:46:29.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda5bfff700 1 -- 172.21.15.72:0/2208319077 >> v1:172.21.15.137:6789/0 conn(0x7fda5c15d000 legacy=0x7fda5c0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda5bfff700 1 -- 172.21.15.72:0/2208319077 >> v1:172.21.15.72:6789/0 conn(0x7fda5c0d10c0 legacy=0x7fda5c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.505+0000 7fda5bfff700 1 -- 172.21.15.72:0/2208319077 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c15d3e0 con 0x7fda5c0b4f10 2023-08-25T04:46:29.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.506+0000 7fda5bfff700 1 --2- 172.21.15.72:0/2208319077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 0x7fda5c167be0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda54009d90 tx=0x7fda5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12635be528bf13b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:29.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.506+0000 7fda5affd700 1 -- 172.21.15.72:0/2208319077 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5400e070 con 0x7fda5c0b4f10 2023-08-25T04:46:29.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.506+0000 7fda5affd700 1 -- 172.21.15.72:0/2208319077 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5400bb20 con 0x7fda5c0b4f10 2023-08-25T04:46:29.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.506+0000 7fda5affd700 1 -- 172.21.15.72:0/2208319077 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54012430 con 0x7fda5c0b4f10 2023-08-25T04:46:29.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.506+0000 7fda61dff700 1 -- 172.21.15.72:0/2208319077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 msgr2=0x7fda5c167be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.506+0000 7fda61dff700 1 --2- 172.21.15.72:0/2208319077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 0x7fda5c167be0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda54009d90 tx=0x7fda5400b330 comp rx=0 tx=0).stop 2023-08-25T04:46:29.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.507+0000 7fda61dff700 1 -- 172.21.15.72:0/2208319077 shutdown_connections 2023-08-25T04:46:29.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.507+0000 7fda61dff700 1 --2- 172.21.15.72:0/2208319077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 0x7fda5c167be0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.507+0000 7fda61dff700 1 -- 172.21.15.72:0/2208319077 >> 172.21.15.72:0/2208319077 conn(0x7fda5c071e10 msgr2=0x7fda5c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:29.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.507+0000 7fda61dff700 1 -- 172.21.15.72:0/2208319077 shutdown_connections 2023-08-25T04:46:29.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.507+0000 7fda61dff700 1 -- 172.21.15.72:0/2208319077 wait complete. 2023-08-25T04:46:29.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.508+0000 7fda61dff700 1 Processor -- start 2023-08-25T04:46:29.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.508+0000 7fda61dff700 1 -- start start 2023-08-25T04:46:29.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.509+0000 7fda61dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 0x7fda5c0d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.509+0000 7fda61dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda5c0d10c0 0x7fda5c15f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.509+0000 7fda61dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda5c15d000 0x7fda5c15f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.509+0000 7fda61dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0c6870 con 0x7fda5c0b4f10 2023-08-25T04:46:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.509+0000 7fda61dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0c6ac0 con 0x7fda5c15d000 2023-08-25T04:46:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.509+0000 7fda61dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0c6da0 con 0x7fda5c0d10c0 2023-08-25T04:46:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda5b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 0x7fda5c0d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda5b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 0x7fda5c0d29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43684/0 (socket says 172.21.15.72:43684) 2023-08-25T04:46:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda5b7fe700 1 -- 172.21.15.72:0/2118219559 learned_addr learned my addr 172.21.15.72:0/2118219559 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:29.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda5bfff700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda5c15d000 0x7fda5c15f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda53fff700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda5c0d10c0 0x7fda5c15f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda5b7fe700 1 -- 172.21.15.72:0/2118219559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda5c0d10c0 msgr2=0x7fda5c15f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda5b7fe700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda5c0d10c0 0x7fda5c15f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda5b7fe700 1 -- 172.21.15.72:0/2118219559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda5c15d000 msgr2=0x7fda5c15f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda5b7fe700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda5c15d000 0x7fda5c15f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda5b7fe700 1 -- 172.21.15.72:0/2118219559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda54009a70 con 0x7fda5c0b4f10 2023-08-25T04:46:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda5b7fe700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 0x7fda5c0d29c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00c450 tx=0x7fda4c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.510+0000 7fda58ff9700 1 -- 172.21.15.72:0/2118219559 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0052d0 con 0x7fda5c0b4f10 2023-08-25T04:46:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.511+0000 7fda58ff9700 1 -- 172.21.15.72:0/2118219559 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c005430 con 0x7fda5c0b4f10 2023-08-25T04:46:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.511+0000 7fda58ff9700 1 -- 172.21.15.72:0/2118219559 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0038c0 con 0x7fda5c0b4f10 2023-08-25T04:46:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.511+0000 7fda61dff700 1 -- 172.21.15.72:0/2118219559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c0c7080 con 0x7fda5c0b4f10 2023-08-25T04:46:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.511+0000 7fda61dff700 1 -- 172.21.15.72:0/2118219559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c0c7640 con 0x7fda5c0b4f10 2023-08-25T04:46:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.512+0000 7fda61dff700 1 -- 172.21.15.72:0/2118219559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c0c7800 con 0x7fda5c0b4f10 2023-08-25T04:46:29.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.513+0000 7fda58ff9700 1 -- 172.21.15.72:0/2118219559 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fda4c003a20 con 0x7fda5c0b4f10 2023-08-25T04:46:29.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.514+0000 7fda58ff9700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda3c06a0e0 0x7fda3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.514+0000 7fda58ff9700 1 -- 172.21.15.72:0/2118219559 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fda4c087ac0 con 0x7fda5c0b4f10 2023-08-25T04:46:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.514+0000 7fda53fff700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda3c06a0e0 0x7fda3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.515+0000 7fda53fff700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda3c06a0e0 0x7fda3c06c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0b3ae0 tx=0x7fda44007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.518+0000 7fda58ff9700 1 -- 172.21.15.72:0/2118219559 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fda4c052f10 con 0x7fda5c0b4f10 2023-08-25T04:46:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.715+0000 7fda61dff700 1 -- 172.21.15.72:0/2118219559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda5c06a2f0 con 0x7fda5c0b4f10 2023-08-25T04:46:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.715+0000 7fda58ff9700 1 -- 172.21.15.72:0/2118219559 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda4c00ce60 con 0x7fda5c0b4f10 2023-08-25T04:46:29.720 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 -- 172.21.15.72:0/2118219559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda3c06a0e0 msgr2=0x7fda3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda3c06a0e0 0x7fda3c06c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0b3ae0 tx=0x7fda44007dc0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 -- 172.21.15.72:0/2118219559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 msgr2=0x7fda5c0d29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 0x7fda5c0d29c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00c450 tx=0x7fda4c00c760 comp rx=0 tx=0).stop 2023-08-25T04:46:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 -- 172.21.15.72:0/2118219559 shutdown_connections 2023-08-25T04:46:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda3c06a0e0 0x7fda3c06c5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda5c15d000 0x7fda5c15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5c0b4f10 0x7fda5c0d29c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 --2- 172.21.15.72:0/2118219559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda5c0d10c0 0x7fda5c15f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 -- 172.21.15.72:0/2118219559 >> 172.21.15.72:0/2118219559 conn(0x7fda5c071e10 msgr2=0x7fda5c15af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 -- 172.21.15.72:0/2118219559 shutdown_connections 2023-08-25T04:46:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.718+0000 7fda61dff700 1 -- 172.21.15.72:0/2118219559 wait complete. 2023-08-25T04:46:29.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:29.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.943+0000 7f4baa9ff700 1 Processor -- start 2023-08-25T04:46:29.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.944+0000 7f4baa9ff700 1 -- start start 2023-08-25T04:46:29.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4baa9ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4ba415d090 0x7f4ba40d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4baa9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ba40b8aa0 0x7f4ba40cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4baa9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba40ce4d0 con 0x7f4ba40ce090 2023-08-25T04:46:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4baa9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba415d470 con 0x7f4ba40b8aa0 2023-08-25T04:46:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4baa9ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba40b6ec0 con 0x7f4ba415d090 2023-08-25T04:46:29.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4ba37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ba40b8aa0 0x7f4ba40cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4ba8f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4ba40ce090 0x7f4ba40b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35690/0 (socket says 172.21.15.72:35690) 2023-08-25T04:46:29.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4ba8f9c700 1 -- 172.21.15.72:0/1119175457 learned_addr learned my addr 172.21.15.72:0/1119175457 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:29.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4ba3fff700 1 --2- 172.21.15.72:0/1119175457 >> v2:172.21.15.137:3300/0 conn(0x7f4ba415d090 0x7f4ba40d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4ba2ffd700 1 -- 172.21.15.72:0/1119175457 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642220560 0 0) 0x7f4ba40ce4d0 con 0x7f4ba40ce090 2023-08-25T04:46:29.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4ba37fe700 1 -- 172.21.15.72:0/1119175457 >> v2:172.21.15.137:3300/0 conn(0x7f4ba415d090 msgr2=0x7f4ba40d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:29.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4ba37fe700 1 --2- 172.21.15.72:0/1119175457 >> v2:172.21.15.137:3300/0 conn(0x7f4ba415d090 0x7f4ba40d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4ba37fe700 1 -- 172.21.15.72:0/1119175457 >> v1:172.21.15.72:6789/0 conn(0x7f4ba40ce090 legacy=0x7f4ba40b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.945+0000 7f4ba37fe700 1 -- 172.21.15.72:0/1119175457 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba40d17e0 con 0x7f4ba40b8aa0 2023-08-25T04:46:29.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.946+0000 7f4ba3fff700 1 --2- 172.21.15.72:0/1119175457 >> v2:172.21.15.137:3300/0 conn(0x7f4ba415d090 0x7f4ba40d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:29.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.946+0000 7f4ba37fe700 1 --2- 172.21.15.72:0/1119175457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40b8aa0 0x7f4ba40cdb50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40d0030 tx=0x7f4b98009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2916b7540061a7ba server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.946+0000 7f4ba2ffd700 1 -- 172.21.15.72:0/1119175457 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98011830 con 0x7f4ba40b8aa0 2023-08-25T04:46:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.946+0000 7f4ba2ffd700 1 -- 172.21.15.72:0/1119175457 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98011990 con 0x7f4ba40b8aa0 2023-08-25T04:46:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.946+0000 7f4ba2ffd700 1 -- 172.21.15.72:0/1119175457 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98011d20 con 0x7f4ba40b8aa0 2023-08-25T04:46:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.946+0000 7f4baa9ff700 1 -- 172.21.15.72:0/1119175457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40b8aa0 msgr2=0x7f4ba40cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.946+0000 7f4baa9ff700 1 --2- 172.21.15.72:0/1119175457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40b8aa0 0x7f4ba40cdb50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40d0030 tx=0x7f4b98009b20 comp rx=0 tx=0).stop 2023-08-25T04:46:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.947+0000 7f4baa9ff700 1 -- 172.21.15.72:0/1119175457 shutdown_connections 2023-08-25T04:46:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.947+0000 7f4baa9ff700 1 --2- 172.21.15.72:0/1119175457 >> v2:172.21.15.137:3300/0 conn(0x7f4ba415d090 0x7f4ba40d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.947+0000 7f4baa9ff700 1 --2- 172.21.15.72:0/1119175457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40b8aa0 0x7f4ba40cdb50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.947+0000 7f4baa9ff700 1 -- 172.21.15.72:0/1119175457 >> 172.21.15.72:0/1119175457 conn(0x7f4ba4071e10 msgr2=0x7f4ba4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.947+0000 7f4baa9ff700 1 -- 172.21.15.72:0/1119175457 shutdown_connections 2023-08-25T04:46:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.947+0000 7f4baa9ff700 1 -- 172.21.15.72:0/1119175457 wait complete. 2023-08-25T04:46:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.948+0000 7f4baa9ff700 1 Processor -- start 2023-08-25T04:46:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.948+0000 7f4baa9ff700 1 -- start start 2023-08-25T04:46:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.949+0000 7f4baa9ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba40b8aa0 0x7f4ba4149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.949+0000 7f4baa9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40ce090 0x7f4ba40c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.949+0000 7f4baa9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d090 0x7f4ba4149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.949+0000 7f4baa9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba41497c0 con 0x7f4ba40ce090 2023-08-25T04:46:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.949+0000 7f4baa9ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba40ca920 con 0x7f4ba40b8aa0 2023-08-25T04:46:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.949+0000 7f4baa9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba40cac00 con 0x7f4ba415d090 2023-08-25T04:46:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40ce090 0x7f4ba40c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40ce090 0x7f4ba40c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43696/0 (socket says 172.21.15.72:43696) 2023-08-25T04:46:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba37fe700 1 -- 172.21.15.72:0/2674962812 learned_addr learned my addr 172.21.15.72:0/2674962812 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba3fff700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba40b8aa0 0x7f4ba4149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba8f9c700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d090 0x7f4ba4149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba37fe700 1 -- 172.21.15.72:0/2674962812 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d090 msgr2=0x7f4ba4149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba37fe700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d090 0x7f4ba4149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba37fe700 1 -- 172.21.15.72:0/2674962812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba40b8aa0 msgr2=0x7f4ba4149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba37fe700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba40b8aa0 0x7f4ba4149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba37fe700 1 -- 172.21.15.72:0/2674962812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980094a0 con 0x7f4ba40ce090 2023-08-25T04:46:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba8f9c700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d090 0x7f4ba4149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.950+0000 7f4ba37fe700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40ce090 0x7f4ba40c9fb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4b98014040 tx=0x7f4b98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.951+0000 7f4ba0ff9700 1 -- 172.21.15.72:0/2674962812 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980038a0 con 0x7f4ba40ce090 2023-08-25T04:46:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.951+0000 7f4ba0ff9700 1 -- 172.21.15.72:0/2674962812 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9801e070 con 0x7f4ba40ce090 2023-08-25T04:46:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.951+0000 7f4baa9ff700 1 -- 172.21.15.72:0/2674962812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba40caee0 con 0x7f4ba40ce090 2023-08-25T04:46:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.951+0000 7f4ba0ff9700 1 -- 172.21.15.72:0/2674962812 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98003c20 con 0x7f4ba40ce090 2023-08-25T04:46:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.951+0000 7f4baa9ff700 1 -- 172.21.15.72:0/2674962812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba40cb4a0 con 0x7f4ba40ce090 2023-08-25T04:46:29.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.952+0000 7f4baa9ff700 1 -- 172.21.15.72:0/2674962812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba406a2f0 con 0x7f4ba40ce090 2023-08-25T04:46:29.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.953+0000 7f4ba0ff9700 1 -- 172.21.15.72:0/2674962812 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b9802d450 con 0x7f4ba40ce090 2023-08-25T04:46:29.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.954+0000 7f4ba0ff9700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4b9006a0e0 0x7f4b9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:29.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.954+0000 7f4ba0ff9700 1 -- 172.21.15.72:0/2674962812 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4b980898d0 con 0x7f4ba40ce090 2023-08-25T04:46:29.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.954+0000 7f4ba3fff700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4b9006a0e0 0x7f4b9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:29.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.954+0000 7f4ba3fff700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4b9006a0e0 0x7f4b9006c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ba414ce80 tx=0x7f4b94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:29.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:29.958+0000 7f4ba0ff9700 1 -- 172.21.15.72:0/2674962812 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4b98054d20 con 0x7f4ba40ce090 2023-08-25T04:46:30.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.152+0000 7f4baa9ff700 1 -- 172.21.15.72:0/2674962812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ba408a000 con 0x7f4ba40ce090 2023-08-25T04:46:30.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.153+0000 7f4ba0ff9700 1 -- 172.21.15.72:0/2674962812 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b98058340 con 0x7f4ba40ce090 2023-08-25T04:46:30.154 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 -- 172.21.15.72:0/2674962812 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4b9006a0e0 msgr2=0x7f4b9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4b9006a0e0 0x7f4b9006c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ba414ce80 tx=0x7f4b94008040 comp rx=0 tx=0).stop 2023-08-25T04:46:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 -- 172.21.15.72:0/2674962812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40ce090 msgr2=0x7f4ba40c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40ce090 0x7f4ba40c9fb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4b98014040 tx=0x7f4b98004750 comp rx=0 tx=0).stop 2023-08-25T04:46:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 -- 172.21.15.72:0/2674962812 shutdown_connections 2023-08-25T04:46:30.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4b9006a0e0 0x7f4b9006c5a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ba415d090 0x7f4ba4149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba40b8aa0 0x7f4ba4149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 --2- 172.21.15.72:0/2674962812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ba40ce090 0x7f4ba40c9fb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 -- 172.21.15.72:0/2674962812 >> 172.21.15.72:0/2674962812 conn(0x7f4ba4071e10 msgr2=0x7f4ba40721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:30.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 -- 172.21.15.72:0/2674962812 shutdown_connections 2023-08-25T04:46:30.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.155+0000 7f4baa9ff700 1 -- 172.21.15.72:0/2674962812 wait complete. 2023-08-25T04:46:30.174 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:30.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.372+0000 7f109e3ff700 1 Processor -- start 2023-08-25T04:46:30.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.372+0000 7f109e3ff700 1 -- start start 2023-08-25T04:46:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.373+0000 7f109e3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 0x7f10980b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.373+0000 7f109e3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10980b4300 con 0x7f10980cb650 2023-08-25T04:46:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.373+0000 7f109e3ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10980b3260 con 0x7f10980add40 2023-08-25T04:46:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.373+0000 7f109e3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10980b3540 con 0x7f10980b2810 2023-08-25T04:46:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.373+0000 7f1097fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f10980cb650 0x7f10980cba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35706/0 (socket says 172.21.15.72:35706) 2023-08-25T04:46:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.373+0000 7f1097fff700 1 -- 172.21.15.72:0/3500276941 learned_addr learned my addr 172.21.15.72:0/3500276941 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.374+0000 7f10977fe700 1 --2- 172.21.15.72:0/3500276941 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 0x7f10980b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.374+0000 7f1096ffd700 1 -- 172.21.15.72:0/3500276941 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073710272 0 0) 0x7f10980b4300 con 0x7f10980cb650 2023-08-25T04:46:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.374+0000 7f1096ffd700 1 -- 172.21.15.72:0/3500276941 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10800035b0 con 0x7f10980cb650 2023-08-25T04:46:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.374+0000 7f1096ffd700 1 -- 172.21.15.72:0/3500276941 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150750579 0 0) 0x7f10980b3260 con 0x7f10980add40 2023-08-25T04:46:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.374+0000 7f1096ffd700 1 -- 172.21.15.72:0/3500276941 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10980b4300 con 0x7f10980add40 2023-08-25T04:46:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.374+0000 7f10977fe700 1 -- 172.21.15.72:0/3500276941 >> v1:172.21.15.137:6789/0 conn(0x7f10980add40 legacy=0x7f10980ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.374+0000 7f10977fe700 1 -- 172.21.15.72:0/3500276941 >> v1:172.21.15.72:6789/0 conn(0x7f10980cb650 legacy=0x7f10980cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.374+0000 7f10977fe700 1 -- 172.21.15.72:0/3500276941 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980b3820 con 0x7f10980b2810 2023-08-25T04:46:30.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.374+0000 7f10977fe700 1 --2- 172.21.15.72:0/3500276941 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 0x7f10980b2c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f108c009870 tx=0x7f108c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d0e0d2e36d01167 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:30.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.375+0000 7f1096ffd700 1 -- 172.21.15.72:0/3500276941 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c011830 con 0x7f10980b2810 2023-08-25T04:46:30.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.375+0000 7f1096ffd700 1 -- 172.21.15.72:0/3500276941 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c011990 con 0x7f10980b2810 2023-08-25T04:46:30.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.375+0000 7f1096ffd700 1 -- 172.21.15.72:0/3500276941 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c011d00 con 0x7f10980b2810 2023-08-25T04:46:30.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.375+0000 7f109e3ff700 1 -- 172.21.15.72:0/3500276941 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 msgr2=0x7f10980b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.375+0000 7f109e3ff700 1 --2- 172.21.15.72:0/3500276941 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 0x7f10980b2c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f108c009870 tx=0x7f108c009b80 comp rx=0 tx=0).stop 2023-08-25T04:46:30.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.375+0000 7f109e3ff700 1 -- 172.21.15.72:0/3500276941 shutdown_connections 2023-08-25T04:46:30.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.375+0000 7f109e3ff700 1 --2- 172.21.15.72:0/3500276941 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 0x7f10980b2c70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.375+0000 7f109e3ff700 1 -- 172.21.15.72:0/3500276941 >> 172.21.15.72:0/3500276941 conn(0x7f109806a710 msgr2=0x7f109806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:30.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.376+0000 7f109e3ff700 1 -- 172.21.15.72:0/3500276941 shutdown_connections 2023-08-25T04:46:30.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.376+0000 7f109e3ff700 1 -- 172.21.15.72:0/3500276941 wait complete. 2023-08-25T04:46:30.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.377+0000 7f109e3ff700 1 Processor -- start 2023-08-25T04:46:30.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.377+0000 7f109e3ff700 1 -- start start 2023-08-25T04:46:30.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.378+0000 7f109e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980add40 0x7f10980c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.378+0000 7f109e3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 0x7f10980ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.378+0000 7f109e3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10980cb650 0x7f10981f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.378+0000 7f109e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10980c7020 con 0x7f10980add40 2023-08-25T04:46:30.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.378+0000 7f109e3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10980c6cb0 con 0x7f10980cb650 2023-08-25T04:46:30.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.378+0000 7f109e3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10981f2de0 con 0x7f10980b2810 2023-08-25T04:46:30.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f1097fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980add40 0x7f10980c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f1097fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980add40 0x7f10980c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43704/0 (socket says 172.21.15.72:43704) 2023-08-25T04:46:30.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f1097fff700 1 -- 172.21.15.72:0/472654902 learned_addr learned my addr 172.21.15.72:0/472654902 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:30.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f10977fe700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 0x7f10980ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f109c99c700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10980cb650 0x7f10981f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f1097fff700 1 -- 172.21.15.72:0/472654902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 msgr2=0x7f10980ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f1097fff700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 0x7f10980ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f1097fff700 1 -- 172.21.15.72:0/472654902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10980cb650 msgr2=0x7f10981f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f1097fff700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10980cb650 0x7f10981f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f1097fff700 1 -- 172.21.15.72:0/472654902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c0094a0 con 0x7f10980add40 2023-08-25T04:46:30.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.379+0000 7f1097fff700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980add40 0x7f10980c4f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1088001eb0 tx=0x7f108800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:30.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.380+0000 7f1094ff9700 1 -- 172.21.15.72:0/472654902 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088005d70 con 0x7f10980add40 2023-08-25T04:46:30.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.380+0000 7f1094ff9700 1 -- 172.21.15.72:0/472654902 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10880070d0 con 0x7f10980add40 2023-08-25T04:46:30.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.380+0000 7f109e3ff700 1 -- 172.21.15.72:0/472654902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10981f30c0 con 0x7f10980add40 2023-08-25T04:46:30.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.380+0000 7f1094ff9700 1 -- 172.21.15.72:0/472654902 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088007460 con 0x7f10980add40 2023-08-25T04:46:30.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.380+0000 7f109e3ff700 1 -- 172.21.15.72:0/472654902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10981f33a0 con 0x7f10980add40 2023-08-25T04:46:30.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.381+0000 7f109e3ff700 1 -- 172.21.15.72:0/472654902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1098072320 con 0x7f10980add40 2023-08-25T04:46:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.382+0000 7f1094ff9700 1 -- 172.21.15.72:0/472654902 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f10880075c0 con 0x7f10980add40 2023-08-25T04:46:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.383+0000 7f1094ff9700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108406a0e0 0x7f108406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.383+0000 7f1094ff9700 1 -- 172.21.15.72:0/472654902 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1088087cc0 con 0x7f10980add40 2023-08-25T04:46:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.383+0000 7f10977fe700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108406a0e0 0x7f108406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.384+0000 7f10977fe700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108406a0e0 0x7f108406c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f108c0097c0 tx=0x7f108c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.387+0000 7f1094ff9700 1 -- 172.21.15.72:0/472654902 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f108808e080 con 0x7f10980add40 2023-08-25T04:46:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.583+0000 7f109e3ff700 1 -- 172.21.15.72:0/472654902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10980744f0 con 0x7f10980add40 2023-08-25T04:46:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.583+0000 7f1094ff9700 1 -- 172.21.15.72:0/472654902 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1088053070 con 0x7f10980add40 2023-08-25T04:46:30.585 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:30.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 -- 172.21.15.72:0/472654902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108406a0e0 msgr2=0x7f108406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108406a0e0 0x7f108406c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f108c0097c0 tx=0x7f108c008030 comp rx=0 tx=0).stop 2023-08-25T04:46:30.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 -- 172.21.15.72:0/472654902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980add40 msgr2=0x7f10980c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980add40 0x7f10980c4f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1088001eb0 tx=0x7f108800c7b0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 -- 172.21.15.72:0/472654902 shutdown_connections 2023-08-25T04:46:30.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f108406a0e0 0x7f108406c5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10980cb650 0x7f10981f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980add40 0x7f10980c4f20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 --2- 172.21.15.72:0/472654902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10980b2810 0x7f10980ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 -- 172.21.15.72:0/472654902 >> 172.21.15.72:0/472654902 conn(0x7f109806a710 msgr2=0x7f1098070890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:30.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 -- 172.21.15.72:0/472654902 shutdown_connections 2023-08-25T04:46:30.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.586+0000 7f109e3ff700 1 -- 172.21.15.72:0/472654902 wait complete. 2023-08-25T04:46:30.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:30.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.809+0000 7f1896bff700 1 Processor -- start 2023-08-25T04:46:30.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.809+0000 7f1896bff700 1 -- start start 2023-08-25T04:46:30.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.810+0000 7f1896bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18900cb650 0x7f18900cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f1896bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18900b2810 0x7f18900b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f1896bff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1890070990 0x7f1890070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f1896bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900b4300 con 0x7f18900cb650 2023-08-25T04:46:30.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f1896bff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900cbf70 con 0x7f1890070990 2023-08-25T04:46:30.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f1896bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18900b3260 con 0x7f18900b2810 2023-08-25T04:46:30.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f189499b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18900cb650 0x7f18900cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f189499b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18900cb650 0x7f18900cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43706/0 (socket says 172.21.15.72:43706) 2023-08-25T04:46:30.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f189499b700 1 -- 172.21.15.72:0/3592387892 learned_addr learned my addr 172.21.15.72:0/3592387892 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:30.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f189519c700 1 --2- 172.21.15.72:0/3592387892 >> v2:172.21.15.137:3300/0 conn(0x7f1890070990 0x7f1890070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f188ffff700 1 --2- 172.21.15.72:0/3592387892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18900b2810 0x7f18900b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f189499b700 1 -- 172.21.15.72:0/3592387892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18900b2810 msgr2=0x7f18900b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:30.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f189499b700 1 --2- 172.21.15.72:0/3592387892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18900b2810 0x7f18900b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f189499b700 1 -- 172.21.15.72:0/3592387892 >> v2:172.21.15.137:3300/0 conn(0x7f1890070990 msgr2=0x7f1890070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:30.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f189499b700 1 --2- 172.21.15.72:0/3592387892 >> v2:172.21.15.137:3300/0 conn(0x7f1890070990 0x7f1890070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f189499b700 1 -- 172.21.15.72:0/3592387892 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900b3540 con 0x7f18900cb650 2023-08-25T04:46:30.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.811+0000 7f189519c700 1 --2- 172.21.15.72:0/3592387892 >> v2:172.21.15.137:3300/0 conn(0x7f1890070990 0x7f1890070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:30.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f189499b700 1 --2- 172.21.15.72:0/3592387892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900cb650 0x7f18900cba30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f189006cb60 tx=0x7f1884009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f6a2883677313e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:30.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f188f7fe700 1 -- 172.21.15.72:0/3592387892 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188400b870 con 0x7f18900cb650 2023-08-25T04:46:30.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f188f7fe700 1 -- 172.21.15.72:0/3592387892 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188400b9d0 con 0x7f18900cb650 2023-08-25T04:46:30.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f188f7fe700 1 -- 172.21.15.72:0/3592387892 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188400bd60 con 0x7f18900cb650 2023-08-25T04:46:30.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f1896bff700 1 -- 172.21.15.72:0/3592387892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900cb650 msgr2=0x7f18900cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f1896bff700 1 --2- 172.21.15.72:0/3592387892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900cb650 0x7f18900cba30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f189006cb60 tx=0x7f1884009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f1896bff700 1 -- 172.21.15.72:0/3592387892 shutdown_connections 2023-08-25T04:46:30.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f1896bff700 1 --2- 172.21.15.72:0/3592387892 >> v2:172.21.15.137:3300/0 conn(0x7f1890070990 0x7f1890070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f1896bff700 1 --2- 172.21.15.72:0/3592387892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900cb650 0x7f18900cba30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f1896bff700 1 --2- 172.21.15.72:0/3592387892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f18900b2810 0x7f18900b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.812+0000 7f1896bff700 1 -- 172.21.15.72:0/3592387892 >> 172.21.15.72:0/3592387892 conn(0x7f189006a710 msgr2=0x7f189006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:30.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.813+0000 7f1896bff700 1 -- 172.21.15.72:0/3592387892 shutdown_connections 2023-08-25T04:46:30.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.813+0000 7f1896bff700 1 -- 172.21.15.72:0/3592387892 wait complete. 2023-08-25T04:46:30.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.814+0000 7f1896bff700 1 Processor -- start 2023-08-25T04:46:30.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.814+0000 7f1896bff700 1 -- start start 2023-08-25T04:46:30.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.815+0000 7f1896bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1890070990 0x7f189015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.815+0000 7f1896bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900b2810 0x7f18901f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.815+0000 7f1896bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18900cb650 0x7f1890158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.815+0000 7f1896bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18901f3a30 con 0x7f18900b2810 2023-08-25T04:46:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.815+0000 7f1896bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18901f3cd0 con 0x7f18900cb650 2023-08-25T04:46:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.815+0000 7f1896bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18901f0c00 con 0x7f1890070990 2023-08-25T04:46:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900b2810 0x7f18901f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900b2810 0x7f18901f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43712/0 (socket says 172.21.15.72:43712) 2023-08-25T04:46:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188ffff700 1 -- 172.21.15.72:0/2829052583 learned_addr learned my addr 172.21.15.72:0/2829052583 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f189519c700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18900cb650 0x7f1890158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f189499b700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1890070990 0x7f189015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188ffff700 1 -- 172.21.15.72:0/2829052583 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1890070990 msgr2=0x7f189015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188ffff700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1890070990 0x7f189015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188ffff700 1 -- 172.21.15.72:0/2829052583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18900cb650 msgr2=0x7f1890158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188ffff700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18900cb650 0x7f1890158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188ffff700 1 -- 172.21.15.72:0/2829052583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884009550 con 0x7f18900b2810 2023-08-25T04:46:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f189499b700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1890070990 0x7f189015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188ffff700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900b2810 0x7f18901f4160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f187c00e810 tx=0x7f187c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188d7fa700 1 -- 172.21.15.72:0/2829052583 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c013610 con 0x7f18900b2810 2023-08-25T04:46:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188d7fa700 1 -- 172.21.15.72:0/2829052583 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c013770 con 0x7f18900b2810 2023-08-25T04:46:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.816+0000 7f188d7fa700 1 -- 172.21.15.72:0/2829052583 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c013b20 con 0x7f18900b2810 2023-08-25T04:46:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.817+0000 7f1896bff700 1 -- 172.21.15.72:0/2829052583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18901f0ee0 con 0x7f18900b2810 2023-08-25T04:46:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.817+0000 7f1896bff700 1 -- 172.21.15.72:0/2829052583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18901f46a0 con 0x7f18900b2810 2023-08-25T04:46:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.818+0000 7f1896bff700 1 -- 172.21.15.72:0/2829052583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18901f4920 con 0x7f18900b2810 2023-08-25T04:46:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.819+0000 7f188d7fa700 1 -- 172.21.15.72:0/2829052583 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f187c013c80 con 0x7f18900b2810 2023-08-25T04:46:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.820+0000 7f188d7fa700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f187406a0e0 0x7f187406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.820+0000 7f188d7fa700 1 -- 172.21.15.72:0/2829052583 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f187c0885a0 con 0x7f18900b2810 2023-08-25T04:46:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.820+0000 7f189499b700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f187406a0e0 0x7f187406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.820+0000 7f189499b700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f187406a0e0 0x7f187406c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f189015c1e0 tx=0x7f1884008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:30.823+0000 7f188d7fa700 1 -- 172.21.15.72:0/2829052583 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f187c0538d0 con 0x7f18900b2810 2023-08-25T04:46:31.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.021+0000 7f1896bff700 1 -- 172.21.15.72:0/2829052583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18901f3e40 con 0x7f18900b2810 2023-08-25T04:46:31.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.021+0000 7f188d7fa700 1 -- 172.21.15.72:0/2829052583 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f187c056ef0 con 0x7f18900b2810 2023-08-25T04:46:31.022 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 -- 172.21.15.72:0/2829052583 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f187406a0e0 msgr2=0x7f187406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f187406a0e0 0x7f187406c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f189015c1e0 tx=0x7f1884008030 comp rx=0 tx=0).stop 2023-08-25T04:46:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 -- 172.21.15.72:0/2829052583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900b2810 msgr2=0x7f18901f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900b2810 0x7f18901f4160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f187c00e810 tx=0x7f187c00ebd0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 -- 172.21.15.72:0/2829052583 shutdown_connections 2023-08-25T04:46:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f187406a0e0 0x7f187406c5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18900cb650 0x7f1890158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1890070990 0x7f189015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 --2- 172.21.15.72:0/2829052583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900b2810 0x7f18901f4160 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 -- 172.21.15.72:0/2829052583 >> 172.21.15.72:0/2829052583 conn(0x7f189006a710 msgr2=0x7f1890070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 -- 172.21.15.72:0/2829052583 shutdown_connections 2023-08-25T04:46:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.024+0000 7f1896bff700 1 -- 172.21.15.72:0/2829052583 wait complete. 2023-08-25T04:46:31.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:31.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.241+0000 7fe9cc5ff700 1 Processor -- start 2023-08-25T04:46:31.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.241+0000 7fe9cc5ff700 1 -- start start 2023-08-25T04:46:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.242+0000 7fe9cc5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 0x7fe9c406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.242+0000 7fe9cc5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe9c406c160 0x7fe9c415c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.242+0000 7fe9cc5ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c40cba40 con 0x7fe9c40c71b0 2023-08-25T04:46:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.242+0000 7fe9cc5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c40d04f0 con 0x7fe9c406c160 2023-08-25T04:46:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.242+0000 7fe9cc5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c406c5f0 con 0x7fe9c406b7a0 2023-08-25T04:46:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.243+0000 7fe9cab9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe9c406c160 0x7fe9c415c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.243+0000 7fe9cab9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe9c406c160 0x7fe9c415c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43728/0 (socket says 172.21.15.72:43728) 2023-08-25T04:46:31.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.243+0000 7fe9cab9c700 1 -- 172.21.15.72:0/3272032828 learned_addr learned my addr 172.21.15.72:0/3272032828 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:31.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.243+0000 7fe9c9b9a700 1 --2- 172.21.15.72:0/3272032828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 0x7fe9c406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.243+0000 7fe9cab9c700 1 -- 172.21.15.72:0/3272032828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 msgr2=0x7fe9c406bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.243+0000 7fe9cab9c700 1 --2- 172.21.15.72:0/3272032828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 0x7fe9c406bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.243+0000 7fe9cab9c700 1 -- 172.21.15.72:0/3272032828 >> v1:172.21.15.137:6789/0 conn(0x7fe9c40c71b0 legacy=0x7fe9c40cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.243+0000 7fe9cab9c700 1 -- 172.21.15.72:0/3272032828 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c40d0210 con 0x7fe9c406c160 2023-08-25T04:46:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.243+0000 7fe9c9b9a700 1 --2- 172.21.15.72:0/3272032828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 0x7fe9c406bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.243+0000 7fe9cab9c700 1 --2- 172.21.15.72:0/3272032828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c406c160 0x7fe9c415c8e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009e50 tx=0x7fe9bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dd32dab8fa2f24 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.244+0000 7fe9c9399700 1 -- 172.21.15.72:0/3272032828 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc00e070 con 0x7fe9c406c160 2023-08-25T04:46:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.244+0000 7fe9c9399700 1 -- 172.21.15.72:0/3272032828 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc00b9c0 con 0x7fe9c406c160 2023-08-25T04:46:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.244+0000 7fe9c9399700 1 -- 172.21.15.72:0/3272032828 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc00bd70 con 0x7fe9c406c160 2023-08-25T04:46:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.244+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/3272032828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c406c160 msgr2=0x7fe9c415c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.244+0000 7fe9cc5ff700 1 --2- 172.21.15.72:0/3272032828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c406c160 0x7fe9c415c8e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009e50 tx=0x7fe9bc00b330 comp rx=0 tx=0).stop 2023-08-25T04:46:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.244+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/3272032828 shutdown_connections 2023-08-25T04:46:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.244+0000 7fe9cc5ff700 1 --2- 172.21.15.72:0/3272032828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c406c160 0x7fe9c415c8e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.244+0000 7fe9cc5ff700 1 --2- 172.21.15.72:0/3272032828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 0x7fe9c406bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.244+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/3272032828 >> 172.21.15.72:0/3272032828 conn(0x7fe9c40d0c70 msgr2=0x7fe9c40d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.244+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/3272032828 shutdown_connections 2023-08-25T04:46:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.245+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/3272032828 wait complete. 2023-08-25T04:46:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.246+0000 7fe9cc5ff700 1 Processor -- start 2023-08-25T04:46:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.246+0000 7fe9cc5ff700 1 -- start start 2023-08-25T04:46:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.247+0000 7fe9cc5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 0x7fe9c41cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.247+0000 7fe9cc5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9c406c160 0x7fe9c40c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.247+0000 7fe9cc5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c40c71b0 0x7fe9c40c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.247+0000 7fe9cc5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40cafe0 con 0x7fe9c40c71b0 2023-08-25T04:46:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.247+0000 7fe9cc5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40ca740 con 0x7fe9c406c160 2023-08-25T04:46:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.247+0000 7fe9cc5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40caa20 con 0x7fe9c406b7a0 2023-08-25T04:46:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9cab9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c40c71b0 0x7fe9c40c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9cab9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c40c71b0 0x7fe9c40c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43730/0 (socket says 172.21.15.72:43730) 2023-08-25T04:46:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9cab9c700 1 -- 172.21.15.72:0/4127479026 learned_addr learned my addr 172.21.15.72:0/4127479026 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9c9b9a700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9c406c160 0x7fe9c40c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9ca39b700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 0x7fe9c41cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9cab9c700 1 -- 172.21.15.72:0/4127479026 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 msgr2=0x7fe9c41cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9cab9c700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 0x7fe9c41cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9cab9c700 1 -- 172.21.15.72:0/4127479026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9c406c160 msgr2=0x7fe9c40c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9cab9c700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9c406c160 0x7fe9c40c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9cab9c700 1 -- 172.21.15.72:0/4127479026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc009b30 con 0x7fe9c40c71b0 2023-08-25T04:46:31.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9ca39b700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 0x7fe9c41cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:31.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9c9b9a700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9c406c160 0x7fe9c40c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:31.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.248+0000 7fe9cab9c700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c40c71b0 0x7fe9c40c4ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe9c406ea40 tx=0x7fe9bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:31.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.249+0000 7fe9baffd700 1 -- 172.21.15.72:0/4127479026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0099b0 con 0x7fe9c40c71b0 2023-08-25T04:46:31.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.249+0000 7fe9baffd700 1 -- 172.21.15.72:0/4127479026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc0092e0 con 0x7fe9c40c71b0 2023-08-25T04:46:31.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.249+0000 7fe9baffd700 1 -- 172.21.15.72:0/4127479026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc01c640 con 0x7fe9c40c71b0 2023-08-25T04:46:31.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.249+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/4127479026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c40cad00 con 0x7fe9c40c71b0 2023-08-25T04:46:31.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.249+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/4127479026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c41ccef0 con 0x7fe9c40c71b0 2023-08-25T04:46:31.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.250+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/4127479026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c409ebb0 con 0x7fe9c40c71b0 2023-08-25T04:46:31.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.251+0000 7fe9baffd700 1 -- 172.21.15.72:0/4127479026 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe9bc01c7a0 con 0x7fe9c40c71b0 2023-08-25T04:46:31.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.251+0000 7fe9baffd700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9a806a0e0 0x7fe9a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.251+0000 7fe9baffd700 1 -- 172.21.15.72:0/4127479026 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe9bc08a450 con 0x7fe9c40c71b0 2023-08-25T04:46:31.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.252+0000 7fe9ca39b700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9a806a0e0 0x7fe9a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.252+0000 7fe9ca39b700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9a806a0e0 0x7fe9a806c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000f60 tx=0x7fe9c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:31.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.256+0000 7fe9baffd700 1 -- 172.21.15.72:0/4127479026 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe9bc0558a0 con 0x7fe9c40c71b0 2023-08-25T04:46:31.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.450+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/4127479026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe9c40c44c0 con 0x7fe9c40c71b0 2023-08-25T04:46:31.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.451+0000 7fe9baffd700 1 -- 172.21.15.72:0/4127479026 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe9bc058ec0 con 0x7fe9c40c71b0 2023-08-25T04:46:31.452 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:31.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/4127479026 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9a806a0e0 msgr2=0x7fe9a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9a806a0e0 0x7fe9a806c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000f60 tx=0x7fe9c0009040 comp rx=0 tx=0).stop 2023-08-25T04:46:31.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/4127479026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c40c71b0 msgr2=0x7fe9c40c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c40c71b0 0x7fe9c40c4ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe9c406ea40 tx=0x7fe9bc004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/4127479026 shutdown_connections 2023-08-25T04:46:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9a806a0e0 0x7fe9a806c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c40c71b0 0x7fe9c40c4ca0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9c406b7a0 0x7fe9c41cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 --2- 172.21.15.72:0/4127479026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9c406c160 0x7fe9c40c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/4127479026 >> 172.21.15.72:0/4127479026 conn(0x7fe9c40d0c70 msgr2=0x7fe9c41e1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/4127479026 shutdown_connections 2023-08-25T04:46:31.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.453+0000 7fe9cc5ff700 1 -- 172.21.15.72:0/4127479026 wait complete. 2023-08-25T04:46:31.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.667+0000 7ff4fabff700 1 Processor -- start 2023-08-25T04:46:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.668+0000 7ff4fabff700 1 -- start start 2023-08-25T04:46:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.669+0000 7ff4fabff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 0x7ff4f406cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.669+0000 7ff4fabff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4f40c3f40 0x7ff4f40c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.669+0000 7ff4fabff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f406d4f0 con 0x7ff4f406e590 2023-08-25T04:46:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.669+0000 7ff4fabff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f40c4900 con 0x7ff4f40c3f40 2023-08-25T04:46:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.669+0000 7ff4fabff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f406d7d0 con 0x7ff4f415ac50 2023-08-25T04:46:31.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.669+0000 7ff4f899b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 0x7ff4f406cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.670+0000 7ff4f899b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 0x7ff4f406cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:58078/0 (socket says 172.21.15.72:58078) 2023-08-25T04:46:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.670+0000 7ff4f899b700 1 -- 172.21.15.72:0/1795564643 learned_addr learned my addr 172.21.15.72:0/1795564643 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.670+0000 7ff4f919c700 1 --2- 172.21.15.72:0/1795564643 >> v2:172.21.15.72:3300/0 conn(0x7ff4f40c3f40 0x7ff4f40c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.670+0000 7ff4f919c700 1 -- 172.21.15.72:0/1795564643 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 msgr2=0x7ff4f406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.670+0000 7ff4f919c700 1 --2- 172.21.15.72:0/1795564643 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 0x7ff4f406cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.670+0000 7ff4f919c700 1 -- 172.21.15.72:0/1795564643 >> v1:172.21.15.72:6789/0 conn(0x7ff4f406e590 legacy=0x7ff4f40addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.670+0000 7ff4f919c700 1 -- 172.21.15.72:0/1795564643 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f406dab0 con 0x7ff4f40c3f40 2023-08-25T04:46:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.670+0000 7ff4f919c700 1 --2- 172.21.15.72:0/1795564643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 0x7ff4f40c43c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009d90 tx=0x7ff4ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28e65985b2b28c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.670+0000 7ff4f37fe700 1 -- 172.21.15.72:0/1795564643 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00e070 con 0x7ff4f40c3f40 2023-08-25T04:46:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.671+0000 7ff4f37fe700 1 -- 172.21.15.72:0/1795564643 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec00bb20 con 0x7ff4f40c3f40 2023-08-25T04:46:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.671+0000 7ff4f37fe700 1 -- 172.21.15.72:0/1795564643 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec012430 con 0x7ff4f40c3f40 2023-08-25T04:46:31.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.671+0000 7ff4fabff700 1 -- 172.21.15.72:0/1795564643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 msgr2=0x7ff4f40c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.671+0000 7ff4fabff700 1 --2- 172.21.15.72:0/1795564643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 0x7ff4f40c43c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009d90 tx=0x7ff4ec00b330 comp rx=0 tx=0).stop 2023-08-25T04:46:31.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.671+0000 7ff4fabff700 1 -- 172.21.15.72:0/1795564643 shutdown_connections 2023-08-25T04:46:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.671+0000 7ff4fabff700 1 --2- 172.21.15.72:0/1795564643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 0x7ff4f40c43c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.671+0000 7ff4fabff700 1 --2- 172.21.15.72:0/1795564643 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 0x7ff4f406cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.671+0000 7ff4fabff700 1 -- 172.21.15.72:0/1795564643 >> 172.21.15.72:0/1795564643 conn(0x7ff4f40ce990 msgr2=0x7ff4f40ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.671+0000 7ff4fabff700 1 -- 172.21.15.72:0/1795564643 shutdown_connections 2023-08-25T04:46:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.671+0000 7ff4fabff700 1 -- 172.21.15.72:0/1795564643 wait complete. 2023-08-25T04:46:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.673+0000 7ff4fabff700 1 Processor -- start 2023-08-25T04:46:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.673+0000 7ff4fabff700 1 -- start start 2023-08-25T04:46:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4fabff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4f406e590 0x7ff4f4156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4fabff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 0x7ff4f40cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4fabff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 0x7ff4f413d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4fabff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4141400 con 0x7ff4f40c3f40 2023-08-25T04:46:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4fabff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4142710 con 0x7ff4f406e590 2023-08-25T04:46:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4fabff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4141670 con 0x7ff4f415ac50 2023-08-25T04:46:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 0x7ff4f40cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 0x7ff4f40cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43742/0 (socket says 172.21.15.72:43742) 2023-08-25T04:46:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4f3fff700 1 -- 172.21.15.72:0/37688989 learned_addr learned my addr 172.21.15.72:0/37688989 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4f899b700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4f406e590 0x7ff4f4156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.674+0000 7ff4f919c700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 0x7ff4f413d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4f3fff700 1 -- 172.21.15.72:0/37688989 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 msgr2=0x7ff4f413d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4f3fff700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 0x7ff4f413d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4f3fff700 1 -- 172.21.15.72:0/37688989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4f406e590 msgr2=0x7ff4f4156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4f3fff700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4f406e590 0x7ff4f4156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4f3fff700 1 -- 172.21.15.72:0/37688989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009a70 con 0x7ff4f40c3f40 2023-08-25T04:46:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4f919c700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 0x7ff4f413d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4f3fff700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 0x7ff4f40cc740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c420 tx=0x7ff4e000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4f17fa700 1 -- 172.21.15.72:0/37688989 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00052d0 con 0x7ff4f40c3f40 2023-08-25T04:46:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4f17fa700 1 -- 172.21.15.72:0/37688989 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0005430 con 0x7ff4f40c3f40 2023-08-25T04:46:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4fabff700 1 -- 172.21.15.72:0/37688989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f4141950 con 0x7ff4f40c3f40 2023-08-25T04:46:31.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4f17fa700 1 -- 172.21.15.72:0/37688989 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00038c0 con 0x7ff4f40c3f40 2023-08-25T04:46:31.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.675+0000 7ff4fabff700 1 -- 172.21.15.72:0/37688989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f4141f10 con 0x7ff4f40c3f40 2023-08-25T04:46:31.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.676+0000 7ff4fabff700 1 -- 172.21.15.72:0/37688989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f404e620 con 0x7ff4f40c3f40 2023-08-25T04:46:31.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.677+0000 7ff4f17fa700 1 -- 172.21.15.72:0/37688989 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff4e0003a20 con 0x7ff4f40c3f40 2023-08-25T04:46:31.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.678+0000 7ff4f17fa700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff4d806a0e0 0x7ff4d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:31.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.678+0000 7ff4f17fa700 1 -- 172.21.15.72:0/37688989 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff4e0087ce0 con 0x7ff4f40c3f40 2023-08-25T04:46:31.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.679+0000 7ff4f899b700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff4d806a0e0 0x7ff4d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:31.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.679+0000 7ff4f899b700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff4d806a0e0 0x7ff4d806c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009bd0 tx=0x7ff4e80092c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:31.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.682+0000 7ff4f17fa700 1 -- 172.21.15.72:0/37688989 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff4e0053000 con 0x7ff4f40c3f40 2023-08-25T04:46:31.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:31.847 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:31.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.895+0000 7ff4fabff700 1 -- 172.21.15.72:0/37688989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4f4155a90 con 0x7ff4f40c3f40 2023-08-25T04:46:31.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.896+0000 7ff4f17fa700 1 -- 172.21.15.72:0/37688989 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7ff4e0056620 con 0x7ff4f40c3f40 2023-08-25T04:46:31.898 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:31.898 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.898+0000 7ff4fabff700 1 -- 172.21.15.72:0/37688989 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff4d806a0e0 msgr2=0x7ff4d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.898+0000 7ff4fabff700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff4d806a0e0 0x7ff4d806c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009bd0 tx=0x7ff4e80092c0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.898+0000 7ff4fabff700 1 -- 172.21.15.72:0/37688989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 msgr2=0x7ff4f40cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.899+0000 7ff4fabff700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 0x7ff4f40cc740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c420 tx=0x7ff4e000c730 comp rx=0 tx=0).stop 2023-08-25T04:46:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.899+0000 7ff4fabff700 1 -- 172.21.15.72:0/37688989 shutdown_connections 2023-08-25T04:46:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.899+0000 7ff4fabff700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff4d806a0e0 0x7ff4d806c5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.899+0000 7ff4fabff700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f415ac50 0x7ff4f413d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.899+0000 7ff4fabff700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4f406e590 0x7ff4f4156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.899+0000 7ff4fabff700 1 --2- 172.21.15.72:0/37688989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4f40c3f40 0x7ff4f40cc740 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:31.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.899+0000 7ff4fabff700 1 -- 172.21.15.72:0/37688989 >> 172.21.15.72:0/37688989 conn(0x7ff4f40ce990 msgr2=0x7ff4f414c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:31.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.899+0000 7ff4fabff700 1 -- 172.21.15.72:0/37688989 shutdown_connections 2023-08-25T04:46:31.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:31.899+0000 7ff4fabff700 1 -- 172.21.15.72:0/37688989 wait complete. 2023-08-25T04:46:31.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:31.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:32.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.119+0000 7f37043ff700 1 Processor -- start 2023-08-25T04:46:32.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.120+0000 7f37043ff700 1 -- start start 2023-08-25T04:46:32.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f37043ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36fc0c71b0 0x7f36fc0cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f37043ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cd4f0 0x7f36fc0cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f37043ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36fc0cba40 con 0x7f36fc0cdeb0 2023-08-25T04:46:32.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f37043ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc0d04f0 con 0x7f36fc0c71b0 2023-08-25T04:46:32.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f37043ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0ce340 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f370219b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36fc0c71b0 0x7f36fc0cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f370299c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f36fc0cdeb0 0x7f36fc06b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35728/0 (socket says 172.21.15.72:35728) 2023-08-25T04:46:32.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f370299c700 1 -- 172.21.15.72:0/2216815019 learned_addr learned my addr 172.21.15.72:0/2216815019 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:32.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f370199a700 1 --2- 172.21.15.72:0/2216815019 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cd4f0 0x7f36fc0cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f370219b700 1 -- 172.21.15.72:0/2216815019 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cd4f0 msgr2=0x7f36fc0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:32.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f370219b700 1 --2- 172.21.15.72:0/2216815019 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cd4f0 0x7f36fc0cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f370219b700 1 -- 172.21.15.72:0/2216815019 >> v1:172.21.15.72:6789/0 conn(0x7f36fc0cdeb0 legacy=0x7f36fc06b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.121+0000 7f3701199700 1 -- 172.21.15.72:0/2216815019 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928150322 0 0) 0x7f36fc0cba40 con 0x7f36fc0cdeb0 2023-08-25T04:46:32.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.122+0000 7f370219b700 1 -- 172.21.15.72:0/2216815019 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc0d0210 con 0x7f36fc0c71b0 2023-08-25T04:46:32.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.122+0000 7f370199a700 1 --2- 172.21.15.72:0/2216815019 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cd4f0 0x7f36fc0cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:32.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.122+0000 7f370219b700 1 --2- 172.21.15.72:0/2216815019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0c71b0 0x7f36fc0cf9c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009840 tx=0x7f36f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b68324e1df3530 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:32.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.122+0000 7f3701199700 1 -- 172.21.15.72:0/2216815019 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8011830 con 0x7f36fc0c71b0 2023-08-25T04:46:32.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.122+0000 7f3701199700 1 -- 172.21.15.72:0/2216815019 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f8011990 con 0x7f36fc0c71b0 2023-08-25T04:46:32.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.122+0000 7f3701199700 1 -- 172.21.15.72:0/2216815019 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8011d20 con 0x7f36fc0c71b0 2023-08-25T04:46:32.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.122+0000 7f37043ff700 1 -- 172.21.15.72:0/2216815019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0c71b0 msgr2=0x7f36fc0cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.122+0000 7f37043ff700 1 --2- 172.21.15.72:0/2216815019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0c71b0 0x7f36fc0cf9c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009840 tx=0x7f36f8009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:32.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.123+0000 7f37043ff700 1 -- 172.21.15.72:0/2216815019 shutdown_connections 2023-08-25T04:46:32.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.123+0000 7f37043ff700 1 --2- 172.21.15.72:0/2216815019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0c71b0 0x7f36fc0cf9c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.123+0000 7f37043ff700 1 --2- 172.21.15.72:0/2216815019 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cd4f0 0x7f36fc0cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.123+0000 7f37043ff700 1 -- 172.21.15.72:0/2216815019 >> 172.21.15.72:0/2216815019 conn(0x7f36fc0d0c70 msgr2=0x7f36fc0d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.123+0000 7f37043ff700 1 -- 172.21.15.72:0/2216815019 shutdown_connections 2023-08-25T04:46:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.123+0000 7f37043ff700 1 -- 172.21.15.72:0/2216815019 wait complete. 2023-08-25T04:46:32.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.125+0000 7f37043ff700 1 Processor -- start 2023-08-25T04:46:32.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.125+0000 7f37043ff700 1 -- start start 2023-08-25T04:46:32.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f37043ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc0c71b0 0x7f36fc0cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f37043ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0cd4f0 0x7f36fc1ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f37043ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cdeb0 0x7f36fc09c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f37043ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc09c850 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f37043ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc1cf2b0 con 0x7f36fc0c71b0 2023-08-25T04:46:32.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f37043ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc1cf590 con 0x7f36fc0cdeb0 2023-08-25T04:46:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0cd4f0 0x7f36fc1ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0cd4f0 0x7f36fc1ceaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43758/0 (socket says 172.21.15.72:43758) 2023-08-25T04:46:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370199a700 1 -- 172.21.15.72:0/1084685565 learned_addr learned my addr 172.21.15.72:0/1084685565 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370219b700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc0c71b0 0x7f36fc0cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370299c700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cdeb0 0x7f36fc09c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370199a700 1 -- 172.21.15.72:0/1084685565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cdeb0 msgr2=0x7f36fc09c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370199a700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cdeb0 0x7f36fc09c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370199a700 1 -- 172.21.15.72:0/1084685565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc0c71b0 msgr2=0x7f36fc0cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370199a700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc0c71b0 0x7f36fc0cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370199a700 1 -- 172.21.15.72:0/1084685565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80094a0 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.126+0000 7f370299c700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cdeb0 0x7f36fc09c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.127+0000 7f370199a700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0cd4f0 0x7f36fc1ceaf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e810 tx=0x7f36ec00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.127+0000 7f36f2ffd700 1 -- 172.21.15.72:0/1084685565 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00c020 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.127+0000 7f36f2ffd700 1 -- 172.21.15.72:0/1084685565 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec004250 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.127+0000 7f37043ff700 1 -- 172.21.15.72:0/1084685565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc1cf870 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.127+0000 7f36f2ffd700 1 -- 172.21.15.72:0/1084685565 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0036a0 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.127+0000 7f37043ff700 1 -- 172.21.15.72:0/1084685565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc1cfe30 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.128+0000 7f37043ff700 1 -- 172.21.15.72:0/1084685565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc09ebb0 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.129+0000 7f36f2ffd700 1 -- 172.21.15.72:0/1084685565 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f36ec003800 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.130+0000 7f36f2ffd700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36e006a0e0 0x7f36e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.130+0000 7f36f2ffd700 1 -- 172.21.15.72:0/1084685565 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f36ec088200 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.130+0000 7f370219b700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36e006a0e0 0x7f36e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.130+0000 7f370219b700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36e006a0e0 0x7f36e006c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f36f80090b0 tx=0x7f36f801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.134+0000 7f36f2ffd700 1 -- 172.21.15.72:0/1084685565 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f36ec053650 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.328+0000 7f37043ff700 1 -- 172.21.15.72:0/1084685565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f36fc0744f0 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.328+0000 7f36f2ffd700 1 -- 172.21.15.72:0/1084685565 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36ec056c70 con 0x7f36fc0cd4f0 2023-08-25T04:46:32.330 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 -- 172.21.15.72:0/1084685565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36e006a0e0 msgr2=0x7f36e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36e006a0e0 0x7f36e006c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f36f80090b0 tx=0x7f36f801c040 comp rx=0 tx=0).stop 2023-08-25T04:46:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 -- 172.21.15.72:0/1084685565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0cd4f0 msgr2=0x7f36fc1ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0cd4f0 0x7f36fc1ceaf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e810 tx=0x7f36ec00eb20 comp rx=0 tx=0).stop 2023-08-25T04:46:32.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 -- 172.21.15.72:0/1084685565 shutdown_connections 2023-08-25T04:46:32.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36e006a0e0 0x7f36e006c5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36fc0cdeb0 0x7f36fc09c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36fc0c71b0 0x7f36fc0cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 --2- 172.21.15.72:0/1084685565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36fc0cd4f0 0x7f36fc1ceaf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 -- 172.21.15.72:0/1084685565 >> 172.21.15.72:0/1084685565 conn(0x7f36fc0d0c70 msgr2=0x7f36fc1e3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 -- 172.21.15.72:0/1084685565 shutdown_connections 2023-08-25T04:46:32.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.331+0000 7f37043ff700 1 -- 172.21.15.72:0/1084685565 wait complete. 2023-08-25T04:46:32.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.551+0000 7f0aff1ff700 1 Processor -- start 2023-08-25T04:46:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.551+0000 7f0aff1ff700 1 -- start start 2023-08-25T04:46:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.552+0000 7f0aff1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0af8150ea0 0x7f0af80cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.552+0000 7f0aff1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af80aebf0 con 0x7f0af80cbb90 2023-08-25T04:46:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.552+0000 7f0aff1ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af80aeed0 con 0x7f0af8150ac0 2023-08-25T04:46:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.552+0000 7f0aff1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af80af490 con 0x7f0af8150ea0 2023-08-25T04:46:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.552+0000 7f0af7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0af8150ea0 0x7f0af80cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.552+0000 7f0af7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0af8150ea0 0x7f0af80cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43774/0 (socket says 172.21.15.72:43774) 2023-08-25T04:46:32.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.552+0000 7f0af7fff700 1 -- 172.21.15.72:0/150275227 learned_addr learned my addr 172.21.15.72:0/150275227 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:32.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.553+0000 7f0af7fff700 1 -- 172.21.15.72:0/150275227 >> v1:172.21.15.137:6789/0 conn(0x7f0af8150ac0 legacy=0x7f0af815def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.553+0000 7f0af7fff700 1 -- 172.21.15.72:0/150275227 >> v1:172.21.15.72:6789/0 conn(0x7f0af80cbb90 legacy=0x7f0af815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.553+0000 7f0af7fff700 1 -- 172.21.15.72:0/150275227 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af80af1b0 con 0x7f0af8150ea0 2023-08-25T04:46:32.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.553+0000 7f0af7fff700 1 --2- 172.21.15.72:0/150275227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 0x7f0af80cb650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40098f0 tx=0x7f0ae4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2b1b83bd8b4233 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:32.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.553+0000 7f0af77fe700 1 -- 172.21.15.72:0/150275227 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400f8a0 con 0x7f0af8150ea0 2023-08-25T04:46:32.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.553+0000 7f0af77fe700 1 -- 172.21.15.72:0/150275227 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae400fa00 con 0x7f0af8150ea0 2023-08-25T04:46:32.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.553+0000 7f0af77fe700 1 -- 172.21.15.72:0/150275227 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400fd90 con 0x7f0af8150ea0 2023-08-25T04:46:32.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.554+0000 7f0aff1ff700 1 -- 172.21.15.72:0/150275227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 msgr2=0x7f0af80cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.554+0000 7f0aff1ff700 1 --2- 172.21.15.72:0/150275227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 0x7f0af80cb650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40098f0 tx=0x7f0ae4009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:32.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.554+0000 7f0aff1ff700 1 -- 172.21.15.72:0/150275227 shutdown_connections 2023-08-25T04:46:32.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.554+0000 7f0aff1ff700 1 --2- 172.21.15.72:0/150275227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 0x7f0af80cb650 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.554+0000 7f0aff1ff700 1 -- 172.21.15.72:0/150275227 >> 172.21.15.72:0/150275227 conn(0x7f0af806a710 msgr2=0x7f0af806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:32.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.554+0000 7f0aff1ff700 1 -- 172.21.15.72:0/150275227 shutdown_connections 2023-08-25T04:46:32.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.554+0000 7f0aff1ff700 1 -- 172.21.15.72:0/150275227 wait complete. 2023-08-25T04:46:32.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.556+0000 7f0aff1ff700 1 Processor -- start 2023-08-25T04:46:32.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.556+0000 7f0aff1ff700 1 -- start start 2023-08-25T04:46:32.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0aff1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0af80cbb90 0x7f0af814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0aff1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af8150ac0 0x7f0af81f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0aff1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 0x7f0af8156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0aff1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af81503b0 con 0x7f0af8150ea0 2023-08-25T04:46:32.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0aff1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af81f6840 con 0x7f0af8150ac0 2023-08-25T04:46:32.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0aff1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af81f6b20 con 0x7f0af80cbb90 2023-08-25T04:46:32.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0afd79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 0x7f0af8156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0afd79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 0x7f0af8156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43790/0 (socket says 172.21.15.72:43790) 2023-08-25T04:46:32.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0afd79c700 1 -- 172.21.15.72:0/2885516231 learned_addr learned my addr 172.21.15.72:0/2885516231 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:32.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0afd79c700 1 -- 172.21.15.72:0/2885516231 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0af80cbb90 msgr2=0x7f0af814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0afd79c700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0af80cbb90 0x7f0af814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0afd79c700 1 -- 172.21.15.72:0/2885516231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af8150ac0 msgr2=0x7f0af81f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.557+0000 7f0af7fff700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af8150ac0 0x7f0af81f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.558+0000 7f0afd79c700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af8150ac0 0x7f0af81f5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.558+0000 7f0afd79c700 1 -- 172.21.15.72:0/2885516231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae4009550 con 0x7f0af8150ea0 2023-08-25T04:46:32.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.558+0000 7f0afd79c700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 0x7f0af8156700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0af000cc50 tx=0x7f0af000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:32.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.558+0000 7f0af57fa700 1 -- 172.21.15.72:0/2885516231 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000ad80 con 0x7f0af8150ea0 2023-08-25T04:46:32.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.558+0000 7f0af57fa700 1 -- 172.21.15.72:0/2885516231 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af000ce50 con 0x7f0af8150ea0 2023-08-25T04:46:32.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.558+0000 7f0af57fa700 1 -- 172.21.15.72:0/2885516231 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0003c40 con 0x7f0af8150ea0 2023-08-25T04:46:32.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.558+0000 7f0aff1ff700 1 -- 172.21.15.72:0/2885516231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af8152300 con 0x7f0af8150ea0 2023-08-25T04:46:32.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.558+0000 7f0aff1ff700 1 -- 172.21.15.72:0/2885516231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af81528c0 con 0x7f0af8150ea0 2023-08-25T04:46:32.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.559+0000 7f0aff1ff700 1 -- 172.21.15.72:0/2885516231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af8072320 con 0x7f0af8150ea0 2023-08-25T04:46:32.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.560+0000 7f0af57fa700 1 -- 172.21.15.72:0/2885516231 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0af00050d0 con 0x7f0af8150ea0 2023-08-25T04:46:32.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.561+0000 7f0af57fa700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0adc06a0e0 0x7f0adc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.561+0000 7f0af57fa700 1 -- 172.21.15.72:0/2885516231 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0af0088a60 con 0x7f0af8150ea0 2023-08-25T04:46:32.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.561+0000 7f0afcf9b700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0adc06a0e0 0x7f0adc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.562+0000 7f0afcf9b700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0adc06a0e0 0x7f0adc06c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0aec000f60 tx=0x7f0aec007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:32.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.566+0000 7f0af57fa700 1 -- 172.21.15.72:0/2885516231 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0af0053d80 con 0x7f0af8150ea0 2023-08-25T04:46:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.766+0000 7f0aff1ff700 1 -- 172.21.15.72:0/2885516231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0af80744f0 con 0x7f0af8150ea0 2023-08-25T04:46:32.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.766+0000 7f0af57fa700 1 -- 172.21.15.72:0/2885516231 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0af00573a0 con 0x7f0af8150ea0 2023-08-25T04:46:32.768 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 -- 172.21.15.72:0/2885516231 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0adc06a0e0 msgr2=0x7f0adc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0adc06a0e0 0x7f0adc06c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0aec000f60 tx=0x7f0aec007a40 comp rx=0 tx=0).stop 2023-08-25T04:46:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 -- 172.21.15.72:0/2885516231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 msgr2=0x7f0af8156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 0x7f0af8156700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0af000cc50 tx=0x7f0af000a340 comp rx=0 tx=0).stop 2023-08-25T04:46:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 -- 172.21.15.72:0/2885516231 shutdown_connections 2023-08-25T04:46:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0adc06a0e0 0x7f0adc06c5a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af8150ea0 0x7f0af8156700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0af80cbb90 0x7f0af814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 --2- 172.21.15.72:0/2885516231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0af8150ac0 0x7f0af81f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 -- 172.21.15.72:0/2885516231 >> 172.21.15.72:0/2885516231 conn(0x7f0af806a710 msgr2=0x7f0af815a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 -- 172.21.15.72:0/2885516231 shutdown_connections 2023-08-25T04:46:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.769+0000 7f0aff1ff700 1 -- 172.21.15.72:0/2885516231 wait complete. 2023-08-25T04:46:32.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:32.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.988+0000 7fa1083ff700 1 Processor -- start 2023-08-25T04:46:32.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.988+0000 7fa1083ff700 1 -- start start 2023-08-25T04:46:32.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.989+0000 7fa1083ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa1000b4f10 0x7fa100167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.989+0000 7fa1083ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1000b8d10 con 0x7fa10015d000 2023-08-25T04:46:32.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.989+0000 7fa1083ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1000b6e90 con 0x7fa1000d10c0 2023-08-25T04:46:32.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.989+0000 7fa1083ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1000b56f0 con 0x7fa1000b4f10 2023-08-25T04:46:32.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa10619b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa10015d000 0x7fa1000b8600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53400/0 (socket says 172.21.15.72:53400) 2023-08-25T04:46:32.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa10619b700 1 -- 172.21.15.72:0/824548729 learned_addr learned my addr 172.21.15.72:0/824548729 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:32.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa10699c700 1 --2- 172.21.15.72:0/824548729 >> v2:172.21.15.137:3300/0 conn(0x7fa1000b4f10 0x7fa100167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020709853 0 0) 0x7fa1000b8d10 con 0x7fa10015d000 2023-08-25T04:46:32.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0ec0035b0 con 0x7fa10015d000 2023-08-25T04:46:32.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3005399624 0 0) 0x7fa0ec0035b0 con 0x7fa10015d000 2023-08-25T04:46:32.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 >> v2:172.21.15.137:3300/0 conn(0x7fa1000b4f10 msgr2=0x7fa100167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:32.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 --2- 172.21.15.72:0/824548729 >> v2:172.21.15.137:3300/0 conn(0x7fa1000b4f10 0x7fa100167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 >> v1:172.21.15.137:6789/0 conn(0x7fa1000d10c0 legacy=0x7fa1000b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10015d3e0 con 0x7fa10015d000 2023-08-25T04:46:32.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fa0fc001670 con 0x7fa10015d000 2023-08-25T04:46:32.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 >> v1:172.21.15.72:6789/0 conn(0x7fa10015d000 legacy=0x7fa1000b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0ec003a50 0x7fa0ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ec004850 0x7fa0ec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec005210 0x7fa0ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:32.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec00c0e0 con 0x7fa0ec004850 2023-08-25T04:46:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec00c250 con 0x7fa0ec003a50 2023-08-25T04:46:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.990+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec00c410 con 0x7fa0ec005210 2023-08-25T04:46:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10599a700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ec004850 0x7fa0ec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10619b700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0ec003a50 0x7fa0ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10699c700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec005210 0x7fa0ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10599a700 1 -- 172.21.15.72:0/824548729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec005210 msgr2=0x7fa0ec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:32.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10599a700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec005210 0x7fa0ec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10599a700 1 -- 172.21.15.72:0/824548729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0ec003a50 msgr2=0x7fa0ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:32.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10599a700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0ec003a50 0x7fa0ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10599a700 1 -- 172.21.15.72:0/824548729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec0035b0 con 0x7fa0ec004850 2023-08-25T04:46:32.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10699c700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec005210 0x7fa0ec00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:32.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10699c700 1 -- 172.21.15.72:0/824548729 reap_dead start 2023-08-25T04:46:32.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.991+0000 7fa10599a700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ec004850 0x7fa0ec004cd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00017c0 tx=0x7fa0ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa084912e3cc9418 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:32.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.992+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00052d0 con 0x7fa0ec004850 2023-08-25T04:46:32.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.992+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f0005430 con 0x7fa0ec004850 2023-08-25T04:46:32.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.992+0000 7fa105199700 1 -- 172.21.15.72:0/824548729 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00038c0 con 0x7fa0ec004850 2023-08-25T04:46:32.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.992+0000 7fa1083ff700 1 -- 172.21.15.72:0/824548729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ec004850 msgr2=0x7fa0ec004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:32.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.992+0000 7fa1083ff700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ec004850 0x7fa0ec004cd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00017c0 tx=0x7fa0ec005880 comp rx=0 tx=0).stop 2023-08-25T04:46:32.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.992+0000 7fa1083ff700 1 -- 172.21.15.72:0/824548729 shutdown_connections 2023-08-25T04:46:32.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.992+0000 7fa1083ff700 1 --2- 172.21.15.72:0/824548729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ec004850 0x7fa0ec004cd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:32.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.992+0000 7fa1083ff700 1 -- 172.21.15.72:0/824548729 >> 172.21.15.72:0/824548729 conn(0x7fa100071e10 msgr2=0x7fa100072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:33.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.992+0000 7fa1083ff700 1 -- 172.21.15.72:0/824548729 shutdown_connections 2023-08-25T04:46:33.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.992+0000 7fa1083ff700 1 -- 172.21.15.72:0/824548729 wait complete. 2023-08-25T04:46:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.994+0000 7fa1083ff700 1 Processor -- start 2023-08-25T04:46:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.994+0000 7fa1083ff700 1 -- start start 2023-08-25T04:46:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa1083ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec004850 0x7fa100150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa1083ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1001601c0 0x7fa1000b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa1083ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa10015ebd0 0x7fa1000b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa1083ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1000cba10 con 0x7fa10015ebd0 2023-08-25T04:46:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa1083ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10015fd30 con 0x7fa1001601c0 2023-08-25T04:46:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa1083ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1001512f0 con 0x7fa0ec004850 2023-08-25T04:46:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa10699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa10015ebd0 0x7fa1000b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa10699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa10015ebd0 0x7fa1000b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33494/0 (socket says 172.21.15.72:33494) 2023-08-25T04:46:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa10699c700 1 -- 172.21.15.72:0/3141930993 learned_addr learned my addr 172.21.15.72:0/3141930993 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa10619b700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec004850 0x7fa100150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.995+0000 7fa10599a700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1001601c0 0x7fa1000b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa10699c700 1 -- 172.21.15.72:0/3141930993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec004850 msgr2=0x7fa100150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa10699c700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec004850 0x7fa100150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa10699c700 1 -- 172.21.15.72:0/3141930993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1001601c0 msgr2=0x7fa1000b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa10699c700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1001601c0 0x7fa1000b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa10699c700 1 -- 172.21.15.72:0/3141930993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10015f120 con 0x7fa10015ebd0 2023-08-25T04:46:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa10619b700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec004850 0x7fa100150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa10699c700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa10015ebd0 0x7fa1000b3a30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa1000d3940 tx=0x7fa0f80114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:33.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa0f6ffd700 1 -- 172.21.15.72:0/3141930993 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800e030 con 0x7fa10015ebd0 2023-08-25T04:46:33.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa0f6ffd700 1 -- 172.21.15.72:0/3141930993 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f8011b10 con 0x7fa10015ebd0 2023-08-25T04:46:33.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa1083ff700 1 -- 172.21.15.72:0/3141930993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10015f400 con 0x7fa10015ebd0 2023-08-25T04:46:33.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.996+0000 7fa0f6ffd700 1 -- 172.21.15.72:0/3141930993 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8011ec0 con 0x7fa10015ebd0 2023-08-25T04:46:33.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.997+0000 7fa1083ff700 1 -- 172.21.15.72:0/3141930993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10015f9c0 con 0x7fa10015ebd0 2023-08-25T04:46:33.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.998+0000 7fa1083ff700 1 -- 172.21.15.72:0/3141930993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10006a2f0 con 0x7fa10015ebd0 2023-08-25T04:46:33.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.998+0000 7fa0f6ffd700 1 -- 172.21.15.72:0/3141930993 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0f8016470 con 0x7fa10015ebd0 2023-08-25T04:46:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.999+0000 7fa0f6ffd700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa0e406a0e0 0x7fa0e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:32.999+0000 7fa0f6ffd700 1 -- 172.21.15.72:0/3141930993 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa0f800f070 con 0x7fa10015ebd0 2023-08-25T04:46:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.000+0000 7fa10619b700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa0e406a0e0 0x7fa0e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.000+0000 7fa10619b700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa0e406a0e0 0x7fa0e406c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0011e0 tx=0x7fa0fc000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.004+0000 7fa0f6ffd700 1 -- 172.21.15.72:0/3141930993 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa0f8054470 con 0x7fa10015ebd0 2023-08-25T04:46:33.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.200+0000 7fa1083ff700 1 -- 172.21.15.72:0/3141930993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa10008a000 con 0x7fa10015ebd0 2023-08-25T04:46:33.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.200+0000 7fa0f6ffd700 1 -- 172.21.15.72:0/3141930993 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0f8057a90 con 0x7fa10015ebd0 2023-08-25T04:46:33.202 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:33.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 -- 172.21.15.72:0/3141930993 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa0e406a0e0 msgr2=0x7fa0e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa0e406a0e0 0x7fa0e406c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0011e0 tx=0x7fa0fc000ed0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 -- 172.21.15.72:0/3141930993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa10015ebd0 msgr2=0x7fa1000b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa10015ebd0 0x7fa1000b3a30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa1000d3940 tx=0x7fa0f80114b0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 -- 172.21.15.72:0/3141930993 shutdown_connections 2023-08-25T04:46:33.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa0e406a0e0 0x7fa0e406c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa10015ebd0 0x7fa1000b3a30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa0ec004850 0x7fa100150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 --2- 172.21.15.72:0/3141930993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1001601c0 0x7fa1000b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 -- 172.21.15.72:0/3141930993 >> 172.21.15.72:0/3141930993 conn(0x7fa100071e10 msgr2=0x7fa1000721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:33.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 -- 172.21.15.72:0/3141930993 shutdown_connections 2023-08-25T04:46:33.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.203+0000 7fa1083ff700 1 -- 172.21.15.72:0/3141930993 wait complete. 2023-08-25T04:46:33.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:33.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.419+0000 7f4f3c9ff700 1 Processor -- start 2023-08-25T04:46:33.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.419+0000 7f4f3c9ff700 1 -- start start 2023-08-25T04:46:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f3c9ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f3815da20 0x7f4f380cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f3c9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f380ade30 0x7f4f380ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f3c9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f380ae9d0 con 0x7f4f38070990 2023-08-25T04:46:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f3c9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f380ae7d0 con 0x7f4f380ade30 2023-08-25T04:46:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f3c9ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f38159d70 con 0x7f4f3815da20 2023-08-25T04:46:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f36d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4f38070990 0x7f4f3806c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53408/0 (socket says 172.21.15.72:53408) 2023-08-25T04:46:33.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f36d9d700 1 -- 172.21.15.72:0/1061527844 learned_addr learned my addr 172.21.15.72:0/1061527844 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:33.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f2ffff700 1 --2- 172.21.15.72:0/1061527844 >> v2:172.21.15.72:3300/0 conn(0x7f4f380ade30 0x7f4f380ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f3659c700 1 --2- 172.21.15.72:0/1061527844 >> v2:172.21.15.137:3300/0 conn(0x7f4f3815da20 0x7f4f380cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f2ffff700 1 -- 172.21.15.72:0/1061527844 >> v2:172.21.15.137:3300/0 conn(0x7f4f3815da20 msgr2=0x7f4f380cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:33.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f2ffff700 1 --2- 172.21.15.72:0/1061527844 >> v2:172.21.15.137:3300/0 conn(0x7f4f3815da20 0x7f4f380cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f2ffff700 1 -- 172.21.15.72:0/1061527844 >> v1:172.21.15.72:6789/0 conn(0x7f4f38070990 legacy=0x7f4f3806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f2ffff700 1 -- 172.21.15.72:0/1061527844 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3815a050 con 0x7f4f380ade30 2023-08-25T04:46:33.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.421+0000 7f4f35d9b700 1 -- 172.21.15.72:0/1061527844 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715426363 0 0) 0x7f4f380ae9d0 con 0x7f4f38070990 2023-08-25T04:46:33.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.422+0000 7f4f2ffff700 1 --2- 172.21.15.72:0/1061527844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f380ade30 0x7f4f380ae290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f380ce920 tx=0x7f4f20009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dad0c17215c5cb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:33.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.422+0000 7f4f35d9b700 1 -- 172.21.15.72:0/1061527844 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20011830 con 0x7f4f380ade30 2023-08-25T04:46:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.422+0000 7f4f35d9b700 1 -- 172.21.15.72:0/1061527844 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20011990 con 0x7f4f380ade30 2023-08-25T04:46:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.422+0000 7f4f35d9b700 1 -- 172.21.15.72:0/1061527844 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20011d20 con 0x7f4f380ade30 2023-08-25T04:46:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.422+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1061527844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f380ade30 msgr2=0x7f4f380ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.422+0000 7f4f3c9ff700 1 --2- 172.21.15.72:0/1061527844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f380ade30 0x7f4f380ae290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f380ce920 tx=0x7f4f20009b20 comp rx=0 tx=0).stop 2023-08-25T04:46:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.423+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1061527844 shutdown_connections 2023-08-25T04:46:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.423+0000 7f4f3c9ff700 1 --2- 172.21.15.72:0/1061527844 >> v2:172.21.15.137:3300/0 conn(0x7f4f3815da20 0x7f4f380cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.423+0000 7f4f3c9ff700 1 --2- 172.21.15.72:0/1061527844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f380ade30 0x7f4f380ae290 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.423+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1061527844 >> 172.21.15.72:0/1061527844 conn(0x7f4f3806a710 msgr2=0x7f4f3806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:33.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.423+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1061527844 shutdown_connections 2023-08-25T04:46:33.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.423+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1061527844 wait complete. 2023-08-25T04:46:33.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.424+0000 7f4f3c9ff700 1 Processor -- start 2023-08-25T04:46:33.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.425+0000 7f4f3c9ff700 1 -- start start 2023-08-25T04:46:33.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.425+0000 7f4f3c9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f38070990 0x7f4f380c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.425+0000 7f4f3c9ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f380ade30 0x7f4f380b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.425+0000 7f4f3c9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f3815da20 0x7f4f38150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3c9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3814ea80 con 0x7f4f38070990 2023-08-25T04:46:33.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3c9ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38150830 con 0x7f4f380ade30 2023-08-25T04:46:33.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3c9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3814e7a0 con 0x7f4f3815da20 2023-08-25T04:46:33.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f38070990 0x7f4f380c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f38070990 0x7f4f380c24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33506/0 (socket says 172.21.15.72:33506) 2023-08-25T04:46:33.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3659c700 1 -- 172.21.15.72:0/1683994559 learned_addr learned my addr 172.21.15.72:0/1683994559 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:33.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f2ffff700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f380ade30 0x7f4f380b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f36d9d700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f3815da20 0x7f4f38150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3659c700 1 -- 172.21.15.72:0/1683994559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f3815da20 msgr2=0x7f4f38150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3659c700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f3815da20 0x7f4f38150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3659c700 1 -- 172.21.15.72:0/1683994559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f380ade30 msgr2=0x7f4f380b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3659c700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f380ade30 0x7f4f380b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3659c700 1 -- 172.21.15.72:0/1683994559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200094a0 con 0x7f4f38070990 2023-08-25T04:46:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f2ffff700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f380ade30 0x7f4f380b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f36d9d700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f3815da20 0x7f4f38150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.426+0000 7f4f3659c700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f38070990 0x7f4f380c24f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800e9b0 tx=0x7f4f2800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.427+0000 7f4f2effd700 1 -- 172.21.15.72:0/1683994559 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28009710 con 0x7f4f38070990 2023-08-25T04:46:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.427+0000 7f4f2effd700 1 -- 172.21.15.72:0/1683994559 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2800c850 con 0x7f4f38070990 2023-08-25T04:46:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.427+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1683994559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f381501e0 con 0x7f4f38070990 2023-08-25T04:46:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.427+0000 7f4f2effd700 1 -- 172.21.15.72:0/1683994559 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800cbc0 con 0x7f4f38070990 2023-08-25T04:46:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.427+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1683994559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f380c2a30 con 0x7f4f38070990 2023-08-25T04:46:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.428+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1683994559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f38150b10 con 0x7f4f38070990 2023-08-25T04:46:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.429+0000 7f4f2effd700 1 -- 172.21.15.72:0/1683994559 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f2800cd20 con 0x7f4f38070990 2023-08-25T04:46:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.430+0000 7f4f2effd700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4f1806a0e0 0x7f4f1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.430+0000 7f4f2effd700 1 -- 172.21.15.72:0/1683994559 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4f28088a90 con 0x7f4f38070990 2023-08-25T04:46:33.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.430+0000 7f4f2ffff700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4f1806a0e0 0x7f4f1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.431+0000 7f4f2ffff700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4f1806a0e0 0x7f4f1806c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f200090b0 tx=0x7f4f20008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:33.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.434+0000 7f4f2effd700 1 -- 172.21.15.72:0/1683994559 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4f28057840 con 0x7f4f38070990 2023-08-25T04:46:33.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.636+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1683994559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f38072320 con 0x7f4f38070990 2023-08-25T04:46:33.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.637+0000 7f4f2effd700 1 -- 172.21.15.72:0/1683994559 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f280573d0 con 0x7f4f38070990 2023-08-25T04:46:33.638 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:33.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1683994559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4f1806a0e0 msgr2=0x7f4f1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4f1806a0e0 0x7f4f1806c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f200090b0 tx=0x7f4f20008030 comp rx=0 tx=0).stop 2023-08-25T04:46:33.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1683994559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f38070990 msgr2=0x7f4f380c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f38070990 0x7f4f380c24f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800e9b0 tx=0x7f4f2800ed70 comp rx=0 tx=0).stop 2023-08-25T04:46:33.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1683994559 shutdown_connections 2023-08-25T04:46:33.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4f1806a0e0 0x7f4f1806c5a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f3815da20 0x7f4f38150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f38070990 0x7f4f380c24f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 --2- 172.21.15.72:0/1683994559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f380ade30 0x7f4f380b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1683994559 >> 172.21.15.72:0/1683994559 conn(0x7f4f3806a710 msgr2=0x7f4f380cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:33.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1683994559 shutdown_connections 2023-08-25T04:46:33.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.639+0000 7f4f3c9ff700 1 -- 172.21.15.72:0/1683994559 wait complete. 2023-08-25T04:46:33.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:33.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.858+0000 7f586a5ff700 1 Processor -- start 2023-08-25T04:46:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.859+0000 7f586a5ff700 1 -- start start 2023-08-25T04:46:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f586a5ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f58640c71b0 0x7f58640cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f586a5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58640cd4f0 0x7f58640cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f586a5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58640cba40 con 0x7f58640cdeb0 2023-08-25T04:46:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f586a5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58640d04f0 con 0x7f58640cd4f0 2023-08-25T04:46:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f586a5ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58640ce320 con 0x7f58640c71b0 2023-08-25T04:46:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f5868b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f58640cdeb0 0x7f586406b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53412/0 (socket says 172.21.15.72:53412) 2023-08-25T04:46:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f5868b9c700 1 -- 172.21.15.72:0/1890984766 learned_addr learned my addr 172.21.15.72:0/1890984766 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f58637fe700 1 --2- 172.21.15.72:0/1890984766 >> v2:172.21.15.72:3300/0 conn(0x7f58640cd4f0 0x7f58640cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f5863fff700 1 --2- 172.21.15.72:0/1890984766 >> v2:172.21.15.137:3300/0 conn(0x7f58640c71b0 0x7f58640cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f58637fe700 1 -- 172.21.15.72:0/1890984766 >> v2:172.21.15.137:3300/0 conn(0x7f58640c71b0 msgr2=0x7f58640cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f58637fe700 1 --2- 172.21.15.72:0/1890984766 >> v2:172.21.15.137:3300/0 conn(0x7f58640c71b0 0x7f58640cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.861+0000 7f58637fe700 1 -- 172.21.15.72:0/1890984766 >> v1:172.21.15.72:6789/0 conn(0x7f58640cdeb0 legacy=0x7f586406b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.861+0000 7f58637fe700 1 -- 172.21.15.72:0/1890984766 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58640d0210 con 0x7f58640cd4f0 2023-08-25T04:46:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.860+0000 7f5862ffd700 1 -- 172.21.15.72:0/1890984766 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650193981 0 0) 0x7f58640cba40 con 0x7f58640cdeb0 2023-08-25T04:46:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.861+0000 7f58637fe700 1 --2- 172.21.15.72:0/1890984766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cd4f0 0x7f58640cd970 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f586406ea10 tx=0x7f5858009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a675d0da6a77e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.861+0000 7f5862ffd700 1 -- 172.21.15.72:0/1890984766 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858011830 con 0x7f58640cd4f0 2023-08-25T04:46:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.861+0000 7f5862ffd700 1 -- 172.21.15.72:0/1890984766 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858011990 con 0x7f58640cd4f0 2023-08-25T04:46:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.861+0000 7f5862ffd700 1 -- 172.21.15.72:0/1890984766 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858011d20 con 0x7f58640cd4f0 2023-08-25T04:46:33.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.861+0000 7f586a5ff700 1 -- 172.21.15.72:0/1890984766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cd4f0 msgr2=0x7f58640cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.861+0000 7f586a5ff700 1 --2- 172.21.15.72:0/1890984766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cd4f0 0x7f58640cd970 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f586406ea10 tx=0x7f5858009b20 comp rx=0 tx=0).stop 2023-08-25T04:46:33.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.862+0000 7f586a5ff700 1 -- 172.21.15.72:0/1890984766 shutdown_connections 2023-08-25T04:46:33.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.862+0000 7f586a5ff700 1 --2- 172.21.15.72:0/1890984766 >> v2:172.21.15.137:3300/0 conn(0x7f58640c71b0 0x7f58640cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.862+0000 7f586a5ff700 1 --2- 172.21.15.72:0/1890984766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cd4f0 0x7f58640cd970 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.862+0000 7f586a5ff700 1 -- 172.21.15.72:0/1890984766 >> 172.21.15.72:0/1890984766 conn(0x7f58640d0c70 msgr2=0x7f58640d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.862+0000 7f586a5ff700 1 -- 172.21.15.72:0/1890984766 shutdown_connections 2023-08-25T04:46:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.862+0000 7f586a5ff700 1 -- 172.21.15.72:0/1890984766 wait complete. 2023-08-25T04:46:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.863+0000 7f586a5ff700 1 Processor -- start 2023-08-25T04:46:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.864+0000 7f586a5ff700 1 -- start start 2023-08-25T04:46:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f586a5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58640c71b0 0x7f58640cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f586a5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f58640cd4f0 0x7f58641e1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f586a5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cdeb0 0x7f58640c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f586a5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58640cb080 con 0x7f58640cdeb0 2023-08-25T04:46:33.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f586a5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58641e1580 con 0x7f58640c71b0 2023-08-25T04:46:33.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f586a5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58640c8280 con 0x7f58640cd4f0 2023-08-25T04:46:33.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f5868b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cdeb0 0x7f58640c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f5868b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cdeb0 0x7f58640c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33522/0 (socket says 172.21.15.72:33522) 2023-08-25T04:46:33.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f5868b9c700 1 -- 172.21.15.72:0/3098056301 learned_addr learned my addr 172.21.15.72:0/3098056301 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:33.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f5863fff700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58640c71b0 0x7f58640cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f58637fe700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f58640cd4f0 0x7f58641e1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f5868b9c700 1 -- 172.21.15.72:0/3098056301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f58640cd4f0 msgr2=0x7f58641e1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f5868b9c700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f58640cd4f0 0x7f58641e1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f5868b9c700 1 -- 172.21.15.72:0/3098056301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58640c71b0 msgr2=0x7f58640cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:33.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f5868b9c700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58640c71b0 0x7f58640cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:33.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.865+0000 7f5868b9c700 1 -- 172.21.15.72:0/3098056301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580094a0 con 0x7f58640cdeb0 2023-08-25T04:46:33.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.866+0000 7f5868b9c700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cdeb0 0x7f58640c7d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f585c00cba0 tx=0x7f585c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:33.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.866+0000 7f5860ff9700 1 -- 172.21.15.72:0/3098056301 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c00aaa0 con 0x7f58640cdeb0 2023-08-25T04:46:33.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.866+0000 7f5860ff9700 1 -- 172.21.15.72:0/3098056301 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c00ac20 con 0x7f58640cdeb0 2023-08-25T04:46:33.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.866+0000 7f5860ff9700 1 -- 172.21.15.72:0/3098056301 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c0070d0 con 0x7f58640cdeb0 2023-08-25T04:46:33.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.866+0000 7f586a5ff700 1 -- 172.21.15.72:0/3098056301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58640c84b0 con 0x7f58640cdeb0 2023-08-25T04:46:33.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.866+0000 7f586a5ff700 1 -- 172.21.15.72:0/3098056301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58640c8a70 con 0x7f58640cdeb0 2023-08-25T04:46:33.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.867+0000 7f586a5ff700 1 -- 172.21.15.72:0/3098056301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586409ebb0 con 0x7f58640cdeb0 2023-08-25T04:46:33.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.868+0000 7f5860ff9700 1 -- 172.21.15.72:0/3098056301 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f585c007230 con 0x7f58640cdeb0 2023-08-25T04:46:33.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.869+0000 7f5860ff9700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f585006a0e0 0x7f585006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:33.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.869+0000 7f5860ff9700 1 -- 172.21.15.72:0/3098056301 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f585c088320 con 0x7f58640cdeb0 2023-08-25T04:46:33.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.869+0000 7f5863fff700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f585006a0e0 0x7f585006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:33.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.870+0000 7f5863fff700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f585006a0e0 0x7f585006c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58641e75b0 tx=0x7f5854008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:33.873+0000 7f5860ff9700 1 -- 172.21.15.72:0/3098056301 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f585c0536d0 con 0x7f58640cdeb0 2023-08-25T04:46:34.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.068+0000 7f586a5ff700 1 -- 172.21.15.72:0/3098056301 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f58640744f0 con 0x7f58640cdeb0 2023-08-25T04:46:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.068+0000 7f5860ff9700 1 -- 172.21.15.72:0/3098056301 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f585c0180a0 con 0x7f58640cdeb0 2023-08-25T04:46:34.070 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:34.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 -- 172.21.15.72:0/3098056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f585006a0e0 msgr2=0x7f585006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f585006a0e0 0x7f585006c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58641e75b0 tx=0x7f5854008040 comp rx=0 tx=0).stop 2023-08-25T04:46:34.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 -- 172.21.15.72:0/3098056301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cdeb0 msgr2=0x7f58640c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cdeb0 0x7f58640c7d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f585c00cba0 tx=0x7f585c00ceb0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 -- 172.21.15.72:0/3098056301 shutdown_connections 2023-08-25T04:46:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f585006a0e0 0x7f585006c5a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58640cdeb0 0x7f58640c7d40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58640c71b0 0x7f58640cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 --2- 172.21.15.72:0/3098056301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f58640cd4f0 0x7f58641e1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 -- 172.21.15.72:0/3098056301 >> 172.21.15.72:0/3098056301 conn(0x7f58640d0c70 msgr2=0x7f58641e3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 -- 172.21.15.72:0/3098056301 shutdown_connections 2023-08-25T04:46:34.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.071+0000 7f586a5ff700 1 -- 172.21.15.72:0/3098056301 wait complete. 2023-08-25T04:46:34.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:34.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.286+0000 7f37005ff700 1 Processor -- start 2023-08-25T04:46:34.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.286+0000 7f37005ff700 1 -- start start 2023-08-25T04:46:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.287+0000 7f37005ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f36f806cfd0 0x7f36f806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.287+0000 7f37005ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36f80cdc20 0x7f36f8070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.287+0000 7f37005ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f8071510 0x7f36f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.287+0000 7f37005ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80cf060 con 0x7f36f80cdc20 2023-08-25T04:46:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.287+0000 7f37005ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f806d8f0 con 0x7f36f806cfd0 2023-08-25T04:46:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.287+0000 7f37005ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f815dd30 con 0x7f36f8071510 2023-08-25T04:46:34.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.287+0000 7f36fdb9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36f80cdc20 0x7f36f8070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.287+0000 7f36fdb9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36f80cdc20 0x7f36f8070fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33534/0 (socket says 172.21.15.72:33534) 2023-08-25T04:46:34.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.287+0000 7f36fdb9a700 1 -- 172.21.15.72:0/2078563460 learned_addr learned my addr 172.21.15.72:0/2078563460 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:34.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36feb9c700 1 --2- 172.21.15.72:0/2078563460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f8071510 0x7f36f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fe39b700 1 --2- 172.21.15.72:0/2078563460 >> v2:172.21.15.137:3300/0 conn(0x7f36f806cfd0 0x7f36f806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fdb9a700 1 -- 172.21.15.72:0/2078563460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f8071510 msgr2=0x7f36f80cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fdb9a700 1 --2- 172.21.15.72:0/2078563460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f8071510 0x7f36f80cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fdb9a700 1 -- 172.21.15.72:0/2078563460 >> v2:172.21.15.137:3300/0 conn(0x7f36f806cfd0 msgr2=0x7f36f806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fdb9a700 1 --2- 172.21.15.72:0/2078563460 >> v2:172.21.15.137:3300/0 conn(0x7f36f806cfd0 0x7f36f806d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fdb9a700 1 -- 172.21.15.72:0/2078563460 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f815e010 con 0x7f36f80cdc20 2023-08-25T04:46:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36feb9c700 1 --2- 172.21.15.72:0/2078563460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f8071510 0x7f36f80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fe39b700 1 --2- 172.21.15.72:0/2078563460 >> v2:172.21.15.137:3300/0 conn(0x7f36f806cfd0 0x7f36f806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fdb9a700 1 --2- 172.21.15.72:0/2078563460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f80cdc20 0x7f36f8070fd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f36f806dc90 tx=0x7f36e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7f27f37a35f360 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fd399700 1 -- 172.21.15.72:0/2078563460 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e800b870 con 0x7f36f80cdc20 2023-08-25T04:46:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fd399700 1 -- 172.21.15.72:0/2078563460 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e800b9d0 con 0x7f36f80cdc20 2023-08-25T04:46:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.288+0000 7f36fd399700 1 -- 172.21.15.72:0/2078563460 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e800bd60 con 0x7f36f80cdc20 2023-08-25T04:46:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.289+0000 7f37005ff700 1 -- 172.21.15.72:0/2078563460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f80cdc20 msgr2=0x7f36f8070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.289+0000 7f37005ff700 1 --2- 172.21.15.72:0/2078563460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f80cdc20 0x7f36f8070fd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f36f806dc90 tx=0x7f36e8009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.289+0000 7f37005ff700 1 -- 172.21.15.72:0/2078563460 shutdown_connections 2023-08-25T04:46:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.289+0000 7f37005ff700 1 --2- 172.21.15.72:0/2078563460 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f8071510 0x7f36f80cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.289+0000 7f37005ff700 1 --2- 172.21.15.72:0/2078563460 >> v2:172.21.15.137:3300/0 conn(0x7f36f806cfd0 0x7f36f806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.289+0000 7f37005ff700 1 --2- 172.21.15.72:0/2078563460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f80cdc20 0x7f36f8070fd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.289+0000 7f37005ff700 1 -- 172.21.15.72:0/2078563460 >> 172.21.15.72:0/2078563460 conn(0x7f36f806a2f0 msgr2=0x7f36f806a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.289+0000 7f37005ff700 1 -- 172.21.15.72:0/2078563460 shutdown_connections 2023-08-25T04:46:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.289+0000 7f37005ff700 1 -- 172.21.15.72:0/2078563460 wait complete. 2023-08-25T04:46:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.291+0000 7f37005ff700 1 Processor -- start 2023-08-25T04:46:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.291+0000 7f37005ff700 1 -- start start 2023-08-25T04:46:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f37005ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36f806cfd0 0x7f36f80b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f37005ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f8071510 0x7f36f814c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f37005ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f80cdc20 0x7f36f814c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f37005ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80b4a80 con 0x7f36f8071510 2023-08-25T04:46:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f37005ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80c4840 con 0x7f36f806cfd0 2023-08-25T04:46:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f37005ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80c4b20 con 0x7f36f80cdc20 2023-08-25T04:46:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f36fdb9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f8071510 0x7f36f814c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f36fdb9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f8071510 0x7f36f814c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33546/0 (socket says 172.21.15.72:33546) 2023-08-25T04:46:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f36fdb9a700 1 -- 172.21.15.72:0/3354462288 learned_addr learned my addr 172.21.15.72:0/3354462288 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f36fe39b700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36f806cfd0 0x7f36f80b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.292+0000 7f36feb9c700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f80cdc20 0x7f36f814c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f36fdb9a700 1 -- 172.21.15.72:0/3354462288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f80cdc20 msgr2=0x7f36f814c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f36fdb9a700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f80cdc20 0x7f36f814c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f36fdb9a700 1 -- 172.21.15.72:0/3354462288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36f806cfd0 msgr2=0x7f36f80b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f36fdb9a700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36f806cfd0 0x7f36f80b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f36fdb9a700 1 -- 172.21.15.72:0/3354462288 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e8009550 con 0x7f36f8071510 2023-08-25T04:46:34.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f36fdb9a700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f8071510 0x7f36f814c210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f36e8014040 tx=0x7f36e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:34.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f36eeffd700 1 -- 172.21.15.72:0/3354462288 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8004310 con 0x7f36f8071510 2023-08-25T04:46:34.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f36eeffd700 1 -- 172.21.15.72:0/3354462288 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e801f070 con 0x7f36f8071510 2023-08-25T04:46:34.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f36eeffd700 1 -- 172.21.15.72:0/3354462288 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80036a0 con 0x7f36f8071510 2023-08-25T04:46:34.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f37005ff700 1 -- 172.21.15.72:0/3354462288 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f80c4e00 con 0x7f36f8071510 2023-08-25T04:46:34.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.293+0000 7f37005ff700 1 -- 172.21.15.72:0/3354462288 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f80c53c0 con 0x7f36f8071510 2023-08-25T04:46:34.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.294+0000 7f37005ff700 1 -- 172.21.15.72:0/3354462288 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f80c2520 con 0x7f36f8071510 2023-08-25T04:46:34.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.295+0000 7f36eeffd700 1 -- 172.21.15.72:0/3354462288 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f36e8021030 con 0x7f36f8071510 2023-08-25T04:46:34.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.296+0000 7f36eeffd700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36dc06a0e0 0x7f36dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.296+0000 7f36eeffd700 1 -- 172.21.15.72:0/3354462288 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f36e8089bc0 con 0x7f36f8071510 2023-08-25T04:46:34.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.296+0000 7f36fe39b700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36dc06a0e0 0x7f36dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.297+0000 7f36fe39b700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36dc06a0e0 0x7f36dc06c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f36f4006ba0 tx=0x7f36f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:34.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.300+0000 7f36eeffd700 1 -- 172.21.15.72:0/3354462288 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f36e8055090 con 0x7f36f8071510 2023-08-25T04:46:34.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.494+0000 7f37005ff700 1 -- 172.21.15.72:0/3354462288 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36f80c5600 con 0x7f36f8071510 2023-08-25T04:46:34.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.496+0000 7f36eeffd700 1 -- 172.21.15.72:0/3354462288 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f36e80586b0 con 0x7f36f8071510 2023-08-25T04:46:34.497 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:34.498 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:34.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.498+0000 7f37005ff700 1 -- 172.21.15.72:0/3354462288 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36dc06a0e0 msgr2=0x7f36dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.498+0000 7f37005ff700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36dc06a0e0 0x7f36dc06c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f36f4006ba0 tx=0x7f36f4008040 comp rx=0 tx=0).stop 2023-08-25T04:46:34.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.498+0000 7f37005ff700 1 -- 172.21.15.72:0/3354462288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f8071510 msgr2=0x7f36f814c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.498+0000 7f37005ff700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f8071510 0x7f36f814c210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f36e8014040 tx=0x7f36e8004750 comp rx=0 tx=0).stop 2023-08-25T04:46:34.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.498+0000 7f37005ff700 1 -- 172.21.15.72:0/3354462288 shutdown_connections 2023-08-25T04:46:34.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.498+0000 7f37005ff700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f36dc06a0e0 0x7f36dc06c5a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.498+0000 7f37005ff700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f36f80cdc20 0x7f36f814c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.498+0000 7f37005ff700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36f806cfd0 0x7f36f80b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.498+0000 7f37005ff700 1 --2- 172.21.15.72:0/3354462288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f8071510 0x7f36f814c210 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.498+0000 7f37005ff700 1 -- 172.21.15.72:0/3354462288 >> 172.21.15.72:0/3354462288 conn(0x7f36f806a2f0 msgr2=0x7f36f815e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:34.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.499+0000 7f37005ff700 1 -- 172.21.15.72:0/3354462288 shutdown_connections 2023-08-25T04:46:34.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.499+0000 7f37005ff700 1 -- 172.21.15.72:0/3354462288 wait complete. 2023-08-25T04:46:34.518 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:34.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:34.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.719+0000 7f41801ff700 1 Processor -- start 2023-08-25T04:46:34.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.719+0000 7f41801ff700 1 -- start start 2023-08-25T04:46:34.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.720+0000 7f41801ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41780ade30 0x7f41780ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.720+0000 7f41801ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f417815da20 0x7f4178070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f41801ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4178070ed0 0x7f417806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f41801ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4178071340 con 0x7f41780ade30 2023-08-25T04:46:34.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f41801ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41780ae750 con 0x7f417815da20 2023-08-25T04:46:34.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f41801ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780ae9d0 con 0x7f4178070ed0 2023-08-25T04:46:34.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f417df9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41780ade30 0x7f41780ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f417df9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41780ade30 0x7f41780ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33554/0 (socket says 172.21.15.72:33554) 2023-08-25T04:46:34.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f417df9b700 1 -- 172.21.15.72:0/3979752455 learned_addr learned my addr 172.21.15.72:0/3979752455 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:34.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f417e79c700 1 --2- 172.21.15.72:0/3979752455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4178070ed0 0x7f417806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f417d79a700 1 --2- 172.21.15.72:0/3979752455 >> v2:172.21.15.137:3300/0 conn(0x7f417815da20 0x7f4178070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f417df9b700 1 -- 172.21.15.72:0/3979752455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4178070ed0 msgr2=0x7f417806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:34.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f417df9b700 1 --2- 172.21.15.72:0/3979752455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4178070ed0 0x7f417806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f417df9b700 1 -- 172.21.15.72:0/3979752455 >> v2:172.21.15.137:3300/0 conn(0x7f417815da20 msgr2=0x7f4178070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:34.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f417df9b700 1 --2- 172.21.15.72:0/3979752455 >> v2:172.21.15.137:3300/0 conn(0x7f417815da20 0x7f4178070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.721+0000 7f417df9b700 1 -- 172.21.15.72:0/3979752455 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178159d70 con 0x7f41780ade30 2023-08-25T04:46:34.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f417df9b700 1 --2- 172.21.15.72:0/3979752455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41780ade30 0x7f41780ae210 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f41780b1630 tx=0x7f417400ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b06e3f416cd468 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:34.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f417cf99700 1 -- 172.21.15.72:0/3979752455 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417400cb70 con 0x7f41780ade30 2023-08-25T04:46:34.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f417cf99700 1 -- 172.21.15.72:0/3979752455 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417400ccd0 con 0x7f41780ade30 2023-08-25T04:46:34.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f417cf99700 1 -- 172.21.15.72:0/3979752455 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174010640 con 0x7f41780ade30 2023-08-25T04:46:34.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f41801ff700 1 -- 172.21.15.72:0/3979752455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41780ade30 msgr2=0x7f41780ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f41801ff700 1 --2- 172.21.15.72:0/3979752455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41780ade30 0x7f41780ae210 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f41780b1630 tx=0x7f417400ad70 comp rx=0 tx=0).stop 2023-08-25T04:46:34.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f41801ff700 1 -- 172.21.15.72:0/3979752455 shutdown_connections 2023-08-25T04:46:34.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f41801ff700 1 --2- 172.21.15.72:0/3979752455 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4178070ed0 0x7f417806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f41801ff700 1 --2- 172.21.15.72:0/3979752455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41780ade30 0x7f41780ae210 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f41801ff700 1 --2- 172.21.15.72:0/3979752455 >> v2:172.21.15.137:3300/0 conn(0x7f417815da20 0x7f4178070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f41801ff700 1 -- 172.21.15.72:0/3979752455 >> 172.21.15.72:0/3979752455 conn(0x7f417806a710 msgr2=0x7f417806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:34.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.722+0000 7f41801ff700 1 -- 172.21.15.72:0/3979752455 shutdown_connections 2023-08-25T04:46:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.723+0000 7f41801ff700 1 -- 172.21.15.72:0/3979752455 wait complete. 2023-08-25T04:46:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.724+0000 7f41801ff700 1 Processor -- start 2023-08-25T04:46:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.724+0000 7f41801ff700 1 -- start start 2023-08-25T04:46:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.725+0000 7f41801ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4178070ed0 0x7f41780c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.725+0000 7f41801ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41780ade30 0x7f41780c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.725+0000 7f41801ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f417815da20 0x7f41781f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.725+0000 7f41801ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c4f40 con 0x7f4178070ed0 2023-08-25T04:46:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.725+0000 7f41801ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c2d90 con 0x7f417815da20 2023-08-25T04:46:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.725+0000 7f41801ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780b2fc0 con 0x7f41780ade30 2023-08-25T04:46:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.725+0000 7f417df9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4178070ed0 0x7f41780c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417df9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4178070ed0 0x7f41780c51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33568/0 (socket says 172.21.15.72:33568) 2023-08-25T04:46:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417df9b700 1 -- 172.21.15.72:0/3661654905 learned_addr learned my addr 172.21.15.72:0/3661654905 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417d79a700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41780ade30 0x7f41780c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417e79c700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f417815da20 0x7f41781f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417df9b700 1 -- 172.21.15.72:0/3661654905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41780ade30 msgr2=0x7f41780c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417df9b700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41780ade30 0x7f41780c3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417df9b700 1 -- 172.21.15.72:0/3661654905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f417815da20 msgr2=0x7f41781f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417df9b700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f417815da20 0x7f41781f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417df9b700 1 -- 172.21.15.72:0/3661654905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417400a6f0 con 0x7f4178070ed0 2023-08-25T04:46:34.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417d79a700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41780ade30 0x7f41780c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:34.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f417df9b700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4178070ed0 0x7f41780c51e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4174000c00 tx=0x7f4174004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:34.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f416e7fc700 1 -- 172.21.15.72:0/3661654905 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417401e070 con 0x7f4178070ed0 2023-08-25T04:46:34.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f416e7fc700 1 -- 172.21.15.72:0/3661654905 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417400ce40 con 0x7f4178070ed0 2023-08-25T04:46:34.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f41801ff700 1 -- 172.21.15.72:0/3661654905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41780c27d0 con 0x7f4178070ed0 2023-08-25T04:46:34.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.726+0000 7f416e7fc700 1 -- 172.21.15.72:0/3661654905 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740036a0 con 0x7f4178070ed0 2023-08-25T04:46:34.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.727+0000 7f41801ff700 1 -- 172.21.15.72:0/3661654905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41780b3260 con 0x7f4178070ed0 2023-08-25T04:46:34.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.728+0000 7f41801ff700 1 -- 172.21.15.72:0/3661654905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4178072320 con 0x7f4178070ed0 2023-08-25T04:46:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.728+0000 7f416e7fc700 1 -- 172.21.15.72:0/3661654905 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4174022070 con 0x7f4178070ed0 2023-08-25T04:46:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.729+0000 7f416e7fc700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f415c06a0e0 0x7f415c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.729+0000 7f416e7fc700 1 -- 172.21.15.72:0/3661654905 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4174089710 con 0x7f4178070ed0 2023-08-25T04:46:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.729+0000 7f417d79a700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f415c06a0e0 0x7f415c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.730+0000 7f417d79a700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f415c06a0e0 0x7f415c06c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f41780c5720 tx=0x7f4168008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.734+0000 7f416e7fc700 1 -- 172.21.15.72:0/3661654905 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4174054ac0 con 0x7f4178070ed0 2023-08-25T04:46:34.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.929+0000 7f41801ff700 1 -- 172.21.15.72:0/3661654905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f41780744f0 con 0x7f4178070ed0 2023-08-25T04:46:34.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.929+0000 7f416e7fc700 1 -- 172.21.15.72:0/3661654905 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f41740580e0 con 0x7f4178070ed0 2023-08-25T04:46:34.931 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:34.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 -- 172.21.15.72:0/3661654905 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f415c06a0e0 msgr2=0x7f415c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f415c06a0e0 0x7f415c06c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f41780c5720 tx=0x7f4168008040 comp rx=0 tx=0).stop 2023-08-25T04:46:34.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 -- 172.21.15.72:0/3661654905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4178070ed0 msgr2=0x7f41780c51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:34.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4178070ed0 0x7f41780c51e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4174000c00 tx=0x7f4174004750 comp rx=0 tx=0).stop 2023-08-25T04:46:34.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 -- 172.21.15.72:0/3661654905 shutdown_connections 2023-08-25T04:46:34.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f415c06a0e0 0x7f415c06c5a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f417815da20 0x7f41781f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4178070ed0 0x7f41780c51e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 --2- 172.21.15.72:0/3661654905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41780ade30 0x7f41780c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 -- 172.21.15.72:0/3661654905 >> 172.21.15.72:0/3661654905 conn(0x7f417806a710 msgr2=0x7f417815ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 -- 172.21.15.72:0/3661654905 shutdown_connections 2023-08-25T04:46:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:34.932+0000 7f41801ff700 1 -- 172.21.15.72:0/3661654905 wait complete. 2023-08-25T04:46:34.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:35.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.150+0000 7fc8459ff700 1 Processor -- start 2023-08-25T04:46:35.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.150+0000 7fc8459ff700 1 -- start start 2023-08-25T04:46:35.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.151+0000 7fc8459ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc840150ac0 0x7fc84015def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.151+0000 7fc8459ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8400cbd60 0x7fc84015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.151+0000 7fc8459ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8400aebf0 con 0x7fc840150ea0 2023-08-25T04:46:35.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.151+0000 7fc8459ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8400af490 con 0x7fc840150ac0 2023-08-25T04:46:35.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.151+0000 7fc8459ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84015d7c0 con 0x7fc8400cbd60 2023-08-25T04:46:35.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.151+0000 7fc83e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc840150ea0 0x7fc8400cb650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53422/0 (socket says 172.21.15.72:53422) 2023-08-25T04:46:35.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.151+0000 7fc83e7fc700 1 -- 172.21.15.72:0/1773377596 learned_addr learned my addr 172.21.15.72:0/1773377596 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:35.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.152+0000 7fc83f7fe700 1 --2- 172.21.15.72:0/1773377596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8400cbd60 0x7fc84015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.152+0000 7fc83effd700 1 --2- 172.21.15.72:0/1773377596 >> v2:172.21.15.137:3300/0 conn(0x7fc840150ac0 0x7fc84015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.152+0000 7fc83dffb700 1 -- 172.21.15.72:0/1773377596 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589133799 0 0) 0x7fc8400aebf0 con 0x7fc840150ea0 2023-08-25T04:46:35.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.152+0000 7fc83dffb700 1 -- 172.21.15.72:0/1773377596 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8280035b0 con 0x7fc840150ea0 2023-08-25T04:46:35.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.152+0000 7fc83effd700 1 -- 172.21.15.72:0/1773377596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8400cbd60 msgr2=0x7fc84015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:35.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.152+0000 7fc83effd700 1 --2- 172.21.15.72:0/1773377596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8400cbd60 0x7fc84015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.152+0000 7fc83effd700 1 -- 172.21.15.72:0/1773377596 >> v1:172.21.15.72:6789/0 conn(0x7fc840150ea0 legacy=0x7fc8400cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.152+0000 7fc83effd700 1 -- 172.21.15.72:0/1773377596 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400aeed0 con 0x7fc840150ac0 2023-08-25T04:46:35.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.152+0000 7fc83effd700 1 --2- 172.21.15.72:0/1773377596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc840150ac0 0x7fc84015def0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc830009840 tx=0x7fc830009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59c684be89513d40 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:35.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc83dffb700 1 -- 172.21.15.72:0/1773377596 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011830 con 0x7fc840150ac0 2023-08-25T04:46:35.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc83dffb700 1 -- 172.21.15.72:0/1773377596 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830011990 con 0x7fc840150ac0 2023-08-25T04:46:35.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc83dffb700 1 -- 172.21.15.72:0/1773377596 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011d20 con 0x7fc840150ac0 2023-08-25T04:46:35.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc8459ff700 1 -- 172.21.15.72:0/1773377596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc840150ac0 msgr2=0x7fc84015def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc8459ff700 1 --2- 172.21.15.72:0/1773377596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc840150ac0 0x7fc84015def0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc830009840 tx=0x7fc830009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:35.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc8459ff700 1 -- 172.21.15.72:0/1773377596 shutdown_connections 2023-08-25T04:46:35.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc8459ff700 1 --2- 172.21.15.72:0/1773377596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc840150ac0 0x7fc84015def0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc8459ff700 1 --2- 172.21.15.72:0/1773377596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc8400cbd60 0x7fc84015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc8459ff700 1 -- 172.21.15.72:0/1773377596 >> 172.21.15.72:0/1773377596 conn(0x7fc84006a710 msgr2=0x7fc84006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc8459ff700 1 -- 172.21.15.72:0/1773377596 shutdown_connections 2023-08-25T04:46:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.153+0000 7fc8459ff700 1 -- 172.21.15.72:0/1773377596 wait complete. 2023-08-25T04:46:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.155+0000 7fc8459ff700 1 Processor -- start 2023-08-25T04:46:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.155+0000 7fc8459ff700 1 -- start start 2023-08-25T04:46:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.156+0000 7fc8459ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8400cbd60 0x7fc8401f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.156+0000 7fc8459ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc840150ac0 0x7fc8400c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.156+0000 7fc8459ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc840150ea0 0x7fc8400c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.156+0000 7fc8459ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401f3480 con 0x7fc840150ea0 2023-08-25T04:46:35.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.156+0000 7fc8459ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401f69d0 con 0x7fc8400cbd60 2023-08-25T04:46:35.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.156+0000 7fc8459ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84013f8d0 con 0x7fc840150ac0 2023-08-25T04:46:35.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc840150ea0 0x7fc8400c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc840150ea0 0x7fc8400c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33578/0 (socket says 172.21.15.72:33578) 2023-08-25T04:46:35.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83f7fe700 1 -- 172.21.15.72:0/1094779044 learned_addr learned my addr 172.21.15.72:0/1094779044 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:35.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83e7fc700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc840150ac0 0x7fc8400c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83effd700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8400cbd60 0x7fc8401f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83f7fe700 1 -- 172.21.15.72:0/1094779044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc840150ac0 msgr2=0x7fc8400c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83f7fe700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc840150ac0 0x7fc8400c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83f7fe700 1 -- 172.21.15.72:0/1094779044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8400cbd60 msgr2=0x7fc8401f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83f7fe700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8400cbd60 0x7fc8401f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83f7fe700 1 -- 172.21.15.72:0/1094779044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300094a0 con 0x7fc840150ea0 2023-08-25T04:46:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc83f7fe700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc840150ea0 0x7fc8400c2a30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc83800efc0 tx=0x7fc83800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc827fff700 1 -- 172.21.15.72:0/1094779044 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800cd40 con 0x7fc840150ea0 2023-08-25T04:46:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc827fff700 1 -- 172.21.15.72:0/1094779044 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800f040 con 0x7fc840150ea0 2023-08-25T04:46:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.157+0000 7fc8459ff700 1 -- 172.21.15.72:0/1094779044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8401f26c0 con 0x7fc840150ea0 2023-08-25T04:46:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.158+0000 7fc827fff700 1 -- 172.21.15.72:0/1094779044 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8380146c0 con 0x7fc840150ea0 2023-08-25T04:46:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.158+0000 7fc8459ff700 1 -- 172.21.15.72:0/1094779044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8401f2c80 con 0x7fc840150ea0 2023-08-25T04:46:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.159+0000 7fc8459ff700 1 -- 172.21.15.72:0/1094779044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc840072320 con 0x7fc840150ea0 2023-08-25T04:46:35.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.159+0000 7fc827fff700 1 -- 172.21.15.72:0/1094779044 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc838014820 con 0x7fc840150ea0 2023-08-25T04:46:35.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.160+0000 7fc827fff700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc82c06a0e0 0x7fc82c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.160+0000 7fc827fff700 1 -- 172.21.15.72:0/1094779044 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc8380894b0 con 0x7fc840150ea0 2023-08-25T04:46:35.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.161+0000 7fc83effd700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc82c06a0e0 0x7fc82c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.161+0000 7fc83effd700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc82c06a0e0 0x7fc82c06c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc830000c00 tx=0x7fc830008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:35.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.165+0000 7fc827fff700 1 -- 172.21.15.72:0/1094779044 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc8380582f0 con 0x7fc840150ea0 2023-08-25T04:46:35.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.361+0000 7fc8459ff700 1 -- 172.21.15.72:0/1094779044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8400744f0 con 0x7fc840150ea0 2023-08-25T04:46:35.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.362+0000 7fc827fff700 1 -- 172.21.15.72:0/1094779044 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc83800cea0 con 0x7fc840150ea0 2023-08-25T04:46:35.363 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:35.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.364+0000 7fc8459ff700 1 -- 172.21.15.72:0/1094779044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc82c06a0e0 msgr2=0x7fc82c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.364+0000 7fc8459ff700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc82c06a0e0 0x7fc82c06c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc830000c00 tx=0x7fc830008030 comp rx=0 tx=0).stop 2023-08-25T04:46:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.364+0000 7fc8459ff700 1 -- 172.21.15.72:0/1094779044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc840150ea0 msgr2=0x7fc8400c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.364+0000 7fc8459ff700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc840150ea0 0x7fc8400c2a30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc83800efc0 tx=0x7fc83800c3a0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.364+0000 7fc8459ff700 1 -- 172.21.15.72:0/1094779044 shutdown_connections 2023-08-25T04:46:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.364+0000 7fc8459ff700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc82c06a0e0 0x7fc82c06c5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.364+0000 7fc8459ff700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc840150ea0 0x7fc8400c2a30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.364+0000 7fc8459ff700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8400cbd60 0x7fc8401f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.364+0000 7fc8459ff700 1 --2- 172.21.15.72:0/1094779044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc840150ac0 0x7fc8400c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.364+0000 7fc8459ff700 1 -- 172.21.15.72:0/1094779044 >> 172.21.15.72:0/1094779044 conn(0x7fc84006a710 msgr2=0x7fc8400b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:35.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.365+0000 7fc8459ff700 1 -- 172.21.15.72:0/1094779044 shutdown_connections 2023-08-25T04:46:35.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.365+0000 7fc8459ff700 1 -- 172.21.15.72:0/1094779044 wait complete. 2023-08-25T04:46:35.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:35.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.580+0000 7f9b23bff700 1 Processor -- start 2023-08-25T04:46:35.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.580+0000 7f9b23bff700 1 -- start start 2023-08-25T04:46:35.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b23bff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0d10c0 0x7f9b1c0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b23bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c0b8d10 con 0x7f9b1c15d000 2023-08-25T04:46:35.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b23bff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c0b6e90 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b23bff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0b56f0 con 0x7f9b1c0d10c0 2023-08-25T04:46:35.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b2199b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9b1c15d000 0x7f9b1c0b8600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53426/0 (socket says 172.21.15.72:53426) 2023-08-25T04:46:35.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b2199b700 1 -- 172.21.15.72:0/2284842936 learned_addr learned my addr 172.21.15.72:0/2284842936 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:35.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b2119a700 1 --2- 172.21.15.72:0/2284842936 >> v2:172.21.15.137:3300/0 conn(0x7f9b1c0d10c0 0x7f9b1c0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b20999700 1 -- 172.21.15.72:0/2284842936 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845774187 0 0) 0x7f9b1c0b8d10 con 0x7f9b1c15d000 2023-08-25T04:46:35.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b20999700 1 -- 172.21.15.72:0/2284842936 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b080035b0 con 0x7f9b1c15d000 2023-08-25T04:46:35.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b20999700 1 -- 172.21.15.72:0/2284842936 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753537007 0 0) 0x7f9b1c0b6e90 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.582+0000 7f9b20999700 1 -- 172.21.15.72:0/2284842936 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b1c0b8d10 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.583+0000 7f9b2119a700 1 -- 172.21.15.72:0/2284842936 >> v1:172.21.15.137:6789/0 conn(0x7f9b1c0b4d40 legacy=0x7f9b1c0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.583+0000 7f9b2119a700 1 -- 172.21.15.72:0/2284842936 >> v1:172.21.15.72:6789/0 conn(0x7f9b1c15d000 legacy=0x7f9b1c0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.583+0000 7f9b2119a700 1 -- 172.21.15.72:0/2284842936 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0b5170 con 0x7f9b1c0d10c0 2023-08-25T04:46:35.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.583+0000 7f9b2119a700 1 --2- 172.21.15.72:0/2284842936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c0d10c0 0x7f9b1c0b4800 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009840 tx=0x7f9b0c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=588516f6b13a69cc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:35.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.583+0000 7f9b20999700 1 -- 172.21.15.72:0/2284842936 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c011830 con 0x7f9b1c0d10c0 2023-08-25T04:46:35.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.583+0000 7f9b20999700 1 -- 172.21.15.72:0/2284842936 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c011990 con 0x7f9b1c0d10c0 2023-08-25T04:46:35.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.583+0000 7f9b20999700 1 -- 172.21.15.72:0/2284842936 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c011d20 con 0x7f9b1c0d10c0 2023-08-25T04:46:35.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.584+0000 7f9b23bff700 1 -- 172.21.15.72:0/2284842936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c0d10c0 msgr2=0x7f9b1c0b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.584+0000 7f9b23bff700 1 --2- 172.21.15.72:0/2284842936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c0d10c0 0x7f9b1c0b4800 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009840 tx=0x7f9b0c009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:35.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.584+0000 7f9b23bff700 1 -- 172.21.15.72:0/2284842936 shutdown_connections 2023-08-25T04:46:35.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.584+0000 7f9b23bff700 1 --2- 172.21.15.72:0/2284842936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c0d10c0 0x7f9b1c0b4800 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.584+0000 7f9b23bff700 1 -- 172.21.15.72:0/2284842936 >> 172.21.15.72:0/2284842936 conn(0x7f9b1c071e10 msgr2=0x7f9b1c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:35.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.584+0000 7f9b23bff700 1 -- 172.21.15.72:0/2284842936 shutdown_connections 2023-08-25T04:46:35.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.584+0000 7f9b23bff700 1 -- 172.21.15.72:0/2284842936 wait complete. 2023-08-25T04:46:35.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.585+0000 7f9b23bff700 1 Processor -- start 2023-08-25T04:46:35.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.586+0000 7f9b23bff700 1 -- start start 2023-08-25T04:46:35.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b23bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1c0b4d40 0x7f9b1c0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b23bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c0d10c0 0x7f9b1c0d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b23bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15d000 0x7f9b1c0d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b23bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1f32a0 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b23bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1f2720 con 0x7f9b1c0d10c0 2023-08-25T04:46:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b23bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1f2a00 con 0x7f9b1c15d000 2023-08-25T04:46:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2199b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1c0b4d40 0x7f9b1c0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2199b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1c0b4d40 0x7f9b1c0cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33588/0 (socket says 172.21.15.72:33588) 2023-08-25T04:46:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2199b700 1 -- 172.21.15.72:0/1019385666 learned_addr learned my addr 172.21.15.72:0/1019385666 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2119a700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c0d10c0 0x7f9b1c0d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2219c700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15d000 0x7f9b1c0d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2199b700 1 -- 172.21.15.72:0/1019385666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15d000 msgr2=0x7f9b1c0d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2199b700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15d000 0x7f9b1c0d19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2199b700 1 -- 172.21.15.72:0/1019385666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c0d10c0 msgr2=0x7f9b1c0d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2199b700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c0d10c0 0x7f9b1c0d14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2199b700 1 -- 172.21.15.72:0/1019385666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c0094a0 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2119a700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c0d10c0 0x7f9b1c0d14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2219c700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15d000 0x7f9b1c0d19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:35.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.587+0000 7f9b2199b700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1c0b4d40 0x7f9b1c0cccd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800c4d0 tx=0x7f9b1800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:35.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.588+0000 7f9b127fc700 1 -- 172.21.15.72:0/1019385666 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18005d70 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.588+0000 7f9b127fc700 1 -- 172.21.15.72:0/1019385666 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b180070d0 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.588+0000 7f9b23bff700 1 -- 172.21.15.72:0/1019385666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c1f2ce0 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.588+0000 7f9b127fc700 1 -- 172.21.15.72:0/1019385666 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18007480 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.588+0000 7f9b23bff700 1 -- 172.21.15.72:0/1019385666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c1f22e0 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.589+0000 7f9b23bff700 1 -- 172.21.15.72:0/1019385666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c06a2f0 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.590+0000 7f9b127fc700 1 -- 172.21.15.72:0/1019385666 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b180075e0 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.591+0000 7f9b127fc700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9b0006a0e0 0x7f9b0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:35.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.591+0000 7f9b127fc700 1 -- 172.21.15.72:0/1019385666 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9b18088220 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.591+0000 7f9b2119a700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9b0006a0e0 0x7f9b0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:35.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.592+0000 7f9b2119a700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9b0006a0e0 0x7f9b0006c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0b8c80 tx=0x7f9b0c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:35.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.594+0000 7f9b127fc700 1 -- 172.21.15.72:0/1019385666 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9b18053650 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.792+0000 7f9b23bff700 1 -- 172.21.15.72:0/1019385666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b1c1f24a0 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.793+0000 7f9b127fc700 1 -- 172.21.15.72:0/1019385666 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b18017020 con 0x7f9b1c0b4d40 2023-08-25T04:46:35.794 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:35.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 -- 172.21.15.72:0/1019385666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9b0006a0e0 msgr2=0x7f9b0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9b0006a0e0 0x7f9b0006c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0b8c80 tx=0x7f9b0c01c040 comp rx=0 tx=0).stop 2023-08-25T04:46:35.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 -- 172.21.15.72:0/1019385666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1c0b4d40 msgr2=0x7f9b1c0cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1c0b4d40 0x7f9b1c0cccd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800c4d0 tx=0x7f9b1800c890 comp rx=0 tx=0).stop 2023-08-25T04:46:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 -- 172.21.15.72:0/1019385666 shutdown_connections 2023-08-25T04:46:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9b0006a0e0 0x7f9b0006c5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b1c15d000 0x7f9b1c0d19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1c0b4d40 0x7f9b1c0cccd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 --2- 172.21.15.72:0/1019385666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b1c0d10c0 0x7f9b1c0d14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 -- 172.21.15.72:0/1019385666 >> 172.21.15.72:0/1019385666 conn(0x7f9b1c071e10 msgr2=0x7f9b1c0b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:35.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 -- 172.21.15.72:0/1019385666 shutdown_connections 2023-08-25T04:46:35.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:35.795+0000 7f9b23bff700 1 -- 172.21.15.72:0/1019385666 wait complete. 2023-08-25T04:46:35.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:36.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.013+0000 7fae545ff700 1 Processor -- start 2023-08-25T04:46:36.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.013+0000 7fae545ff700 1 -- start start 2023-08-25T04:46:36.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.014+0000 7fae545ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae4c150ac0 0x7fae4c15def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.014+0000 7fae545ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fae4c150ea0 0x7fae4c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae545ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c0aebf0 con 0x7fae4c15e430 2023-08-25T04:46:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae545ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4c0af490 con 0x7fae4c150ac0 2023-08-25T04:46:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae545ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4c15d7c0 con 0x7fae4c150ea0 2023-08-25T04:46:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae5239b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae4c150ac0 0x7fae4c15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae5239b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae4c150ac0 0x7fae4c15def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33598/0 (socket says 172.21.15.72:33598) 2023-08-25T04:46:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae5239b700 1 -- 172.21.15.72:0/3067389859 learned_addr learned my addr 172.21.15.72:0/3067389859 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae51b9a700 1 --2- 172.21.15.72:0/3067389859 >> v2:172.21.15.137:3300/0 conn(0x7fae4c150ea0 0x7fae4c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae5239b700 1 -- 172.21.15.72:0/3067389859 >> v2:172.21.15.137:3300/0 conn(0x7fae4c150ea0 msgr2=0x7fae4c0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae5239b700 1 --2- 172.21.15.72:0/3067389859 >> v2:172.21.15.137:3300/0 conn(0x7fae4c150ea0 0x7fae4c0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae5239b700 1 -- 172.21.15.72:0/3067389859 >> v1:172.21.15.137:6789/0 conn(0x7fae4c15e430 legacy=0x7fae4c15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae5239b700 1 -- 172.21.15.72:0/3067389859 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0aeed0 con 0x7fae4c150ac0 2023-08-25T04:46:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.015+0000 7fae5239b700 1 --2- 172.21.15.72:0/3067389859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 0x7fae4c15def0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0cb0a0 tx=0x7fae4800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3bd562917db742 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae51399700 1 -- 172.21.15.72:0/3067389859 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800dcf0 con 0x7fae4c150ac0 2023-08-25T04:46:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae51399700 1 -- 172.21.15.72:0/3067389859 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800de50 con 0x7fae4c150ac0 2023-08-25T04:46:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae51399700 1 -- 172.21.15.72:0/3067389859 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48004250 con 0x7fae4c150ac0 2023-08-25T04:46:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae545ff700 1 -- 172.21.15.72:0/3067389859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 msgr2=0x7fae4c15def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae545ff700 1 --2- 172.21.15.72:0/3067389859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 0x7fae4c15def0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0cb0a0 tx=0x7fae4800be70 comp rx=0 tx=0).stop 2023-08-25T04:46:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae545ff700 1 -- 172.21.15.72:0/3067389859 shutdown_connections 2023-08-25T04:46:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae545ff700 1 --2- 172.21.15.72:0/3067389859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 0x7fae4c15def0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae545ff700 1 --2- 172.21.15.72:0/3067389859 >> v2:172.21.15.137:3300/0 conn(0x7fae4c150ea0 0x7fae4c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae545ff700 1 -- 172.21.15.72:0/3067389859 >> 172.21.15.72:0/3067389859 conn(0x7fae4c06a710 msgr2=0x7fae4c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae545ff700 1 -- 172.21.15.72:0/3067389859 shutdown_connections 2023-08-25T04:46:36.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.016+0000 7fae545ff700 1 -- 172.21.15.72:0/3067389859 wait complete. 2023-08-25T04:46:36.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.018+0000 7fae545ff700 1 Processor -- start 2023-08-25T04:46:36.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.018+0000 7fae545ff700 1 -- start start 2023-08-25T04:46:36.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.019+0000 7fae545ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 0x7fae4c0c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.019+0000 7fae545ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae4c150ea0 0x7fae4c0c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.019+0000 7fae545ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae4c15e430 0x7fae4c0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.019+0000 7fae545ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0c2d40 con 0x7fae4c150ac0 2023-08-25T04:46:36.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.019+0000 7fae545ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c151420 con 0x7fae4c15e430 2023-08-25T04:46:36.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.019+0000 7fae545ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c151700 con 0x7fae4c150ea0 2023-08-25T04:46:36.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.019+0000 7fae5239b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 0x7fae4c0c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.019+0000 7fae5239b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 0x7fae4c0c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33606/0 (socket says 172.21.15.72:33606) 2023-08-25T04:46:36.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.019+0000 7fae5239b700 1 -- 172.21.15.72:0/3045637095 learned_addr learned my addr 172.21.15.72:0/3045637095 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:36.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae51b9a700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae4c150ea0 0x7fae4c0c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae52b9c700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae4c15e430 0x7fae4c0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae5239b700 1 -- 172.21.15.72:0/3045637095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae4c150ea0 msgr2=0x7fae4c0c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae5239b700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae4c150ea0 0x7fae4c0c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae5239b700 1 -- 172.21.15.72:0/3045637095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae4c15e430 msgr2=0x7fae4c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae5239b700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae4c15e430 0x7fae4c0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae5239b700 1 -- 172.21.15.72:0/3045637095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4800b7f0 con 0x7fae4c150ac0 2023-08-25T04:46:36.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae51b9a700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae4c150ea0 0x7fae4c0c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:36.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae52b9c700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae4c15e430 0x7fae4c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:36.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae5239b700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 0x7fae4c0c4fc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fae4800beb0 tx=0x7fae48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:36.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae42ffd700 1 -- 172.21.15.72:0/3045637095 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48004230 con 0x7fae4c150ac0 2023-08-25T04:46:36.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae42ffd700 1 -- 172.21.15.72:0/3045637095 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae48010470 con 0x7fae4c150ac0 2023-08-25T04:46:36.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae545ff700 1 -- 172.21.15.72:0/3045637095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c1519e0 con 0x7fae4c150ac0 2023-08-25T04:46:36.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae42ffd700 1 -- 172.21.15.72:0/3045637095 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48010820 con 0x7fae4c150ac0 2023-08-25T04:46:36.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.020+0000 7fae545ff700 1 -- 172.21.15.72:0/3045637095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c0c2a30 con 0x7fae4c150ac0 2023-08-25T04:46:36.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.021+0000 7fae545ff700 1 -- 172.21.15.72:0/3045637095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c151f00 con 0x7fae4c150ac0 2023-08-25T04:46:36.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.022+0000 7fae42ffd700 1 -- 172.21.15.72:0/3045637095 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fae480193f0 con 0x7fae4c150ac0 2023-08-25T04:46:36.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.023+0000 7fae42ffd700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fae3006a0e0 0x7fae3006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.024+0000 7fae42ffd700 1 -- 172.21.15.72:0/3045637095 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fae4808a7e0 con 0x7fae4c150ac0 2023-08-25T04:46:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.024+0000 7fae51b9a700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fae3006a0e0 0x7fae3006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.024+0000 7fae51b9a700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fae3006a0e0 0x7fae3006c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0caa60 tx=0x7fae3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:36.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.028+0000 7fae42ffd700 1 -- 172.21.15.72:0/3045637095 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fae480596c0 con 0x7fae4c150ac0 2023-08-25T04:46:36.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.221+0000 7fae545ff700 1 -- 172.21.15.72:0/3045637095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae4c072320 con 0x7fae4c150ac0 2023-08-25T04:46:36.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.221+0000 7fae42ffd700 1 -- 172.21.15.72:0/3045637095 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae48059250 con 0x7fae4c150ac0 2023-08-25T04:46:36.223 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:36.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 -- 172.21.15.72:0/3045637095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fae3006a0e0 msgr2=0x7fae3006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fae3006a0e0 0x7fae3006c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0caa60 tx=0x7fae3c008040 comp rx=0 tx=0).stop 2023-08-25T04:46:36.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 -- 172.21.15.72:0/3045637095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 msgr2=0x7fae4c0c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 0x7fae4c0c4fc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fae4800beb0 tx=0x7fae48004750 comp rx=0 tx=0).stop 2023-08-25T04:46:36.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 -- 172.21.15.72:0/3045637095 shutdown_connections 2023-08-25T04:46:36.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fae3006a0e0 0x7fae3006c5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae4c15e430 0x7fae4c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c150ac0 0x7fae4c0c4fc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 --2- 172.21.15.72:0/3045637095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae4c150ea0 0x7fae4c0c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 -- 172.21.15.72:0/3045637095 >> 172.21.15.72:0/3045637095 conn(0x7fae4c06a710 msgr2=0x7fae4c06c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:36.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 -- 172.21.15.72:0/3045637095 shutdown_connections 2023-08-25T04:46:36.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.224+0000 7fae545ff700 1 -- 172.21.15.72:0/3045637095 wait complete. 2023-08-25T04:46:36.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:36.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.443+0000 7f32c07ff700 1 Processor -- start 2023-08-25T04:46:36.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.443+0000 7f32c07ff700 1 -- start start 2023-08-25T04:46:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.444+0000 7f32c07ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 0x7f32b80cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.444+0000 7f32c07ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f32b80b2c90 0x7f32b80710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.444+0000 7f32c07ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b80b4300 con 0x7f32b80b2810 2023-08-25T04:46:36.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.444+0000 7f32c07ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b80cbf70 con 0x7f32b80b2c90 2023-08-25T04:46:36.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.444+0000 7f32c07ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80b3260 con 0x7f32b80cb650 2023-08-25T04:46:36.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32bed9c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f32b80b2c90 0x7f32b80710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32be59b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 0x7f32b80cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32bed9c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f32b80b2c90 0x7f32b80710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:35548/0 (socket says 172.21.15.72:35548) 2023-08-25T04:46:36.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32bed9c700 1 -- 172.21.15.72:0/2782422471 learned_addr learned my addr 172.21.15.72:0/2782422471 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:36.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32bdd9a700 1 --1- 172.21.15.72:0/2782422471 >> v1:172.21.15.137:6789/0 conn(0x7f32b80b2810 0x7f32b8070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:57406/0 (socket says 172.21.15.72:57406) 2023-08-25T04:46:36.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32be59b700 1 -- 172.21.15.72:0/2782422471 >> v2:172.21.15.137:3300/0 conn(0x7f32b80b2c90 msgr2=0x7f32b80710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:36.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32be59b700 1 --2- 172.21.15.72:0/2782422471 >> v2:172.21.15.137:3300/0 conn(0x7f32b80b2c90 0x7f32b80710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32be59b700 1 -- 172.21.15.72:0/2782422471 >> v1:172.21.15.137:6789/0 conn(0x7f32b80b2810 legacy=0x7f32b8070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32be59b700 1 -- 172.21.15.72:0/2782422471 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80b3540 con 0x7f32b80cb650 2023-08-25T04:46:36.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32bd599700 1 -- 172.21.15.72:0/2782422471 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100118071 0 0) 0x7f32b80b4300 con 0x7f32b80b2810 2023-08-25T04:46:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.445+0000 7f32bed9c700 1 --2- 172.21.15.72:0/2782422471 >> v2:172.21.15.137:3300/0 conn(0x7f32b80b2c90 0x7f32b80710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.446+0000 7f32be59b700 1 --2- 172.21.15.72:0/2782422471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 0x7f32b80cba30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009840 tx=0x7f32b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c94d3240b10ae71e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.446+0000 7f32bd599700 1 -- 172.21.15.72:0/2782422471 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4011830 con 0x7f32b80cb650 2023-08-25T04:46:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.446+0000 7f32bd599700 1 -- 172.21.15.72:0/2782422471 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b4011990 con 0x7f32b80cb650 2023-08-25T04:46:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.446+0000 7f32bd599700 1 -- 172.21.15.72:0/2782422471 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4011d20 con 0x7f32b80cb650 2023-08-25T04:46:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.446+0000 7f32c07ff700 1 -- 172.21.15.72:0/2782422471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 msgr2=0x7f32b80cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.446+0000 7f32c07ff700 1 --2- 172.21.15.72:0/2782422471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 0x7f32b80cba30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009840 tx=0x7f32b4009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.447+0000 7f32c07ff700 1 -- 172.21.15.72:0/2782422471 shutdown_connections 2023-08-25T04:46:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.447+0000 7f32c07ff700 1 --2- 172.21.15.72:0/2782422471 >> v2:172.21.15.137:3300/0 conn(0x7f32b80b2c90 0x7f32b80710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.447+0000 7f32c07ff700 1 --2- 172.21.15.72:0/2782422471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 0x7f32b80cba30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.447+0000 7f32c07ff700 1 -- 172.21.15.72:0/2782422471 >> 172.21.15.72:0/2782422471 conn(0x7f32b806a710 msgr2=0x7f32b806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.447+0000 7f32c07ff700 1 -- 172.21.15.72:0/2782422471 shutdown_connections 2023-08-25T04:46:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.447+0000 7f32c07ff700 1 -- 172.21.15.72:0/2782422471 wait complete. 2023-08-25T04:46:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.448+0000 7f32c07ff700 1 Processor -- start 2023-08-25T04:46:36.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.449+0000 7f32c07ff700 1 -- start start 2023-08-25T04:46:36.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.449+0000 7f32c07ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32b80b2810 0x7f32b815d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32c07ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32b80b2c90 0x7f32b81f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32c07ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 0x7f32b80c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32c07ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b815d970 con 0x7f32b80b2c90 2023-08-25T04:46:36.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32c07ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b81f3340 con 0x7f32b80b2810 2023-08-25T04:46:36.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32c07ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b81f2d80 con 0x7f32b80cb650 2023-08-25T04:46:36.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32bdd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32b80b2c90 0x7f32b81f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32bdd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32b80b2c90 0x7f32b81f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33620/0 (socket says 172.21.15.72:33620) 2023-08-25T04:46:36.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32bdd9a700 1 -- 172.21.15.72:0/2944193536 learned_addr learned my addr 172.21.15.72:0/2944193536 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32be59b700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32b80b2810 0x7f32b815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32bed9c700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 0x7f32b80c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32bdd9a700 1 -- 172.21.15.72:0/2944193536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 msgr2=0x7f32b80c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32bdd9a700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 0x7f32b80c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32bdd9a700 1 -- 172.21.15.72:0/2944193536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32b80b2810 msgr2=0x7f32b815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32bdd9a700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32b80b2810 0x7f32b815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32bdd9a700 1 -- 172.21.15.72:0/2944193536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009b30 con 0x7f32b80b2c90 2023-08-25T04:46:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.450+0000 7f32bed9c700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 0x7f32b80c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.451+0000 7f32bdd9a700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32b80b2c90 0x7f32b81f2340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f32a800c550 tx=0x7f32a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.451+0000 7f32aeffd700 1 -- 172.21.15.72:0/2944193536 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8004c80 con 0x7f32b80b2c90 2023-08-25T04:46:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.451+0000 7f32aeffd700 1 -- 172.21.15.72:0/2944193536 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a8004e00 con 0x7f32b80b2c90 2023-08-25T04:46:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.451+0000 7f32aeffd700 1 -- 172.21.15.72:0/2944193536 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8007310 con 0x7f32b80b2c90 2023-08-25T04:46:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.451+0000 7f32c07ff700 1 -- 172.21.15.72:0/2944193536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b40094a0 con 0x7f32b80b2c90 2023-08-25T04:46:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.451+0000 7f32c07ff700 1 -- 172.21.15.72:0/2944193536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b80c6c10 con 0x7f32b80b2c90 2023-08-25T04:46:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.452+0000 7f32c07ff700 1 -- 172.21.15.72:0/2944193536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b8072320 con 0x7f32b80b2c90 2023-08-25T04:46:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.453+0000 7f32aeffd700 1 -- 172.21.15.72:0/2944193536 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f32a8007470 con 0x7f32b80b2c90 2023-08-25T04:46:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.454+0000 7f32aeffd700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f329c06a0e0 0x7f329c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.454+0000 7f32aeffd700 1 -- 172.21.15.72:0/2944193536 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32a8088590 con 0x7f32b80b2c90 2023-08-25T04:46:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.454+0000 7f32be59b700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f329c06a0e0 0x7f329c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.455+0000 7f32be59b700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f329c06a0e0 0x7f329c06c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f32b4000c00 tx=0x7f32b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.458+0000 7f32aeffd700 1 -- 172.21.15.72:0/2944193536 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f32a8053940 con 0x7f32b80b2c90 2023-08-25T04:46:36.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.653+0000 7f32c07ff700 1 -- 172.21.15.72:0/2944193536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f32b80b3ad0 con 0x7f32b80b2c90 2023-08-25T04:46:36.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.654+0000 7f32aeffd700 1 -- 172.21.15.72:0/2944193536 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f32a8056f60 con 0x7f32b80b2c90 2023-08-25T04:46:36.655 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:36.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.656+0000 7f32c07ff700 1 -- 172.21.15.72:0/2944193536 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f329c06a0e0 msgr2=0x7f329c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.656+0000 7f32c07ff700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f329c06a0e0 0x7f329c06c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f32b4000c00 tx=0x7f32b4008030 comp rx=0 tx=0).stop 2023-08-25T04:46:36.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.656+0000 7f32c07ff700 1 -- 172.21.15.72:0/2944193536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32b80b2c90 msgr2=0x7f32b81f2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.656+0000 7f32c07ff700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32b80b2c90 0x7f32b81f2340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f32a800c550 tx=0x7f32a800c910 comp rx=0 tx=0).stop 2023-08-25T04:46:36.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.656+0000 7f32c07ff700 1 -- 172.21.15.72:0/2944193536 shutdown_connections 2023-08-25T04:46:36.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.656+0000 7f32c07ff700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f329c06a0e0 0x7f329c06c5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.656+0000 7f32c07ff700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32b80cb650 0x7f32b80c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.656+0000 7f32c07ff700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32b80b2810 0x7f32b815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.656+0000 7f32c07ff700 1 --2- 172.21.15.72:0/2944193536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32b80b2c90 0x7f32b81f2340 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.656+0000 7f32c07ff700 1 -- 172.21.15.72:0/2944193536 >> 172.21.15.72:0/2944193536 conn(0x7f32b806a710 msgr2=0x7f32b806db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:36.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.657+0000 7f32c07ff700 1 -- 172.21.15.72:0/2944193536 shutdown_connections 2023-08-25T04:46:36.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.657+0000 7f32c07ff700 1 -- 172.21.15.72:0/2944193536 wait complete. 2023-08-25T04:46:36.685 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-25T04:46:36.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-08-25T04:46:36.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.881+0000 7f756c3ff700 1 Processor -- start 2023-08-25T04:46:36.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.881+0000 7f756c3ff700 1 -- start start 2023-08-25T04:46:36.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.882+0000 7f756c3ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f756415d130 0x7f75640d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.882+0000 7f756c3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75640d1780 con 0x7f75640b47c0 2023-08-25T04:46:36.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.882+0000 7f756c3ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75640d1a60 con 0x7f75640b86b0 2023-08-25T04:46:36.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.882+0000 7f756c3ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75640d1d40 con 0x7f756415d130 2023-08-25T04:46:36.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.882+0000 7f756a19b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f75640b47c0 0x7f75640b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53436/0 (socket says 172.21.15.72:53436) 2023-08-25T04:46:36.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.882+0000 7f756a19b700 1 -- 172.21.15.72:0/4058304331 learned_addr learned my addr 172.21.15.72:0/4058304331 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:36.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f756999a700 1 --2- 172.21.15.72:0/4058304331 >> v2:172.21.15.137:3300/0 conn(0x7f756415d130 0x7f75640d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279518752 0 0) 0x7f75640d1780 con 0x7f75640b47c0 2023-08-25T04:46:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75500035b0 con 0x7f75640b47c0 2023-08-25T04:46:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005007352 0 0) 0x7f75640d1a60 con 0x7f75640b86b0 2023-08-25T04:46:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75640d1780 con 0x7f75640b86b0 2023-08-25T04:46:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 156558083 0 0) 0x7f75500035b0 con 0x7f75640b47c0 2023-08-25T04:46:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 >> v2:172.21.15.137:3300/0 conn(0x7f756415d130 msgr2=0x7f75640d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 --2- 172.21.15.72:0/4058304331 >> v2:172.21.15.137:3300/0 conn(0x7f756415d130 0x7f75640d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 >> v1:172.21.15.137:6789/0 conn(0x7f75640b86b0 legacy=0x7f75640b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75640d2020 con 0x7f75640b47c0 2023-08-25T04:46:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f7560001670 con 0x7f75640b47c0 2023-08-25T04:46:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 >> v1:172.21.15.72:6789/0 conn(0x7f75640b47c0 legacy=0x7f75640b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7550003b90 0x7f7550003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7550004850 0x7f7550004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550005210 0x7f755000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75640d1d40 con 0x7f7550004850 2023-08-25T04:46:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755000c000 con 0x7f7550005210 2023-08-25T04:46:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.883+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755000c1c0 con 0x7f7550003b90 2023-08-25T04:46:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756999a700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7550004850 0x7f7550004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756a19b700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7550003b90 0x7f7550003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756a99c700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550005210 0x7f755000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756999a700 1 -- 172.21.15.72:0/4058304331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7550003b90 msgr2=0x7f7550003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756999a700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7550003b90 0x7f7550003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756999a700 1 -- 172.21.15.72:0/4058304331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550005210 msgr2=0x7f755000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:36.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756999a700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550005210 0x7f755000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756999a700 1 -- 172.21.15.72:0/4058304331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75500035b0 con 0x7f7550004850 2023-08-25T04:46:36.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756a99c700 1 -- 172.21.15.72:0/4058304331 reap_dead start 2023-08-25T04:46:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756a19b700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7550003b90 0x7f7550003f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f756999a700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7550004850 0x7f7550004cd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7554009b30 tx=0x7f7550005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a04050413bbe216 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.884+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400e6c0 con 0x7f7550004850 2023-08-25T04:46:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.885+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755400e820 con 0x7f7550004850 2023-08-25T04:46:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.885+0000 7f7569199700 1 -- 172.21.15.72:0/4058304331 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400eb90 con 0x7f7550004850 2023-08-25T04:46:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.885+0000 7f756c3ff700 1 -- 172.21.15.72:0/4058304331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7550004850 msgr2=0x7f7550004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.885+0000 7f756c3ff700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7550004850 0x7f7550004cd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7554009b30 tx=0x7f7550005880 comp rx=0 tx=0).stop 2023-08-25T04:46:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.885+0000 7f756c3ff700 1 -- 172.21.15.72:0/4058304331 shutdown_connections 2023-08-25T04:46:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.885+0000 7f756c3ff700 1 --2- 172.21.15.72:0/4058304331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7550004850 0x7f7550004cd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.885+0000 7f756c3ff700 1 -- 172.21.15.72:0/4058304331 >> 172.21.15.72:0/4058304331 conn(0x7f7564072050 msgr2=0x7f75640d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.885+0000 7f756c3ff700 1 -- 172.21.15.72:0/4058304331 shutdown_connections 2023-08-25T04:46:36.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.885+0000 7f756c3ff700 1 -- 172.21.15.72:0/4058304331 wait complete. 2023-08-25T04:46:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.887+0000 7f756c3ff700 1 Processor -- start 2023-08-25T04:46:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.887+0000 7f756c3ff700 1 -- start start 2023-08-25T04:46:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.888+0000 7f756c3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7550004850 0x7f7564142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.888+0000 7f756c3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f756415a3f0 0x7f756415b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.888+0000 7f756c3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f756415a870 0x7f756415bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.888+0000 7f756c3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7564159400 con 0x7f756415a3f0 2023-08-25T04:46:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.888+0000 7f756c3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7564146730 con 0x7f756415a870 2023-08-25T04:46:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.888+0000 7f756c3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7564159f60 con 0x7f7550004850 2023-08-25T04:46:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.888+0000 7f756999a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f756415a3f0 0x7f756415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.888+0000 7f756999a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f756415a3f0 0x7f756415b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33640/0 (socket says 172.21.15.72:33640) 2023-08-25T04:46:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.888+0000 7f756999a700 1 -- 172.21.15.72:0/3223520317 learned_addr learned my addr 172.21.15.72:0/3223520317 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.888+0000 7f756a19b700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7550004850 0x7f7564142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f756a99c700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f756415a870 0x7f756415bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f756999a700 1 -- 172.21.15.72:0/3223520317 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7550004850 msgr2=0x7f7564142e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f756999a700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7550004850 0x7f7564142e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f756999a700 1 -- 172.21.15.72:0/3223520317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f756415a870 msgr2=0x7f756415bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:36.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f756999a700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f756415a870 0x7f756415bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:36.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f756999a700 1 -- 172.21.15.72:0/3223520317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564159630 con 0x7f756415a3f0 2023-08-25T04:46:36.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f756a99c700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f756415a870 0x7f756415bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:36.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f756999a700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f756415a3f0 0x7f756415b730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75540090b0 tx=0x7f75540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:36.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f755affd700 1 -- 172.21.15.72:0/3223520317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400e6c0 con 0x7f756415a3f0 2023-08-25T04:46:36.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f755affd700 1 -- 172.21.15.72:0/3223520317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7554003ab0 con 0x7f756415a3f0 2023-08-25T04:46:36.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f755affd700 1 -- 172.21.15.72:0/3223520317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554003e60 con 0x7f756415a3f0 2023-08-25T04:46:36.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f756c3ff700 1 -- 172.21.15.72:0/3223520317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7564159910 con 0x7f756415a3f0 2023-08-25T04:46:36.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.889+0000 7f756c3ff700 1 -- 172.21.15.72:0/3223520317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7564143380 con 0x7f756415a3f0 2023-08-25T04:46:36.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.891+0000 7f756c3ff700 1 -- 172.21.15.72:0/3223520317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7564159400 con 0x7f756415a3f0 2023-08-25T04:46:36.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.891+0000 7f755affd700 1 -- 172.21.15.72:0/3223520317 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7554013470 con 0x7f756415a3f0 2023-08-25T04:46:36.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.892+0000 7f755affd700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f754806a0e0 0x7f754806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:36.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.892+0000 7f755affd700 1 -- 172.21.15.72:0/3223520317 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7554089f70 con 0x7f756415a3f0 2023-08-25T04:46:36.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.892+0000 7f756a19b700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f754806a0e0 0x7f754806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:36.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.893+0000 7f756a19b700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f754806a0e0 0x7f754806c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7560001eb0 tx=0x7f7560007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:36.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:36.897+0000 7f755affd700 1 -- 172.21.15.72:0/3223520317 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f75540bc990 con 0x7f756415a3f0 2023-08-25T04:46:37.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.171+0000 7f756c3ff700 1 -- 172.21.15.72:0/3223520317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f756404e620 con 0x7f756415a3f0 2023-08-25T04:46:37.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.713+0000 7f755affd700 1 -- 172.21.15.72:0/3223520317 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v78) v1 ==== 147+0+0 (secure 0 0 0) 0x7f75540170d0 con 0x7f756415a3f0 2023-08-25T04:46:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 -- 172.21.15.72:0/3223520317 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f754806a0e0 msgr2=0x7f754806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f754806a0e0 0x7f754806c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7560001eb0 tx=0x7f7560007040 comp rx=0 tx=0).stop 2023-08-25T04:46:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 -- 172.21.15.72:0/3223520317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f756415a3f0 msgr2=0x7f756415b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f756415a3f0 0x7f756415b730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75540090b0 tx=0x7f75540047c0 comp rx=0 tx=0).stop 2023-08-25T04:46:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 -- 172.21.15.72:0/3223520317 shutdown_connections 2023-08-25T04:46:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f754806a0e0 0x7f754806c5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f756415a870 0x7f756415bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7550004850 0x7f7564142e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 --2- 172.21.15.72:0/3223520317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f756415a3f0 0x7f756415b730 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 -- 172.21.15.72:0/3223520317 >> 172.21.15.72:0/3223520317 conn(0x7f7564072050 msgr2=0x7f75640cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:37.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.715+0000 7f756c3ff700 1 -- 172.21.15.72:0/3223520317 shutdown_connections 2023-08-25T04:46:37.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.716+0000 7f756c3ff700 1 -- 172.21.15.72:0/3223520317 wait complete. 2023-08-25T04:46:37.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:37.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.931+0000 7f4ebafff700 1 Processor -- start 2023-08-25T04:46:37.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.931+0000 7f4ebafff700 1 -- start start 2023-08-25T04:46:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.932+0000 7f4ebafff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eb40b86b0 0x7f4eb4167a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.932+0000 7f4ebafff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb40b6db0 con 0x7f4eb40b47c0 2023-08-25T04:46:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.932+0000 7f4ebafff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb40d1780 con 0x7f4eb415d130 2023-08-25T04:46:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.932+0000 7f4ebafff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb40d1590 con 0x7f4eb40b86b0 2023-08-25T04:46:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.932+0000 7f4eb8d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4eb40b47c0 0x7f4eb40b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53446/0 (socket says 172.21.15.72:53446) 2023-08-25T04:46:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.932+0000 7f4eb959c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eb40b86b0 0x7f4eb4167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.932+0000 7f4eb8d9b700 1 -- 172.21.15.72:0/1067366232 learned_addr learned my addr 172.21.15.72:0/1067366232 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.933+0000 7f4eb959c700 1 -- 172.21.15.72:0/1067366232 >> v1:172.21.15.137:6789/0 conn(0x7f4eb415d130 legacy=0x7f4eb40d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.933+0000 7f4eb959c700 1 -- 172.21.15.72:0/1067366232 >> v1:172.21.15.72:6789/0 conn(0x7f4eb40b47c0 legacy=0x7f4eb40b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.933+0000 7f4eb959c700 1 -- 172.21.15.72:0/1067366232 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40d1a60 con 0x7f4eb40b86b0 2023-08-25T04:46:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.933+0000 7f4eb37fe700 1 -- 172.21.15.72:0/1067366232 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425728121 0 0) 0x7f4eb40b6db0 con 0x7f4eb40b47c0 2023-08-25T04:46:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.933+0000 7f4eb959c700 1 --2- 172.21.15.72:0/1067366232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b86b0 0x7f4eb4167a50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009d90 tx=0x7f4eac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adaad6789f369cc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.933+0000 7f4eb37fe700 1 -- 172.21.15.72:0/1067366232 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00e070 con 0x7f4eb40b86b0 2023-08-25T04:46:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.933+0000 7f4eb37fe700 1 -- 172.21.15.72:0/1067366232 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac00bbd0 con 0x7f4eb40b86b0 2023-08-25T04:46:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.933+0000 7f4eb37fe700 1 -- 172.21.15.72:0/1067366232 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac012430 con 0x7f4eb40b86b0 2023-08-25T04:46:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.934+0000 7f4ebafff700 1 -- 172.21.15.72:0/1067366232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b86b0 msgr2=0x7f4eb4167a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.934+0000 7f4ebafff700 1 --2- 172.21.15.72:0/1067366232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b86b0 0x7f4eb4167a50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009d90 tx=0x7f4eac00b330 comp rx=0 tx=0).stop 2023-08-25T04:46:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.934+0000 7f4ebafff700 1 -- 172.21.15.72:0/1067366232 shutdown_connections 2023-08-25T04:46:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.934+0000 7f4ebafff700 1 --2- 172.21.15.72:0/1067366232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b86b0 0x7f4eb4167a50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.934+0000 7f4ebafff700 1 -- 172.21.15.72:0/1067366232 >> 172.21.15.72:0/1067366232 conn(0x7f4eb4072050 msgr2=0x7f4eb40d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.934+0000 7f4ebafff700 1 -- 172.21.15.72:0/1067366232 shutdown_connections 2023-08-25T04:46:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.934+0000 7f4ebafff700 1 -- 172.21.15.72:0/1067366232 wait complete. 2023-08-25T04:46:37.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.936+0000 7f4ebafff700 1 Processor -- start 2023-08-25T04:46:37.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.936+0000 7f4ebafff700 1 -- start start 2023-08-25T04:46:37.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4ebafff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b47c0 0x7f4eb40cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:37.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4ebafff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b86b0 0x7f4eb4154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:37.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4ebafff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb415d130 0x7f4eb415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:37.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4ebafff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40cbce0 con 0x7f4eb40b47c0 2023-08-25T04:46:37.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4ebafff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb415d980 con 0x7f4eb415d130 2023-08-25T04:46:37.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4ebafff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb415dc60 con 0x7f4eb40b86b0 2023-08-25T04:46:37.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4eb8d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b47c0 0x7f4eb40cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:37.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4eb8d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b47c0 0x7f4eb40cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33650/0 (socket says 172.21.15.72:33650) 2023-08-25T04:46:37.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4eb8d9b700 1 -- 172.21.15.72:0/1878733077 learned_addr learned my addr 172.21.15.72:0/1878733077 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:37.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4eb959c700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb415d130 0x7f4eb415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:37.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.937+0000 7f4eb3fff700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b86b0 0x7f4eb4154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:37.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4eb8d9b700 1 -- 172.21.15.72:0/1878733077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b86b0 msgr2=0x7f4eb4154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4eb8d9b700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b86b0 0x7f4eb4154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4eb8d9b700 1 -- 172.21.15.72:0/1878733077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb415d130 msgr2=0x7f4eb415ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4eb8d9b700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb415d130 0x7f4eb415ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4eb8d9b700 1 -- 172.21.15.72:0/1878733077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac009a70 con 0x7f4eb40b47c0 2023-08-25T04:46:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4eb959c700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb415d130 0x7f4eb415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4eb8d9b700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b47c0 0x7f4eb40cb7a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c520 tx=0x7f4ea800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4eb17fa700 1 -- 172.21.15.72:0/1878733077 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8004c80 con 0x7f4eb40b47c0 2023-08-25T04:46:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4eb17fa700 1 -- 172.21.15.72:0/1878733077 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea8004e20 con 0x7f4eb40b47c0 2023-08-25T04:46:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4eb17fa700 1 -- 172.21.15.72:0/1878733077 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8007310 con 0x7f4eb40b47c0 2023-08-25T04:46:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4ebafff700 1 -- 172.21.15.72:0/1878733077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb415df40 con 0x7f4eb40b47c0 2023-08-25T04:46:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.938+0000 7f4ebafff700 1 -- 172.21.15.72:0/1878733077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb415e500 con 0x7f4eb40b47c0 2023-08-25T04:46:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.939+0000 7f4ebafff700 1 -- 172.21.15.72:0/1878733077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb415e720 con 0x7f4eb40b47c0 2023-08-25T04:46:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.940+0000 7f4eb17fa700 1 -- 172.21.15.72:0/1878733077 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ea8007470 con 0x7f4eb40b47c0 2023-08-25T04:46:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.941+0000 7f4eb17fa700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4e9806a160 0x7f4e9806c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.941+0000 7f4eb17fa700 1 -- 172.21.15.72:0/1878733077 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4ea80884b0 con 0x7f4eb40b47c0 2023-08-25T04:46:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.942+0000 7f4eb3fff700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4e9806a160 0x7f4e9806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.942+0000 7f4eb3fff700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4e9806a160 0x7f4e9806c620 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4151920 tx=0x7f4ea0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:37.946+0000 7f4eb17fa700 1 -- 172.21.15.72:0/1878733077 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4ea80538e0 con 0x7f4eb40b47c0 2023-08-25T04:46:38.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.142+0000 7f4ebafff700 1 -- 172.21.15.72:0/1878733077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4eb40b7ff0 con 0x7f4eb40b47c0 2023-08-25T04:46:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.143+0000 7f4eb17fa700 1 -- 172.21.15.72:0/1878733077 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f4ea8056f00 con 0x7f4eb40b47c0 2023-08-25T04:46:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:38.146 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.145+0000 7f4ebafff700 1 -- 172.21.15.72:0/1878733077 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4e9806a160 msgr2=0x7f4e9806c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.145+0000 7f4ebafff700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4e9806a160 0x7f4e9806c620 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4151920 tx=0x7f4ea0009040 comp rx=0 tx=0).stop 2023-08-25T04:46:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.145+0000 7f4ebafff700 1 -- 172.21.15.72:0/1878733077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b47c0 msgr2=0x7f4eb40cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.145+0000 7f4ebafff700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b47c0 0x7f4eb40cb7a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c520 tx=0x7f4ea800c8e0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.145+0000 7f4ebafff700 1 -- 172.21.15.72:0/1878733077 shutdown_connections 2023-08-25T04:46:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.145+0000 7f4ebafff700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4e9806a160 0x7f4e9806c620 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.145+0000 7f4ebafff700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eb415d130 0x7f4eb415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.145+0000 7f4ebafff700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40b47c0 0x7f4eb40cb7a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.145+0000 7f4ebafff700 1 --2- 172.21.15.72:0/1878733077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eb40b86b0 0x7f4eb4154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.146+0000 7f4ebafff700 1 -- 172.21.15.72:0/1878733077 >> 172.21.15.72:0/1878733077 conn(0x7f4eb4072050 msgr2=0x7f4eb40cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.146+0000 7f4ebafff700 1 -- 172.21.15.72:0/1878733077 shutdown_connections 2023-08-25T04:46:38.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.146+0000 7f4ebafff700 1 -- 172.21.15.72:0/1878733077 wait complete. 2023-08-25T04:46:38.167 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:38.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:38.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.364+0000 7fcae07ff700 1 Processor -- start 2023-08-25T04:46:38.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.364+0000 7fcae07ff700 1 -- start start 2023-08-25T04:46:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.365+0000 7fcae07ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 0x7fcad80cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.365+0000 7fcae07ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcad80cbb90 0x7fcad815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.365+0000 7fcae07ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad80cbfe0 con 0x7fcad8150ac0 2023-08-25T04:46:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.365+0000 7fcae07ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad80af490 con 0x7fcad80cbb90 2023-08-25T04:46:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.365+0000 7fcae07ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad815d7c0 con 0x7fcad8150ea0 2023-08-25T04:46:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcade59b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcad8150ac0 0x7fcad815def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53456/0 (socket says 172.21.15.72:53456) 2023-08-25T04:46:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcade59b700 1 -- 172.21.15.72:0/3361234092 learned_addr learned my addr 172.21.15.72:0/3361234092 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcaded9c700 1 --2- 172.21.15.72:0/3361234092 >> v2:172.21.15.72:3300/0 conn(0x7fcad80cbb90 0x7fcad815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcaddd9a700 1 --2- 172.21.15.72:0/3361234092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 0x7fcad80cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcadd599700 1 -- 172.21.15.72:0/3361234092 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431345021 0 0) 0x7fcad4001110 con 0x7fcad8150ac0 2023-08-25T04:46:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcadd599700 1 -- 172.21.15.72:0/3361234092 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac40035b0 con 0x7fcad8150ac0 2023-08-25T04:46:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcaded9c700 1 -- 172.21.15.72:0/3361234092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 msgr2=0x7fcad80cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcaded9c700 1 --2- 172.21.15.72:0/3361234092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 0x7fcad80cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcaded9c700 1 -- 172.21.15.72:0/3361234092 >> v1:172.21.15.72:6789/0 conn(0x7fcad8150ac0 legacy=0x7fcad815def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcaded9c700 1 -- 172.21.15.72:0/3361234092 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80aebf0 con 0x7fcad80cbb90 2023-08-25T04:46:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.366+0000 7fcaded9c700 1 --2- 172.21.15.72:0/3361234092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad80cbb90 0x7fcad815a180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009d90 tx=0x7fcad000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452c426424c5aa75 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcadd599700 1 -- 172.21.15.72:0/3361234092 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad000e070 con 0x7fcad80cbb90 2023-08-25T04:46:38.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcadd599700 1 -- 172.21.15.72:0/3361234092 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad000bb20 con 0x7fcad80cbb90 2023-08-25T04:46:38.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcadd599700 1 -- 172.21.15.72:0/3361234092 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad000be90 con 0x7fcad80cbb90 2023-08-25T04:46:38.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcae07ff700 1 -- 172.21.15.72:0/3361234092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad80cbb90 msgr2=0x7fcad815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcae07ff700 1 --2- 172.21.15.72:0/3361234092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad80cbb90 0x7fcad815a180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009d90 tx=0x7fcad000b330 comp rx=0 tx=0).stop 2023-08-25T04:46:38.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcae07ff700 1 -- 172.21.15.72:0/3361234092 shutdown_connections 2023-08-25T04:46:38.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcae07ff700 1 --2- 172.21.15.72:0/3361234092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad80cbb90 0x7fcad815a180 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcae07ff700 1 --2- 172.21.15.72:0/3361234092 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 0x7fcad80cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcae07ff700 1 -- 172.21.15.72:0/3361234092 >> 172.21.15.72:0/3361234092 conn(0x7fcad806a710 msgr2=0x7fcad806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:38.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcae07ff700 1 -- 172.21.15.72:0/3361234092 shutdown_connections 2023-08-25T04:46:38.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.367+0000 7fcae07ff700 1 -- 172.21.15.72:0/3361234092 wait complete. 2023-08-25T04:46:38.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.369+0000 7fcae07ff700 1 Processor -- start 2023-08-25T04:46:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.369+0000 7fcae07ff700 1 -- start start 2023-08-25T04:46:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.370+0000 7fcae07ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcad80cbb90 0x7fcad80ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.370+0000 7fcae07ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad8150ac0 0x7fcad81f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.370+0000 7fcae07ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 0x7fcad814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.370+0000 7fcae07ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad81f3780 con 0x7fcad8150ac0 2023-08-25T04:46:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.370+0000 7fcae07ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80ca980 con 0x7fcad80cbb90 2023-08-25T04:46:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.370+0000 7fcae07ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad815b290 con 0x7fcad8150ea0 2023-08-25T04:46:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.370+0000 7fcaddd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad8150ac0 0x7fcad81f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.370+0000 7fcaddd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad8150ac0 0x7fcad81f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33676/0 (socket says 172.21.15.72:33676) 2023-08-25T04:46:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.370+0000 7fcaddd9a700 1 -- 172.21.15.72:0/3847805349 learned_addr learned my addr 172.21.15.72:0/3847805349 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcade59b700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcad80cbb90 0x7fcad80ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaded9c700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 0x7fcad814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaddd9a700 1 -- 172.21.15.72:0/3847805349 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 msgr2=0x7fcad814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaddd9a700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 0x7fcad814fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaddd9a700 1 -- 172.21.15.72:0/3847805349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcad80cbb90 msgr2=0x7fcad80ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaddd9a700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcad80cbb90 0x7fcad80ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaddd9a700 1 -- 172.21.15.72:0/3847805349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0009a70 con 0x7fcad8150ac0 2023-08-25T04:46:38.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaded9c700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 0x7fcad814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaddd9a700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad8150ac0 0x7fcad81f2740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcac800e840 tx=0x7fcac800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaceffd700 1 -- 172.21.15.72:0/3847805349 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8009590 con 0x7fcad8150ac0 2023-08-25T04:46:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaceffd700 1 -- 172.21.15.72:0/3847805349 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8013680 con 0x7fcad8150ac0 2023-08-25T04:46:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcae07ff700 1 -- 172.21.15.72:0/3847805349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad81f2c80 con 0x7fcad8150ac0 2023-08-25T04:46:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.371+0000 7fcaceffd700 1 -- 172.21.15.72:0/3847805349 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8013a30 con 0x7fcad8150ac0 2023-08-25T04:46:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.372+0000 7fcae07ff700 1 -- 172.21.15.72:0/3847805349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad81f31c0 con 0x7fcad8150ac0 2023-08-25T04:46:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.373+0000 7fcae07ff700 1 -- 172.21.15.72:0/3847805349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad8072320 con 0x7fcad8150ac0 2023-08-25T04:46:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.373+0000 7fcaceffd700 1 -- 172.21.15.72:0/3847805349 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcac8013b90 con 0x7fcad8150ac0 2023-08-25T04:46:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.374+0000 7fcaceffd700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcabc06a0e0 0x7fcabc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.374+0000 7fcaceffd700 1 -- 172.21.15.72:0/3847805349 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcac8088830 con 0x7fcad8150ac0 2023-08-25T04:46:38.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.375+0000 7fcade59b700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcabc06a0e0 0x7fcabc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.375+0000 7fcade59b700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcabc06a0e0 0x7fcabc06c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005910 tx=0x7fcad4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:38.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.379+0000 7fcaceffd700 1 -- 172.21.15.72:0/3847805349 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcac80575e0 con 0x7fcad8150ac0 2023-08-25T04:46:38.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.573+0000 7fcae07ff700 1 -- 172.21.15.72:0/3847805349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcad815b3d0 con 0x7fcad8150ac0 2023-08-25T04:46:38.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.573+0000 7fcaceffd700 1 -- 172.21.15.72:0/3847805349 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcac8057170 con 0x7fcad8150ac0 2023-08-25T04:46:38.576 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:38.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 -- 172.21.15.72:0/3847805349 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcabc06a0e0 msgr2=0x7fcabc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcabc06a0e0 0x7fcabc06c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005910 tx=0x7fcad4009040 comp rx=0 tx=0).stop 2023-08-25T04:46:38.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 -- 172.21.15.72:0/3847805349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad8150ac0 msgr2=0x7fcad81f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad8150ac0 0x7fcad81f2740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcac800e840 tx=0x7fcac800eb50 comp rx=0 tx=0).stop 2023-08-25T04:46:38.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 -- 172.21.15.72:0/3847805349 shutdown_connections 2023-08-25T04:46:38.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcabc06a0e0 0x7fcabc06c5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcad8150ea0 0x7fcad814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcad80cbb90 0x7fcad80ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 --2- 172.21.15.72:0/3847805349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcad8150ac0 0x7fcad81f2740 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 -- 172.21.15.72:0/3847805349 >> 172.21.15.72:0/3847805349 conn(0x7fcad806a710 msgr2=0x7fcad806aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:38.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 -- 172.21.15.72:0/3847805349 shutdown_connections 2023-08-25T04:46:38.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.576+0000 7fcae07ff700 1 -- 172.21.15.72:0/3847805349 wait complete. 2023-08-25T04:46:38.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:38.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.795+0000 7f3969bff700 1 Processor -- start 2023-08-25T04:46:38.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.796+0000 7f3969bff700 1 -- start start 2023-08-25T04:46:38.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.797+0000 7f3969bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640cbd60 0x7f396415a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.797+0000 7f3969bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640aebf0 con 0x7f3964150ac0 2023-08-25T04:46:38.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.797+0000 7f3969bff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640aeed0 con 0x7f3964150ea0 2023-08-25T04:46:38.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.797+0000 7f3969bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640af490 con 0x7f39640cbd60 2023-08-25T04:46:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.797+0000 7f39637fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3964150ac0 0x7f396415def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53466/0 (socket says 172.21.15.72:53466) 2023-08-25T04:46:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.797+0000 7f39637fe700 1 -- 172.21.15.72:0/2805054853 learned_addr learned my addr 172.21.15.72:0/2805054853 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.797+0000 7f3963fff700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640cbd60 0x7f396415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.797+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905369175 0 0) 0x7f39640aebf0 con 0x7f3964150ac0 2023-08-25T04:46:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c0035b0 con 0x7f3964150ac0 2023-08-25T04:46:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724332387 0 0) 0x7f39640aeed0 con 0x7f3964150ea0 2023-08-25T04:46:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39640aebf0 con 0x7f3964150ea0 2023-08-25T04:46:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 14642750 0 0) 0x7f394c0035b0 con 0x7f3964150ac0 2023-08-25T04:46:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640cbd60 msgr2=0x7f396415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640cbd60 0x7f396415a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 >> v1:172.21.15.137:6789/0 conn(0x7f3964150ea0 legacy=0x7f39640cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640af1b0 con 0x7f3964150ac0 2023-08-25T04:46:38.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f3954001670 con 0x7f3964150ac0 2023-08-25T04:46:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f3963fff700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640cbd60 0x7f396415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 >> v1:172.21.15.72:6789/0 conn(0x7f3964150ac0 legacy=0x7f396415def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f394c003bc0 0x7f394c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640cbd60 0x7f394c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f394c004d90 0x7f394c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640af490 con 0x7f394c003bc0 2023-08-25T04:46:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c00bac0 con 0x7f394c004d90 2023-08-25T04:46:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c00de10 con 0x7f39640cbd60 2023-08-25T04:46:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f39637fe700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f394c003bc0 0x7f394c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f3962ffd700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640cbd60 0x7f394c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.798+0000 7f3963fff700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f394c004d90 0x7f394c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f39637fe700 1 -- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640cbd60 msgr2=0x7f394c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f39637fe700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640cbd60 0x7f394c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f39637fe700 1 -- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f394c004d90 msgr2=0x7f394c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f39637fe700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f394c004d90 0x7f394c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f39637fe700 1 -- 172.21.15.72:0/2805054853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c009a70 con 0x7f394c003bc0 2023-08-25T04:46:38.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f39637fe700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f394c003bc0 0x7f394c003fc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f395400c240 tx=0x7f394c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba7fd27351d3199 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:38.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395400cd40 con 0x7f394c003bc0 2023-08-25T04:46:38.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3954005960 con 0x7f394c003bc0 2023-08-25T04:46:38.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f39627fc700 1 -- 172.21.15.72:0/2805054853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954005d10 con 0x7f394c003bc0 2023-08-25T04:46:38.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f3969bff700 1 -- 172.21.15.72:0/2805054853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f394c003bc0 msgr2=0x7f394c003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f3969bff700 1 --2- 172.21.15.72:0/2805054853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f394c003bc0 0x7f394c003fc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f395400c240 tx=0x7f394c005880 comp rx=0 tx=0).stop 2023-08-25T04:46:38.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.799+0000 7f3963fff700 1 -- 172.21.15.72:0/2805054853 reap_dead start 2023-08-25T04:46:38.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.800+0000 7f3969bff700 1 -- 172.21.15.72:0/2805054853 shutdown_connections 2023-08-25T04:46:38.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.800+0000 7f3969bff700 1 -- 172.21.15.72:0/2805054853 >> 172.21.15.72:0/2805054853 conn(0x7f396406a710 msgr2=0x7f396406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:38.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.800+0000 7f3969bff700 1 -- 172.21.15.72:0/2805054853 shutdown_connections 2023-08-25T04:46:38.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.800+0000 7f3969bff700 1 -- 172.21.15.72:0/2805054853 wait complete. 2023-08-25T04:46:38.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.801+0000 7f3969bff700 1 Processor -- start 2023-08-25T04:46:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.802+0000 7f3969bff700 1 -- start start 2023-08-25T04:46:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.802+0000 7f3969bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f394c003bc0 0x7f396414bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.802+0000 7f3969bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396414f6e0 0x7f39640cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.802+0000 7f3969bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640c2f10 0x7f39640c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.802+0000 7f3969bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396414c1f0 con 0x7f396414f6e0 2023-08-25T04:46:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.802+0000 7f3969bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396414f250 con 0x7f394c003bc0 2023-08-25T04:46:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.802+0000 7f3969bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396414ec40 con 0x7f39640c2f10 2023-08-25T04:46:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f3962ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396414f6e0 0x7f39640cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f3962ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396414f6e0 0x7f39640cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33694/0 (socket says 172.21.15.72:33694) 2023-08-25T04:46:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f3962ffd700 1 -- 172.21.15.72:0/3632123894 learned_addr learned my addr 172.21.15.72:0/3632123894 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f39637fe700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f394c003bc0 0x7f396414bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f3963fff700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640c2f10 0x7f39640c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f3962ffd700 1 -- 172.21.15.72:0/3632123894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640c2f10 msgr2=0x7f39640c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f3962ffd700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640c2f10 0x7f39640c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f3962ffd700 1 -- 172.21.15.72:0/3632123894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f394c003bc0 msgr2=0x7f396414bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f3962ffd700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f394c003bc0 0x7f396414bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f3962ffd700 1 -- 172.21.15.72:0/3632123894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396414c830 con 0x7f396414f6e0 2023-08-25T04:46:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f3962ffd700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396414f6e0 0x7f39640cea40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f395800f840 tx=0x7f395800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.803+0000 7f394bfff700 1 -- 172.21.15.72:0/3632123894 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580052e0 con 0x7f396414f6e0 2023-08-25T04:46:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.804+0000 7f394bfff700 1 -- 172.21.15.72:0/3632123894 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958005480 con 0x7f396414f6e0 2023-08-25T04:46:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.804+0000 7f394bfff700 1 -- 172.21.15.72:0/3632123894 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580038c0 con 0x7f396414f6e0 2023-08-25T04:46:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.804+0000 7f3969bff700 1 -- 172.21.15.72:0/3632123894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396414eee0 con 0x7f396414f6e0 2023-08-25T04:46:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.804+0000 7f3969bff700 1 -- 172.21.15.72:0/3632123894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396414c4c0 con 0x7f396414f6e0 2023-08-25T04:46:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.805+0000 7f3969bff700 1 -- 172.21.15.72:0/3632123894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39640c2360 con 0x7f396414f6e0 2023-08-25T04:46:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.806+0000 7f394bfff700 1 -- 172.21.15.72:0/3632123894 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3958003a20 con 0x7f396414f6e0 2023-08-25T04:46:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.806+0000 7f394bfff700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f395006a0e0 0x7f395006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.806+0000 7f394bfff700 1 -- 172.21.15.72:0/3632123894 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f39580888f0 con 0x7f396414f6e0 2023-08-25T04:46:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.807+0000 7f39637fe700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f395006a0e0 0x7f395006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.807+0000 7f39637fe700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f395006a0e0 0x7f395006c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3954001eb0 tx=0x7f3954007f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:38.811+0000 7f394bfff700 1 -- 172.21.15.72:0/3632123894 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3958053c10 con 0x7f396414f6e0 2023-08-25T04:46:39.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.007+0000 7f3969bff700 1 -- 172.21.15.72:0/3632123894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3964072320 con 0x7f396414f6e0 2023-08-25T04:46:39.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.007+0000 7f394bfff700 1 -- 172.21.15.72:0/3632123894 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3958057230 con 0x7f396414f6e0 2023-08-25T04:46:39.009 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:39.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 -- 172.21.15.72:0/3632123894 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f395006a0e0 msgr2=0x7f395006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f395006a0e0 0x7f395006c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3954001eb0 tx=0x7f3954007f90 comp rx=0 tx=0).stop 2023-08-25T04:46:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 -- 172.21.15.72:0/3632123894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396414f6e0 msgr2=0x7f39640cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396414f6e0 0x7f39640cea40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f395800f840 tx=0x7f395800fc00 comp rx=0 tx=0).stop 2023-08-25T04:46:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 -- 172.21.15.72:0/3632123894 shutdown_connections 2023-08-25T04:46:39.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f395006a0e0 0x7f395006c5a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39640c2f10 0x7f39640c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f394c003bc0 0x7f396414bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 --2- 172.21.15.72:0/3632123894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396414f6e0 0x7f39640cea40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 -- 172.21.15.72:0/3632123894 >> 172.21.15.72:0/3632123894 conn(0x7f396406a710 msgr2=0x7f3964147cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 -- 172.21.15.72:0/3632123894 shutdown_connections 2023-08-25T04:46:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.010+0000 7f3969bff700 1 -- 172.21.15.72:0/3632123894 wait complete. 2023-08-25T04:46:39.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:39.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.228+0000 7f85b31ff700 1 Processor -- start 2023-08-25T04:46:39.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.228+0000 7f85b31ff700 1 -- start start 2023-08-25T04:46:39.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.229+0000 7f85b31ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac15d000 0x7f85ac0b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.229+0000 7f85b31ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85ac0d10c0 0x7f85ac0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.229+0000 7f85b31ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85ac0b4d40 0x7f85ac160af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.229+0000 7f85b31ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac0b56f0 con 0x7f85ac0b4d40 2023-08-25T04:46:39.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.229+0000 7f85b31ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac0b5190 con 0x7f85ac0d10c0 2023-08-25T04:46:39.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b31ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0b6e90 con 0x7f85ac15d000 2023-08-25T04:46:39.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b179c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85ac0b4d40 0x7f85ac160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b179c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85ac0b4d40 0x7f85ac160af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33700/0 (socket says 172.21.15.72:33700) 2023-08-25T04:46:39.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b179c700 1 -- 172.21.15.72:0/3423781917 learned_addr learned my addr 172.21.15.72:0/3423781917 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b0f9b700 1 --2- 172.21.15.72:0/3423781917 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac15d000 0x7f85ac0b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85abfff700 1 --2- 172.21.15.72:0/3423781917 >> v2:172.21.15.137:3300/0 conn(0x7f85ac0d10c0 0x7f85ac0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b179c700 1 -- 172.21.15.72:0/3423781917 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac15d000 msgr2=0x7f85ac0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b179c700 1 --2- 172.21.15.72:0/3423781917 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac15d000 0x7f85ac0b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b179c700 1 -- 172.21.15.72:0/3423781917 >> v2:172.21.15.137:3300/0 conn(0x7f85ac0d10c0 msgr2=0x7f85ac0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b179c700 1 --2- 172.21.15.72:0/3423781917 >> v2:172.21.15.137:3300/0 conn(0x7f85ac0d10c0 0x7f85ac0b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b179c700 1 -- 172.21.15.72:0/3423781917 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac15d3e0 con 0x7f85ac0b4d40 2023-08-25T04:46:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.230+0000 7f85b179c700 1 --2- 172.21.15.72:0/3423781917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac0b4d40 0x7f85ac160af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0b5930 tx=0x7f85a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6af8f5f2520dda2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85ab7fe700 1 -- 172.21.15.72:0/3423781917 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a400e070 con 0x7f85ac0b4d40 2023-08-25T04:46:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85ab7fe700 1 -- 172.21.15.72:0/3423781917 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a400b9c0 con 0x7f85ac0b4d40 2023-08-25T04:46:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85ab7fe700 1 -- 172.21.15.72:0/3423781917 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a400bd70 con 0x7f85ac0b4d40 2023-08-25T04:46:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85b31ff700 1 -- 172.21.15.72:0/3423781917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac0b4d40 msgr2=0x7f85ac160af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85b31ff700 1 --2- 172.21.15.72:0/3423781917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac0b4d40 0x7f85ac160af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0b5930 tx=0x7f85a400b330 comp rx=0 tx=0).stop 2023-08-25T04:46:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85b31ff700 1 -- 172.21.15.72:0/3423781917 shutdown_connections 2023-08-25T04:46:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85b31ff700 1 --2- 172.21.15.72:0/3423781917 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac15d000 0x7f85ac0b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85b31ff700 1 --2- 172.21.15.72:0/3423781917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac0b4d40 0x7f85ac160af0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85b31ff700 1 --2- 172.21.15.72:0/3423781917 >> v2:172.21.15.137:3300/0 conn(0x7f85ac0d10c0 0x7f85ac0b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85b31ff700 1 -- 172.21.15.72:0/3423781917 >> 172.21.15.72:0/3423781917 conn(0x7f85ac071e10 msgr2=0x7f85ac072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85b31ff700 1 -- 172.21.15.72:0/3423781917 shutdown_connections 2023-08-25T04:46:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.231+0000 7f85b31ff700 1 -- 172.21.15.72:0/3423781917 wait complete. 2023-08-25T04:46:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.233+0000 7f85b31ff700 1 Processor -- start 2023-08-25T04:46:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.233+0000 7f85b31ff700 1 -- start start 2023-08-25T04:46:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.234+0000 7f85b31ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac0b4d40 0x7f85ac0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.234+0000 7f85b31ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85ac0d10c0 0x7f85ac0ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.234+0000 7f85b31ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac15d000 0x7f85ac0cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.234+0000 7f85b31ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac1f6a00 con 0x7f85ac15d000 2023-08-25T04:46:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.234+0000 7f85b31ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac1f5e80 con 0x7f85ac0d10c0 2023-08-25T04:46:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.234+0000 7f85b31ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac1f6160 con 0x7f85ac0b4d40 2023-08-25T04:46:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b179c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac15d000 0x7f85ac0cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b179c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac15d000 0x7f85ac0cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33706/0 (socket says 172.21.15.72:33706) 2023-08-25T04:46:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b179c700 1 -- 172.21.15.72:0/2771890095 learned_addr learned my addr 172.21.15.72:0/2771890095 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85abfff700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85ac0d10c0 0x7f85ac0ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b0f9b700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac0b4d40 0x7f85ac0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b179c700 1 -- 172.21.15.72:0/2771890095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac0b4d40 msgr2=0x7f85ac0c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b179c700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac0b4d40 0x7f85ac0c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b179c700 1 -- 172.21.15.72:0/2771890095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85ac0d10c0 msgr2=0x7f85ac0ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b179c700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85ac0d10c0 0x7f85ac0ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b179c700 1 -- 172.21.15.72:0/2771890095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a4009b30 con 0x7f85ac15d000 2023-08-25T04:46:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85abfff700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85ac0d10c0 0x7f85ac0ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b0f9b700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac0b4d40 0x7f85ac0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85b179c700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac15d000 0x7f85ac0cad50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0d3ae0 tx=0x7f85a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.235+0000 7f85a97fa700 1 -- 172.21.15.72:0/2771890095 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4004250 con 0x7f85ac15d000 2023-08-25T04:46:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.236+0000 7f85a97fa700 1 -- 172.21.15.72:0/2771890095 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a40043d0 con 0x7f85ac15d000 2023-08-25T04:46:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.236+0000 7f85b31ff700 1 -- 172.21.15.72:0/2771890095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac1f6440 con 0x7f85ac15d000 2023-08-25T04:46:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.236+0000 7f85a97fa700 1 -- 172.21.15.72:0/2771890095 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4004780 con 0x7f85ac15d000 2023-08-25T04:46:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.236+0000 7f85b31ff700 1 -- 172.21.15.72:0/2771890095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac156050 con 0x7f85ac15d000 2023-08-25T04:46:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.237+0000 7f85b31ff700 1 -- 172.21.15.72:0/2771890095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac06a2f0 con 0x7f85ac15d000 2023-08-25T04:46:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.237+0000 7f85a97fa700 1 -- 172.21.15.72:0/2771890095 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f85a401c440 con 0x7f85ac15d000 2023-08-25T04:46:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.239+0000 7f85a97fa700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f859006a0e0 0x7f859006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.239+0000 7f85a97fa700 1 -- 172.21.15.72:0/2771890095 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f85a4089e40 con 0x7f85ac15d000 2023-08-25T04:46:39.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.239+0000 7f85b0f9b700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f859006a0e0 0x7f859006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.239+0000 7f85b0f9b700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f859006a0e0 0x7f859006c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0c7750 tx=0x7f85a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:39.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.243+0000 7f85a97fa700 1 -- 172.21.15.72:0/2771890095 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f85a40551f0 con 0x7f85ac15d000 2023-08-25T04:46:39.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.440+0000 7f85b31ff700 1 -- 172.21.15.72:0/2771890095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85ac08a000 con 0x7f85ac15d000 2023-08-25T04:46:39.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.441+0000 7f85a97fa700 1 -- 172.21.15.72:0/2771890095 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85a40200a0 con 0x7f85ac15d000 2023-08-25T04:46:39.443 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:39.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.443+0000 7f85b31ff700 1 -- 172.21.15.72:0/2771890095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f859006a0e0 msgr2=0x7f859006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.443+0000 7f85b31ff700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f859006a0e0 0x7f859006c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0c7750 tx=0x7f85a0008040 comp rx=0 tx=0).stop 2023-08-25T04:46:39.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.443+0000 7f85b31ff700 1 -- 172.21.15.72:0/2771890095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac15d000 msgr2=0x7f85ac0cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.443+0000 7f85b31ff700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac15d000 0x7f85ac0cad50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0d3ae0 tx=0x7f85a4004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.443+0000 7f85b31ff700 1 -- 172.21.15.72:0/2771890095 shutdown_connections 2023-08-25T04:46:39.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.443+0000 7f85b31ff700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f859006a0e0 0x7f859006c5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.443+0000 7f85b31ff700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac15d000 0x7f85ac0cad50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.443+0000 7f85b31ff700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85ac0b4d40 0x7f85ac0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.443+0000 7f85b31ff700 1 --2- 172.21.15.72:0/2771890095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85ac0d10c0 0x7f85ac0ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.443+0000 7f85b31ff700 1 -- 172.21.15.72:0/2771890095 >> 172.21.15.72:0/2771890095 conn(0x7f85ac071e10 msgr2=0x7f85ac0b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:39.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.444+0000 7f85b31ff700 1 -- 172.21.15.72:0/2771890095 shutdown_connections 2023-08-25T04:46:39.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.444+0000 7f85b31ff700 1 -- 172.21.15.72:0/2771890095 wait complete. 2023-08-25T04:46:39.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:39.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.661+0000 7f9b065ff700 1 Processor -- start 2023-08-25T04:46:39.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.661+0000 7f9b065ff700 1 -- start start 2023-08-25T04:46:39.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.662+0000 7f9b065ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b000d10c0 0x7f9b000b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.662+0000 7f9b065ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b000b8d10 con 0x7f9b000b4d40 2023-08-25T04:46:39.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.662+0000 7f9b065ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b000b6e90 con 0x7f9b0015d000 2023-08-25T04:46:39.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.662+0000 7f9b065ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b000b56f0 con 0x7f9b000d10c0 2023-08-25T04:46:39.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.662+0000 7f9b04b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9b000b4d40 0x7f9b000b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53472/0 (socket says 172.21.15.72:53472) 2023-08-25T04:46:39.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.662+0000 7f9b04b9c700 1 -- 172.21.15.72:0/4056089596 learned_addr learned my addr 172.21.15.72:0/4056089596 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:39.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.662+0000 7f9aff7fe700 1 --2- 172.21.15.72:0/4056089596 >> v2:172.21.15.72:3300/0 conn(0x7f9b000d10c0 0x7f9b000b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.663+0000 7f9afeffd700 1 -- 172.21.15.72:0/4056089596 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906919423 0 0) 0x7f9b000b8d10 con 0x7f9b000b4d40 2023-08-25T04:46:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.663+0000 7f9afeffd700 1 -- 172.21.15.72:0/4056089596 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae80035b0 con 0x7f9b000b4d40 2023-08-25T04:46:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.663+0000 7f9aff7fe700 1 -- 172.21.15.72:0/4056089596 >> v1:172.21.15.137:6789/0 conn(0x7f9b0015d000 legacy=0x7f9b000b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.663+0000 7f9aff7fe700 1 -- 172.21.15.72:0/4056089596 >> v1:172.21.15.72:6789/0 conn(0x7f9b000b4d40 legacy=0x7f9b000b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.663+0000 7f9aff7fe700 1 -- 172.21.15.72:0/4056089596 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000b5170 con 0x7f9b000d10c0 2023-08-25T04:46:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.663+0000 7f9aff7fe700 1 --2- 172.21.15.72:0/4056089596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000d10c0 0x7f9b000b4800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009840 tx=0x7f9af4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe954fdfff6401 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.663+0000 7f9afeffd700 1 -- 172.21.15.72:0/4056089596 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4011830 con 0x7f9b000d10c0 2023-08-25T04:46:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.663+0000 7f9afeffd700 1 -- 172.21.15.72:0/4056089596 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af4011990 con 0x7f9b000d10c0 2023-08-25T04:46:39.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.663+0000 7f9afeffd700 1 -- 172.21.15.72:0/4056089596 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4011d20 con 0x7f9b000d10c0 2023-08-25T04:46:39.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.664+0000 7f9b065ff700 1 -- 172.21.15.72:0/4056089596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000d10c0 msgr2=0x7f9b000b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.664+0000 7f9b065ff700 1 --2- 172.21.15.72:0/4056089596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000d10c0 0x7f9b000b4800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009840 tx=0x7f9af4009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:39.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.664+0000 7f9b065ff700 1 -- 172.21.15.72:0/4056089596 shutdown_connections 2023-08-25T04:46:39.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.664+0000 7f9b065ff700 1 --2- 172.21.15.72:0/4056089596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000d10c0 0x7f9b000b4800 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.664+0000 7f9b065ff700 1 -- 172.21.15.72:0/4056089596 >> 172.21.15.72:0/4056089596 conn(0x7f9b00071e10 msgr2=0x7f9b00072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:39.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.664+0000 7f9b065ff700 1 -- 172.21.15.72:0/4056089596 shutdown_connections 2023-08-25T04:46:39.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.664+0000 7f9b065ff700 1 -- 172.21.15.72:0/4056089596 wait complete. 2023-08-25T04:46:39.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.666+0000 7f9b065ff700 1 Processor -- start 2023-08-25T04:46:39.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.666+0000 7f9b065ff700 1 -- start start 2023-08-25T04:46:39.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b065ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b000b4d40 0x7f9b000c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b065ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b000d10c0 0x7f9b0015f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b065ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b0015d000 0x7f9b000c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b065ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00153100 con 0x7f9b0015d000 2023-08-25T04:46:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b065ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000cccb0 con 0x7f9b000b4d40 2023-08-25T04:46:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b065ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0015f9a0 con 0x7f9b000d10c0 2023-08-25T04:46:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b04b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b0015d000 0x7f9b000c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b04b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b0015d000 0x7f9b000c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33722/0 (socket says 172.21.15.72:33722) 2023-08-25T04:46:39.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b04b9c700 1 -- 172.21.15.72:0/2131720222 learned_addr learned my addr 172.21.15.72:0/2131720222 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:39.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9aff7fe700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b000d10c0 0x7f9b0015f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9afffff700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b000b4d40 0x7f9b000c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b04b9c700 1 -- 172.21.15.72:0/2131720222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b000d10c0 msgr2=0x7f9b0015f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b04b9c700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b000d10c0 0x7f9b0015f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b04b9c700 1 -- 172.21.15.72:0/2131720222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b000b4d40 msgr2=0x7f9b000c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b04b9c700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b000b4d40 0x7f9b000c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9b04b9c700 1 -- 172.21.15.72:0/2131720222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40094a0 con 0x7f9b0015d000 2023-08-25T04:46:39.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.667+0000 7f9afffff700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b000b4d40 0x7f9b000c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:39.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.668+0000 7f9b04b9c700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b0015d000 0x7f9b000c6870 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9af800cb40 tx=0x7f9af800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:39.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.668+0000 7f9afcff9700 1 -- 172.21.15.72:0/2131720222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800aaa0 con 0x7f9b0015d000 2023-08-25T04:46:39.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.668+0000 7f9afcff9700 1 -- 172.21.15.72:0/2131720222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af800ac00 con 0x7f9b0015d000 2023-08-25T04:46:39.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.668+0000 7f9afcff9700 1 -- 172.21.15.72:0/2131720222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8012400 con 0x7f9b0015d000 2023-08-25T04:46:39.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.668+0000 7f9b065ff700 1 -- 172.21.15.72:0/2131720222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0015fc80 con 0x7f9b0015d000 2023-08-25T04:46:39.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.668+0000 7f9b065ff700 1 -- 172.21.15.72:0/2131720222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b00152d90 con 0x7f9b0015d000 2023-08-25T04:46:39.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.669+0000 7f9b065ff700 1 -- 172.21.15.72:0/2131720222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b001532b0 con 0x7f9b0015d000 2023-08-25T04:46:39.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.670+0000 7f9afcff9700 1 -- 172.21.15.72:0/2131720222 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9af801b3b0 con 0x7f9b0015d000 2023-08-25T04:46:39.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.671+0000 7f9afcff9700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9aec06a0e0 0x7f9aec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:39.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.671+0000 7f9afcff9700 1 -- 172.21.15.72:0/2131720222 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9af80885a0 con 0x7f9b0015d000 2023-08-25T04:46:39.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.671+0000 7f9afffff700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9aec06a0e0 0x7f9aec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:39.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.672+0000 7f9afffff700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9aec06a0e0 0x7f9aec06c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b000d08f0 tx=0x7f9af0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:39.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.675+0000 7f9afcff9700 1 -- 172.21.15.72:0/2131720222 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9b001532b0 con 0x7f9b0015d000 2023-08-25T04:46:39.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.874+0000 7f9b065ff700 1 -- 172.21.15.72:0/2131720222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b0006a2f0 con 0x7f9b0015d000 2023-08-25T04:46:39.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.875+0000 7f9afcff9700 1 -- 172.21.15.72:0/2131720222 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9af8053950 con 0x7f9b0015d000 2023-08-25T04:46:39.876 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:39.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 -- 172.21.15.72:0/2131720222 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9aec06a0e0 msgr2=0x7f9aec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9aec06a0e0 0x7f9aec06c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b000d08f0 tx=0x7f9af0009040 comp rx=0 tx=0).stop 2023-08-25T04:46:39.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 -- 172.21.15.72:0/2131720222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b0015d000 msgr2=0x7f9b000c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:39.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b0015d000 0x7f9b000c6870 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9af800cb40 tx=0x7f9af800ce50 comp rx=0 tx=0).stop 2023-08-25T04:46:39.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 -- 172.21.15.72:0/2131720222 shutdown_connections 2023-08-25T04:46:39.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9aec06a0e0 0x7f9aec06c5a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b0015d000 0x7f9b000c6870 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b000b4d40 0x7f9b000c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 --2- 172.21.15.72:0/2131720222 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9b000d10c0 0x7f9b0015f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:39.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 -- 172.21.15.72:0/2131720222 >> 172.21.15.72:0/2131720222 conn(0x7f9b00071e10 msgr2=0x7f9b000b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:39.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 -- 172.21.15.72:0/2131720222 shutdown_connections 2023-08-25T04:46:39.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:39.877+0000 7f9b065ff700 1 -- 172.21.15.72:0/2131720222 wait complete. 2023-08-25T04:46:39.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:40.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.095+0000 7ff581fff700 1 Processor -- start 2023-08-25T04:46:40.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.095+0000 7ff581fff700 1 -- start start 2023-08-25T04:46:40.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.096+0000 7ff581fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0d10c0 0x7ff57c0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.096+0000 7ff581fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c0b8d10 con 0x7ff57c0b4d40 2023-08-25T04:46:40.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.096+0000 7ff581fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c0b5190 con 0x7ff57c15d000 2023-08-25T04:46:40.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.096+0000 7ff581fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c0b56f0 con 0x7ff57c0d10c0 2023-08-25T04:46:40.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff57c0b4d40 0x7ff57c0b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53480/0 (socket says 172.21.15.72:53480) 2023-08-25T04:46:40.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57bfff700 1 -- 172.21.15.72:0/2615995609 learned_addr learned my addr 172.21.15.72:0/2615995609 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:40.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57affd700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0d10c0 0x7ff57c0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905662629 0 0) 0x7ff57c0b8d10 con 0x7ff57c0b4d40 2023-08-25T04:46:40.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5640035b0 con 0x7ff57c0b4d40 2023-08-25T04:46:40.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643433562 0 0) 0x7ff56c001110 con 0x7ff57c15d000 2023-08-25T04:46:40.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff57c0b8d10 con 0x7ff57c15d000 2023-08-25T04:46:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 293410946 0 0) 0x7ff5640035b0 con 0x7ff57c0b4d40 2023-08-25T04:46:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0d10c0 msgr2=0x7ff57c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0d10c0 0x7ff57c0b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 >> v1:172.21.15.137:6789/0 conn(0x7ff57c15d000 legacy=0x7ff57c0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c0b6e90 con 0x7ff57c0b4d40 2023-08-25T04:46:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7ff5740019f0 con 0x7ff57c0b4d40 2023-08-25T04:46:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 >> v1:172.21.15.72:6789/0 conn(0x7ff57c0b4d40 legacy=0x7ff57c0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.097+0000 7ff57a7fc700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 0x7ff564003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57a7fc700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff564004850 0x7ff564004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57a7fc700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0d10c0 0x7ff564005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56400bac0 con 0x7ff564003bc0 2023-08-25T04:46:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56400bc00 con 0x7ff564004850 2023-08-25T04:46:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56400bdc0 con 0x7ff57c0d10c0 2023-08-25T04:46:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57b7fe700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 0x7ff564003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57bfff700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0d10c0 0x7ff564005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57affd700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff564004850 0x7ff564004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57b7fe700 1 -- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0d10c0 msgr2=0x7ff564005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:40.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57b7fe700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0d10c0 0x7ff564005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57b7fe700 1 -- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff564004850 msgr2=0x7ff564004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57b7fe700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff564004850 0x7ff564004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57b7fe700 1 -- 172.21.15.72:0/2615995609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5640035b0 con 0x7ff564003bc0 2023-08-25T04:46:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57affd700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff564004850 0x7ff564004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57bfff700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0d10c0 0x7ff564005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.098+0000 7ff57b7fe700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 0x7ff564003fc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff56c001930 tx=0x7ff564005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147ab3603542920e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.099+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0015c0 con 0x7ff564003bc0 2023-08-25T04:46:40.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.099+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c0052d0 con 0x7ff564003bc0 2023-08-25T04:46:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.099+0000 7ff57a7fc700 1 -- 172.21.15.72:0/2615995609 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c001d60 con 0x7ff564003bc0 2023-08-25T04:46:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.099+0000 7ff581fff700 1 -- 172.21.15.72:0/2615995609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 msgr2=0x7ff564003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.099+0000 7ff581fff700 1 --2- 172.21.15.72:0/2615995609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 0x7ff564003fc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff56c001930 tx=0x7ff564005880 comp rx=0 tx=0).stop 2023-08-25T04:46:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.099+0000 7ff57bfff700 1 -- 172.21.15.72:0/2615995609 reap_dead start 2023-08-25T04:46:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.099+0000 7ff581fff700 1 -- 172.21.15.72:0/2615995609 shutdown_connections 2023-08-25T04:46:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.099+0000 7ff581fff700 1 -- 172.21.15.72:0/2615995609 >> 172.21.15.72:0/2615995609 conn(0x7ff57c071e10 msgr2=0x7ff57c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:40.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.099+0000 7ff581fff700 1 -- 172.21.15.72:0/2615995609 shutdown_connections 2023-08-25T04:46:40.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.099+0000 7ff581fff700 1 -- 172.21.15.72:0/2615995609 wait complete. 2023-08-25T04:46:40.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.102+0000 7ff581fff700 1 Processor -- start 2023-08-25T04:46:40.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.102+0000 7ff581fff700 1 -- start start 2023-08-25T04:46:40.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.103+0000 7ff581fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 0x7ff57c14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.103+0000 7ff581fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c14b400 0x7ff57c14cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.103+0000 7ff581fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0a9780 0x7ff57c0a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.103+0000 7ff581fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c14c7f0 con 0x7ff564003bc0 2023-08-25T04:46:40.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.103+0000 7ff581fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c1f2610 con 0x7ff57c14b400 2023-08-25T04:46:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.103+0000 7ff581fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c14bbe0 con 0x7ff57c0a9780 2023-08-25T04:46:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.103+0000 7ff57b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 0x7ff57c14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.103+0000 7ff57b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 0x7ff57c14ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33736/0 (socket says 172.21.15.72:33736) 2023-08-25T04:46:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.103+0000 7ff57b7fe700 1 -- 172.21.15.72:0/3099213927 learned_addr learned my addr 172.21.15.72:0/3099213927 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff57bfff700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0a9780 0x7ff57c0a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff57affd700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c14b400 0x7ff57c14cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff57b7fe700 1 -- 172.21.15.72:0/3099213927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0a9780 msgr2=0x7ff57c0a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff57b7fe700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0a9780 0x7ff57c0a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff57b7fe700 1 -- 172.21.15.72:0/3099213927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c14b400 msgr2=0x7ff57c14cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff57b7fe700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c14b400 0x7ff57c14cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff57b7fe700 1 -- 172.21.15.72:0/3099213927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c14bec0 con 0x7ff564003bc0 2023-08-25T04:46:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff57affd700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c14b400 0x7ff57c14cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:40.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff57b7fe700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 0x7ff57c14ad50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c3c0 tx=0x7ff56c001460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff563fff700 1 -- 172.21.15.72:0/3099213927 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c001560 con 0x7ff564003bc0 2023-08-25T04:46:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff563fff700 1 -- 172.21.15.72:0/3099213927 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c001110 con 0x7ff564003bc0 2023-08-25T04:46:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff563fff700 1 -- 172.21.15.72:0/3099213927 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c007240 con 0x7ff564003bc0 2023-08-25T04:46:40.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.104+0000 7ff581fff700 1 -- 172.21.15.72:0/3099213927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c14c7f0 con 0x7ff564003bc0 2023-08-25T04:46:40.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.105+0000 7ff581fff700 1 -- 172.21.15.72:0/3099213927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c14c480 con 0x7ff564003bc0 2023-08-25T04:46:40.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.105+0000 7ff581fff700 1 -- 172.21.15.72:0/3099213927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c14c610 con 0x7ff564003bc0 2023-08-25T04:46:40.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.106+0000 7ff563fff700 1 -- 172.21.15.72:0/3099213927 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff56c0073a0 con 0x7ff564003bc0 2023-08-25T04:46:40.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.107+0000 7ff563fff700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff56806a0e0 0x7ff56806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.107+0000 7ff563fff700 1 -- 172.21.15.72:0/3099213927 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff56c089770 con 0x7ff564003bc0 2023-08-25T04:46:40.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.107+0000 7ff57affd700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff56806a0e0 0x7ff56806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.108+0000 7ff57affd700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff56806a0e0 0x7ff56806c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff57c15b250 tx=0x7ff570008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:40.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.111+0000 7ff563fff700 1 -- 172.21.15.72:0/3099213927 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff56c054b20 con 0x7ff564003bc0 2023-08-25T04:46:40.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.311+0000 7ff581fff700 1 -- 172.21.15.72:0/3099213927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff57c0b5190 con 0x7ff564003bc0 2023-08-25T04:46:40.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.312+0000 7ff563fff700 1 -- 172.21.15.72:0/3099213927 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff57c0b5190 con 0x7ff564003bc0 2023-08-25T04:46:40.313 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 -- 172.21.15.72:0/3099213927 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff56806a0e0 msgr2=0x7ff56806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff56806a0e0 0x7ff56806c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff57c15b250 tx=0x7ff570008040 comp rx=0 tx=0).stop 2023-08-25T04:46:40.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 -- 172.21.15.72:0/3099213927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 msgr2=0x7ff57c14ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 0x7ff57c14ad50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c3c0 tx=0x7ff56c001460 comp rx=0 tx=0).stop 2023-08-25T04:46:40.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 -- 172.21.15.72:0/3099213927 shutdown_connections 2023-08-25T04:46:40.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff56806a0e0 0x7ff56806c5a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff57c0a9780 0x7ff57c0a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff564003bc0 0x7ff57c14ad50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 --2- 172.21.15.72:0/3099213927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c14b400 0x7ff57c14cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 -- 172.21.15.72:0/3099213927 >> 172.21.15.72:0/3099213927 conn(0x7ff57c071e10 msgr2=0x7ff57c15c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:40.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 -- 172.21.15.72:0/3099213927 shutdown_connections 2023-08-25T04:46:40.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.314+0000 7ff581fff700 1 -- 172.21.15.72:0/3099213927 wait complete. 2023-08-25T04:46:40.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T04:46:40.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.532+0000 7f470a1ff700 1 Processor -- start 2023-08-25T04:46:40.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.533+0000 7f470a1ff700 1 -- start start 2023-08-25T04:46:40.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.534+0000 7f470a1ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f470415d090 0x7f47040d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.534+0000 7f470a1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470415d470 con 0x7f47040ce260 2023-08-25T04:46:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.534+0000 7f470a1ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47040d17e0 con 0x7f47040b8aa0 2023-08-25T04:46:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.534+0000 7f470a1ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47040d1ac0 con 0x7f470415d090 2023-08-25T04:46:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.535+0000 7f4703fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f47040ce260 0x7f47040b5eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53482/0 (socket says 172.21.15.72:53482) 2023-08-25T04:46:40.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.535+0000 7f4703fff700 1 -- 172.21.15.72:0/3575152591 learned_addr learned my addr 172.21.15.72:0/3575152591 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.535+0000 7f47037fe700 1 --2- 172.21.15.72:0/3575152591 >> v2:172.21.15.137:3300/0 conn(0x7f470415d090 0x7f47040d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.535+0000 7f47027fc700 1 -- 172.21.15.72:0/3575152591 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645633924 0 0) 0x7f470415d470 con 0x7f47040ce260 2023-08-25T04:46:40.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.535+0000 7f47027fc700 1 -- 172.21.15.72:0/3575152591 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46ec0035b0 con 0x7f47040ce260 2023-08-25T04:46:40.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.535+0000 7f47027fc700 1 -- 172.21.15.72:0/3575152591 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647809858 0 0) 0x7f47040d17e0 con 0x7f47040b8aa0 2023-08-25T04:46:40.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.535+0000 7f47037fe700 1 -- 172.21.15.72:0/3575152591 >> v1:172.21.15.137:6789/0 conn(0x7f47040b8aa0 legacy=0x7f47040cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.535+0000 7f47037fe700 1 -- 172.21.15.72:0/3575152591 >> v1:172.21.15.72:6789/0 conn(0x7f47040ce260 legacy=0x7f47040b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.535+0000 7f47037fe700 1 -- 172.21.15.72:0/3575152591 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040d1da0 con 0x7f470415d090 2023-08-25T04:46:40.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.536+0000 7f47037fe700 1 --2- 172.21.15.72:0/3575152591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f470415d090 0x7f47040d0e70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009840 tx=0x7f46f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e573bb548c6bba server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:40.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.536+0000 7f47027fc700 1 -- 172.21.15.72:0/3575152591 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4011830 con 0x7f470415d090 2023-08-25T04:46:40.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.536+0000 7f47027fc700 1 -- 172.21.15.72:0/3575152591 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f4011990 con 0x7f470415d090 2023-08-25T04:46:40.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.536+0000 7f47027fc700 1 -- 172.21.15.72:0/3575152591 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4011d00 con 0x7f470415d090 2023-08-25T04:46:40.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.536+0000 7f470a1ff700 1 -- 172.21.15.72:0/3575152591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f470415d090 msgr2=0x7f47040d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.536+0000 7f470a1ff700 1 --2- 172.21.15.72:0/3575152591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f470415d090 0x7f47040d0e70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009840 tx=0x7f46f4009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:40.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.537+0000 7f470a1ff700 1 -- 172.21.15.72:0/3575152591 shutdown_connections 2023-08-25T04:46:40.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.537+0000 7f470a1ff700 1 --2- 172.21.15.72:0/3575152591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f470415d090 0x7f47040d0e70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.537+0000 7f470a1ff700 1 -- 172.21.15.72:0/3575152591 >> 172.21.15.72:0/3575152591 conn(0x7f4704071e10 msgr2=0x7f4704072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:40.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.537+0000 7f470a1ff700 1 -- 172.21.15.72:0/3575152591 shutdown_connections 2023-08-25T04:46:40.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.537+0000 7f470a1ff700 1 -- 172.21.15.72:0/3575152591 wait complete. 2023-08-25T04:46:40.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.538+0000 7f470a1ff700 1 Processor -- start 2023-08-25T04:46:40.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.538+0000 7f470a1ff700 1 -- start start 2023-08-25T04:46:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.539+0000 7f470a1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47040b8aa0 0x7f47041f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.539+0000 7f470a1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47040ce260 0x7f470414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.539+0000 7f470a1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f470415d090 0x7f470415f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.539+0000 7f470a1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47041f47d0 con 0x7f47040b8aa0 2023-08-25T04:46:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.539+0000 7f470a1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47041f3bc0 con 0x7f47040ce260 2023-08-25T04:46:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.539+0000 7f470a1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47041f3ea0 con 0x7f470415d090 2023-08-25T04:46:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f47037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47040b8aa0 0x7f47041f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f47037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47040b8aa0 0x7f47041f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33742/0 (socket says 172.21.15.72:33742) 2023-08-25T04:46:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f47037fe700 1 -- 172.21.15.72:0/230434246 learned_addr learned my addr 172.21.15.72:0/230434246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f47037fe700 1 -- 172.21.15.72:0/230434246 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f470415d090 msgr2=0x7f470415f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f47037fe700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f470415d090 0x7f470415f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f47037fe700 1 -- 172.21.15.72:0/230434246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47040ce260 msgr2=0x7f470414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f47037fe700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47040ce260 0x7f470414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f47037fe700 1 -- 172.21.15.72:0/230434246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40094a0 con 0x7f47040b8aa0 2023-08-25T04:46:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f47037fe700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47040b8aa0 0x7f47041f35e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f46f4014040 tx=0x7f46f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f46ebfff700 1 -- 172.21.15.72:0/230434246 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f40038a0 con 0x7f47040b8aa0 2023-08-25T04:46:40.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.540+0000 7f46ebfff700 1 -- 172.21.15.72:0/230434246 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f401e070 con 0x7f47040b8aa0 2023-08-25T04:46:40.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.541+0000 7f46ebfff700 1 -- 172.21.15.72:0/230434246 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4003c40 con 0x7f47040b8aa0 2023-08-25T04:46:40.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.541+0000 7f470a1ff700 1 -- 172.21.15.72:0/230434246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47041f4180 con 0x7f47040b8aa0 2023-08-25T04:46:40.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.541+0000 7f470a1ff700 1 -- 172.21.15.72:0/230434246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470414f420 con 0x7f47040b8aa0 2023-08-25T04:46:40.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.542+0000 7f470a1ff700 1 -- 172.21.15.72:0/230434246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470406a2f0 con 0x7f47040b8aa0 2023-08-25T04:46:40.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.543+0000 7f46ebfff700 1 -- 172.21.15.72:0/230434246 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f46f402d450 con 0x7f47040b8aa0 2023-08-25T04:46:40.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.543+0000 7f46ebfff700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f46f006a0e0 0x7f46f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.543+0000 7f46ebfff700 1 -- 172.21.15.72:0/230434246 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f46f40898f0 con 0x7f47040b8aa0 2023-08-25T04:46:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.544+0000 7f4702ffd700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f46f006a0e0 0x7f46f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.544+0000 7f4702ffd700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f46f006a0e0 0x7f46f006c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f46f8007fd0 tx=0x7f46f8007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:40.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.548+0000 7f46ebfff700 1 -- 172.21.15.72:0/230434246 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f46f4054ca0 con 0x7f47040b8aa0 2023-08-25T04:46:40.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.749+0000 7f470a1ff700 1 -- 172.21.15.72:0/230434246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f470408a000 con 0x7f47040b8aa0 2023-08-25T04:46:40.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.755+0000 7f46ebfff700 1 -- 172.21.15.72:0/230434246 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f46f40200c0 con 0x7f47040b8aa0 2023-08-25T04:46:40.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 -- 172.21.15.72:0/230434246 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f46f006a0e0 msgr2=0x7f46f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f46f006a0e0 0x7f46f006c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f46f8007fd0 tx=0x7f46f8007980 comp rx=0 tx=0).stop 2023-08-25T04:46:40.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 -- 172.21.15.72:0/230434246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47040b8aa0 msgr2=0x7f47041f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:40.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47040b8aa0 0x7f47041f35e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f46f4014040 tx=0x7f46f4004750 comp rx=0 tx=0).stop 2023-08-25T04:46:40.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 -- 172.21.15.72:0/230434246 shutdown_connections 2023-08-25T04:46:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f46f006a0e0 0x7f46f006c5a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f470415d090 0x7f470415f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47040b8aa0 0x7f47041f35e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 --2- 172.21.15.72:0/230434246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47040ce260 0x7f470414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 -- 172.21.15.72:0/230434246 >> 172.21.15.72:0/230434246 conn(0x7f4704071e10 msgr2=0x7f47040c8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 -- 172.21.15.72:0/230434246 shutdown_connections 2023-08-25T04:46:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:40.758+0000 7f470a1ff700 1 -- 172.21.15.72:0/230434246 wait complete. 2023-08-25T04:46:40.776 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:46:40.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:46:40.876 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:46:40.988 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:46:40.988 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:46:40.989 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:46:41.036 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:46:41.037 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:46:41.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.356+0000 7f11eb5ff700 1 Processor -- start 2023-08-25T04:46:41.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.356+0000 7f11eb5ff700 1 -- start start 2023-08-25T04:46:41.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.357+0000 7f11eb5ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f11e40cdcb0 0x7f11e40ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.357+0000 7f11eb5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40c8f50 0x7f11e40c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.357+0000 7f11eb5ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e40c48f0 con 0x7f11e4159b90 2023-08-25T04:46:41.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.357+0000 7f11eb5ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e40c5470 con 0x7f11e40cdcb0 2023-08-25T04:46:41.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.357+0000 7f11eb5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4159f70 con 0x7f11e40c8f50 2023-08-25T04:46:41.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11e9b9c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40c8f50 0x7f11e40c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11e8b9a700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f11e40cdcb0 0x7f11e40ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11e9b9c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40c8f50 0x7f11e40c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:41496/0 (socket says 172.21.15.72:41496) 2023-08-25T04:46:41.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11e9b9c700 1 -- 172.21.15.72:0/3882327291 learned_addr learned my addr 172.21.15.72:0/3882327291 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:41.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11dbfff700 1 -- 172.21.15.72:0/3882327291 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453250758 0 0) 0x7f11e40c48f0 con 0x7f11e4159b90 2023-08-25T04:46:41.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11dbfff700 1 -- 172.21.15.72:0/3882327291 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11d00035b0 con 0x7f11e4159b90 2023-08-25T04:46:41.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11e9b9c700 1 -- 172.21.15.72:0/3882327291 >> v2:172.21.15.137:3300/0 conn(0x7f11e40cdcb0 msgr2=0x7f11e40ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:41.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11e9b9c700 1 --2- 172.21.15.72:0/3882327291 >> v2:172.21.15.137:3300/0 conn(0x7f11e40cdcb0 0x7f11e40ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11e9b9c700 1 -- 172.21.15.72:0/3882327291 >> v1:172.21.15.137:6789/0 conn(0x7f11e4159b90 legacy=0x7f11e40b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:41.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11e9b9c700 1 -- 172.21.15.72:0/3882327291 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e40c4b40 con 0x7f11e40c8f50 2023-08-25T04:46:41.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.358+0000 7f11e8b9a700 1 --2- 172.21.15.72:0/3882327291 >> v2:172.21.15.137:3300/0 conn(0x7f11e40cdcb0 0x7f11e40ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:41.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.359+0000 7f11e9b9c700 1 --2- 172.21.15.72:0/3882327291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40c8f50 0x7f11e40c93c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009e50 tx=0x7f11dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e54a69535edb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:41.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.359+0000 7f11dbfff700 1 -- 172.21.15.72:0/3882327291 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00bb10 con 0x7f11e40c8f50 2023-08-25T04:46:41.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.359+0000 7f11dbfff700 1 -- 172.21.15.72:0/3882327291 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc00bc70 con 0x7f11e40c8f50 2023-08-25T04:46:41.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.359+0000 7f11dbfff700 1 -- 172.21.15.72:0/3882327291 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc011460 con 0x7f11e40c8f50 2023-08-25T04:46:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.359+0000 7f11eb5ff700 1 -- 172.21.15.72:0/3882327291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40c8f50 msgr2=0x7f11e40c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.359+0000 7f11eb5ff700 1 --2- 172.21.15.72:0/3882327291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40c8f50 0x7f11e40c93c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009e50 tx=0x7f11dc00b330 comp rx=0 tx=0).stop 2023-08-25T04:46:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.359+0000 7f11eb5ff700 1 -- 172.21.15.72:0/3882327291 shutdown_connections 2023-08-25T04:46:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.359+0000 7f11eb5ff700 1 --2- 172.21.15.72:0/3882327291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40c8f50 0x7f11e40c93c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.359+0000 7f11eb5ff700 1 --2- 172.21.15.72:0/3882327291 >> v2:172.21.15.137:3300/0 conn(0x7f11e40cdcb0 0x7f11e40ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.359+0000 7f11eb5ff700 1 -- 172.21.15.72:0/3882327291 >> 172.21.15.72:0/3882327291 conn(0x7f11e40ce990 msgr2=0x7f11e40ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.360+0000 7f11eb5ff700 1 -- 172.21.15.72:0/3882327291 shutdown_connections 2023-08-25T04:46:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.360+0000 7f11eb5ff700 1 -- 172.21.15.72:0/3882327291 wait complete. 2023-08-25T04:46:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.361+0000 7f11eb5ff700 1 Processor -- start 2023-08-25T04:46:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.361+0000 7f11eb5ff700 1 -- start start 2023-08-25T04:46:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.362+0000 7f11eb5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e40c8f50 0x7f11e4141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.362+0000 7f11eb5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40cdcb0 0x7f11e413ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.362+0000 7f11eb5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e4159b90 0x7f11e40c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.362+0000 7f11eb5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e41418d0 con 0x7f11e40c8f50 2023-08-25T04:46:41.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.362+0000 7f11eb5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e413efd0 con 0x7f11e4159b90 2023-08-25T04:46:41.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.362+0000 7f11eb5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4141b70 con 0x7f11e40cdcb0 2023-08-25T04:46:41.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e939b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e40c8f50 0x7f11e4141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e939b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e40c8f50 0x7f11e4141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33748/0 (socket says 172.21.15.72:33748) 2023-08-25T04:46:41.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e939b700 1 -- 172.21.15.72:0/1212108968 learned_addr learned my addr 172.21.15.72:0/1212108968 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e9b9c700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e4159b90 0x7f11e40c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e8b9a700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40cdcb0 0x7f11e413ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e939b700 1 -- 172.21.15.72:0/1212108968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40cdcb0 msgr2=0x7f11e413ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e939b700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40cdcb0 0x7f11e413ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e939b700 1 -- 172.21.15.72:0/1212108968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e4159b90 msgr2=0x7f11e40c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e939b700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e4159b90 0x7f11e40c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e939b700 1 -- 172.21.15.72:0/1212108968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d40094a0 con 0x7f11e40c8f50 2023-08-25T04:46:41.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11e939b700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e40c8f50 0x7f11e4141390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f11e000c500 tx=0x7f11e000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:41.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.363+0000 7f11d9ffb700 1 -- 172.21.15.72:0/1212108968 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e00052d0 con 0x7f11e40c8f50 2023-08-25T04:46:41.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.364+0000 7f11d9ffb700 1 -- 172.21.15.72:0/1212108968 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0005450 con 0x7f11e40c8f50 2023-08-25T04:46:41.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.364+0000 7f11eb5ff700 1 -- 172.21.15.72:0/1212108968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc009b30 con 0x7f11e40c8f50 2023-08-25T04:46:41.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.364+0000 7f11d9ffb700 1 -- 172.21.15.72:0/1212108968 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e00038c0 con 0x7f11e40c8f50 2023-08-25T04:46:41.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.364+0000 7f11eb5ff700 1 -- 172.21.15.72:0/1212108968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e4142130 con 0x7f11e40c8f50 2023-08-25T04:46:41.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.365+0000 7f11eb5ff700 1 -- 172.21.15.72:0/1212108968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e404e620 con 0x7f11e40c8f50 2023-08-25T04:46:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.365+0000 7f11d9ffb700 1 -- 172.21.15.72:0/1212108968 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f11e0003a20 con 0x7f11e40c8f50 2023-08-25T04:46:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.366+0000 7f11d9ffb700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f11c806a0e0 0x7f11c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.366+0000 7f11d9ffb700 1 -- 172.21.15.72:0/1212108968 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f11e0087cc0 con 0x7f11e40c8f50 2023-08-25T04:46:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.367+0000 7f11e8b9a700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f11c806a0e0 0x7f11c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.367+0000 7f11e8b9a700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f11c806a0e0 0x7f11c806c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f11e40c9f20 tx=0x7f11d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.371+0000 7f11d9ffb700 1 -- 172.21.15.72:0/1212108968 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f11e0053080 con 0x7f11e40c8f50 2023-08-25T04:46:41.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.576+0000 7f11eb5ff700 1 -- 172.21.15.72:0/1212108968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11e4072840 con 0x7f11e40c8f50 2023-08-25T04:46:41.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.577+0000 7f11d9ffb700 1 -- 172.21.15.72:0/1212108968 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f11e00566a0 con 0x7f11e40c8f50 2023-08-25T04:46:41.579 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:41.579 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 -- 172.21.15.72:0/1212108968 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f11c806a0e0 msgr2=0x7f11c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f11c806a0e0 0x7f11c806c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f11e40c9f20 tx=0x7f11d4008040 comp rx=0 tx=0).stop 2023-08-25T04:46:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 -- 172.21.15.72:0/1212108968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e40c8f50 msgr2=0x7f11e4141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e40c8f50 0x7f11e4141390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f11e000c500 tx=0x7f11e000c810 comp rx=0 tx=0).stop 2023-08-25T04:46:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 -- 172.21.15.72:0/1212108968 shutdown_connections 2023-08-25T04:46:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f11c806a0e0 0x7f11c806c5a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e4159b90 0x7f11e40c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e40c8f50 0x7f11e4141390 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 --2- 172.21.15.72:0/1212108968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f11e40cdcb0 0x7f11e413ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 -- 172.21.15.72:0/1212108968 >> 172.21.15.72:0/1212108968 conn(0x7f11e40ce990 msgr2=0x7f11e406c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 -- 172.21.15.72:0/1212108968 shutdown_connections 2023-08-25T04:46:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.580+0000 7f11eb5ff700 1 -- 172.21.15.72:0/1212108968 wait complete. 2023-08-25T04:46:41.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:41.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:41.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.801+0000 7f14c3fff700 1 Processor -- start 2023-08-25T04:46:41.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.801+0000 7f14c3fff700 1 -- start start 2023-08-25T04:46:41.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.802+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14bc0c71b0 0x7f14bc0cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.802+0000 7f14c3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14bc0cd4f0 0x7f14bc0cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.802+0000 7f14c3fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc0cba40 con 0x7f14bc0cdeb0 2023-08-25T04:46:41.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.802+0000 7f14c3fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14bc0d04f0 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.802+0000 7f14c3fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0ce340 con 0x7f14bc0c71b0 2023-08-25T04:46:41.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.802+0000 7f14c159a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14bc0cd4f0 0x7f14bc0cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.802+0000 7f14c259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f14bc0cdeb0 0x7f14bc06b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53496/0 (socket says 172.21.15.72:53496) 2023-08-25T04:46:41.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.802+0000 7f14c259c700 1 -- 172.21.15.72:0/1976574501 learned_addr learned my addr 172.21.15.72:0/1976574501 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:41.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.802+0000 7f14c1d9b700 1 --2- 172.21.15.72:0/1976574501 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14bc0c71b0 0x7f14bc0cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.803+0000 7f14c0d99700 1 -- 172.21.15.72:0/1976574501 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283400466 0 0) 0x7f14bc0cba40 con 0x7f14bc0cdeb0 2023-08-25T04:46:41.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.803+0000 7f14c159a700 1 -- 172.21.15.72:0/1976574501 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14bc0c71b0 msgr2=0x7f14bc0cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:41.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.803+0000 7f14c159a700 1 --2- 172.21.15.72:0/1976574501 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14bc0c71b0 0x7f14bc0cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.803+0000 7f14c159a700 1 -- 172.21.15.72:0/1976574501 >> v1:172.21.15.72:6789/0 conn(0x7f14bc0cdeb0 legacy=0x7f14bc06b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:41.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.803+0000 7f14c159a700 1 -- 172.21.15.72:0/1976574501 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc0d0210 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.803+0000 7f14c159a700 1 --2- 172.21.15.72:0/1976574501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 0x7f14bc0cd970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009840 tx=0x7f14ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5733fefed0b12b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:41.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.803+0000 7f14c0d99700 1 -- 172.21.15.72:0/1976574501 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac011830 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.803+0000 7f14c0d99700 1 -- 172.21.15.72:0/1976574501 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac011990 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.803+0000 7f14c0d99700 1 -- 172.21.15.72:0/1976574501 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac011d20 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.804+0000 7f14c3fff700 1 -- 172.21.15.72:0/1976574501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 msgr2=0x7f14bc0cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:41.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.804+0000 7f14c3fff700 1 --2- 172.21.15.72:0/1976574501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 0x7f14bc0cd970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009840 tx=0x7f14ac009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:41.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.804+0000 7f14c3fff700 1 -- 172.21.15.72:0/1976574501 shutdown_connections 2023-08-25T04:46:41.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.804+0000 7f14c3fff700 1 --2- 172.21.15.72:0/1976574501 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14bc0c71b0 0x7f14bc0cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.804+0000 7f14c3fff700 1 --2- 172.21.15.72:0/1976574501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 0x7f14bc0cd970 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.804+0000 7f14c3fff700 1 -- 172.21.15.72:0/1976574501 >> 172.21.15.72:0/1976574501 conn(0x7f14bc0d0c70 msgr2=0x7f14bc0d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:41.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.804+0000 7f14c3fff700 1 -- 172.21.15.72:0/1976574501 shutdown_connections 2023-08-25T04:46:41.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.804+0000 7f14c3fff700 1 -- 172.21.15.72:0/1976574501 wait complete. 2023-08-25T04:46:41.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.806+0000 7f14c3fff700 1 Processor -- start 2023-08-25T04:46:41.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.806+0000 7f14c3fff700 1 -- start start 2023-08-25T04:46:41.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14bc0c71b0 0x7f14bc06c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 0x7f14bc1e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14bc0cdeb0 0x7f14bc0c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c3fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc1e7bc0 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c3fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc1e7600 con 0x7f14bc0cdeb0 2023-08-25T04:46:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c3fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc1e78e0 con 0x7f14bc0c71b0 2023-08-25T04:46:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 0x7f14bc1e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 0x7f14bc1e6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33760/0 (socket says 172.21.15.72:33760) 2023-08-25T04:46:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c159a700 1 -- 172.21.15.72:0/4248507744 learned_addr learned my addr 172.21.15.72:0/4248507744 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c1d9b700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14bc0c71b0 0x7f14bc06c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.807+0000 7f14c259c700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14bc0cdeb0 0x7f14bc0c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14c159a700 1 -- 172.21.15.72:0/4248507744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14bc0c71b0 msgr2=0x7f14bc06c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:41.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14c159a700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14bc0c71b0 0x7f14bc06c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14c159a700 1 -- 172.21.15.72:0/4248507744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14bc0cdeb0 msgr2=0x7f14bc0c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:41.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14c159a700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14bc0cdeb0 0x7f14bc0c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:41.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14c159a700 1 -- 172.21.15.72:0/4248507744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0094a0 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14c259c700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14bc0cdeb0 0x7f14bc0c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14c159a700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 0x7f14bc1e6bb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f14ac014040 tx=0x7f14ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14b27fc700 1 -- 172.21.15.72:0/4248507744 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0036a0 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14b27fc700 1 -- 172.21.15.72:0/4248507744 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac01e070 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14b27fc700 1 -- 172.21.15.72:0/4248507744 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac003a20 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14c3fff700 1 -- 172.21.15.72:0/4248507744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc0c7e70 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.808+0000 7f14c3fff700 1 -- 172.21.15.72:0/4248507744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc1d42f0 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.809+0000 7f14c3fff700 1 -- 172.21.15.72:0/4248507744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc1e7a20 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.810+0000 7f14b27fc700 1 -- 172.21.15.72:0/4248507744 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f14ac003b80 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.811+0000 7f14b27fc700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14a006a0e0 0x7f14a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:41.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.812+0000 7f14b27fc700 1 -- 172.21.15.72:0/4248507744 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f14ac0897d0 con 0x7f14bc0cd4f0 2023-08-25T04:46:41.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.812+0000 7f14c1d9b700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14a006a0e0 0x7f14a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:41.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.812+0000 7f14c1d9b700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14a006a0e0 0x7f14a006c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009b40 tx=0x7f14b8009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:41.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:41.816+0000 7f14b27fc700 1 -- 172.21.15.72:0/4248507744 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f14bc1e7a20 con 0x7f14bc0cd4f0 2023-08-25T04:46:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.013+0000 7f14c3fff700 1 -- 172.21.15.72:0/4248507744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f14bc1e7a20 con 0x7f14bc0cd4f0 2023-08-25T04:46:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.014+0000 7f14b27fc700 1 -- 172.21.15.72:0/4248507744 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f14bc1e7a20 con 0x7f14bc0cd4f0 2023-08-25T04:46:42.016 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:42.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 -- 172.21.15.72:0/4248507744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14a006a0e0 msgr2=0x7f14a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14a006a0e0 0x7f14a006c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009b40 tx=0x7f14b8009210 comp rx=0 tx=0).stop 2023-08-25T04:46:42.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 -- 172.21.15.72:0/4248507744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 msgr2=0x7f14bc1e6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 0x7f14bc1e6bb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f14ac014040 tx=0x7f14ac004750 comp rx=0 tx=0).stop 2023-08-25T04:46:42.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 -- 172.21.15.72:0/4248507744 shutdown_connections 2023-08-25T04:46:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f14a006a0e0 0x7f14a006c5a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14bc0cdeb0 0x7f14bc0c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f14bc0c71b0 0x7f14bc06c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 --2- 172.21.15.72:0/4248507744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14bc0cd4f0 0x7f14bc1e6bb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 -- 172.21.15.72:0/4248507744 >> 172.21.15.72:0/4248507744 conn(0x7f14bc0d0c70 msgr2=0x7f14bc1e3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 -- 172.21.15.72:0/4248507744 shutdown_connections 2023-08-25T04:46:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.016+0000 7f14c3fff700 1 -- 172.21.15.72:0/4248507744 wait complete. 2023-08-25T04:46:42.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:42.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.235+0000 7f192dbff700 1 Processor -- start 2023-08-25T04:46:42.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.235+0000 7f192dbff700 1 -- start start 2023-08-25T04:46:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.236+0000 7f192dbff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f192815d000 0x7f19280b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.236+0000 7f192dbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19280b6e90 con 0x7f19280b4f10 2023-08-25T04:46:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.236+0000 7f192dbff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192815d3e0 con 0x7f19280d10c0 2023-08-25T04:46:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.236+0000 7f192dbff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280b56f0 con 0x7f192815d000 2023-08-25T04:46:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.236+0000 7f1927fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f19280b4f10 0x7f19280b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53502/0 (socket says 172.21.15.72:53502) 2023-08-25T04:46:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.236+0000 7f1927fff700 1 -- 172.21.15.72:0/2109857324 learned_addr learned my addr 172.21.15.72:0/2109857324 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.237+0000 7f19277fe700 1 --2- 172.21.15.72:0/2109857324 >> v2:172.21.15.137:3300/0 conn(0x7f192815d000 0x7f19280b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.237+0000 7f19267fc700 1 -- 172.21.15.72:0/2109857324 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91631403 0 0) 0x7f19280b6e90 con 0x7f19280b4f10 2023-08-25T04:46:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.237+0000 7f19267fc700 1 -- 172.21.15.72:0/2109857324 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19100035b0 con 0x7f19280b4f10 2023-08-25T04:46:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.237+0000 7f19277fe700 1 -- 172.21.15.72:0/2109857324 >> v1:172.21.15.137:6789/0 conn(0x7f19280d10c0 legacy=0x7f19280b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.237+0000 7f19277fe700 1 -- 172.21.15.72:0/2109857324 >> v1:172.21.15.72:6789/0 conn(0x7f19280b4f10 legacy=0x7f19280b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.237+0000 7f19277fe700 1 -- 172.21.15.72:0/2109857324 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280b6280 con 0x7f192815d000 2023-08-25T04:46:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.237+0000 7f19277fe700 1 --2- 172.21.15.72:0/2109857324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192815d000 0x7f19280b8600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1918009840 tx=0x7f1918009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7afddea37652d2d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.238+0000 7f19267fc700 1 -- 172.21.15.72:0/2109857324 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918011830 con 0x7f192815d000 2023-08-25T04:46:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.238+0000 7f19267fc700 1 -- 172.21.15.72:0/2109857324 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1918011990 con 0x7f192815d000 2023-08-25T04:46:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.238+0000 7f19267fc700 1 -- 172.21.15.72:0/2109857324 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918011d20 con 0x7f192815d000 2023-08-25T04:46:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.238+0000 7f192dbff700 1 -- 172.21.15.72:0/2109857324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192815d000 msgr2=0x7f19280b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.238+0000 7f192dbff700 1 --2- 172.21.15.72:0/2109857324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192815d000 0x7f19280b8600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1918009840 tx=0x7f1918009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.238+0000 7f192dbff700 1 -- 172.21.15.72:0/2109857324 shutdown_connections 2023-08-25T04:46:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.238+0000 7f192dbff700 1 --2- 172.21.15.72:0/2109857324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192815d000 0x7f19280b8600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.238+0000 7f192dbff700 1 -- 172.21.15.72:0/2109857324 >> 172.21.15.72:0/2109857324 conn(0x7f1928071e10 msgr2=0x7f1928072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.239+0000 7f192dbff700 1 -- 172.21.15.72:0/2109857324 shutdown_connections 2023-08-25T04:46:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.239+0000 7f192dbff700 1 -- 172.21.15.72:0/2109857324 wait complete. 2023-08-25T04:46:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.240+0000 7f192dbff700 1 Processor -- start 2023-08-25T04:46:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.240+0000 7f192dbff700 1 -- start start 2023-08-25T04:46:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.241+0000 7f192dbff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19280b4f10 0x7f19280cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.241+0000 7f192dbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280d10c0 0x7f19280caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.241+0000 7f192dbff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192815d000 0x7f19281564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.241+0000 7f192dbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280cd1e0 con 0x7f19280d10c0 2023-08-25T04:46:42.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.241+0000 7f192dbff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192815e8d0 con 0x7f192815d000 2023-08-25T04:46:42.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.241+0000 7f192dbff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19280ccc20 con 0x7f19280b4f10 2023-08-25T04:46:42.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.241+0000 7f1926ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280d10c0 0x7f19280caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f1926ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280d10c0 0x7f19280caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33776/0 (socket says 172.21.15.72:33776) 2023-08-25T04:46:42.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f1926ffd700 1 -- 172.21.15.72:0/3334910425 learned_addr learned my addr 172.21.15.72:0/3334910425 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:42.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f19277fe700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19280b4f10 0x7f19280cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f1927fff700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192815d000 0x7f19281564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f1926ffd700 1 -- 172.21.15.72:0/3334910425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19280b4f10 msgr2=0x7f19280cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f1926ffd700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19280b4f10 0x7f19280cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f1926ffd700 1 -- 172.21.15.72:0/3334910425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192815d000 msgr2=0x7f19281564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f1926ffd700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192815d000 0x7f19281564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f1926ffd700 1 -- 172.21.15.72:0/3334910425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180094a0 con 0x7f19280d10c0 2023-08-25T04:46:42.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f1926ffd700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280d10c0 0x7f19280caa40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f191c00c490 tx=0x7f191c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:42.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f190ffff700 1 -- 172.21.15.72:0/3334910425 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c0052d0 con 0x7f19280d10c0 2023-08-25T04:46:42.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f190ffff700 1 -- 172.21.15.72:0/3334910425 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c005450 con 0x7f19280d10c0 2023-08-25T04:46:42.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f190ffff700 1 -- 172.21.15.72:0/3334910425 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c006aa0 con 0x7f19280d10c0 2023-08-25T04:46:42.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.242+0000 7f192dbff700 1 -- 172.21.15.72:0/3334910425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19280ccf00 con 0x7f19280d10c0 2023-08-25T04:46:42.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.243+0000 7f192dbff700 1 -- 172.21.15.72:0/3334910425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19280caf80 con 0x7f19280d10c0 2023-08-25T04:46:42.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.243+0000 7f192dbff700 1 -- 172.21.15.72:0/3334910425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192815e730 con 0x7f19280d10c0 2023-08-25T04:46:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.244+0000 7f190ffff700 1 -- 172.21.15.72:0/3334910425 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f191c003680 con 0x7f19280d10c0 2023-08-25T04:46:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.245+0000 7f190ffff700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191406a0e0 0x7f191406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.245+0000 7f190ffff700 1 -- 172.21.15.72:0/3334910425 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f191c087ba0 con 0x7f19280d10c0 2023-08-25T04:46:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.245+0000 7f19277fe700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191406a0e0 0x7f191406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.246+0000 7f19277fe700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191406a0e0 0x7f191406c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1918000c00 tx=0x7f191801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.250+0000 7f190ffff700 1 -- 172.21.15.72:0/3334910425 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f192815e730 con 0x7f19280d10c0 2023-08-25T04:46:42.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.444+0000 7f192dbff700 1 -- 172.21.15.72:0/3334910425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f192815edb0 con 0x7f19280d10c0 2023-08-25T04:46:42.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.444+0000 7f190ffff700 1 -- 172.21.15.72:0/3334910425 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f192815edb0 con 0x7f19280d10c0 2023-08-25T04:46:42.446 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 -- 172.21.15.72:0/3334910425 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191406a0e0 msgr2=0x7f191406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191406a0e0 0x7f191406c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1918000c00 tx=0x7f191801c040 comp rx=0 tx=0).stop 2023-08-25T04:46:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 -- 172.21.15.72:0/3334910425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280d10c0 msgr2=0x7f19280caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280d10c0 0x7f19280caa40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f191c00c490 tx=0x7f191c00c7a0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 -- 172.21.15.72:0/3334910425 shutdown_connections 2023-08-25T04:46:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191406a0e0 0x7f191406c5a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192815d000 0x7f19281564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19280b4f10 0x7f19280cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 --2- 172.21.15.72:0/3334910425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19280d10c0 0x7f19280caa40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 -- 172.21.15.72:0/3334910425 >> 172.21.15.72:0/3334910425 conn(0x7f1928071e10 msgr2=0x7f19280b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 -- 172.21.15.72:0/3334910425 shutdown_connections 2023-08-25T04:46:42.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.447+0000 7f192dbff700 1 -- 172.21.15.72:0/3334910425 wait complete. 2023-08-25T04:46:42.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.664+0000 7f86771ff700 1 Processor -- start 2023-08-25T04:46:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.664+0000 7f86771ff700 1 -- start start 2023-08-25T04:46:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.665+0000 7f86771ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86700b4f10 0x7f8670167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.665+0000 7f86771ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700b8d10 con 0x7f86700d10c0 2023-08-25T04:46:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.665+0000 7f86771ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700b6e90 con 0x7f867015d000 2023-08-25T04:46:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.665+0000 7f86771ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86700b56f0 con 0x7f86700b4f10 2023-08-25T04:46:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f86700d10c0 0x7f86700b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53504/0 (socket says 172.21.15.72:53504) 2023-08-25T04:46:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866ffff700 1 -- 172.21.15.72:0/152735078 learned_addr learned my addr 172.21.15.72:0/152735078 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f867579c700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86700b4f10 0x7f8670167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989139620 0 0) 0x7f86700b8d10 con 0x7f86700d10c0 2023-08-25T04:46:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86600035b0 con 0x7f86700d10c0 2023-08-25T04:46:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372920927 0 0) 0x7f86700b6e90 con 0x7f867015d000 2023-08-25T04:46:42.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86700b8d10 con 0x7f867015d000 2023-08-25T04:46:42.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 523114998 0 0) 0x7f86600035b0 con 0x7f86700d10c0 2023-08-25T04:46:42.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86700b4f10 msgr2=0x7f8670167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:42.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866f7fe700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86700b4f10 0x7f8670167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 >> v1:172.21.15.137:6789/0 conn(0x7f867015d000 legacy=0x7f86700b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867015d3e0 con 0x7f86700d10c0 2023-08-25T04:46:42.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.666+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f865c001670 con 0x7f86700d10c0 2023-08-25T04:46:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 >> v1:172.21.15.72:6789/0 conn(0x7f86700d10c0 legacy=0x7f86700b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866f7fe700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8660003bc0 0x7f8660003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866f7fe700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 0x7f8660004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866f7fe700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8660005210 0x7f866000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866000c000 con 0x7f8660004850 2023-08-25T04:46:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866000c170 con 0x7f8660005210 2023-08-25T04:46:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866000c330 con 0x7f8660003bc0 2023-08-25T04:46:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f867579c700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f86700b4f10 0x7f8670167be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866ffff700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 0x7f8660004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f8674f9b700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8660003bc0 0x7f8660003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f867579c700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8660005210 0x7f866000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866ffff700 1 -- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8660003bc0 msgr2=0x7f8660003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866ffff700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8660003bc0 0x7f8660003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866ffff700 1 -- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8660005210 msgr2=0x7f866000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866ffff700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8660005210 0x7f866000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.667+0000 7f866ffff700 1 -- 172.21.15.72:0/152735078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600035b0 con 0x7f8660004850 2023-08-25T04:46:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.668+0000 7f866ffff700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 0x7f8660004cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c110 tx=0x7f8660005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb87304ee2eebd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.668+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00ccb0 con 0x7f8660004850 2023-08-25T04:46:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.668+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c00ce30 con 0x7f8660004850 2023-08-25T04:46:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.668+0000 7f866f7fe700 1 -- 172.21.15.72:0/152735078 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c005ba0 con 0x7f8660004850 2023-08-25T04:46:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.668+0000 7f86771ff700 1 -- 172.21.15.72:0/152735078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 msgr2=0x7f8660004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.668+0000 7f86771ff700 1 --2- 172.21.15.72:0/152735078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 0x7f8660004cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c110 tx=0x7f8660005880 comp rx=0 tx=0).stop 2023-08-25T04:46:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.668+0000 7f867579c700 1 -- 172.21.15.72:0/152735078 reap_dead start 2023-08-25T04:46:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.668+0000 7f86771ff700 1 -- 172.21.15.72:0/152735078 shutdown_connections 2023-08-25T04:46:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.668+0000 7f86771ff700 1 -- 172.21.15.72:0/152735078 >> 172.21.15.72:0/152735078 conn(0x7f8670071e10 msgr2=0x7f8670072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.668+0000 7f86771ff700 1 -- 172.21.15.72:0/152735078 shutdown_connections 2023-08-25T04:46:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.669+0000 7f86771ff700 1 -- 172.21.15.72:0/152735078 wait complete. 2023-08-25T04:46:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.670+0000 7f86771ff700 1 Processor -- start 2023-08-25T04:46:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.670+0000 7f86771ff700 1 -- start start 2023-08-25T04:46:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.671+0000 7f86771ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 0x7f8670152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.671+0000 7f86771ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f867015e620 0x7f86700cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.671+0000 7f86771ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86700ccb30 0x7f86700c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.671+0000 7f86771ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86700cb140 con 0x7f8660004850 2023-08-25T04:46:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.671+0000 7f86771ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86700c7bb0 con 0x7f86700ccb30 2023-08-25T04:46:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.671+0000 7f86771ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86700cab80 con 0x7f867015e620 2023-08-25T04:46:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f8674f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 0x7f8670152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f8674f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 0x7f8670152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33790/0 (socket says 172.21.15.72:33790) 2023-08-25T04:46:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f8674f9b700 1 -- 172.21.15.72:0/2243362192 learned_addr learned my addr 172.21.15.72:0/2243362192 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f867579c700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86700ccb30 0x7f86700c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f866ffff700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f867015e620 0x7f86700cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f8674f9b700 1 -- 172.21.15.72:0/2243362192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f867015e620 msgr2=0x7f86700cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f8674f9b700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f867015e620 0x7f86700cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f8674f9b700 1 -- 172.21.15.72:0/2243362192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86700ccb30 msgr2=0x7f86700c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f8674f9b700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86700ccb30 0x7f86700c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f8674f9b700 1 -- 172.21.15.72:0/2243362192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86700cae60 con 0x7f8660004850 2023-08-25T04:46:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f8674f9b700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 0x7f8670152210 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f866400f7a0 tx=0x7f866400fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f866d7fa700 1 -- 172.21.15.72:0/2243362192 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664005320 con 0x7f8660004850 2023-08-25T04:46:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f866d7fa700 1 -- 172.21.15.72:0/2243362192 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86640054a0 con 0x7f8660004850 2023-08-25T04:46:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f86771ff700 1 -- 172.21.15.72:0/2243362192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86700c7840 con 0x7f8660004850 2023-08-25T04:46:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.672+0000 7f866d7fa700 1 -- 172.21.15.72:0/2243362192 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664006aa0 con 0x7f8660004850 2023-08-25T04:46:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.673+0000 7f86771ff700 1 -- 172.21.15.72:0/2243362192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8670152750 con 0x7f8660004850 2023-08-25T04:46:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.674+0000 7f86771ff700 1 -- 172.21.15.72:0/2243362192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86700c76a0 con 0x7f8660004850 2023-08-25T04:46:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.674+0000 7f866d7fa700 1 -- 172.21.15.72:0/2243362192 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8664006c00 con 0x7f8660004850 2023-08-25T04:46:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.676+0000 7f866d7fa700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f865406a0e0 0x7f865406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.676+0000 7f866d7fa700 1 -- 172.21.15.72:0/2243362192 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8664088230 con 0x7f8660004850 2023-08-25T04:46:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.676+0000 7f866ffff700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f865406a0e0 0x7f865406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.676+0000 7f866ffff700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f865406a0e0 0x7f865406c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f86701605f0 tx=0x7f865c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.680+0000 7f866d7fa700 1 -- 172.21.15.72:0/2243362192 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f86700c76a0 con 0x7f8660004850 2023-08-25T04:46:42.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.881+0000 7f86771ff700 1 -- 172.21.15.72:0/2243362192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86700c76a0 con 0x7f8660004850 2023-08-25T04:46:42.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.882+0000 7f866d7fa700 1 -- 172.21.15.72:0/2243362192 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86700c76a0 con 0x7f8660004850 2023-08-25T04:46:42.883 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 -- 172.21.15.72:0/2243362192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f865406a0e0 msgr2=0x7f865406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f865406a0e0 0x7f865406c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f86701605f0 tx=0x7f865c007000 comp rx=0 tx=0).stop 2023-08-25T04:46:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 -- 172.21.15.72:0/2243362192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 msgr2=0x7f8670152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 0x7f8670152210 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f866400f7a0 tx=0x7f866400fb60 comp rx=0 tx=0).stop 2023-08-25T04:46:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 -- 172.21.15.72:0/2243362192 shutdown_connections 2023-08-25T04:46:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f865406a0e0 0x7f865406c5a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86700ccb30 0x7f86700c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8660004850 0x7f8670152210 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 --2- 172.21.15.72:0/2243362192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f867015e620 0x7f86700cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 -- 172.21.15.72:0/2243362192 >> 172.21.15.72:0/2243362192 conn(0x7f8670071e10 msgr2=0x7f86700cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 -- 172.21.15.72:0/2243362192 shutdown_connections 2023-08-25T04:46:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:42.884+0000 7f86771ff700 1 -- 172.21.15.72:0/2243362192 wait complete. 2023-08-25T04:46:42.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:43.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.101+0000 7f06b6bff700 1 Processor -- start 2023-08-25T04:46:43.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.101+0000 7f06b6bff700 1 -- start start 2023-08-25T04:46:43.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.102+0000 7f06b6bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8aa0 0x7f06b00cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.102+0000 7f06b6bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06b00ce090 0x7f06b00b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.102+0000 7f06b6bff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b00d1580 con 0x7f06b015d090 2023-08-25T04:46:43.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.102+0000 7f06b6bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b00ce4b0 con 0x7f06b00ce090 2023-08-25T04:46:43.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.102+0000 7f06b6bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b015d470 con 0x7f06b00b8aa0 2023-08-25T04:46:43.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.102+0000 7f06b519c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06b00ce090 0x7f06b00b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.102+0000 7f06b519c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06b00ce090 0x7f06b00b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46794/0 (socket says 172.21.15.72:46794) 2023-08-25T04:46:43.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.102+0000 7f06b519c700 1 -- 172.21.15.72:0/3522604654 learned_addr learned my addr 172.21.15.72:0/3522604654 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:43.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.102+0000 7f06affff700 1 --2- 172.21.15.72:0/3522604654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8aa0 0x7f06b00cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.103+0000 7f06b519c700 1 -- 172.21.15.72:0/3522604654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8aa0 msgr2=0x7f06b00cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:43.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.103+0000 7f06b519c700 1 --2- 172.21.15.72:0/3522604654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8aa0 0x7f06b00cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.103+0000 7f06b519c700 1 -- 172.21.15.72:0/3522604654 >> v1:172.21.15.137:6789/0 conn(0x7f06b015d090 legacy=0x7f06b00d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.103+0000 7f06b519c700 1 -- 172.21.15.72:0/3522604654 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b00d17e0 con 0x7f06b00ce090 2023-08-25T04:46:43.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.103+0000 7f06b519c700 1 --2- 172.21.15.72:0/3522604654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b00ce090 0x7f06b00b5eb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009e50 tx=0x7f06a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6ab4d9dd6483d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:43.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.103+0000 7f06af7fe700 1 -- 172.21.15.72:0/3522604654 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800e070 con 0x7f06b00ce090 2023-08-25T04:46:43.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.103+0000 7f06af7fe700 1 -- 172.21.15.72:0/3522604654 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a800b9c0 con 0x7f06b00ce090 2023-08-25T04:46:43.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.103+0000 7f06af7fe700 1 -- 172.21.15.72:0/3522604654 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800bd70 con 0x7f06b00ce090 2023-08-25T04:46:43.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.104+0000 7f06b6bff700 1 -- 172.21.15.72:0/3522604654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b00ce090 msgr2=0x7f06b00b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.104+0000 7f06b6bff700 1 --2- 172.21.15.72:0/3522604654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b00ce090 0x7f06b00b5eb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009e50 tx=0x7f06a800b330 comp rx=0 tx=0).stop 2023-08-25T04:46:43.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.104+0000 7f06b6bff700 1 -- 172.21.15.72:0/3522604654 shutdown_connections 2023-08-25T04:46:43.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.104+0000 7f06b6bff700 1 --2- 172.21.15.72:0/3522604654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b00ce090 0x7f06b00b5eb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.104+0000 7f06b6bff700 1 --2- 172.21.15.72:0/3522604654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8aa0 0x7f06b00cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.104+0000 7f06b6bff700 1 -- 172.21.15.72:0/3522604654 >> 172.21.15.72:0/3522604654 conn(0x7f06b0071e10 msgr2=0x7f06b0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:43.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.104+0000 7f06b6bff700 1 -- 172.21.15.72:0/3522604654 shutdown_connections 2023-08-25T04:46:43.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.104+0000 7f06b6bff700 1 -- 172.21.15.72:0/3522604654 wait complete. 2023-08-25T04:46:43.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.105+0000 7f06b6bff700 1 Processor -- start 2023-08-25T04:46:43.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.106+0000 7f06b6bff700 1 -- start start 2023-08-25T04:46:43.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.106+0000 7f06b6bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8aa0 0x7f06b01e7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.106+0000 7f06b6bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b00ce090 0x7f06b00b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b6bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b015d090 0x7f06b01587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b6bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00b4b80 con 0x7f06b015d090 2023-08-25T04:46:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b6bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b01e63a0 con 0x7f06b00ce090 2023-08-25T04:46:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b6bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b01e6680 con 0x7f06b00b8aa0 2023-08-25T04:46:43.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b519c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b015d090 0x7f06b01587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b519c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b015d090 0x7f06b01587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46796/0 (socket says 172.21.15.72:46796) 2023-08-25T04:46:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b519c700 1 -- 172.21.15.72:0/1135959269 learned_addr learned my addr 172.21.15.72:0/1135959269 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b499b700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8aa0 0x7f06b01e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06affff700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b00ce090 0x7f06b00b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b519c700 1 -- 172.21.15.72:0/1135959269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8aa0 msgr2=0x7f06b01e7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b519c700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8aa0 0x7f06b01e7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b519c700 1 -- 172.21.15.72:0/1135959269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b00ce090 msgr2=0x7f06b00b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b519c700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b00ce090 0x7f06b00b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.107+0000 7f06b519c700 1 -- 172.21.15.72:0/1135959269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8009b30 con 0x7f06b015d090 2023-08-25T04:46:43.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.108+0000 7f06b519c700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b015d090 0x7f06b01587c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f06b00d1710 tx=0x7f06a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:43.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.108+0000 7f06ad7fa700 1 -- 172.21.15.72:0/1135959269 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8004800 con 0x7f06b015d090 2023-08-25T04:46:43.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.108+0000 7f06ad7fa700 1 -- 172.21.15.72:0/1135959269 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a8004960 con 0x7f06b015d090 2023-08-25T04:46:43.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.108+0000 7f06b6bff700 1 -- 172.21.15.72:0/1135959269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b01e6960 con 0x7f06b015d090 2023-08-25T04:46:43.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.108+0000 7f06ad7fa700 1 -- 172.21.15.72:0/1135959269 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a801c680 con 0x7f06b015d090 2023-08-25T04:46:43.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.108+0000 7f06b6bff700 1 -- 172.21.15.72:0/1135959269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b01e6f20 con 0x7f06b015d090 2023-08-25T04:46:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.109+0000 7f06b6bff700 1 -- 172.21.15.72:0/1135959269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b006a2f0 con 0x7f06b015d090 2023-08-25T04:46:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.110+0000 7f06ad7fa700 1 -- 172.21.15.72:0/1135959269 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f06a801c7e0 con 0x7f06b015d090 2023-08-25T04:46:43.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.111+0000 7f06ad7fa700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069406a0e0 0x7f069406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.111+0000 7f06ad7fa700 1 -- 172.21.15.72:0/1135959269 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f06a808a3e0 con 0x7f06b015d090 2023-08-25T04:46:43.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.111+0000 7f06b499b700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069406a0e0 0x7f069406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.112+0000 7f06b499b700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069406a0e0 0x7f069406c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06a4007fd0 tx=0x7f06a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:43.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.115+0000 7f06ad7fa700 1 -- 172.21.15.72:0/1135959269 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f06a8055830 con 0x7f06b015d090 2023-08-25T04:46:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.310+0000 7f06b6bff700 1 -- 172.21.15.72:0/1135959269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06b0066bc0 con 0x7f06b015d090 2023-08-25T04:46:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.311+0000 7f06ad7fa700 1 -- 172.21.15.72:0/1135959269 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06a8058e50 con 0x7f06b015d090 2023-08-25T04:46:43.312 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:43.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 -- 172.21.15.72:0/1135959269 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069406a0e0 msgr2=0x7f069406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069406a0e0 0x7f069406c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06a4007fd0 tx=0x7f06a4009040 comp rx=0 tx=0).stop 2023-08-25T04:46:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 -- 172.21.15.72:0/1135959269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b015d090 msgr2=0x7f06b01587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b015d090 0x7f06b01587c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f06b00d1710 tx=0x7f06a8004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 -- 172.21.15.72:0/1135959269 shutdown_connections 2023-08-25T04:46:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f069406a0e0 0x7f069406c5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b015d090 0x7f06b01587c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06b00b8aa0 0x7f06b01e7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 --2- 172.21.15.72:0/1135959269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06b00ce090 0x7f06b00b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 -- 172.21.15.72:0/1135959269 >> 172.21.15.72:0/1135959269 conn(0x7f06b0071e10 msgr2=0x7f06b00721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.313+0000 7f06b6bff700 1 -- 172.21.15.72:0/1135959269 shutdown_connections 2023-08-25T04:46:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.314+0000 7f06b6bff700 1 -- 172.21.15.72:0/1135959269 wait complete. 2023-08-25T04:46:43.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.531+0000 7f4152fff700 1 Processor -- start 2023-08-25T04:46:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.531+0000 7f4152fff700 1 -- start start 2023-08-25T04:46:43.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.532+0000 7f4152fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f414c15d000 0x7f414c0b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.532+0000 7f4152fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f414c0d10c0 0x7f414c0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.532+0000 7f4152fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c0b6e90 con 0x7f414c0b4d40 2023-08-25T04:46:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.532+0000 7f4152fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0b56f0 con 0x7f414c15d000 2023-08-25T04:46:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.532+0000 7f4152fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0b5170 con 0x7f414c0d10c0 2023-08-25T04:46:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f415159c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f414c0b4d40 0x7f414c160af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41708/0 (socket says 172.21.15.72:41708) 2023-08-25T04:46:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f415159c700 1 -- 172.21.15.72:0/704414288 learned_addr learned my addr 172.21.15.72:0/704414288 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f4150d9b700 1 --2- 172.21.15.72:0/704414288 >> v2:172.21.15.72:3300/0 conn(0x7f414c15d000 0x7f414c0b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f414bfff700 1 --2- 172.21.15.72:0/704414288 >> v2:172.21.15.137:3300/0 conn(0x7f414c0d10c0 0x7f414c0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f414b7fe700 1 -- 172.21.15.72:0/704414288 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668470018 0 0) 0x7f414c0b6e90 con 0x7f414c0b4d40 2023-08-25T04:46:43.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f414b7fe700 1 -- 172.21.15.72:0/704414288 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f413c0035b0 con 0x7f414c0b4d40 2023-08-25T04:46:43.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f4150d9b700 1 -- 172.21.15.72:0/704414288 >> v2:172.21.15.137:3300/0 conn(0x7f414c0d10c0 msgr2=0x7f414c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:43.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f4150d9b700 1 --2- 172.21.15.72:0/704414288 >> v2:172.21.15.137:3300/0 conn(0x7f414c0d10c0 0x7f414c0b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f4150d9b700 1 -- 172.21.15.72:0/704414288 >> v1:172.21.15.72:6789/0 conn(0x7f414c0b4d40 legacy=0x7f414c160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f4150d9b700 1 -- 172.21.15.72:0/704414288 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c15d3e0 con 0x7f414c15d000 2023-08-25T04:46:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.533+0000 7f4150d9b700 1 --2- 172.21.15.72:0/704414288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 0x7f414c0b8600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f414c160a50 tx=0x7f4140009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db907a0e66449bd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f414b7fe700 1 -- 172.21.15.72:0/704414288 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140011830 con 0x7f414c15d000 2023-08-25T04:46:43.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f414b7fe700 1 -- 172.21.15.72:0/704414288 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140011990 con 0x7f414c15d000 2023-08-25T04:46:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f414b7fe700 1 -- 172.21.15.72:0/704414288 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140011d20 con 0x7f414c15d000 2023-08-25T04:46:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f4152fff700 1 -- 172.21.15.72:0/704414288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 msgr2=0x7f414c0b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f4152fff700 1 --2- 172.21.15.72:0/704414288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 0x7f414c0b8600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f414c160a50 tx=0x7f4140009b20 comp rx=0 tx=0).stop 2023-08-25T04:46:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f4152fff700 1 -- 172.21.15.72:0/704414288 shutdown_connections 2023-08-25T04:46:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f4152fff700 1 --2- 172.21.15.72:0/704414288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 0x7f414c0b8600 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f4152fff700 1 --2- 172.21.15.72:0/704414288 >> v2:172.21.15.137:3300/0 conn(0x7f414c0d10c0 0x7f414c0b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f4152fff700 1 -- 172.21.15.72:0/704414288 >> 172.21.15.72:0/704414288 conn(0x7f414c071e10 msgr2=0x7f414c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f4152fff700 1 -- 172.21.15.72:0/704414288 shutdown_connections 2023-08-25T04:46:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.534+0000 7f4152fff700 1 -- 172.21.15.72:0/704414288 wait complete. 2023-08-25T04:46:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.536+0000 7f4152fff700 1 Processor -- start 2023-08-25T04:46:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.536+0000 7f4152fff700 1 -- start start 2023-08-25T04:46:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.537+0000 7f4152fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f414c0b4d40 0x7f414c155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.537+0000 7f4152fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f414c0d10c0 0x7f414c151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.537+0000 7f4152fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 0x7f414c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.537+0000 7f4152fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c154f30 con 0x7f414c15d000 2023-08-25T04:46:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.537+0000 7f4152fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c15e620 con 0x7f414c0b4d40 2023-08-25T04:46:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.537+0000 7f4152fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c15e900 con 0x7f414c0d10c0 2023-08-25T04:46:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.537+0000 7f415159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 0x7f414c152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f415159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 0x7f414c152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46822/0 (socket says 172.21.15.72:46822) 2023-08-25T04:46:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f415159c700 1 -- 172.21.15.72:0/569079565 learned_addr learned my addr 172.21.15.72:0/569079565 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f4150d9b700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f414c0b4d40 0x7f414c155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f415159c700 1 -- 172.21.15.72:0/569079565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f414c0d10c0 msgr2=0x7f414c151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f414bfff700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f414c0d10c0 0x7f414c151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f415159c700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f414c0d10c0 0x7f414c151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f415159c700 1 -- 172.21.15.72:0/569079565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f414c0b4d40 msgr2=0x7f414c155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f415159c700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f414c0b4d40 0x7f414c155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f415159c700 1 -- 172.21.15.72:0/569079565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41400094a0 con 0x7f414c15d000 2023-08-25T04:46:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f4150d9b700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f414c0b4d40 0x7f414c155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f414bfff700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f414c0d10c0 0x7f414c151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f415159c700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 0x7f414c152b30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f414400cb40 tx=0x7f414400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f41497fa700 1 -- 172.21.15.72:0/569079565 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414400ab50 con 0x7f414c15d000 2023-08-25T04:46:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f41497fa700 1 -- 172.21.15.72:0/569079565 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414400acb0 con 0x7f414c15d000 2023-08-25T04:46:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f41497fa700 1 -- 172.21.15.72:0/569079565 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144012620 con 0x7f414c15d000 2023-08-25T04:46:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.538+0000 7f4152fff700 1 -- 172.21.15.72:0/569079565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c15ebe0 con 0x7f414c15d000 2023-08-25T04:46:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.539+0000 7f4152fff700 1 -- 172.21.15.72:0/569079565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c15f1a0 con 0x7f414c15d000 2023-08-25T04:46:43.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.540+0000 7f4152fff700 1 -- 172.21.15.72:0/569079565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c15f3c0 con 0x7f414c15d000 2023-08-25T04:46:43.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.540+0000 7f41497fa700 1 -- 172.21.15.72:0/569079565 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f414401b3b0 con 0x7f414c15d000 2023-08-25T04:46:43.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.542+0000 7f41497fa700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413006a0e0 0x7f413006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.542+0000 7f41497fa700 1 -- 172.21.15.72:0/569079565 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4144088650 con 0x7f414c15d000 2023-08-25T04:46:43.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.542+0000 7f4150d9b700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413006a0e0 0x7f413006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.542+0000 7f4150d9b700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413006a0e0 0x7f413006c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f41400090b0 tx=0x7f4140008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:43.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.546+0000 7f41497fa700 1 -- 172.21.15.72:0/569079565 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4144053a10 con 0x7f414c15d000 2023-08-25T04:46:43.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.741+0000 7f4152fff700 1 -- 172.21.15.72:0/569079565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f414c06a2f0 con 0x7f414c15d000 2023-08-25T04:46:43.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.741+0000 7f41497fa700 1 -- 172.21.15.72:0/569079565 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4144057030 con 0x7f414c15d000 2023-08-25T04:46:43.743 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:43.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 -- 172.21.15.72:0/569079565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413006a0e0 msgr2=0x7f413006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413006a0e0 0x7f413006c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f41400090b0 tx=0x7f4140008030 comp rx=0 tx=0).stop 2023-08-25T04:46:43.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 -- 172.21.15.72:0/569079565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 msgr2=0x7f414c152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 0x7f414c152b30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f414400cb40 tx=0x7f414400cf00 comp rx=0 tx=0).stop 2023-08-25T04:46:43.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 -- 172.21.15.72:0/569079565 shutdown_connections 2023-08-25T04:46:43.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413006a0e0 0x7f413006c5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f414c15d000 0x7f414c152b30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f414c0b4d40 0x7f414c155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 --2- 172.21.15.72:0/569079565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f414c0d10c0 0x7f414c151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 -- 172.21.15.72:0/569079565 >> 172.21.15.72:0/569079565 conn(0x7f414c071e10 msgr2=0x7f414c0b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:43.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 -- 172.21.15.72:0/569079565 shutdown_connections 2023-08-25T04:46:43.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.744+0000 7f4152fff700 1 -- 172.21.15.72:0/569079565 wait complete. 2023-08-25T04:46:43.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:46:43.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.960+0000 7fe0753ff700 1 Processor -- start 2023-08-25T04:46:43.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.960+0000 7fe0753ff700 1 -- start start 2023-08-25T04:46:43.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.961+0000 7fe0753ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe070070890 0x7fe0700ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.961+0000 7fe0753ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0700b1870 con 0x7fe0700b0f50 2023-08-25T04:46:43.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.961+0000 7fe0753ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0700b46a0 con 0x7fe070159ff0 2023-08-25T04:46:43.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.961+0000 7fe0753ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe070070de0 con 0x7fe070070890 2023-08-25T04:46:43.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.962+0000 7fe06f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe0700b0f50 0x7fe0700ae550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41724/0 (socket says 172.21.15.72:41724) 2023-08-25T04:46:43.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.962+0000 7fe06f7fe700 1 -- 172.21.15.72:0/4160322146 learned_addr learned my addr 172.21.15.72:0/4160322146 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.962+0000 7fe06e7fc700 1 --2- 172.21.15.72:0/4160322146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe070070890 0x7fe0700ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.962+0000 7fe06dffb700 1 -- 172.21.15.72:0/4160322146 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724650880 0 0) 0x7fe0700b1870 con 0x7fe0700b0f50 2023-08-25T04:46:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.962+0000 7fe06dffb700 1 -- 172.21.15.72:0/4160322146 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0580035b0 con 0x7fe0700b0f50 2023-08-25T04:46:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.962+0000 7fe06e7fc700 1 -- 172.21.15.72:0/4160322146 >> v1:172.21.15.137:6789/0 conn(0x7fe070159ff0 legacy=0x7fe0700b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.962+0000 7fe06dffb700 1 -- 172.21.15.72:0/4160322146 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862268337 0 0) 0x7fe0700b46a0 con 0x7fe070159ff0 2023-08-25T04:46:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.962+0000 7fe06e7fc700 1 -- 172.21.15.72:0/4160322146 >> v1:172.21.15.72:6789/0 conn(0x7fe0700b0f50 legacy=0x7fe0700ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.962+0000 7fe06e7fc700 1 -- 172.21.15.72:0/4160322146 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700710c0 con 0x7fe070070890 2023-08-25T04:46:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.963+0000 7fe06e7fc700 1 --2- 172.21.15.72:0/4160322146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe070070890 0x7fe0700ca980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe0640098a0 tx=0x7fe064009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa340992f40a192 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:43.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.963+0000 7fe06dffb700 1 -- 172.21.15.72:0/4160322146 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe064011830 con 0x7fe070070890 2023-08-25T04:46:43.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.963+0000 7fe06dffb700 1 -- 172.21.15.72:0/4160322146 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe064011990 con 0x7fe070070890 2023-08-25T04:46:43.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.963+0000 7fe06dffb700 1 -- 172.21.15.72:0/4160322146 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe064011d20 con 0x7fe070070890 2023-08-25T04:46:43.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.963+0000 7fe0753ff700 1 -- 172.21.15.72:0/4160322146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe070070890 msgr2=0x7fe0700ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.963+0000 7fe0753ff700 1 --2- 172.21.15.72:0/4160322146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe070070890 0x7fe0700ca980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe0640098a0 tx=0x7fe064009bb0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.964+0000 7fe0753ff700 1 -- 172.21.15.72:0/4160322146 shutdown_connections 2023-08-25T04:46:43.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.964+0000 7fe0753ff700 1 --2- 172.21.15.72:0/4160322146 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe070070890 0x7fe0700ca980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.964+0000 7fe0753ff700 1 -- 172.21.15.72:0/4160322146 >> 172.21.15.72:0/4160322146 conn(0x7fe0700ce9a0 msgr2=0x7fe0700ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:43.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.964+0000 7fe0753ff700 1 -- 172.21.15.72:0/4160322146 shutdown_connections 2023-08-25T04:46:43.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.964+0000 7fe0753ff700 1 -- 172.21.15.72:0/4160322146 wait complete. 2023-08-25T04:46:43.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.965+0000 7fe0753ff700 1 Processor -- start 2023-08-25T04:46:43.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.965+0000 7fe0753ff700 1 -- start start 2023-08-25T04:46:43.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.966+0000 7fe0753ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe070070890 0x7fe0701e5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.966+0000 7fe0753ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0700b0f50 0x7fe07015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.966+0000 7fe0753ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe070159ff0 0x7fe07015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.966+0000 7fe0753ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0700c6f70 con 0x7fe070070890 2023-08-25T04:46:43.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.966+0000 7fe0753ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0700c74f0 con 0x7fe0700b0f50 2023-08-25T04:46:43.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.966+0000 7fe0753ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0700c63f0 con 0x7fe070159ff0 2023-08-25T04:46:43.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.967+0000 7fe06effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe070070890 0x7fe0701e5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.967+0000 7fe06effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe070070890 0x7fe0701e5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46834/0 (socket says 172.21.15.72:46834) 2023-08-25T04:46:43.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.967+0000 7fe06effd700 1 -- 172.21.15.72:0/919124776 learned_addr learned my addr 172.21.15.72:0/919124776 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:43.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.967+0000 7fe06effd700 1 -- 172.21.15.72:0/919124776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe070159ff0 msgr2=0x7fe07015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.967+0000 7fe06effd700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe070159ff0 0x7fe07015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.967+0000 7fe06effd700 1 -- 172.21.15.72:0/919124776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0700b0f50 msgr2=0x7fe07015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:43.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.967+0000 7fe06effd700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0700b0f50 0x7fe07015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:43.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.967+0000 7fe06effd700 1 -- 172.21.15.72:0/919124776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640094a0 con 0x7fe070070890 2023-08-25T04:46:43.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.967+0000 7fe06effd700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe070070890 0x7fe0701e5b30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe06000c550 tx=0x7fe06000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:43.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.967+0000 7fe0577fe700 1 -- 172.21.15.72:0/919124776 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600054e0 con 0x7fe070070890 2023-08-25T04:46:43.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.968+0000 7fe0577fe700 1 -- 172.21.15.72:0/919124776 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe060003680 con 0x7fe070070890 2023-08-25T04:46:43.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.968+0000 7fe0753ff700 1 -- 172.21.15.72:0/919124776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0700c66d0 con 0x7fe070070890 2023-08-25T04:46:43.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.968+0000 7fe0577fe700 1 -- 172.21.15.72:0/919124776 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe060003a30 con 0x7fe070070890 2023-08-25T04:46:43.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.968+0000 7fe0753ff700 1 -- 172.21.15.72:0/919124776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0700c6c90 con 0x7fe070070890 2023-08-25T04:46:43.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.969+0000 7fe0753ff700 1 -- 172.21.15.72:0/919124776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0700c72c0 con 0x7fe070070890 2023-08-25T04:46:43.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.970+0000 7fe0577fe700 1 -- 172.21.15.72:0/919124776 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe060003b90 con 0x7fe070070890 2023-08-25T04:46:43.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.970+0000 7fe0577fe700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe05c06a0e0 0x7fe05c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:43.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.970+0000 7fe0577fe700 1 -- 172.21.15.72:0/919124776 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe060087d40 con 0x7fe070070890 2023-08-25T04:46:43.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.971+0000 7fe06e7fc700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe05c06a0e0 0x7fe05c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:43.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.971+0000 7fe06e7fc700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe05c06a0e0 0x7fe05c06c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe0640098a0 tx=0x7fe064010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:43.975+0000 7fe0577fe700 1 -- 172.21.15.72:0/919124776 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe0700c72c0 con 0x7fe070070890 2023-08-25T04:46:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.189+0000 7fe0753ff700 1 -- 172.21.15.72:0/919124776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0700c72c0 con 0x7fe070070890 2023-08-25T04:46:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.189+0000 7fe0577fe700 1 -- 172.21.15.72:0/919124776 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe0700c72c0 con 0x7fe070070890 2023-08-25T04:46:44.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.191+0000 7fe0753ff700 1 -- 172.21.15.72:0/919124776 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe05c06a0e0 msgr2=0x7fe05c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.191+0000 7fe0753ff700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe05c06a0e0 0x7fe05c06c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe0640098a0 tx=0x7fe064010000 comp rx=0 tx=0).stop 2023-08-25T04:46:44.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.191+0000 7fe0753ff700 1 -- 172.21.15.72:0/919124776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe070070890 msgr2=0x7fe0701e5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.191+0000 7fe0753ff700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe070070890 0x7fe0701e5b30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe06000c550 tx=0x7fe06000c910 comp rx=0 tx=0).stop 2023-08-25T04:46:44.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.191+0000 7fe0753ff700 1 -- 172.21.15.72:0/919124776 shutdown_connections 2023-08-25T04:46:44.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.191+0000 7fe0753ff700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe05c06a0e0 0x7fe05c06c5a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.191+0000 7fe0753ff700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe070159ff0 0x7fe07015b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.191+0000 7fe0753ff700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe070070890 0x7fe0701e5b30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.191+0000 7fe0753ff700 1 --2- 172.21.15.72:0/919124776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0700b0f50 0x7fe07015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.191+0000 7fe0753ff700 1 -- 172.21.15.72:0/919124776 >> 172.21.15.72:0/919124776 conn(0x7fe0700ce9a0 msgr2=0x7fe070158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:44.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.192+0000 7fe0753ff700 1 -- 172.21.15.72:0/919124776 shutdown_connections 2023-08-25T04:46:44.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.192+0000 7fe0753ff700 1 -- 172.21.15.72:0/919124776 wait complete. 2023-08-25T04:46:44.194 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-08-25T04:46:44.213 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:46:44.214 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:46:44.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:44.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.497+0000 7fcc22fff700 1 Processor -- start 2023-08-25T04:46:44.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.497+0000 7fcc22fff700 1 -- start start 2023-08-25T04:46:44.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.498+0000 7fcc22fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 0x7fcc1c0b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.498+0000 7fcc22fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc1c0b86b0 0x7fcc1c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.498+0000 7fcc22fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1c0b50e0 con 0x7fcc1c15d130 2023-08-25T04:46:44.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.498+0000 7fcc22fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1c0d1590 con 0x7fcc1c0b86b0 2023-08-25T04:46:44.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.498+0000 7fcc22fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0d1780 con 0x7fcc1c0b47c0 2023-08-25T04:46:44.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.499+0000 7fcc1bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcc1c15d130 0x7fcc1c0d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41726/0 (socket says 172.21.15.72:41726) 2023-08-25T04:46:44.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.499+0000 7fcc1bfff700 1 -- 172.21.15.72:0/2801000972 learned_addr learned my addr 172.21.15.72:0/2801000972 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:44.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.499+0000 7fcc2159c700 1 --2- 172.21.15.72:0/2801000972 >> v2:172.21.15.72:3300/0 conn(0x7fcc1c0b86b0 0x7fcc1c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.499+0000 7fcc20d9b700 1 --2- 172.21.15.72:0/2801000972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 0x7fcc1c0b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.499+0000 7fcc1b7fe700 1 -- 172.21.15.72:0/2801000972 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375514567 0 0) 0x7fcc1c0b50e0 con 0x7fcc1c15d130 2023-08-25T04:46:44.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.499+0000 7fcc2159c700 1 -- 172.21.15.72:0/2801000972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 msgr2=0x7fcc1c0b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:44.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.499+0000 7fcc2159c700 1 --2- 172.21.15.72:0/2801000972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 0x7fcc1c0b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.499+0000 7fcc2159c700 1 -- 172.21.15.72:0/2801000972 >> v1:172.21.15.72:6789/0 conn(0x7fcc1c15d130 legacy=0x7fcc1c0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.499+0000 7fcc2159c700 1 -- 172.21.15.72:0/2801000972 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0d1a60 con 0x7fcc1c0b86b0 2023-08-25T04:46:44.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.499+0000 7fcc20d9b700 1 --2- 172.21.15.72:0/2801000972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 0x7fcc1c0b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:44.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc2159c700 1 --2- 172.21.15.72:0/2801000972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c0b86b0 0x7fcc1c0b5da0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009d90 tx=0x7fcc1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efabe9f2406c3dee server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:44.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc1b7fe700 1 -- 172.21.15.72:0/2801000972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400e070 con 0x7fcc1c0b86b0 2023-08-25T04:46:44.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc1b7fe700 1 -- 172.21.15.72:0/2801000972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1400bbd0 con 0x7fcc1c0b86b0 2023-08-25T04:46:44.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc1b7fe700 1 -- 172.21.15.72:0/2801000972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14012430 con 0x7fcc1c0b86b0 2023-08-25T04:46:44.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc22fff700 1 -- 172.21.15.72:0/2801000972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c0b86b0 msgr2=0x7fcc1c0b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc22fff700 1 --2- 172.21.15.72:0/2801000972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c0b86b0 0x7fcc1c0b5da0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009d90 tx=0x7fcc1400b330 comp rx=0 tx=0).stop 2023-08-25T04:46:44.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc22fff700 1 -- 172.21.15.72:0/2801000972 shutdown_connections 2023-08-25T04:46:44.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc22fff700 1 --2- 172.21.15.72:0/2801000972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c0b86b0 0x7fcc1c0b5da0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc22fff700 1 --2- 172.21.15.72:0/2801000972 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 0x7fcc1c0b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc22fff700 1 -- 172.21.15.72:0/2801000972 >> 172.21.15.72:0/2801000972 conn(0x7fcc1c072050 msgr2=0x7fcc1c0d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:44.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.500+0000 7fcc22fff700 1 -- 172.21.15.72:0/2801000972 shutdown_connections 2023-08-25T04:46:44.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.501+0000 7fcc22fff700 1 -- 172.21.15.72:0/2801000972 wait complete. 2023-08-25T04:46:44.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.502+0000 7fcc22fff700 1 Processor -- start 2023-08-25T04:46:44.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.502+0000 7fcc22fff700 1 -- start start 2023-08-25T04:46:44.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.503+0000 7fcc22fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 0x7fcc1c0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.503+0000 7fcc22fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c0b86b0 0x7fcc1c0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.503+0000 7fcc22fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c15d130 0x7fcc1c140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.503+0000 7fcc22fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1555d0 con 0x7fcc1c15d130 2023-08-25T04:46:44.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.503+0000 7fcc22fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c160210 con 0x7fcc1c0b86b0 2023-08-25T04:46:44.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.503+0000 7fcc22fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c154c30 con 0x7fcc1c0b47c0 2023-08-25T04:46:44.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc2159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c15d130 0x7fcc1c140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc2159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c15d130 0x7fcc1c140b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46864/0 (socket says 172.21.15.72:46864) 2023-08-25T04:46:44.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc2159c700 1 -- 172.21.15.72:0/2873734135 learned_addr learned my addr 172.21.15.72:0/2873734135 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:44.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc20d9b700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 0x7fcc1c0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc1bfff700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c0b86b0 0x7fcc1c0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc2159c700 1 -- 172.21.15.72:0/2873734135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 msgr2=0x7fcc1c0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc2159c700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 0x7fcc1c0c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc2159c700 1 -- 172.21.15.72:0/2873734135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c0b86b0 msgr2=0x7fcc1c0b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc2159c700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c0b86b0 0x7fcc1c0b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc2159c700 1 -- 172.21.15.72:0/2873734135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc14009a70 con 0x7fcc1c15d130 2023-08-25T04:46:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc20d9b700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 0x7fcc1c0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.504+0000 7fcc2159c700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c15d130 0x7fcc1c140b00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcc14013000 tx=0x7fcc14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:44.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.505+0000 7fcc197fa700 1 -- 172.21.15.72:0/2873734135 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14012430 con 0x7fcc1c15d130 2023-08-25T04:46:44.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.505+0000 7fcc197fa700 1 -- 172.21.15.72:0/2873734135 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc14020070 con 0x7fcc1c15d130 2023-08-25T04:46:44.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.505+0000 7fcc22fff700 1 -- 172.21.15.72:0/2873734135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c154f10 con 0x7fcc1c15d130 2023-08-25T04:46:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.505+0000 7fcc197fa700 1 -- 172.21.15.72:0/2873734135 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14004280 con 0x7fcc1c15d130 2023-08-25T04:46:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.505+0000 7fcc22fff700 1 -- 172.21.15.72:0/2873734135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c0b78c0 con 0x7fcc1c15d130 2023-08-25T04:46:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.506+0000 7fcc22fff700 1 -- 172.21.15.72:0/2873734135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c155710 con 0x7fcc1c15d130 2023-08-25T04:46:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.507+0000 7fcc197fa700 1 -- 172.21.15.72:0/2873734135 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcc140043e0 con 0x7fcc1c15d130 2023-08-25T04:46:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.508+0000 7fcc197fa700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc0006a0e0 0x7fcc0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.508+0000 7fcc197fa700 1 -- 172.21.15.72:0/2873734135 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcc14022070 con 0x7fcc1c15d130 2023-08-25T04:46:44.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.508+0000 7fcc20d9b700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc0006a0e0 0x7fcc0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.509+0000 7fcc20d9b700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc0006a0e0 0x7fcc0006c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcc100099b0 tx=0x7fcc10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.512+0000 7fcc197fa700 1 -- 172.21.15.72:0/2873734135 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcc1c155710 con 0x7fcc1c15d130 2023-08-25T04:46:44.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.710+0000 7fcc22fff700 1 -- 172.21.15.72:0/2873734135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc1c155710 con 0x7fcc1c15d130 2023-08-25T04:46:44.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.712+0000 7fcc197fa700 1 -- 172.21.15.72:0/2873734135 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7fcc1c155710 con 0x7fcc1c15d130 2023-08-25T04:46:44.713 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:44.713 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:44.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 -- 172.21.15.72:0/2873734135 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc0006a0e0 msgr2=0x7fcc0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc0006a0e0 0x7fcc0006c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcc100099b0 tx=0x7fcc10008040 comp rx=0 tx=0).stop 2023-08-25T04:46:44.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 -- 172.21.15.72:0/2873734135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c15d130 msgr2=0x7fcc1c140b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c15d130 0x7fcc1c140b00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcc14013000 tx=0x7fcc14004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 -- 172.21.15.72:0/2873734135 shutdown_connections 2023-08-25T04:46:44.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc0006a0e0 0x7fcc0006c5a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c15d130 0x7fcc1c140b00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc1c0b47c0 0x7fcc1c0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 --2- 172.21.15.72:0/2873734135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc1c0b86b0 0x7fcc1c0b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 -- 172.21.15.72:0/2873734135 >> 172.21.15.72:0/2873734135 conn(0x7fcc1c072050 msgr2=0x7fcc1c0cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:44.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 -- 172.21.15.72:0/2873734135 shutdown_connections 2023-08-25T04:46:44.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.714+0000 7fcc22fff700 1 -- 172.21.15.72:0/2873734135 wait complete. 2023-08-25T04:46:44.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:44.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.937+0000 7fb96bbff700 1 Processor -- start 2023-08-25T04:46:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.937+0000 7fb96bbff700 1 -- start start 2023-08-25T04:46:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.938+0000 7fb96bbff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb96406b7a0 0x7fb96406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.938+0000 7fb96bbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640cba40 con 0x7fb96406c160 2023-08-25T04:46:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.938+0000 7fb96bbff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640d04f0 con 0x7fb9640c71b0 2023-08-25T04:46:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.938+0000 7fb96bbff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96406c5d0 con 0x7fb96406b7a0 2023-08-25T04:46:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.939+0000 7fb96a19c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb96406c160 0x7fb96415c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41734/0 (socket says 172.21.15.72:41734) 2023-08-25T04:46:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.939+0000 7fb96a19c700 1 -- 172.21.15.72:0/3618634928 learned_addr learned my addr 172.21.15.72:0/3618634928 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.939+0000 7fb96919a700 1 --2- 172.21.15.72:0/3618634928 >> v2:172.21.15.137:3300/0 conn(0x7fb96406b7a0 0x7fb96406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.939+0000 7fb968999700 1 -- 172.21.15.72:0/3618634928 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502337257 0 0) 0x7fb9640cba40 con 0x7fb96406c160 2023-08-25T04:46:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.939+0000 7fb968999700 1 -- 172.21.15.72:0/3618634928 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9500035b0 con 0x7fb96406c160 2023-08-25T04:46:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.939+0000 7fb96919a700 1 -- 172.21.15.72:0/3618634928 >> v1:172.21.15.137:6789/0 conn(0x7fb9640c71b0 legacy=0x7fb9640cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.939+0000 7fb96919a700 1 -- 172.21.15.72:0/3618634928 >> v1:172.21.15.72:6789/0 conn(0x7fb96406c160 legacy=0x7fb96415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.939+0000 7fb96919a700 1 -- 172.21.15.72:0/3618634928 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640d0210 con 0x7fb96406b7a0 2023-08-25T04:46:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.940+0000 7fb96919a700 1 --2- 172.21.15.72:0/3618634928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb96406b7a0 0x7fb96406bc20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb954009840 tx=0x7fb954009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c37c4c8d9d1de269 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.940+0000 7fb968999700 1 -- 172.21.15.72:0/3618634928 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954011830 con 0x7fb96406b7a0 2023-08-25T04:46:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.940+0000 7fb968999700 1 -- 172.21.15.72:0/3618634928 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb954011990 con 0x7fb96406b7a0 2023-08-25T04:46:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.940+0000 7fb968999700 1 -- 172.21.15.72:0/3618634928 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954011d20 con 0x7fb96406b7a0 2023-08-25T04:46:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.940+0000 7fb96bbff700 1 -- 172.21.15.72:0/3618634928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb96406b7a0 msgr2=0x7fb96406bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.940+0000 7fb96bbff700 1 --2- 172.21.15.72:0/3618634928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb96406b7a0 0x7fb96406bc20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb954009840 tx=0x7fb954009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.940+0000 7fb96bbff700 1 -- 172.21.15.72:0/3618634928 shutdown_connections 2023-08-25T04:46:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.940+0000 7fb96bbff700 1 --2- 172.21.15.72:0/3618634928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb96406b7a0 0x7fb96406bc20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.940+0000 7fb96bbff700 1 -- 172.21.15.72:0/3618634928 >> 172.21.15.72:0/3618634928 conn(0x7fb9640d0c70 msgr2=0x7fb9640d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:44.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.941+0000 7fb96bbff700 1 -- 172.21.15.72:0/3618634928 shutdown_connections 2023-08-25T04:46:44.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.941+0000 7fb96bbff700 1 -- 172.21.15.72:0/3618634928 wait complete. 2023-08-25T04:46:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.942+0000 7fb96bbff700 1 Processor -- start 2023-08-25T04:46:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.943+0000 7fb96bbff700 1 -- start start 2023-08-25T04:46:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.943+0000 7fb96bbff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb96406b7a0 0x7fb9641daee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.943+0000 7fb96bbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb96406c160 0x7fb9640c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.943+0000 7fb96bbff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9640c71b0 0x7fb9640ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96bbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9641db420 con 0x7fb96406c160 2023-08-25T04:46:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96bbff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96409ba60 con 0x7fb96406b7a0 2023-08-25T04:46:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96bbff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96409bd40 con 0x7fb9640c71b0 2023-08-25T04:46:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96919a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb96406c160 0x7fb9640c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96919a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb96406c160 0x7fb9640c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46866/0 (socket says 172.21.15.72:46866) 2023-08-25T04:46:44.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96919a700 1 -- 172.21.15.72:0/785941053 learned_addr learned my addr 172.21.15.72:0/785941053 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96999b700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb96406b7a0 0x7fb9641daee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96a19c700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9640c71b0 0x7fb9640ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96919a700 1 -- 172.21.15.72:0/785941053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9640c71b0 msgr2=0x7fb9640ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96919a700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9640c71b0 0x7fb9640ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96919a700 1 -- 172.21.15.72:0/785941053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb96406b7a0 msgr2=0x7fb9641daee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96919a700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb96406b7a0 0x7fb9641daee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96919a700 1 -- 172.21.15.72:0/785941053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9540094a0 con 0x7fb96406c160 2023-08-25T04:46:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96999b700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb96406b7a0 0x7fb9641daee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.944+0000 7fb96919a700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb96406c160 0x7fb9640c9f10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb954009b90 tx=0x7fb954004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.945+0000 7fb95a7fc700 1 -- 172.21.15.72:0/785941053 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9540038a0 con 0x7fb96406c160 2023-08-25T04:46:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.945+0000 7fb95a7fc700 1 -- 172.21.15.72:0/785941053 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95401e070 con 0x7fb96406c160 2023-08-25T04:46:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.945+0000 7fb96bbff700 1 -- 172.21.15.72:0/785941053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96409c020 con 0x7fb96406c160 2023-08-25T04:46:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.945+0000 7fb95a7fc700 1 -- 172.21.15.72:0/785941053 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954003c40 con 0x7fb96406c160 2023-08-25T04:46:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.945+0000 7fb96bbff700 1 -- 172.21.15.72:0/785941053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96409c5e0 con 0x7fb96406c160 2023-08-25T04:46:44.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.946+0000 7fb96bbff700 1 -- 172.21.15.72:0/785941053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96408ac40 con 0x7fb96406c160 2023-08-25T04:46:44.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.947+0000 7fb95a7fc700 1 -- 172.21.15.72:0/785941053 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb95402d450 con 0x7fb96406c160 2023-08-25T04:46:44.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.948+0000 7fb95a7fc700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb94806a0e0 0x7fb94806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:44.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.948+0000 7fb95a7fc700 1 -- 172.21.15.72:0/785941053 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb9540898a0 con 0x7fb96406c160 2023-08-25T04:46:44.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.948+0000 7fb96999b700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb94806a0e0 0x7fb94806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:44.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.948+0000 7fb96999b700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb94806a0e0 0x7fb94806c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb960000f60 tx=0x7fb960009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:44.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:44.952+0000 7fb95a7fc700 1 -- 172.21.15.72:0/785941053 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb954054c50 con 0x7fb96406c160 2023-08-25T04:46:45.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.148+0000 7fb96bbff700 1 -- 172.21.15.72:0/785941053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb96409ebb0 con 0x7fb96406c160 2023-08-25T04:46:45.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.148+0000 7fb95a7fc700 1 -- 172.21.15.72:0/785941053 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb954020020 con 0x7fb96406c160 2023-08-25T04:46:45.150 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:45.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 -- 172.21.15.72:0/785941053 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb94806a0e0 msgr2=0x7fb94806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb94806a0e0 0x7fb94806c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb960000f60 tx=0x7fb960009040 comp rx=0 tx=0).stop 2023-08-25T04:46:45.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 -- 172.21.15.72:0/785941053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb96406c160 msgr2=0x7fb9640c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb96406c160 0x7fb9640c9f10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb954009b90 tx=0x7fb954004750 comp rx=0 tx=0).stop 2023-08-25T04:46:45.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 -- 172.21.15.72:0/785941053 shutdown_connections 2023-08-25T04:46:45.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb94806a0e0 0x7fb94806c5a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb9640c71b0 0x7fb9640ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb96406b7a0 0x7fb9641daee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 --2- 172.21.15.72:0/785941053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb96406c160 0x7fb9640c9f10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 -- 172.21.15.72:0/785941053 >> 172.21.15.72:0/785941053 conn(0x7fb9640d0c70 msgr2=0x7fb9640c59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:45.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 -- 172.21.15.72:0/785941053 shutdown_connections 2023-08-25T04:46:45.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.151+0000 7fb96bbff700 1 -- 172.21.15.72:0/785941053 wait complete. 2023-08-25T04:46:45.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.370+0000 7f432b1ff700 1 Processor -- start 2023-08-25T04:46:45.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.370+0000 7f432b1ff700 1 -- start start 2023-08-25T04:46:45.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.371+0000 7f432b1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432415d180 0x7f43240cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.371+0000 7f432b1ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f432406ee50 0x7f43240c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.371+0000 7f432b1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432406b030 con 0x7f432406f950 2023-08-25T04:46:45.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.371+0000 7f432b1ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432415d560 con 0x7f432406ee50 2023-08-25T04:46:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.371+0000 7f432b1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432406a420 con 0x7f432415d180 2023-08-25T04:46:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f4323fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f432406f950 0x7f432406e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41740/0 (socket says 172.21.15.72:41740) 2023-08-25T04:46:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f4323fff700 1 -- 172.21.15.72:0/431014394 learned_addr learned my addr 172.21.15.72:0/431014394 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f4328f9b700 1 --2- 172.21.15.72:0/431014394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432415d180 0x7f43240cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f432979c700 1 --2- 172.21.15.72:0/431014394 >> v2:172.21.15.137:3300/0 conn(0x7f432406ee50 0x7f43240c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f43237fe700 1 -- 172.21.15.72:0/431014394 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120527228 0 0) 0x7f432406b030 con 0x7f432406f950 2023-08-25T04:46:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f43237fe700 1 -- 172.21.15.72:0/431014394 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43140035b0 con 0x7f432406f950 2023-08-25T04:46:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f4328f9b700 1 -- 172.21.15.72:0/431014394 >> v2:172.21.15.137:3300/0 conn(0x7f432406ee50 msgr2=0x7f43240c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f4328f9b700 1 --2- 172.21.15.72:0/431014394 >> v2:172.21.15.137:3300/0 conn(0x7f432406ee50 0x7f43240c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f4328f9b700 1 -- 172.21.15.72:0/431014394 >> v1:172.21.15.72:6789/0 conn(0x7f432406f950 legacy=0x7f432406e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f4328f9b700 1 -- 172.21.15.72:0/431014394 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432406a700 con 0x7f432415d180 2023-08-25T04:46:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.372+0000 7f432979c700 1 --2- 172.21.15.72:0/431014394 >> v2:172.21.15.137:3300/0 conn(0x7f432406ee50 0x7f43240c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.373+0000 7f4328f9b700 1 --2- 172.21.15.72:0/431014394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432415d180 0x7f43240cda70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4318009840 tx=0x7f4318009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=896f50aeb078f675 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.373+0000 7f43237fe700 1 -- 172.21.15.72:0/431014394 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4318011830 con 0x7f432415d180 2023-08-25T04:46:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.373+0000 7f43237fe700 1 -- 172.21.15.72:0/431014394 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4318011990 con 0x7f432415d180 2023-08-25T04:46:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.373+0000 7f43237fe700 1 -- 172.21.15.72:0/431014394 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4318011d20 con 0x7f432415d180 2023-08-25T04:46:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.373+0000 7f432b1ff700 1 -- 172.21.15.72:0/431014394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432415d180 msgr2=0x7f43240cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.373+0000 7f432b1ff700 1 --2- 172.21.15.72:0/431014394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432415d180 0x7f43240cda70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4318009840 tx=0x7f4318009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.374+0000 7f432b1ff700 1 -- 172.21.15.72:0/431014394 shutdown_connections 2023-08-25T04:46:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.374+0000 7f432b1ff700 1 --2- 172.21.15.72:0/431014394 >> v2:172.21.15.137:3300/0 conn(0x7f432406ee50 0x7f43240c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.374+0000 7f432b1ff700 1 --2- 172.21.15.72:0/431014394 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432415d180 0x7f43240cda70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.374+0000 7f432b1ff700 1 -- 172.21.15.72:0/431014394 >> 172.21.15.72:0/431014394 conn(0x7f432406d200 msgr2=0x7f432406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.374+0000 7f432b1ff700 1 -- 172.21.15.72:0/431014394 shutdown_connections 2023-08-25T04:46:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.374+0000 7f432b1ff700 1 -- 172.21.15.72:0/431014394 wait complete. 2023-08-25T04:46:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.376+0000 7f432b1ff700 1 Processor -- start 2023-08-25T04:46:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.376+0000 7f432b1ff700 1 -- start start 2023-08-25T04:46:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.377+0000 7f432b1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432406ee50 0x7f4324154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.377+0000 7f432b1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f432406f950 0x7f43240c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.377+0000 7f432b1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432415d180 0x7f43240c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432b1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43240c5260 con 0x7f432415d180 2023-08-25T04:46:45.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432b1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43240c4650 con 0x7f432406f950 2023-08-25T04:46:45.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432b1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43240c4930 con 0x7f432406ee50 2023-08-25T04:46:45.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432979c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432415d180 0x7f43240c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432979c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432415d180 0x7f43240c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46870/0 (socket says 172.21.15.72:46870) 2023-08-25T04:46:45.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432979c700 1 -- 172.21.15.72:0/3302521373 learned_addr learned my addr 172.21.15.72:0/3302521373 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:45.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f4328f9b700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432406ee50 0x7f4324154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f4323fff700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f432406f950 0x7f43240c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432979c700 1 -- 172.21.15.72:0/3302521373 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432406ee50 msgr2=0x7f4324154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432979c700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432406ee50 0x7f4324154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432979c700 1 -- 172.21.15.72:0/3302521373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f432406f950 msgr2=0x7f43240c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432979c700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f432406f950 0x7f43240c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432979c700 1 -- 172.21.15.72:0/3302521373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c009a70 con 0x7f432415d180 2023-08-25T04:46:45.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.378+0000 7f432979c700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432415d180 0x7f43240c7270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f431c00efc0 tx=0x7f431c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:45.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.379+0000 7f43217fa700 1 -- 172.21.15.72:0/3302521373 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c00cc90 con 0x7f432415d180 2023-08-25T04:46:45.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.379+0000 7f43217fa700 1 -- 172.21.15.72:0/3302521373 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c00f040 con 0x7f432415d180 2023-08-25T04:46:45.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.379+0000 7f432b1ff700 1 -- 172.21.15.72:0/3302521373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43180094a0 con 0x7f432415d180 2023-08-25T04:46:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.379+0000 7f43217fa700 1 -- 172.21.15.72:0/3302521373 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c0146c0 con 0x7f432415d180 2023-08-25T04:46:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.379+0000 7f432b1ff700 1 -- 172.21.15.72:0/3302521373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43240c4ef0 con 0x7f432415d180 2023-08-25T04:46:45.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.380+0000 7f432b1ff700 1 -- 172.21.15.72:0/3302521373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432406e530 con 0x7f432415d180 2023-08-25T04:46:45.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.381+0000 7f43217fa700 1 -- 172.21.15.72:0/3302521373 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f431c014820 con 0x7f432415d180 2023-08-25T04:46:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.382+0000 7f43217fa700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f430806a0e0 0x7f430806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.382+0000 7f43217fa700 1 -- 172.21.15.72:0/3302521373 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f431c089350 con 0x7f432415d180 2023-08-25T04:46:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.382+0000 7f4328f9b700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f430806a0e0 0x7f430806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.383+0000 7f4328f9b700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f430806a0e0 0x7f430806c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4318000c00 tx=0x7f4318008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.386+0000 7f43217fa700 1 -- 172.21.15.72:0/3302521373 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f431c0547a0 con 0x7f432415d180 2023-08-25T04:46:45.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.581+0000 7f432b1ff700 1 -- 172.21.15.72:0/3302521373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43240744f0 con 0x7f432415d180 2023-08-25T04:46:45.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.582+0000 7f43217fa700 1 -- 172.21.15.72:0/3302521373 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f431c057dc0 con 0x7f432415d180 2023-08-25T04:46:45.583 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:45.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 -- 172.21.15.72:0/3302521373 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f430806a0e0 msgr2=0x7f430806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f430806a0e0 0x7f430806c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4318000c00 tx=0x7f4318008030 comp rx=0 tx=0).stop 2023-08-25T04:46:45.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 -- 172.21.15.72:0/3302521373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432415d180 msgr2=0x7f43240c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432415d180 0x7f43240c7270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f431c00efc0 tx=0x7f431c00c3a0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 -- 172.21.15.72:0/3302521373 shutdown_connections 2023-08-25T04:46:45.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f430806a0e0 0x7f430806c5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432415d180 0x7f43240c7270 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f432406ee50 0x7f4324154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 --2- 172.21.15.72:0/3302521373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f432406f950 0x7f43240c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 -- 172.21.15.72:0/3302521373 >> 172.21.15.72:0/3302521373 conn(0x7f432406d200 msgr2=0x7f4324071160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:45.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 -- 172.21.15.72:0/3302521373 shutdown_connections 2023-08-25T04:46:45.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.584+0000 7f432b1ff700 1 -- 172.21.15.72:0/3302521373 wait complete. 2023-08-25T04:46:45.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:45.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.813+0000 7f0ef55ff700 1 Processor -- start 2023-08-25T04:46:45.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.813+0000 7f0ef55ff700 1 -- start start 2023-08-25T04:46:45.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.814+0000 7f0ef55ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0ef0150ea0 0x7f0ef00cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.814+0000 7f0ef55ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ef00cbb90 0x7f0ef015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.814+0000 7f0ef55ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef00aebf0 con 0x7f0ef0150ac0 2023-08-25T04:46:45.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.814+0000 7f0ef55ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef00af490 con 0x7f0ef00cbb90 2023-08-25T04:46:45.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.814+0000 7f0ef55ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef015d7c0 con 0x7f0ef0150ea0 2023-08-25T04:46:45.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.815+0000 7f0eef7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ef00cbb90 0x7f0ef015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.815+0000 7f0eef7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ef00cbb90 0x7f0ef015a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46884/0 (socket says 172.21.15.72:46884) 2023-08-25T04:46:45.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.815+0000 7f0eef7fe700 1 -- 172.21.15.72:0/2442682786 learned_addr learned my addr 172.21.15.72:0/2442682786 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:45.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.815+0000 7f0eee7fc700 1 --2- 172.21.15.72:0/2442682786 >> v2:172.21.15.137:3300/0 conn(0x7f0ef0150ea0 0x7f0ef00cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.815+0000 7f0eef7fe700 1 -- 172.21.15.72:0/2442682786 >> v2:172.21.15.137:3300/0 conn(0x7f0ef0150ea0 msgr2=0x7f0ef00cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.815+0000 7f0eef7fe700 1 --2- 172.21.15.72:0/2442682786 >> v2:172.21.15.137:3300/0 conn(0x7f0ef0150ea0 0x7f0ef00cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.815+0000 7f0eef7fe700 1 -- 172.21.15.72:0/2442682786 >> v1:172.21.15.137:6789/0 conn(0x7f0ef0150ac0 legacy=0x7f0ef015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.815+0000 7f0eef7fe700 1 -- 172.21.15.72:0/2442682786 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00aeed0 con 0x7f0ef00cbb90 2023-08-25T04:46:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.815+0000 7f0eef7fe700 1 --2- 172.21.15.72:0/2442682786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef00cbb90 0x7f0ef015a180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00cb0a0 tx=0x7f0ee800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313a1273723b25ae server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.815+0000 7f0eedffb700 1 -- 172.21.15.72:0/2442682786 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8010070 con 0x7f0ef00cbb90 2023-08-25T04:46:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.816+0000 7f0eedffb700 1 -- 172.21.15.72:0/2442682786 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800dce0 con 0x7f0ef00cbb90 2023-08-25T04:46:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.816+0000 7f0eedffb700 1 -- 172.21.15.72:0/2442682786 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800b310 con 0x7f0ef00cbb90 2023-08-25T04:46:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.816+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2442682786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef00cbb90 msgr2=0x7f0ef015a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.816+0000 7f0ef55ff700 1 --2- 172.21.15.72:0/2442682786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef00cbb90 0x7f0ef015a180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00cb0a0 tx=0x7f0ee800d430 comp rx=0 tx=0).stop 2023-08-25T04:46:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.816+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2442682786 shutdown_connections 2023-08-25T04:46:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.816+0000 7f0ef55ff700 1 --2- 172.21.15.72:0/2442682786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef00cbb90 0x7f0ef015a180 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.816+0000 7f0ef55ff700 1 --2- 172.21.15.72:0/2442682786 >> v2:172.21.15.137:3300/0 conn(0x7f0ef0150ea0 0x7f0ef00cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.816+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2442682786 >> 172.21.15.72:0/2442682786 conn(0x7f0ef006a710 msgr2=0x7f0ef006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.816+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2442682786 shutdown_connections 2023-08-25T04:46:45.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.816+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2442682786 wait complete. 2023-08-25T04:46:45.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.818+0000 7f0ef55ff700 1 Processor -- start 2023-08-25T04:46:45.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.818+0000 7f0ef55ff700 1 -- start start 2023-08-25T04:46:45.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0ef55ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ef00cbb90 0x7f0ef014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0ef55ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ef0150ac0 0x7f0ef014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0ef55ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef0150ea0 0x7f0ef00cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0ef55ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef014e790 con 0x7f0ef0150ea0 2023-08-25T04:46:45.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0ef55ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef014efb0 con 0x7f0ef00cbb90 2023-08-25T04:46:45.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0ef55ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef014db80 con 0x7f0ef0150ac0 2023-08-25T04:46:45.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0eef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef0150ea0 0x7f0ef00cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0eef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef0150ea0 0x7f0ef00cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46886/0 (socket says 172.21.15.72:46886) 2023-08-25T04:46:45.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0eef7fe700 1 -- 172.21.15.72:0/2676954652 learned_addr learned my addr 172.21.15.72:0/2676954652 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:45.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0eeeffd700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ef00cbb90 0x7f0ef014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.819+0000 7f0eee7fc700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ef0150ac0 0x7f0ef014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0eef7fe700 1 -- 172.21.15.72:0/2676954652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ef0150ac0 msgr2=0x7f0ef014d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0eef7fe700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ef0150ac0 0x7f0ef014d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0eef7fe700 1 -- 172.21.15.72:0/2676954652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ef00cbb90 msgr2=0x7f0ef014e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:45.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0eef7fe700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ef00cbb90 0x7f0ef014e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:45.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0eef7fe700 1 -- 172.21.15.72:0/2676954652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee800bd40 con 0x7f0ef0150ea0 2023-08-25T04:46:45.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0eef7fe700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef0150ea0 0x7f0ef00cc4c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00cc1d0 tx=0x7f0ee8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:45.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0ed77fe700 1 -- 172.21.15.72:0/2676954652 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800bbc0 con 0x7f0ef0150ea0 2023-08-25T04:46:45.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0ed77fe700 1 -- 172.21.15.72:0/2676954652 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800b4c0 con 0x7f0ef0150ea0 2023-08-25T04:46:45.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2676954652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef014ce80 con 0x7f0ef0150ea0 2023-08-25T04:46:45.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0ed77fe700 1 -- 172.21.15.72:0/2676954652 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800ae70 con 0x7f0ef0150ea0 2023-08-25T04:46:45.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.820+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2676954652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef014ecd0 con 0x7f0ef0150ea0 2023-08-25T04:46:45.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.821+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2676954652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef0072320 con 0x7f0ef0150ea0 2023-08-25T04:46:45.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.822+0000 7f0ed77fe700 1 -- 172.21.15.72:0/2676954652 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ee8004040 con 0x7f0ef0150ea0 2023-08-25T04:46:45.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.823+0000 7f0ed77fe700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0edc06a0e0 0x7f0edc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:45.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.823+0000 7f0ed77fe700 1 -- 172.21.15.72:0/2676954652 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0ee808c0a0 con 0x7f0ef0150ea0 2023-08-25T04:46:45.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.824+0000 7f0eeeffd700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0edc06a0e0 0x7f0edc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.824+0000 7f0eeeffd700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0edc06a0e0 0x7f0edc06c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0007fd0 tx=0x7f0ee0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:45.827+0000 7f0ed77fe700 1 -- 172.21.15.72:0/2676954652 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ee8057450 con 0x7f0ef0150ea0 2023-08-25T04:46:46.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.025+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2676954652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ef00af180 con 0x7f0ef0150ea0 2023-08-25T04:46:46.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.025+0000 7f0ed77fe700 1 -- 172.21.15.72:0/2676954652 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ee805aa70 con 0x7f0ef0150ea0 2023-08-25T04:46:46.026 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:46.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2676954652 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0edc06a0e0 msgr2=0x7f0edc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0edc06a0e0 0x7f0edc06c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0007fd0 tx=0x7f0ee0009040 comp rx=0 tx=0).stop 2023-08-25T04:46:46.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2676954652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef0150ea0 msgr2=0x7f0ef00cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef0150ea0 0x7f0ef00cc4c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00cc1d0 tx=0x7f0ee8004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2676954652 shutdown_connections 2023-08-25T04:46:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0edc06a0e0 0x7f0edc06c5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ef0150ea0 0x7f0ef00cc4c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ef00cbb90 0x7f0ef014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 --2- 172.21.15.72:0/2676954652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ef0150ac0 0x7f0ef014d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2676954652 >> 172.21.15.72:0/2676954652 conn(0x7f0ef006a710 msgr2=0x7f0ef0070950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:46.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2676954652 shutdown_connections 2023-08-25T04:46:46.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.028+0000 7f0ef55ff700 1 -- 172.21.15.72:0/2676954652 wait complete. 2023-08-25T04:46:46.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:46.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.246+0000 7f9627bff700 1 Processor -- start 2023-08-25T04:46:46.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.246+0000 7f9627bff700 1 -- start start 2023-08-25T04:46:46.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.247+0000 7f9627bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96200c71b0 0x7f96200cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.247+0000 7f9627bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96200cd4f0 0x7f96200cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.247+0000 7f9627bff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96200cba40 con 0x7f96200cdeb0 2023-08-25T04:46:46.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.247+0000 7f9627bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96200d04f0 con 0x7f96200cd4f0 2023-08-25T04:46:46.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.247+0000 7f9627bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96200ce340 con 0x7f96200c71b0 2023-08-25T04:46:46.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.248+0000 7f962519a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96200cd4f0 0x7f96200cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.248+0000 7f962519a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96200cd4f0 0x7f96200cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46890/0 (socket says 172.21.15.72:46890) 2023-08-25T04:46:46.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.248+0000 7f962519a700 1 -- 172.21.15.72:0/3245367941 learned_addr learned my addr 172.21.15.72:0/3245367941 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:46.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.248+0000 7f962599b700 1 --2- 172.21.15.72:0/3245367941 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96200c71b0 0x7f96200cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.248+0000 7f962519a700 1 -- 172.21.15.72:0/3245367941 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96200c71b0 msgr2=0x7f96200cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:46.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.248+0000 7f962519a700 1 --2- 172.21.15.72:0/3245367941 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96200c71b0 0x7f96200cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.248+0000 7f962519a700 1 -- 172.21.15.72:0/3245367941 >> v1:172.21.15.137:6789/0 conn(0x7f96200cdeb0 legacy=0x7f962006b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.248+0000 7f962519a700 1 -- 172.21.15.72:0/3245367941 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96200d0210 con 0x7f96200cd4f0 2023-08-25T04:46:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.248+0000 7f962519a700 1 --2- 172.21.15.72:0/3245367941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cd4f0 0x7f96200cd970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f96100098f0 tx=0x7f9610009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b28923f3c9132c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9624999700 1 -- 172.21.15.72:0/3245367941 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610011830 con 0x7f96200cd4f0 2023-08-25T04:46:46.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9624999700 1 -- 172.21.15.72:0/3245367941 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9610011990 con 0x7f96200cd4f0 2023-08-25T04:46:46.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9624999700 1 -- 172.21.15.72:0/3245367941 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610011d20 con 0x7f96200cd4f0 2023-08-25T04:46:46.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9627bff700 1 -- 172.21.15.72:0/3245367941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cd4f0 msgr2=0x7f96200cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9627bff700 1 --2- 172.21.15.72:0/3245367941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cd4f0 0x7f96200cd970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f96100098f0 tx=0x7f9610009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9627bff700 1 -- 172.21.15.72:0/3245367941 shutdown_connections 2023-08-25T04:46:46.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9627bff700 1 --2- 172.21.15.72:0/3245367941 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96200c71b0 0x7f96200cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9627bff700 1 --2- 172.21.15.72:0/3245367941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cd4f0 0x7f96200cd970 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9627bff700 1 -- 172.21.15.72:0/3245367941 >> 172.21.15.72:0/3245367941 conn(0x7f96200d0c70 msgr2=0x7f96200d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:46.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9627bff700 1 -- 172.21.15.72:0/3245367941 shutdown_connections 2023-08-25T04:46:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.249+0000 7f9627bff700 1 -- 172.21.15.72:0/3245367941 wait complete. 2023-08-25T04:46:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.251+0000 7f9627bff700 1 Processor -- start 2023-08-25T04:46:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.251+0000 7f9627bff700 1 -- start start 2023-08-25T04:46:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.252+0000 7f9627bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96200c71b0 0x7f962006f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.252+0000 7f9627bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96200cd4f0 0x7f96201e1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.252+0000 7f9627bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cdeb0 0x7f962009dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.252+0000 7f9627bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9620070950 con 0x7f96200cdeb0 2023-08-25T04:46:46.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.252+0000 7f9627bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96200c9ca0 con 0x7f96200c71b0 2023-08-25T04:46:46.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.252+0000 7f9627bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96200c9f80 con 0x7f96200cd4f0 2023-08-25T04:46:46.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962619c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cdeb0 0x7f962009dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962619c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cdeb0 0x7f962009dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46892/0 (socket says 172.21.15.72:46892) 2023-08-25T04:46:46.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962619c700 1 -- 172.21.15.72:0/689516706 learned_addr learned my addr 172.21.15.72:0/689516706 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:46.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962519a700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96200cd4f0 0x7f96201e1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962599b700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96200c71b0 0x7f962006f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962619c700 1 -- 172.21.15.72:0/689516706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96200cd4f0 msgr2=0x7f96201e1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962619c700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96200cd4f0 0x7f96201e1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962619c700 1 -- 172.21.15.72:0/689516706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96200c71b0 msgr2=0x7f962006f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962619c700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96200c71b0 0x7f962006f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962619c700 1 -- 172.21.15.72:0/689516706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610009550 con 0x7f96200cdeb0 2023-08-25T04:46:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f962619c700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cdeb0 0x7f962009dc40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f961800cc50 tx=0x7f961800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f96167fc700 1 -- 172.21.15.72:0/689516706 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800ad80 con 0x7f96200cdeb0 2023-08-25T04:46:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f96167fc700 1 -- 172.21.15.72:0/689516706 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961800ce50 con 0x7f96200cdeb0 2023-08-25T04:46:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f96167fc700 1 -- 172.21.15.72:0/689516706 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618003c40 con 0x7f96200cdeb0 2023-08-25T04:46:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.253+0000 7f9627bff700 1 -- 172.21.15.72:0/689516706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96200ca260 con 0x7f96200cdeb0 2023-08-25T04:46:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.254+0000 7f9627bff700 1 -- 172.21.15.72:0/689516706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962006fbc0 con 0x7f96200cdeb0 2023-08-25T04:46:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.255+0000 7f9627bff700 1 -- 172.21.15.72:0/689516706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962009ebb0 con 0x7f96200cdeb0 2023-08-25T04:46:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.256+0000 7f96167fc700 1 -- 172.21.15.72:0/689516706 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f96180050d0 con 0x7f96200cdeb0 2023-08-25T04:46:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.257+0000 7f96167fc700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f960406a0e0 0x7f960406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.257+0000 7f96167fc700 1 -- 172.21.15.72:0/689516706 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f96180889d0 con 0x7f96200cdeb0 2023-08-25T04:46:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.257+0000 7f962599b700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f960406a0e0 0x7f960406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.258+0000 7f962599b700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f960406a0e0 0x7f960406c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f961c009ad0 tx=0x7f961c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:46.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.261+0000 7f96167fc700 1 -- 172.21.15.72:0/689516706 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9618053d80 con 0x7f96200cdeb0 2023-08-25T04:46:46.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.456+0000 7f9627bff700 1 -- 172.21.15.72:0/689516706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96200c44c0 con 0x7f96200cdeb0 2023-08-25T04:46:46.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.457+0000 7f96167fc700 1 -- 172.21.15.72:0/689516706 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96180573a0 con 0x7f96200cdeb0 2023-08-25T04:46:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:46.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 -- 172.21.15.72:0/689516706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f960406a0e0 msgr2=0x7f960406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f960406a0e0 0x7f960406c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f961c009ad0 tx=0x7f961c008040 comp rx=0 tx=0).stop 2023-08-25T04:46:46.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 -- 172.21.15.72:0/689516706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cdeb0 msgr2=0x7f962009dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cdeb0 0x7f962009dc40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f961800cc50 tx=0x7f961800a340 comp rx=0 tx=0).stop 2023-08-25T04:46:46.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 -- 172.21.15.72:0/689516706 shutdown_connections 2023-08-25T04:46:46.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f960406a0e0 0x7f960406c5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96200cdeb0 0x7f962009dc40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96200c71b0 0x7f962006f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 --2- 172.21.15.72:0/689516706 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f96200cd4f0 0x7f96201e1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 -- 172.21.15.72:0/689516706 >> 172.21.15.72:0/689516706 conn(0x7f96200d0c70 msgr2=0x7f96201e4040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:46.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 -- 172.21.15.72:0/689516706 shutdown_connections 2023-08-25T04:46:46.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.459+0000 7f9627bff700 1 -- 172.21.15.72:0/689516706 wait complete. 2023-08-25T04:46:46.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.678+0000 7f542e3ff700 1 Processor -- start 2023-08-25T04:46:46.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.678+0000 7f542e3ff700 1 -- start start 2023-08-25T04:46:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.679+0000 7f542e3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54280ade30 0x7f54280ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.679+0000 7f542e3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f542815da20 0x7f5428070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.679+0000 7f542e3ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5428070ed0 0x7f542806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.679+0000 7f542e3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5428071360 con 0x7f542815da20 2023-08-25T04:46:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.679+0000 7f542e3ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54280ae750 con 0x7f5428070ed0 2023-08-25T04:46:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.679+0000 7f542e3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54280ae9d0 con 0x7f54280ade30 2023-08-25T04:46:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.679+0000 7f54277fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f542815da20 0x7f5428070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.679+0000 7f54277fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f542815da20 0x7f5428070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46904/0 (socket says 172.21.15.72:46904) 2023-08-25T04:46:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.679+0000 7f54277fe700 1 -- 172.21.15.72:0/3946739303 learned_addr learned my addr 172.21.15.72:0/3946739303 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f542c99c700 1 --2- 172.21.15.72:0/3946739303 >> v2:172.21.15.137:3300/0 conn(0x7f5428070ed0 0x7f542806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f5427fff700 1 --2- 172.21.15.72:0/3946739303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54280ade30 0x7f54280ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f54277fe700 1 -- 172.21.15.72:0/3946739303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54280ade30 msgr2=0x7f54280ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f54277fe700 1 --2- 172.21.15.72:0/3946739303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54280ade30 0x7f54280ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f54277fe700 1 -- 172.21.15.72:0/3946739303 >> v2:172.21.15.137:3300/0 conn(0x7f5428070ed0 msgr2=0x7f542806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f54277fe700 1 --2- 172.21.15.72:0/3946739303 >> v2:172.21.15.137:3300/0 conn(0x7f5428070ed0 0x7f542806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f54277fe700 1 -- 172.21.15.72:0/3946739303 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5428159d70 con 0x7f542815da20 2023-08-25T04:46:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f54277fe700 1 --2- 172.21.15.72:0/3946739303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542815da20 0x7f5428070990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f542806eea0 tx=0x7f541c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0b2e4aa9ef4444 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f5426ffd700 1 -- 172.21.15.72:0/3946739303 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00b870 con 0x7f542815da20 2023-08-25T04:46:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f5426ffd700 1 -- 172.21.15.72:0/3946739303 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00b9d0 con 0x7f542815da20 2023-08-25T04:46:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.680+0000 7f5426ffd700 1 -- 172.21.15.72:0/3946739303 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00bd60 con 0x7f542815da20 2023-08-25T04:46:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.681+0000 7f542e3ff700 1 -- 172.21.15.72:0/3946739303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542815da20 msgr2=0x7f5428070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.681+0000 7f542e3ff700 1 --2- 172.21.15.72:0/3946739303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542815da20 0x7f5428070990 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f542806eea0 tx=0x7f541c009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.681+0000 7f542e3ff700 1 -- 172.21.15.72:0/3946739303 shutdown_connections 2023-08-25T04:46:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.681+0000 7f542e3ff700 1 --2- 172.21.15.72:0/3946739303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54280ade30 0x7f54280ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.681+0000 7f542e3ff700 1 --2- 172.21.15.72:0/3946739303 >> v2:172.21.15.137:3300/0 conn(0x7f5428070ed0 0x7f542806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.681+0000 7f542e3ff700 1 --2- 172.21.15.72:0/3946739303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542815da20 0x7f5428070990 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.681+0000 7f542e3ff700 1 -- 172.21.15.72:0/3946739303 >> 172.21.15.72:0/3946739303 conn(0x7f542806a710 msgr2=0x7f542806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.681+0000 7f542e3ff700 1 -- 172.21.15.72:0/3946739303 shutdown_connections 2023-08-25T04:46:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.681+0000 7f542e3ff700 1 -- 172.21.15.72:0/3946739303 wait complete. 2023-08-25T04:46:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.683+0000 7f542e3ff700 1 Processor -- start 2023-08-25T04:46:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.683+0000 7f542e3ff700 1 -- start start 2023-08-25T04:46:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.684+0000 7f542e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5428070ed0 0x7f54280c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.684+0000 7f542e3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54280ade30 0x7f54280cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.684+0000 7f542e3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f542815da20 0x7f54280ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.684+0000 7f542e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54280b1dc0 con 0x7f5428070ed0 2023-08-25T04:46:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.684+0000 7f542e3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54280b2bb0 con 0x7f542815da20 2023-08-25T04:46:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.684+0000 7f542e3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54280c1a30 con 0x7f54280ade30 2023-08-25T04:46:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.684+0000 7f5427fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5428070ed0 0x7f54280c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.684+0000 7f5427fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5428070ed0 0x7f54280c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46912/0 (socket says 172.21.15.72:46912) 2023-08-25T04:46:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.684+0000 7f5427fff700 1 -- 172.21.15.72:0/229915293 learned_addr learned my addr 172.21.15.72:0/229915293 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f5427fff700 1 -- 172.21.15.72:0/229915293 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54280ade30 msgr2=0x7f54280cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f5427fff700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54280ade30 0x7f54280cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f5427fff700 1 -- 172.21.15.72:0/229915293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f542815da20 msgr2=0x7f54280ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f5427fff700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f542815da20 0x7f54280ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f5427fff700 1 -- 172.21.15.72:0/229915293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c009550 con 0x7f5428070ed0 2023-08-25T04:46:46.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f5427fff700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5428070ed0 0x7f54280c14f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f541800e810 tx=0x7f541800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:46.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f5424ff9700 1 -- 172.21.15.72:0/229915293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418013610 con 0x7f5428070ed0 2023-08-25T04:46:46.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f5424ff9700 1 -- 172.21.15.72:0/229915293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5418013770 con 0x7f5428070ed0 2023-08-25T04:46:46.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f542e3ff700 1 -- 172.21.15.72:0/229915293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54280b1fa0 con 0x7f5428070ed0 2023-08-25T04:46:46.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f5424ff9700 1 -- 172.21.15.72:0/229915293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418013b20 con 0x7f5428070ed0 2023-08-25T04:46:46.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.685+0000 7f542e3ff700 1 -- 172.21.15.72:0/229915293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54280b2560 con 0x7f5428070ed0 2023-08-25T04:46:46.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.686+0000 7f542e3ff700 1 -- 172.21.15.72:0/229915293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5428072320 con 0x7f5428070ed0 2023-08-25T04:46:46.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.687+0000 7f5424ff9700 1 -- 172.21.15.72:0/229915293 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5418013c80 con 0x7f5428070ed0 2023-08-25T04:46:46.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.688+0000 7f5424ff9700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f541406a0e0 0x7f541406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:46.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.688+0000 7f5424ff9700 1 -- 172.21.15.72:0/229915293 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5418088620 con 0x7f5428070ed0 2023-08-25T04:46:46.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.688+0000 7f54277fe700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f541406a0e0 0x7f541406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:46.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.689+0000 7f54277fe700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f541406a0e0 0x7f541406c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f54280c54d0 tx=0x7f541c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:46.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.693+0000 7f5424ff9700 1 -- 172.21.15.72:0/229915293 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5418053950 con 0x7f5428070ed0 2023-08-25T04:46:46.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.891+0000 7f542e3ff700 1 -- 172.21.15.72:0/229915293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f54280744f0 con 0x7f5428070ed0 2023-08-25T04:46:46.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.891+0000 7f5424ff9700 1 -- 172.21.15.72:0/229915293 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5418056f70 con 0x7f5428070ed0 2023-08-25T04:46:46.893 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:46.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 -- 172.21.15.72:0/229915293 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f541406a0e0 msgr2=0x7f541406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f541406a0e0 0x7f541406c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f54280c54d0 tx=0x7f541c010000 comp rx=0 tx=0).stop 2023-08-25T04:46:46.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 -- 172.21.15.72:0/229915293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5428070ed0 msgr2=0x7f54280c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:46.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5428070ed0 0x7f54280c14f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f541800e810 tx=0x7f541800ebd0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 -- 172.21.15.72:0/229915293 shutdown_connections 2023-08-25T04:46:46.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f541406a0e0 0x7f541406c5a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f542815da20 0x7f54280ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5428070ed0 0x7f54280c14f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 --2- 172.21.15.72:0/229915293 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54280ade30 0x7f54280cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:46.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 -- 172.21.15.72:0/229915293 >> 172.21.15.72:0/229915293 conn(0x7f542806a710 msgr2=0x7f5428158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:46.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 -- 172.21.15.72:0/229915293 shutdown_connections 2023-08-25T04:46:46.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:46.894+0000 7f542e3ff700 1 -- 172.21.15.72:0/229915293 wait complete. 2023-08-25T04:46:46.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:46:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.109+0000 7fe7f6dff700 1 Processor -- start 2023-08-25T04:46:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.109+0000 7fe7f6dff700 1 -- start start 2023-08-25T04:46:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.111+0000 7fe7f6dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 0x7fe7f00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.111+0000 7fe7f6dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7f00cba20 0x7fe7f00b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.111+0000 7fe7f6dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f006bb30 con 0x7fe7f015cf70 2023-08-25T04:46:47.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.111+0000 7fe7f6dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f015d350 con 0x7fe7f00cba20 2023-08-25T04:46:47.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.111+0000 7fe7f6dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00cf800 con 0x7fe7f01615d0 2023-08-25T04:46:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.111+0000 7fe7effff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 0x7fe7f00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.111+0000 7fe7f539c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7f00cba20 0x7fe7f00b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.111+0000 7fe7effff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 0x7fe7f00cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:50498/0 (socket says 172.21.15.72:50498) 2023-08-25T04:46:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.111+0000 7fe7effff700 1 -- 172.21.15.72:0/3420073280 learned_addr learned my addr 172.21.15.72:0/3420073280 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.112+0000 7fe7effff700 1 -- 172.21.15.72:0/3420073280 >> v2:172.21.15.137:3300/0 conn(0x7fe7f00cba20 msgr2=0x7fe7f00b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.112+0000 7fe7effff700 1 --2- 172.21.15.72:0/3420073280 >> v2:172.21.15.137:3300/0 conn(0x7fe7f00cba20 0x7fe7f00b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.112+0000 7fe7effff700 1 -- 172.21.15.72:0/3420073280 >> v1:172.21.15.137:6789/0 conn(0x7fe7f015cf70 legacy=0x7fe7f00cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.112+0000 7fe7effff700 1 -- 172.21.15.72:0/3420073280 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f006bdf0 con 0x7fe7f01615d0 2023-08-25T04:46:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.112+0000 7fe7f539c700 1 --2- 172.21.15.72:0/3420073280 >> v2:172.21.15.137:3300/0 conn(0x7fe7f00cba20 0x7fe7f00b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.112+0000 7fe7effff700 1 --2- 172.21.15.72:0/3420073280 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 0x7fe7f00cb4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0098f0 tx=0x7fe7dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de08b9f3a5b110c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.112+0000 7fe7ef7fe700 1 -- 172.21.15.72:0/3420073280 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc011830 con 0x7fe7f01615d0 2023-08-25T04:46:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.112+0000 7fe7ef7fe700 1 -- 172.21.15.72:0/3420073280 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc011990 con 0x7fe7f01615d0 2023-08-25T04:46:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.112+0000 7fe7ef7fe700 1 -- 172.21.15.72:0/3420073280 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc011d20 con 0x7fe7f01615d0 2023-08-25T04:46:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.113+0000 7fe7f6dff700 1 -- 172.21.15.72:0/3420073280 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 msgr2=0x7fe7f00cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.113+0000 7fe7f6dff700 1 --2- 172.21.15.72:0/3420073280 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 0x7fe7f00cb4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0098f0 tx=0x7fe7dc009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.113+0000 7fe7f6dff700 1 -- 172.21.15.72:0/3420073280 shutdown_connections 2023-08-25T04:46:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.113+0000 7fe7f6dff700 1 --2- 172.21.15.72:0/3420073280 >> v2:172.21.15.137:3300/0 conn(0x7fe7f00cba20 0x7fe7f00b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.113+0000 7fe7f6dff700 1 --2- 172.21.15.72:0/3420073280 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 0x7fe7f00cb4e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.113+0000 7fe7f6dff700 1 -- 172.21.15.72:0/3420073280 >> 172.21.15.72:0/3420073280 conn(0x7fe7f00cd650 msgr2=0x7fe7f00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:47.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.113+0000 7fe7f6dff700 1 -- 172.21.15.72:0/3420073280 shutdown_connections 2023-08-25T04:46:47.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.113+0000 7fe7f6dff700 1 -- 172.21.15.72:0/3420073280 wait complete. 2023-08-25T04:46:47.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.115+0000 7fe7f6dff700 1 Processor -- start 2023-08-25T04:46:47.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.115+0000 7fe7f6dff700 1 -- start start 2023-08-25T04:46:47.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7f6dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f00cba20 0x7fe7f0159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7f6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f015cf70 0x7fe7f015f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7f6dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 0x7fe7f015fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7f6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f015eba0 con 0x7fe7f015cf70 2023-08-25T04:46:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7f6dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f015e8c0 con 0x7fe7f00cba20 2023-08-25T04:46:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7f6dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00c48a0 con 0x7fe7f01615d0 2023-08-25T04:46:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f015cf70 0x7fe7f015f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f015cf70 0x7fe7f015f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46928/0 (socket says 172.21.15.72:46928) 2023-08-25T04:46:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7effff700 1 -- 172.21.15.72:0/4157899595 learned_addr learned my addr 172.21.15.72:0/4157899595 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7f4b9b700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f00cba20 0x7fe7f0159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7f539c700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 0x7fe7f015fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7effff700 1 -- 172.21.15.72:0/4157899595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 msgr2=0x7fe7f015fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7effff700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 0x7fe7f015fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7effff700 1 -- 172.21.15.72:0/4157899595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f00cba20 msgr2=0x7fe7f0159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7effff700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f00cba20 0x7fe7f0159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.116+0000 7fe7effff700 1 -- 172.21.15.72:0/4157899595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8009a70 con 0x7fe7f015cf70 2023-08-25T04:46:47.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.117+0000 7fe7effff700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f015cf70 0x7fe7f015f980 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009c40 tx=0x7fe7dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:47.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.117+0000 7fe7ed7fa700 1 -- 172.21.15.72:0/4157899595 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0044d0 con 0x7fe7f015cf70 2023-08-25T04:46:47.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.117+0000 7fe7ed7fa700 1 -- 172.21.15.72:0/4157899595 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc01e070 con 0x7fe7f015cf70 2023-08-25T04:46:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.117+0000 7fe7f6dff700 1 -- 172.21.15.72:0/4157899595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc009550 con 0x7fe7f015cf70 2023-08-25T04:46:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.117+0000 7fe7ed7fa700 1 -- 172.21.15.72:0/4157899595 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0038e0 con 0x7fe7f015cf70 2023-08-25T04:46:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.117+0000 7fe7f6dff700 1 -- 172.21.15.72:0/4157899595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f00c4e60 con 0x7fe7f015cf70 2023-08-25T04:46:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.118+0000 7fe7f6dff700 1 -- 172.21.15.72:0/4157899595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f00c4700 con 0x7fe7f015cf70 2023-08-25T04:46:47.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.119+0000 7fe7ed7fa700 1 -- 172.21.15.72:0/4157899595 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe7dc003a40 con 0x7fe7f015cf70 2023-08-25T04:46:47.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.120+0000 7fe7ed7fa700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe7d406a0e0 0x7fe7d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.120+0000 7fe7ed7fa700 1 -- 172.21.15.72:0/4157899595 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe7dc0896c0 con 0x7fe7f015cf70 2023-08-25T04:46:47.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.120+0000 7fe7f4b9b700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe7d406a0e0 0x7fe7d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.121+0000 7fe7f4b9b700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe7d406a0e0 0x7fe7d406c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00c7310 tx=0x7fe7e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:47.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.125+0000 7fe7ed7fa700 1 -- 172.21.15.72:0/4157899595 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe7f00c4700 con 0x7fe7f015cf70 2023-08-25T04:46:47.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.336+0000 7fe7f6dff700 1 -- 172.21.15.72:0/4157899595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe7f00c4700 con 0x7fe7f015cf70 2023-08-25T04:46:47.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.336+0000 7fe7ed7fa700 1 -- 172.21.15.72:0/4157899595 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe7f00c4700 con 0x7fe7f015cf70 2023-08-25T04:46:47.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 -- 172.21.15.72:0/4157899595 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe7d406a0e0 msgr2=0x7fe7d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe7d406a0e0 0x7fe7d406c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00c7310 tx=0x7fe7e4009040 comp rx=0 tx=0).stop 2023-08-25T04:46:47.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 -- 172.21.15.72:0/4157899595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f015cf70 msgr2=0x7fe7f015f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f015cf70 0x7fe7f015f980 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009c40 tx=0x7fe7dc004750 comp rx=0 tx=0).stop 2023-08-25T04:46:47.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 -- 172.21.15.72:0/4157899595 shutdown_connections 2023-08-25T04:46:47.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe7d406a0e0 0x7fe7d406c5a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7f01615d0 0x7fe7f015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7f00cba20 0x7fe7f0159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 --2- 172.21.15.72:0/4157899595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f015cf70 0x7fe7f015f980 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 -- 172.21.15.72:0/4157899595 >> 172.21.15.72:0/4157899595 conn(0x7fe7f00cd650 msgr2=0x7fe7f00b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:47.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 -- 172.21.15.72:0/4157899595 shutdown_connections 2023-08-25T04:46:47.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.339+0000 7fe7f6dff700 1 -- 172.21.15.72:0/4157899595 wait complete. 2023-08-25T04:46:47.342 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-08-25T04:46:47.358 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-08-25T04:46:47.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:47.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-25T04:46:47.428 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:46:47.429 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-25T04:46:47.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:47.430 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T04:46:47.478 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:46:47.479 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:46:47.531 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:46:47.532 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:46:47.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:47.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.778+0000 7facb25ff700 1 Processor -- start 2023-08-25T04:46:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.778+0000 7facb25ff700 1 -- start start 2023-08-25T04:46:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facb25ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facac15d240 0x7facac0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facb25ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7facac0cbd60 0x7facac0cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facb25ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac0cb2a0 con 0x7facac0cf970 2023-08-25T04:46:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facb25ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac0cfe80 con 0x7facac15d240 2023-08-25T04:46:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facb25ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac0d0160 con 0x7facac0cbd60 2023-08-25T04:46:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facabfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facac15d240 0x7facac0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7faca3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7facac0cf970 0x7facac0cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41752/0 (socket says 172.21.15.72:41752) 2023-08-25T04:46:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7faca3fff700 1 -- 172.21.15.72:0/532659080 learned_addr learned my addr 172.21.15.72:0/532659080 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facb0b9c700 1 --2- 172.21.15.72:0/532659080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7facac0cbd60 0x7facac0cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facabfff700 1 -- 172.21.15.72:0/532659080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7facac0cbd60 msgr2=0x7facac0cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facabfff700 1 --2- 172.21.15.72:0/532659080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7facac0cbd60 0x7facac0cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facabfff700 1 -- 172.21.15.72:0/532659080 >> v1:172.21.15.72:6789/0 conn(0x7facac0cf970 legacy=0x7facac0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facab7fe700 1 -- 172.21.15.72:0/532659080 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571711405 0 0) 0x7facac0cb2a0 con 0x7facac0cf970 2023-08-25T04:46:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.780+0000 7facabfff700 1 -- 172.21.15.72:0/532659080 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0cb560 con 0x7facac15d240 2023-08-25T04:46:47.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.781+0000 7facabfff700 1 --2- 172.21.15.72:0/532659080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac15d240 0x7facac0cd4d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009840 tx=0x7fac9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aadd8978c17757e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:47.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.781+0000 7facab7fe700 1 -- 172.21.15.72:0/532659080 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c011830 con 0x7facac15d240 2023-08-25T04:46:47.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.781+0000 7facab7fe700 1 -- 172.21.15.72:0/532659080 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c011990 con 0x7facac15d240 2023-08-25T04:46:47.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.781+0000 7facab7fe700 1 -- 172.21.15.72:0/532659080 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c011d20 con 0x7facac15d240 2023-08-25T04:46:47.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.782+0000 7facb25ff700 1 -- 172.21.15.72:0/532659080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac15d240 msgr2=0x7facac0cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.782+0000 7facb25ff700 1 --2- 172.21.15.72:0/532659080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac15d240 0x7facac0cd4d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009840 tx=0x7fac9c009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.782+0000 7facb25ff700 1 -- 172.21.15.72:0/532659080 shutdown_connections 2023-08-25T04:46:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.782+0000 7facb25ff700 1 --2- 172.21.15.72:0/532659080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac15d240 0x7facac0cd4d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.782+0000 7facb25ff700 1 --2- 172.21.15.72:0/532659080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7facac0cbd60 0x7facac0cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.782+0000 7facb25ff700 1 -- 172.21.15.72:0/532659080 >> 172.21.15.72:0/532659080 conn(0x7facac0d0c50 msgr2=0x7facac0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.782+0000 7facb25ff700 1 -- 172.21.15.72:0/532659080 shutdown_connections 2023-08-25T04:46:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.782+0000 7facb25ff700 1 -- 172.21.15.72:0/532659080 wait complete. 2023-08-25T04:46:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.784+0000 7facb25ff700 1 Processor -- start 2023-08-25T04:46:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.784+0000 7facb25ff700 1 -- start start 2023-08-25T04:46:47.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7facb25ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0cbd60 0x7facac160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7facb25ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7facac0cf970 0x7facac14c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7facb25ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facac15d240 0x7facac15e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7facb25ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac0b49c0 con 0x7facac0cbd60 2023-08-25T04:46:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7facb25ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac160840 con 0x7facac15d240 2023-08-25T04:46:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7facb25ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac0ccb90 con 0x7facac0cf970 2023-08-25T04:46:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7facabfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0cbd60 0x7facac160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7facabfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0cbd60 0x7facac160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46950/0 (socket says 172.21.15.72:46950) 2023-08-25T04:46:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7facabfff700 1 -- 172.21.15.72:0/3153736867 learned_addr learned my addr 172.21.15.72:0/3153736867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7faca3fff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7facac0cf970 0x7facac14c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.785+0000 7facb0b9c700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facac15d240 0x7facac15e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7facabfff700 1 -- 172.21.15.72:0/3153736867 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7facac0cf970 msgr2=0x7facac14c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7facabfff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7facac0cf970 0x7facac14c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7facabfff700 1 -- 172.21.15.72:0/3153736867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facac15d240 msgr2=0x7facac15e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7facabfff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facac15d240 0x7facac15e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7facabfff700 1 -- 172.21.15.72:0/3153736867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0094a0 con 0x7facac0cbd60 2023-08-25T04:46:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7facb0b9c700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facac15d240 0x7facac15e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:47.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7facabfff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0cbd60 0x7facac160300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0090b0 tx=0x7fac9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7faca97fa700 1 -- 172.21.15.72:0/3153736867 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c0036a0 con 0x7facac0cbd60 2023-08-25T04:46:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7faca97fa700 1 -- 172.21.15.72:0/3153736867 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c01f070 con 0x7facac0cbd60 2023-08-25T04:46:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7facb25ff700 1 -- 172.21.15.72:0/3153736867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac15d620 con 0x7facac0cbd60 2023-08-25T04:46:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7faca97fa700 1 -- 172.21.15.72:0/3153736867 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c003a00 con 0x7facac0cbd60 2023-08-25T04:46:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.786+0000 7facb25ff700 1 -- 172.21.15.72:0/3153736867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac15db50 con 0x7facac0cbd60 2023-08-25T04:46:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.787+0000 7facb25ff700 1 -- 172.21.15.72:0/3153736867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac04e620 con 0x7facac0cbd60 2023-08-25T04:46:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.788+0000 7faca97fa700 1 -- 172.21.15.72:0/3153736867 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fac9c003b60 con 0x7facac0cbd60 2023-08-25T04:46:47.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.789+0000 7faca97fa700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fac8c06a0e0 0x7fac8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:47.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.790+0000 7faca97fa700 1 -- 172.21.15.72:0/3153736867 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fac9c021070 con 0x7facac0cbd60 2023-08-25T04:46:47.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.790+0000 7faca3fff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fac8c06a0e0 0x7fac8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:47.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.790+0000 7faca3fff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fac8c06a0e0 0x7fac8c06c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7facac1f55b0 tx=0x7fac94007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:47.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.794+0000 7faca97fa700 1 -- 172.21.15.72:0/3153736867 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fac9c055650 con 0x7facac0cbd60 2023-08-25T04:46:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.995+0000 7facb25ff700 1 -- 172.21.15.72:0/3153736867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facac15d870 con 0x7facac0cbd60 2023-08-25T04:46:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.996+0000 7faca97fa700 1 -- 172.21.15.72:0/3153736867 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7fac9c058c70 con 0x7facac0cbd60 2023-08-25T04:46:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:47.997 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 -- 172.21.15.72:0/3153736867 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fac8c06a0e0 msgr2=0x7fac8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fac8c06a0e0 0x7fac8c06c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7facac1f55b0 tx=0x7fac94007de0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 -- 172.21.15.72:0/3153736867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0cbd60 msgr2=0x7facac160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0cbd60 0x7facac160300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0090b0 tx=0x7fac9c004750 comp rx=0 tx=0).stop 2023-08-25T04:46:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 -- 172.21.15.72:0/3153736867 shutdown_connections 2023-08-25T04:46:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fac8c06a0e0 0x7fac8c06c5a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facac15d240 0x7facac15e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0cbd60 0x7facac160300 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 --2- 172.21.15.72:0/3153736867 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7facac0cf970 0x7facac14c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 -- 172.21.15.72:0/3153736867 >> 172.21.15.72:0/3153736867 conn(0x7facac0d0c50 msgr2=0x7facac06f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:48.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 -- 172.21.15.72:0/3153736867 shutdown_connections 2023-08-25T04:46:48.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:47.999+0000 7facb25ff700 1 -- 172.21.15.72:0/3153736867 wait complete. 2023-08-25T04:46:48.017 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:48.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:48.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.219+0000 7f33033ff700 1 Processor -- start 2023-08-25T04:46:48.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.219+0000 7f33033ff700 1 -- start start 2023-08-25T04:46:48.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.220+0000 7f33033ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f32fc15d000 0x7f32fc0b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.220+0000 7f33033ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32fc0b4f10 0x7f32fc0b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.220+0000 7f33033ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc0b6e90 con 0x7f32fc0d10c0 2023-08-25T04:46:48.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.220+0000 7f33033ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc0b56f0 con 0x7f32fc15d000 2023-08-25T04:46:48.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.220+0000 7f33033ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc15d3e0 con 0x7f32fc0b4f10 2023-08-25T04:46:48.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.220+0000 7f330119b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f32fc15d000 0x7f32fc0b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.220+0000 7f330099a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f32fc0d10c0 0x7f32fc0b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41754/0 (socket says 172.21.15.72:41754) 2023-08-25T04:46:48.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.220+0000 7f330099a700 1 -- 172.21.15.72:0/2650820946 learned_addr learned my addr 172.21.15.72:0/2650820946 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:48.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.221+0000 7f330199c700 1 --2- 172.21.15.72:0/2650820946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32fc0b4f10 0x7f32fc0b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.221+0000 7f330119b700 1 -- 172.21.15.72:0/2650820946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32fc0b4f10 msgr2=0x7f32fc0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:48.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.221+0000 7f330119b700 1 --2- 172.21.15.72:0/2650820946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32fc0b4f10 0x7f32fc0b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.221+0000 7f330119b700 1 -- 172.21.15.72:0/2650820946 >> v1:172.21.15.72:6789/0 conn(0x7f32fc0d10c0 legacy=0x7f32fc0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.221+0000 7f330119b700 1 -- 172.21.15.72:0/2650820946 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc0b6280 con 0x7f32fc15d000 2023-08-25T04:46:48.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.221+0000 7f32f3fff700 1 -- 172.21.15.72:0/2650820946 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070347613 0 0) 0x7f32fc0b6e90 con 0x7f32fc0d10c0 2023-08-25T04:46:48.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.221+0000 7f330119b700 1 --2- 172.21.15.72:0/2650820946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc15d000 0x7f32fc0b8600 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009840 tx=0x7f32f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46948ca5eaeae8fb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:48.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.221+0000 7f32f3fff700 1 -- 172.21.15.72:0/2650820946 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8011830 con 0x7f32fc15d000 2023-08-25T04:46:48.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.221+0000 7f32f3fff700 1 -- 172.21.15.72:0/2650820946 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f8011990 con 0x7f32fc15d000 2023-08-25T04:46:48.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.221+0000 7f32f3fff700 1 -- 172.21.15.72:0/2650820946 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8011d20 con 0x7f32fc15d000 2023-08-25T04:46:48.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.222+0000 7f33033ff700 1 -- 172.21.15.72:0/2650820946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc15d000 msgr2=0x7f32fc0b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.222+0000 7f33033ff700 1 --2- 172.21.15.72:0/2650820946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc15d000 0x7f32fc0b8600 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009840 tx=0x7f32f8009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:48.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.222+0000 7f33033ff700 1 -- 172.21.15.72:0/2650820946 shutdown_connections 2023-08-25T04:46:48.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.222+0000 7f33033ff700 1 --2- 172.21.15.72:0/2650820946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc15d000 0x7f32fc0b8600 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.222+0000 7f33033ff700 1 --2- 172.21.15.72:0/2650820946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32fc0b4f10 0x7f32fc0b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.222+0000 7f33033ff700 1 -- 172.21.15.72:0/2650820946 >> 172.21.15.72:0/2650820946 conn(0x7f32fc071e10 msgr2=0x7f32fc072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:48.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.222+0000 7f33033ff700 1 -- 172.21.15.72:0/2650820946 shutdown_connections 2023-08-25T04:46:48.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.222+0000 7f33033ff700 1 -- 172.21.15.72:0/2650820946 wait complete. 2023-08-25T04:46:48.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.224+0000 7f33033ff700 1 Processor -- start 2023-08-25T04:46:48.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.224+0000 7f33033ff700 1 -- start start 2023-08-25T04:46:48.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f33033ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc0b4f10 0x7f32fc1f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f33033ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32fc0d10c0 0x7f32fc0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f33033ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32fc15d000 0x7f32fc1f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f33033ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0c96f0 con 0x7f32fc0b4f10 2023-08-25T04:46:48.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f33033ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc1f2d50 con 0x7f32fc0d10c0 2023-08-25T04:46:48.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f33033ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc1f3030 con 0x7f32fc15d000 2023-08-25T04:46:48.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330119b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc0b4f10 0x7f32fc1f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330119b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc0b4f10 0x7f32fc1f3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46970/0 (socket says 172.21.15.72:46970) 2023-08-25T04:46:48.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330119b700 1 -- 172.21.15.72:0/1443139576 learned_addr learned my addr 172.21.15.72:0/1443139576 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:48.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330199c700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32fc15d000 0x7f32fc1f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330119b700 1 -- 172.21.15.72:0/1443139576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32fc15d000 msgr2=0x7f32fc1f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330119b700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32fc15d000 0x7f32fc1f2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330119b700 1 -- 172.21.15.72:0/1443139576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32fc0d10c0 msgr2=0x7f32fc0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330099a700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32fc0d10c0 0x7f32fc0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330119b700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32fc0d10c0 0x7f32fc0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330119b700 1 -- 172.21.15.72:0/1443139576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80094a0 con 0x7f32fc0b4f10 2023-08-25T04:46:48.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.225+0000 7f330099a700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32fc0d10c0 0x7f32fc0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:48.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.226+0000 7f330119b700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc0b4f10 0x7f32fc1f3310 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f32f8014040 tx=0x7f32f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:48.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.226+0000 7f32f1ffb700 1 -- 172.21.15.72:0/1443139576 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80038a0 con 0x7f32fc0b4f10 2023-08-25T04:46:48.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.226+0000 7f32f1ffb700 1 -- 172.21.15.72:0/1443139576 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f801e070 con 0x7f32fc0b4f10 2023-08-25T04:46:48.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.226+0000 7f32f1ffb700 1 -- 172.21.15.72:0/1443139576 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8003c20 con 0x7f32fc0b4f10 2023-08-25T04:46:48.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.226+0000 7f33033ff700 1 -- 172.21.15.72:0/1443139576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc15e6e0 con 0x7f32fc0b4f10 2023-08-25T04:46:48.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.226+0000 7f33033ff700 1 -- 172.21.15.72:0/1443139576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc1f29d0 con 0x7f32fc0b4f10 2023-08-25T04:46:48.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.227+0000 7f33033ff700 1 -- 172.21.15.72:0/1443139576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc06a2f0 con 0x7f32fc0b4f10 2023-08-25T04:46:48.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.228+0000 7f32f1ffb700 1 -- 172.21.15.72:0/1443139576 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f32f802d450 con 0x7f32fc0b4f10 2023-08-25T04:46:48.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.229+0000 7f32f1ffb700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32e006a0e0 0x7f32e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.229+0000 7f32f1ffb700 1 -- 172.21.15.72:0/1443139576 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32f80899c0 con 0x7f32fc0b4f10 2023-08-25T04:46:48.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.229+0000 7f330099a700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32e006a0e0 0x7f32e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.230+0000 7f330099a700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32e006a0e0 0x7f32e006c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32fc1f3850 tx=0x7f32ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:48.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.234+0000 7f32f1ffb700 1 -- 172.21.15.72:0/1443139576 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f32f8054d70 con 0x7f32fc0b4f10 2023-08-25T04:46:48.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.427+0000 7f33033ff700 1 -- 172.21.15.72:0/1443139576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f32fc08a000 con 0x7f32fc0b4f10 2023-08-25T04:46:48.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.428+0000 7f32f1ffb700 1 -- 172.21.15.72:0/1443139576 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f32f8058390 con 0x7f32fc0b4f10 2023-08-25T04:46:48.428 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:48.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 -- 172.21.15.72:0/1443139576 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32e006a0e0 msgr2=0x7f32e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32e006a0e0 0x7f32e006c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32fc1f3850 tx=0x7f32ec009040 comp rx=0 tx=0).stop 2023-08-25T04:46:48.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 -- 172.21.15.72:0/1443139576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc0b4f10 msgr2=0x7f32fc1f3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc0b4f10 0x7f32fc1f3310 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f32f8014040 tx=0x7f32f8004750 comp rx=0 tx=0).stop 2023-08-25T04:46:48.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 -- 172.21.15.72:0/1443139576 shutdown_connections 2023-08-25T04:46:48.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f32e006a0e0 0x7f32e006c5a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f32fc15d000 0x7f32fc1f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32fc0b4f10 0x7f32fc1f3310 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 --2- 172.21.15.72:0/1443139576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32fc0d10c0 0x7f32fc0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 -- 172.21.15.72:0/1443139576 >> 172.21.15.72:0/1443139576 conn(0x7f32fc071e10 msgr2=0x7f32fc15c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:48.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 -- 172.21.15.72:0/1443139576 shutdown_connections 2023-08-25T04:46:48.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.430+0000 7f33033ff700 1 -- 172.21.15.72:0/1443139576 wait complete. 2023-08-25T04:46:48.456 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:48.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.655+0000 7f95f2fff700 1 Processor -- start 2023-08-25T04:46:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.655+0000 7f95f2fff700 1 -- start start 2023-08-25T04:46:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.656+0000 7f95f2fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95ec0b4f10 0x7f95ec167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.656+0000 7f95f2fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec0b8d10 con 0x7f95ec0d10c0 2023-08-25T04:46:48.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.656+0000 7f95f2fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec0b6e90 con 0x7f95ec15d000 2023-08-25T04:46:48.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.656+0000 7f95f2fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ec0b56f0 con 0x7f95ec0b4f10 2023-08-25T04:46:48.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.657+0000 7f95ebfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f95ec0d10c0 0x7f95ec0b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41764/0 (socket says 172.21.15.72:41764) 2023-08-25T04:46:48.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.657+0000 7f95ebfff700 1 -- 172.21.15.72:0/2837914919 learned_addr learned my addr 172.21.15.72:0/2837914919 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:48.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.657+0000 7f95f159c700 1 --2- 172.21.15.72:0/2837914919 >> v2:172.21.15.72:3300/0 conn(0x7f95ec0b4f10 0x7f95ec167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.657+0000 7f95f159c700 1 -- 172.21.15.72:0/2837914919 >> v1:172.21.15.137:6789/0 conn(0x7f95ec15d000 legacy=0x7f95ec0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.657+0000 7f95f159c700 1 -- 172.21.15.72:0/2837914919 >> v1:172.21.15.72:6789/0 conn(0x7f95ec0d10c0 legacy=0x7f95ec0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.657+0000 7f95eb7fe700 1 -- 172.21.15.72:0/2837914919 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617349797 0 0) 0x7f95ec0b8d10 con 0x7f95ec0d10c0 2023-08-25T04:46:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.657+0000 7f95f159c700 1 -- 172.21.15.72:0/2837914919 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec15d3e0 con 0x7f95ec0b4f10 2023-08-25T04:46:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.657+0000 7f95f159c700 1 --2- 172.21.15.72:0/2837914919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec0b4f10 0x7f95ec167be0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009d90 tx=0x7f95e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc20e7cbb85ff9d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.658+0000 7f95eb7fe700 1 -- 172.21.15.72:0/2837914919 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400e070 con 0x7f95ec0b4f10 2023-08-25T04:46:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.658+0000 7f95eb7fe700 1 -- 172.21.15.72:0/2837914919 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400bbd0 con 0x7f95ec0b4f10 2023-08-25T04:46:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.658+0000 7f95eb7fe700 1 -- 172.21.15.72:0/2837914919 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4012430 con 0x7f95ec0b4f10 2023-08-25T04:46:48.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.658+0000 7f95f2fff700 1 -- 172.21.15.72:0/2837914919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec0b4f10 msgr2=0x7f95ec167be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.658+0000 7f95f2fff700 1 --2- 172.21.15.72:0/2837914919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec0b4f10 0x7f95ec167be0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009d90 tx=0x7f95e400b330 comp rx=0 tx=0).stop 2023-08-25T04:46:48.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.658+0000 7f95f2fff700 1 -- 172.21.15.72:0/2837914919 shutdown_connections 2023-08-25T04:46:48.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.658+0000 7f95f2fff700 1 --2- 172.21.15.72:0/2837914919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec0b4f10 0x7f95ec167be0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.658+0000 7f95f2fff700 1 -- 172.21.15.72:0/2837914919 >> 172.21.15.72:0/2837914919 conn(0x7f95ec071e10 msgr2=0x7f95ec072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:48.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.658+0000 7f95f2fff700 1 -- 172.21.15.72:0/2837914919 shutdown_connections 2023-08-25T04:46:48.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.658+0000 7f95f2fff700 1 -- 172.21.15.72:0/2837914919 wait complete. 2023-08-25T04:46:48.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.660+0000 7f95f2fff700 1 Processor -- start 2023-08-25T04:46:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.660+0000 7f95f2fff700 1 -- start start 2023-08-25T04:46:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.661+0000 7f95f2fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ec0b4f10 0x7f95ec156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.661+0000 7f95f2fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95ec0d10c0 0x7f95ec155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.661+0000 7f95f2fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec15d000 0x7f95ec0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.661+0000 7f95f2fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0c7810 con 0x7f95ec15d000 2023-08-25T04:46:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.661+0000 7f95f2fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0c9ef0 con 0x7f95ec0b4f10 2023-08-25T04:46:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.661+0000 7f95f2fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0ca1d0 con 0x7f95ec0d10c0 2023-08-25T04:46:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95f159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec15d000 0x7f95ec0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95f159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec15d000 0x7f95ec0b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46990/0 (socket says 172.21.15.72:46990) 2023-08-25T04:46:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95f159c700 1 -- 172.21.15.72:0/1001308621 learned_addr learned my addr 172.21.15.72:0/1001308621 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95f0d9b700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ec0b4f10 0x7f95ec156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95ebfff700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95ec0d10c0 0x7f95ec155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95f159c700 1 -- 172.21.15.72:0/1001308621 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95ec0d10c0 msgr2=0x7f95ec155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95f159c700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95ec0d10c0 0x7f95ec155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95f159c700 1 -- 172.21.15.72:0/1001308621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ec0b4f10 msgr2=0x7f95ec156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95f159c700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ec0b4f10 0x7f95ec156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95f159c700 1 -- 172.21.15.72:0/1001308621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4009a70 con 0x7f95ec15d000 2023-08-25T04:46:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95f159c700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec15d000 0x7f95ec0b39b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f95e4014040 tx=0x7f95e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.662+0000 7f95e97fa700 1 -- 172.21.15.72:0/1001308621 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e401b920 con 0x7f95ec15d000 2023-08-25T04:46:48.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.663+0000 7f95e97fa700 1 -- 172.21.15.72:0/1001308621 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e4020070 con 0x7f95ec15d000 2023-08-25T04:46:48.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.663+0000 7f95e97fa700 1 -- 172.21.15.72:0/1001308621 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e401bcc0 con 0x7f95ec15d000 2023-08-25T04:46:48.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.663+0000 7f95f2fff700 1 -- 172.21.15.72:0/1001308621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ec0ca4b0 con 0x7f95ec15d000 2023-08-25T04:46:48.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.663+0000 7f95f2fff700 1 -- 172.21.15.72:0/1001308621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec1563d0 con 0x7f95ec15d000 2023-08-25T04:46:48.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.664+0000 7f95f2fff700 1 -- 172.21.15.72:0/1001308621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec0ca9d0 con 0x7f95ec15d000 2023-08-25T04:46:48.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.664+0000 7f95e97fa700 1 -- 172.21.15.72:0/1001308621 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f95e4026400 con 0x7f95ec15d000 2023-08-25T04:46:48.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.666+0000 7f95e97fa700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d006a0e0 0x7f95d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:48.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.667+0000 7f95e97fa700 1 -- 172.21.15.72:0/1001308621 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f95e408a8b0 con 0x7f95ec15d000 2023-08-25T04:46:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.667+0000 7f95f0d9b700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d006a0e0 0x7f95d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.667+0000 7f95f0d9b700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d006a0e0 0x7f95d006c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000f60 tx=0x7f95e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:48.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.671+0000 7f95e97fa700 1 -- 172.21.15.72:0/1001308621 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f95ec0ca9d0 con 0x7f95ec15d000 2023-08-25T04:46:48.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.869+0000 7f95f2fff700 1 -- 172.21.15.72:0/1001308621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95ec0ca9d0 con 0x7f95ec15d000 2023-08-25T04:46:48.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.869+0000 7f95e97fa700 1 -- 172.21.15.72:0/1001308621 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95ec0ca9d0 con 0x7f95ec15d000 2023-08-25T04:46:48.870 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:48.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 -- 172.21.15.72:0/1001308621 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d006a0e0 msgr2=0x7f95d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d006a0e0 0x7f95d006c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000f60 tx=0x7f95e0009040 comp rx=0 tx=0).stop 2023-08-25T04:46:48.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 -- 172.21.15.72:0/1001308621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec15d000 msgr2=0x7f95ec0b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:48.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec15d000 0x7f95ec0b39b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f95e4014040 tx=0x7f95e4004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 -- 172.21.15.72:0/1001308621 shutdown_connections 2023-08-25T04:46:48.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f95d006a0e0 0x7f95d006c5a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95ec15d000 0x7f95ec0b39b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ec0b4f10 0x7f95ec156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 --2- 172.21.15.72:0/1001308621 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f95ec0d10c0 0x7f95ec155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:48.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 -- 172.21.15.72:0/1001308621 >> 172.21.15.72:0/1001308621 conn(0x7f95ec071e10 msgr2=0x7f95ec0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:48.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 -- 172.21.15.72:0/1001308621 shutdown_connections 2023-08-25T04:46:48.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:48.872+0000 7f95f2fff700 1 -- 172.21.15.72:0/1001308621 wait complete. 2023-08-25T04:46:48.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:49.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.089+0000 7fdc475ff700 1 Processor -- start 2023-08-25T04:46:49.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.089+0000 7fdc475ff700 1 -- start start 2023-08-25T04:46:49.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.090+0000 7fdc475ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400cb650 0x7fdc400cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.090+0000 7fdc475ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc400b2810 0x7fdc40070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.090+0000 7fdc475ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdc400b2c90 0x7fdc40070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.090+0000 7fdc475ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc400b4300 con 0x7fdc400b2810 2023-08-25T04:46:49.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.090+0000 7fdc475ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc400cbf70 con 0x7fdc400b2c90 2023-08-25T04:46:49.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.090+0000 7fdc475ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400b3260 con 0x7fdc400cb650 2023-08-25T04:46:49.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc44b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc400b2810 0x7fdc40070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc44b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc400b2810 0x7fdc40070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46996/0 (socket says 172.21.15.72:46996) 2023-08-25T04:46:49.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc44b9a700 1 -- 172.21.15.72:0/3838696295 learned_addr learned my addr 172.21.15.72:0/3838696295 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:49.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc44b9a700 1 -- 172.21.15.72:0/3838696295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400cb650 msgr2=0x7fdc400cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:49.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc45b9c700 1 --2- 172.21.15.72:0/3838696295 >> v2:172.21.15.137:3300/0 conn(0x7fdc400b2c90 0x7fdc40070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc4539b700 1 --2- 172.21.15.72:0/3838696295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400cb650 0x7fdc400cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc44b9a700 1 --2- 172.21.15.72:0/3838696295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400cb650 0x7fdc400cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc44b9a700 1 -- 172.21.15.72:0/3838696295 >> v2:172.21.15.137:3300/0 conn(0x7fdc400b2c90 msgr2=0x7fdc40070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:49.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc44b9a700 1 --2- 172.21.15.72:0/3838696295 >> v2:172.21.15.137:3300/0 conn(0x7fdc400b2c90 0x7fdc40070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc44b9a700 1 -- 172.21.15.72:0/3838696295 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc400b3540 con 0x7fdc400b2810 2023-08-25T04:46:49.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc4539b700 1 --2- 172.21.15.72:0/3838696295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400cb650 0x7fdc400cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:49.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc45b9c700 1 --2- 172.21.15.72:0/3838696295 >> v2:172.21.15.137:3300/0 conn(0x7fdc400b2c90 0x7fdc40070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:49.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.091+0000 7fdc44b9a700 1 --2- 172.21.15.72:0/3838696295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 0x7fdc40070990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc400b4730 tx=0x7fdc30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c6f8bb9ccd3748 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:49.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc37fff700 1 -- 172.21.15.72:0/3838696295 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3000b870 con 0x7fdc400b2810 2023-08-25T04:46:49.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc37fff700 1 -- 172.21.15.72:0/3838696295 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3000b9d0 con 0x7fdc400b2810 2023-08-25T04:46:49.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc37fff700 1 -- 172.21.15.72:0/3838696295 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3000bd60 con 0x7fdc400b2810 2023-08-25T04:46:49.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc475ff700 1 -- 172.21.15.72:0/3838696295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 msgr2=0x7fdc40070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc475ff700 1 --2- 172.21.15.72:0/3838696295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 0x7fdc40070990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc400b4730 tx=0x7fdc30009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc475ff700 1 -- 172.21.15.72:0/3838696295 shutdown_connections 2023-08-25T04:46:49.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc475ff700 1 --2- 172.21.15.72:0/3838696295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400cb650 0x7fdc400cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc475ff700 1 --2- 172.21.15.72:0/3838696295 >> v2:172.21.15.137:3300/0 conn(0x7fdc400b2c90 0x7fdc40070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc475ff700 1 --2- 172.21.15.72:0/3838696295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 0x7fdc40070990 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc475ff700 1 -- 172.21.15.72:0/3838696295 >> 172.21.15.72:0/3838696295 conn(0x7fdc4006a710 msgr2=0x7fdc4006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:49.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc475ff700 1 -- 172.21.15.72:0/3838696295 shutdown_connections 2023-08-25T04:46:49.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.092+0000 7fdc475ff700 1 -- 172.21.15.72:0/3838696295 wait complete. 2023-08-25T04:46:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.095+0000 7fdc475ff700 1 Processor -- start 2023-08-25T04:46:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.095+0000 7fdc475ff700 1 -- start start 2023-08-25T04:46:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.096+0000 7fdc475ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 0x7fdc40152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.096+0000 7fdc475ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400b2c90 0x7fdc40153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.096+0000 7fdc475ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc400cb650 0x7fdc400af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.096+0000 7fdc475ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc40155350 con 0x7fdc400b2810 2023-08-25T04:46:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.096+0000 7fdc475ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400aeb60 con 0x7fdc400cb650 2023-08-25T04:46:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.096+0000 7fdc475ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400ae5a0 con 0x7fdc400b2c90 2023-08-25T04:46:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.096+0000 7fdc4539b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 0x7fdc40152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.096+0000 7fdc4539b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 0x7fdc40152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47002/0 (socket says 172.21.15.72:47002) 2023-08-25T04:46:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.096+0000 7fdc4539b700 1 -- 172.21.15.72:0/3656456331 learned_addr learned my addr 172.21.15.72:0/3656456331 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc44b9a700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400b2c90 0x7fdc40153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc45b9c700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc400cb650 0x7fdc400af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc4539b700 1 -- 172.21.15.72:0/3656456331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400b2c90 msgr2=0x7fdc40153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc4539b700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400b2c90 0x7fdc40153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc4539b700 1 -- 172.21.15.72:0/3656456331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc400cb650 msgr2=0x7fdc400af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc4539b700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc400cb650 0x7fdc400af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc4539b700 1 -- 172.21.15.72:0/3656456331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc30009550 con 0x7fdc400b2810 2023-08-25T04:46:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc4539b700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 0x7fdc40152a50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00c750 tx=0x7fdc3c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc35ffb700 1 -- 172.21.15.72:0/3656456331 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c011800 con 0x7fdc400b2810 2023-08-25T04:46:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc35ffb700 1 -- 172.21.15.72:0/3656456331 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c011960 con 0x7fdc400b2810 2023-08-25T04:46:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc475ff700 1 -- 172.21.15.72:0/3656456331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc400ae880 con 0x7fdc400b2810 2023-08-25T04:46:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.097+0000 7fdc35ffb700 1 -- 172.21.15.72:0/3656456331 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c011cd0 con 0x7fdc400b2810 2023-08-25T04:46:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.098+0000 7fdc475ff700 1 -- 172.21.15.72:0/3656456331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc40155860 con 0x7fdc400b2810 2023-08-25T04:46:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.099+0000 7fdc475ff700 1 -- 172.21.15.72:0/3656456331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc40072320 con 0x7fdc400b2810 2023-08-25T04:46:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.100+0000 7fdc35ffb700 1 -- 172.21.15.72:0/3656456331 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdc3c021350 con 0x7fdc400b2810 2023-08-25T04:46:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.100+0000 7fdc35ffb700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc2406a0e0 0x7fdc2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.101+0000 7fdc35ffb700 1 -- 172.21.15.72:0/3656456331 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc3c0886f0 con 0x7fdc400b2810 2023-08-25T04:46:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.101+0000 7fdc44b9a700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc2406a0e0 0x7fdc2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.101+0000 7fdc44b9a700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc2406a0e0 0x7fdc2406c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc30014040 tx=0x7fdc30008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.105+0000 7fdc35ffb700 1 -- 172.21.15.72:0/3656456331 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdc3c057540 con 0x7fdc400b2810 2023-08-25T04:46:49.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.299+0000 7fdc475ff700 1 -- 172.21.15.72:0/3656456331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc400744f0 con 0x7fdc400b2810 2023-08-25T04:46:49.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.300+0000 7fdc35ffb700 1 -- 172.21.15.72:0/3656456331 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc3c0570d0 con 0x7fdc400b2810 2023-08-25T04:46:49.300 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:49.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 -- 172.21.15.72:0/3656456331 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc2406a0e0 msgr2=0x7fdc2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc2406a0e0 0x7fdc2406c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc30014040 tx=0x7fdc30008030 comp rx=0 tx=0).stop 2023-08-25T04:46:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 -- 172.21.15.72:0/3656456331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 msgr2=0x7fdc40152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 0x7fdc40152a50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00c750 tx=0x7fdc3c00ca60 comp rx=0 tx=0).stop 2023-08-25T04:46:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 -- 172.21.15.72:0/3656456331 shutdown_connections 2023-08-25T04:46:49.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdc2406a0e0 0x7fdc2406c5a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc400cb650 0x7fdc400af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc400b2810 0x7fdc40152a50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 --2- 172.21.15.72:0/3656456331 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdc400b2c90 0x7fdc40153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 -- 172.21.15.72:0/3656456331 >> 172.21.15.72:0/3656456331 conn(0x7fdc4006a710 msgr2=0x7fdc400cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:49.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 -- 172.21.15.72:0/3656456331 shutdown_connections 2023-08-25T04:46:49.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.302+0000 7fdc475ff700 1 -- 172.21.15.72:0/3656456331 wait complete. 2023-08-25T04:46:49.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:49.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.530+0000 7f8843dff700 1 Processor -- start 2023-08-25T04:46:49.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.531+0000 7f8843dff700 1 -- start start 2023-08-25T04:46:49.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.532+0000 7f8843dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c0b4f10 0x7f883c167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.532+0000 7f8843dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0b8d10 con 0x7f883c15d000 2023-08-25T04:46:49.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.532+0000 7f8843dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0b6e90 con 0x7f883c0d10c0 2023-08-25T04:46:49.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.532+0000 7f8843dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0b56f0 con 0x7f883c0b4f10 2023-08-25T04:46:49.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.532+0000 7f8841b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f883c15d000 0x7f883c0b8600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41770/0 (socket says 172.21.15.72:41770) 2023-08-25T04:46:49.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.532+0000 7f8841b9b700 1 -- 172.21.15.72:0/1050647221 learned_addr learned my addr 172.21.15.72:0/1050647221 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:49.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.532+0000 7f884239c700 1 --2- 172.21.15.72:0/1050647221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c0b4f10 0x7f883c167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.532+0000 7f8840b99700 1 -- 172.21.15.72:0/1050647221 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970169075 0 0) 0x7f883c0b8d10 con 0x7f883c15d000 2023-08-25T04:46:49.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f8840b99700 1 -- 172.21.15.72:0/1050647221 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88280035b0 con 0x7f883c15d000 2023-08-25T04:46:49.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f8840b99700 1 -- 172.21.15.72:0/1050647221 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234279422 0 0) 0x7f883c0b6e90 con 0x7f883c0d10c0 2023-08-25T04:46:49.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f8840b99700 1 -- 172.21.15.72:0/1050647221 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f883c0b8d10 con 0x7f883c0d10c0 2023-08-25T04:46:49.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f884239c700 1 -- 172.21.15.72:0/1050647221 >> v1:172.21.15.137:6789/0 conn(0x7f883c0d10c0 legacy=0x7f883c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f884239c700 1 -- 172.21.15.72:0/1050647221 >> v1:172.21.15.72:6789/0 conn(0x7f883c15d000 legacy=0x7f883c0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f8840b99700 1 -- 172.21.15.72:0/1050647221 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3365575354 0 0) 0x7f88280035b0 con 0x7f883c15d000 2023-08-25T04:46:49.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f884239c700 1 -- 172.21.15.72:0/1050647221 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c15d3e0 con 0x7f883c0b4f10 2023-08-25T04:46:49.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f884239c700 1 --2- 172.21.15.72:0/1050647221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c0b4f10 0x7f883c167be0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8834009dc0 tx=0x7f883400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=262e43c8360f9a46 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:49.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f8840b99700 1 -- 172.21.15.72:0/1050647221 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883400e070 con 0x7f883c0b4f10 2023-08-25T04:46:49.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f8840b99700 1 -- 172.21.15.72:0/1050647221 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8834003a20 con 0x7f883c0b4f10 2023-08-25T04:46:49.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.533+0000 7f8840b99700 1 -- 172.21.15.72:0/1050647221 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838001670 con 0x7f883c0b4f10 2023-08-25T04:46:49.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.534+0000 7f8843dff700 1 -- 172.21.15.72:0/1050647221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c0b4f10 msgr2=0x7f883c167be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.534+0000 7f8843dff700 1 --2- 172.21.15.72:0/1050647221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c0b4f10 0x7f883c167be0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8834009dc0 tx=0x7f883400b330 comp rx=0 tx=0).stop 2023-08-25T04:46:49.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.534+0000 7f8843dff700 1 -- 172.21.15.72:0/1050647221 shutdown_connections 2023-08-25T04:46:49.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.534+0000 7f8843dff700 1 --2- 172.21.15.72:0/1050647221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c0b4f10 0x7f883c167be0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.534+0000 7f8843dff700 1 -- 172.21.15.72:0/1050647221 >> 172.21.15.72:0/1050647221 conn(0x7f883c071e10 msgr2=0x7f883c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:49.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.534+0000 7f8843dff700 1 -- 172.21.15.72:0/1050647221 shutdown_connections 2023-08-25T04:46:49.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.534+0000 7f8843dff700 1 -- 172.21.15.72:0/1050647221 wait complete. 2023-08-25T04:46:49.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.536+0000 7f8843dff700 1 Processor -- start 2023-08-25T04:46:49.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.536+0000 7f8843dff700 1 -- start start 2023-08-25T04:46:49.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.537+0000 7f8843dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c0b4f10 0x7f883c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.537+0000 7f8843dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883c0d10c0 0x7f883c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.537+0000 7f8843dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c15d000 0x7f883c14df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.537+0000 7f8843dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0ca410 con 0x7f883c0d10c0 2023-08-25T04:46:49.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.537+0000 7f8843dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0ca6f0 con 0x7f883c0b4f10 2023-08-25T04:46:49.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.537+0000 7f8843dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0ca9d0 con 0x7f883c15d000 2023-08-25T04:46:49.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.537+0000 7f884139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883c0d10c0 0x7f883c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.537+0000 7f884139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883c0d10c0 0x7f883c0cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47014/0 (socket says 172.21.15.72:47014) 2023-08-25T04:46:49.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.537+0000 7f884139a700 1 -- 172.21.15.72:0/2392623403 learned_addr learned my addr 172.21.15.72:0/2392623403 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:49.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.537+0000 7f884239c700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c15d000 0x7f883c14df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f884139a700 1 -- 172.21.15.72:0/2392623403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c15d000 msgr2=0x7f883c14df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f884139a700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c15d000 0x7f883c14df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f884139a700 1 -- 172.21.15.72:0/2392623403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c0b4f10 msgr2=0x7f883c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f884139a700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c0b4f10 0x7f883c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f884139a700 1 -- 172.21.15.72:0/2392623403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8834009a70 con 0x7f883c0d10c0 2023-08-25T04:46:49.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f884139a700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883c0d10c0 0x7f883c0cdde0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f882c00c520 tx=0x7f882c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:49.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f88327fc700 1 -- 172.21.15.72:0/2392623403 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0052d0 con 0x7f883c0d10c0 2023-08-25T04:46:49.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f88327fc700 1 -- 172.21.15.72:0/2392623403 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c005430 con 0x7f883c0d10c0 2023-08-25T04:46:49.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f88327fc700 1 -- 172.21.15.72:0/2392623403 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0038a0 con 0x7f883c0d10c0 2023-08-25T04:46:49.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f8843dff700 1 -- 172.21.15.72:0/2392623403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c0cacb0 con 0x7f883c0d10c0 2023-08-25T04:46:49.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.538+0000 7f8843dff700 1 -- 172.21.15.72:0/2392623403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c14efe0 con 0x7f883c0d10c0 2023-08-25T04:46:49.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.539+0000 7f8843dff700 1 -- 172.21.15.72:0/2392623403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c14f170 con 0x7f883c0d10c0 2023-08-25T04:46:49.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.540+0000 7f88327fc700 1 -- 172.21.15.72:0/2392623403 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f882c003a00 con 0x7f883c0d10c0 2023-08-25T04:46:49.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.542+0000 7f88327fc700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f882006a0e0 0x7f882006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.542+0000 7f88327fc700 1 -- 172.21.15.72:0/2392623403 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f882c087e30 con 0x7f883c0d10c0 2023-08-25T04:46:49.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.542+0000 7f8841b9b700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f882006a0e0 0x7f882006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.542+0000 7f8841b9b700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f882006a0e0 0x7f882006c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f88380011e0 tx=0x7f8838001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:49.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.546+0000 7f88327fc700 1 -- 172.21.15.72:0/2392623403 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f883c14f170 con 0x7f883c0d10c0 2023-08-25T04:46:49.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.740+0000 7f8843dff700 1 -- 172.21.15.72:0/2392623403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f883c14f170 con 0x7f883c0d10c0 2023-08-25T04:46:49.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.740+0000 7f88327fc700 1 -- 172.21.15.72:0/2392623403 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f882c017020 con 0x7f883c0d10c0 2023-08-25T04:46:49.741 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:49.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 -- 172.21.15.72:0/2392623403 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f882006a0e0 msgr2=0x7f882006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f882006a0e0 0x7f882006c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f88380011e0 tx=0x7f8838001230 comp rx=0 tx=0).stop 2023-08-25T04:46:49.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 -- 172.21.15.72:0/2392623403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883c0d10c0 msgr2=0x7f883c0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883c0d10c0 0x7f883c0cdde0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f882c00c520 tx=0x7f882c00c830 comp rx=0 tx=0).stop 2023-08-25T04:46:49.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 -- 172.21.15.72:0/2392623403 shutdown_connections 2023-08-25T04:46:49.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f882006a0e0 0x7f882006c5a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f883c15d000 0x7f883c14df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c0b4f10 0x7f883c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 --2- 172.21.15.72:0/2392623403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883c0d10c0 0x7f883c0cdde0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 -- 172.21.15.72:0/2392623403 >> 172.21.15.72:0/2392623403 conn(0x7f883c071e10 msgr2=0x7f883c0b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:49.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 -- 172.21.15.72:0/2392623403 shutdown_connections 2023-08-25T04:46:49.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.742+0000 7f8843dff700 1 -- 172.21.15.72:0/2392623403 wait complete. 2023-08-25T04:46:49.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:49.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.965+0000 7f83f61ff700 1 Processor -- start 2023-08-25T04:46:49.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.965+0000 7f83f61ff700 1 -- start start 2023-08-25T04:46:49.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.966+0000 7f83f61ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83f00c71b0 0x7f83f00cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.966+0000 7f83f61ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83f00ce080 0x7f83f015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.966+0000 7f83f61ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f00cba40 con 0x7f83f00cd4f0 2023-08-25T04:46:49.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.966+0000 7f83f61ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f00d04f0 con 0x7f83f00c71b0 2023-08-25T04:46:49.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.966+0000 7f83f61ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00d0210 con 0x7f83f00ce080 2023-08-25T04:46:49.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.966+0000 7f83ef7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83f00c71b0 0x7f83f00cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.966+0000 7f83eeffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83f00cd4f0 0x7f83f00cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41780/0 (socket says 172.21.15.72:41780) 2023-08-25T04:46:49.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83eeffd700 1 -- 172.21.15.72:0/851953521 learned_addr learned my addr 172.21.15.72:0/851953521 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:49.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83effff700 1 --2- 172.21.15.72:0/851953521 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83f00ce080 0x7f83f015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83ee7fc700 1 -- 172.21.15.72:0/851953521 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586736899 0 0) 0x7f83f00cba40 con 0x7f83f00cd4f0 2023-08-25T04:46:49.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83ef7fe700 1 -- 172.21.15.72:0/851953521 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83f00ce080 msgr2=0x7f83f015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:49.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83ef7fe700 1 --2- 172.21.15.72:0/851953521 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83f00ce080 0x7f83f015c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83ef7fe700 1 -- 172.21.15.72:0/851953521 >> v1:172.21.15.72:6789/0 conn(0x7f83f00cd4f0 legacy=0x7f83f00cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83ef7fe700 1 -- 172.21.15.72:0/851953521 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f00cb3f0 con 0x7f83f00c71b0 2023-08-25T04:46:49.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83ef7fe700 1 --2- 172.21.15.72:0/851953521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 0x7f83f00cf9c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009840 tx=0x7f83e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c480f286c9876a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:49.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83ee7fc700 1 -- 172.21.15.72:0/851953521 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0011830 con 0x7f83f00c71b0 2023-08-25T04:46:49.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83ee7fc700 1 -- 172.21.15.72:0/851953521 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0011990 con 0x7f83f00c71b0 2023-08-25T04:46:49.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.967+0000 7f83ee7fc700 1 -- 172.21.15.72:0/851953521 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0011d20 con 0x7f83f00c71b0 2023-08-25T04:46:49.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.968+0000 7f83f61ff700 1 -- 172.21.15.72:0/851953521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 msgr2=0x7f83f00cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.968+0000 7f83f61ff700 1 --2- 172.21.15.72:0/851953521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 0x7f83f00cf9c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009840 tx=0x7f83e0009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:49.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.968+0000 7f83f61ff700 1 -- 172.21.15.72:0/851953521 shutdown_connections 2023-08-25T04:46:49.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.968+0000 7f83f61ff700 1 --2- 172.21.15.72:0/851953521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 0x7f83f00cf9c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.968+0000 7f83f61ff700 1 --2- 172.21.15.72:0/851953521 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83f00ce080 0x7f83f015c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.968+0000 7f83f61ff700 1 -- 172.21.15.72:0/851953521 >> 172.21.15.72:0/851953521 conn(0x7f83f00d0c70 msgr2=0x7f83f00d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:49.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.968+0000 7f83f61ff700 1 -- 172.21.15.72:0/851953521 shutdown_connections 2023-08-25T04:46:49.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.968+0000 7f83f61ff700 1 -- 172.21.15.72:0/851953521 wait complete. 2023-08-25T04:46:49.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.970+0000 7f83f61ff700 1 Processor -- start 2023-08-25T04:46:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.970+0000 7f83f61ff700 1 -- start start 2023-08-25T04:46:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83f61ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 0x7f83f0156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83f61ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83f00cd4f0 0x7f83f00d1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83f61ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83f00ce080 0x7f83f00d1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83f61ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f0158960 con 0x7f83f00c71b0 2023-08-25T04:46:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83f61ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00c8fe0 con 0x7f83f00ce080 2023-08-25T04:46:49.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83f61ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00c92c0 con 0x7f83f00cd4f0 2023-08-25T04:46:49.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 0x7f83f0156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 0x7f83f0156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47026/0 (socket says 172.21.15.72:47026) 2023-08-25T04:46:49.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83ef7fe700 1 -- 172.21.15.72:0/4192685648 learned_addr learned my addr 172.21.15.72:0/4192685648 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:49.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83eeffd700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83f00cd4f0 0x7f83f00d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83effff700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83f00ce080 0x7f83f00d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83ef7fe700 1 -- 172.21.15.72:0/4192685648 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83f00cd4f0 msgr2=0x7f83f00d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83ef7fe700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83f00cd4f0 0x7f83f00d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83ef7fe700 1 -- 172.21.15.72:0/4192685648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83f00ce080 msgr2=0x7f83f00d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:49.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83ef7fe700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83f00ce080 0x7f83f00d1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:49.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.971+0000 7f83ef7fe700 1 -- 172.21.15.72:0/4192685648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e00094a0 con 0x7f83f00c71b0 2023-08-25T04:46:49.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.972+0000 7f83ef7fe700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 0x7f83f0156360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f83e0014040 tx=0x7f83e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:49.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.972+0000 7f83d7fff700 1 -- 172.21.15.72:0/4192685648 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00038a0 con 0x7f83f00c71b0 2023-08-25T04:46:49.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.972+0000 7f83d7fff700 1 -- 172.21.15.72:0/4192685648 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e001e070 con 0x7f83f00c71b0 2023-08-25T04:46:49.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.972+0000 7f83f61ff700 1 -- 172.21.15.72:0/4192685648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f00c95a0 con 0x7f83f00c71b0 2023-08-25T04:46:49.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.972+0000 7f83d7fff700 1 -- 172.21.15.72:0/4192685648 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0003c20 con 0x7f83f00c71b0 2023-08-25T04:46:49.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.972+0000 7f83f61ff700 1 -- 172.21.15.72:0/4192685648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f00c82b0 con 0x7f83f00c71b0 2023-08-25T04:46:49.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.973+0000 7f83f61ff700 1 -- 172.21.15.72:0/4192685648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f00cb090 con 0x7f83f00c71b0 2023-08-25T04:46:49.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.974+0000 7f83d7fff700 1 -- 172.21.15.72:0/4192685648 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f83e002d450 con 0x7f83f00c71b0 2023-08-25T04:46:49.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.975+0000 7f83d7fff700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f83dc06a0e0 0x7f83dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:49.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.975+0000 7f83d7fff700 1 -- 172.21.15.72:0/4192685648 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f83e00899c0 con 0x7f83f00c71b0 2023-08-25T04:46:49.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.975+0000 7f83eeffd700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f83dc06a0e0 0x7f83dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:49.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.976+0000 7f83eeffd700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f83dc06a0e0 0x7f83dc06c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f83f01568a0 tx=0x7f83e4007be0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:49.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:49.979+0000 7f83d7fff700 1 -- 172.21.15.72:0/4192685648 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f83e0054d70 con 0x7f83f00c71b0 2023-08-25T04:46:50.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.177+0000 7f83f61ff700 1 -- 172.21.15.72:0/4192685648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f83f009ebb0 con 0x7f83f00c71b0 2023-08-25T04:46:50.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.177+0000 7f83d7fff700 1 -- 172.21.15.72:0/4192685648 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f83e0058390 con 0x7f83f00c71b0 2023-08-25T04:46:50.178 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 -- 172.21.15.72:0/4192685648 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f83dc06a0e0 msgr2=0x7f83dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:50.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f83dc06a0e0 0x7f83dc06c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f83f01568a0 tx=0x7f83e4007be0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 -- 172.21.15.72:0/4192685648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 msgr2=0x7f83f0156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:50.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 0x7f83f0156360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f83e0014040 tx=0x7f83e0004750 comp rx=0 tx=0).stop 2023-08-25T04:46:50.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 -- 172.21.15.72:0/4192685648 shutdown_connections 2023-08-25T04:46:50.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f83dc06a0e0 0x7f83dc06c5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83f00ce080 0x7f83f00d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f00c71b0 0x7f83f0156360 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 --2- 172.21.15.72:0/4192685648 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83f00cd4f0 0x7f83f00d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 -- 172.21.15.72:0/4192685648 >> 172.21.15.72:0/4192685648 conn(0x7f83f00d0c70 msgr2=0x7f83f00c4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:50.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 -- 172.21.15.72:0/4192685648 shutdown_connections 2023-08-25T04:46:50.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.180+0000 7f83f61ff700 1 -- 172.21.15.72:0/4192685648 wait complete. 2023-08-25T04:46:50.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:46:50.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.397+0000 7fb4af7ff700 1 Processor -- start 2023-08-25T04:46:50.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.398+0000 7fb4af7ff700 1 -- start start 2023-08-25T04:46:50.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4af7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4a8070890 0x7fb4a80ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4af7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a80b0f50 0x7fb4a80ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4af7ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a80b1870 con 0x7fb4a8159ff0 2023-08-25T04:46:50.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4af7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a80b46a0 con 0x7fb4a8070890 2023-08-25T04:46:50.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4af7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a8070de0 con 0x7fb4a80b0f50 2023-08-25T04:46:50.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4acd9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4a8070890 0x7fb4a80ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4acd9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4a8070890 0x7fb4a80ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47042/0 (socket says 172.21.15.72:47042) 2023-08-25T04:46:50.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4acd9a700 1 -- 172.21.15.72:0/2878367765 learned_addr learned my addr 172.21.15.72:0/2878367765 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:50.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4add9c700 1 --2- 172.21.15.72:0/2878367765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a80b0f50 0x7fb4a80ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4acd9a700 1 -- 172.21.15.72:0/2878367765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a80b0f50 msgr2=0x7fb4a80ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:50.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4acd9a700 1 --2- 172.21.15.72:0/2878367765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a80b0f50 0x7fb4a80ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.399+0000 7fb4acd9a700 1 -- 172.21.15.72:0/2878367765 >> v1:172.21.15.137:6789/0 conn(0x7fb4a8159ff0 legacy=0x7fb4a80b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:50.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.400+0000 7fb4acd9a700 1 -- 172.21.15.72:0/2878367765 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a80710c0 con 0x7fb4a8070890 2023-08-25T04:46:50.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.400+0000 7fb4acd9a700 1 --2- 172.21.15.72:0/2878367765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 0x7fb4a80ca980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb49800bb90 tx=0x7fb49800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7d34b9842d8e90 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:50.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.400+0000 7fb49ffff700 1 -- 172.21.15.72:0/2878367765 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49800dd50 con 0x7fb4a8070890 2023-08-25T04:46:50.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.400+0000 7fb49ffff700 1 -- 172.21.15.72:0/2878367765 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb498010470 con 0x7fb4a8070890 2023-08-25T04:46:50.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.400+0000 7fb49ffff700 1 -- 172.21.15.72:0/2878367765 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498010800 con 0x7fb4a8070890 2023-08-25T04:46:50.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.401+0000 7fb4af7ff700 1 -- 172.21.15.72:0/2878367765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 msgr2=0x7fb4a80ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:50.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.401+0000 7fb4af7ff700 1 --2- 172.21.15.72:0/2878367765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 0x7fb4a80ca980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb49800bb90 tx=0x7fb49800bea0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.401+0000 7fb4af7ff700 1 -- 172.21.15.72:0/2878367765 shutdown_connections 2023-08-25T04:46:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.401+0000 7fb4af7ff700 1 --2- 172.21.15.72:0/2878367765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a80b0f50 0x7fb4a80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.401+0000 7fb4af7ff700 1 --2- 172.21.15.72:0/2878367765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 0x7fb4a80ca980 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.401+0000 7fb4af7ff700 1 -- 172.21.15.72:0/2878367765 >> 172.21.15.72:0/2878367765 conn(0x7fb4a80ce9a0 msgr2=0x7fb4a80ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.401+0000 7fb4af7ff700 1 -- 172.21.15.72:0/2878367765 shutdown_connections 2023-08-25T04:46:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.401+0000 7fb4af7ff700 1 -- 172.21.15.72:0/2878367765 wait complete. 2023-08-25T04:46:50.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.402+0000 7fb4af7ff700 1 Processor -- start 2023-08-25T04:46:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.403+0000 7fb4af7ff700 1 -- start start 2023-08-25T04:46:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.403+0000 7fb4af7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 0x7fb4a81f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.403+0000 7fb4af7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a80b0f50 0x7fb4a81ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.403+0000 7fb4af7ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8159ff0 0x7fb4a8154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.403+0000 7fb4af7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81ef2e0 con 0x7fb4a8070890 2023-08-25T04:46:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.403+0000 7fb4af7ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81ee830 con 0x7fb4a8159ff0 2023-08-25T04:46:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.403+0000 7fb4af7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81eea40 con 0x7fb4a80b0f50 2023-08-25T04:46:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4ad59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 0x7fb4a81f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4ad59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 0x7fb4a81f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47052/0 (socket says 172.21.15.72:47052) 2023-08-25T04:46:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4ad59b700 1 -- 172.21.15.72:0/433376627 learned_addr learned my addr 172.21.15.72:0/433376627 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4acd9a700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a80b0f50 0x7fb4a81ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4add9c700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8159ff0 0x7fb4a8154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4ad59b700 1 -- 172.21.15.72:0/433376627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a80b0f50 msgr2=0x7fb4a81ee2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4ad59b700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a80b0f50 0x7fb4a81ee2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4ad59b700 1 -- 172.21.15.72:0/433376627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8159ff0 msgr2=0x7fb4a8154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4ad59b700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8159ff0 0x7fb4a8154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4ad59b700 1 -- 172.21.15.72:0/433376627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49800b7f0 con 0x7fb4a8070890 2023-08-25T04:46:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.404+0000 7fb4ad59b700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 0x7fb4a81f2340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400c450 tx=0x7fb4a400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.405+0000 7fb49dffb700 1 -- 172.21.15.72:0/433376627 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a40052d0 con 0x7fb4a8070890 2023-08-25T04:46:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.405+0000 7fb49dffb700 1 -- 172.21.15.72:0/433376627 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a4005430 con 0x7fb4a8070890 2023-08-25T04:46:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.405+0000 7fb49dffb700 1 -- 172.21.15.72:0/433376627 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a40038c0 con 0x7fb4a8070890 2023-08-25T04:46:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.405+0000 7fb4af7ff700 1 -- 172.21.15.72:0/433376627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a81eed20 con 0x7fb4a8070890 2023-08-25T04:46:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.405+0000 7fb4af7ff700 1 -- 172.21.15.72:0/433376627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a80c5b80 con 0x7fb4a8070890 2023-08-25T04:46:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.406+0000 7fb4af7ff700 1 -- 172.21.15.72:0/433376627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a80c59e0 con 0x7fb4a8070890 2023-08-25T04:46:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.407+0000 7fb49dffb700 1 -- 172.21.15.72:0/433376627 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb4a4003a20 con 0x7fb4a8070890 2023-08-25T04:46:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.407+0000 7fb49dffb700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb48c06a0e0 0x7fb48c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.408+0000 7fb49dffb700 1 -- 172.21.15.72:0/433376627 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb4a4087d10 con 0x7fb4a8070890 2023-08-25T04:46:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.408+0000 7fb4acd9a700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb48c06a0e0 0x7fb48c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.408+0000 7fb4acd9a700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb48c06a0e0 0x7fb48c06c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb49800bee0 tx=0x7fb498013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.412+0000 7fb49dffb700 1 -- 172.21.15.72:0/433376627 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb4a80c59e0 con 0x7fb4a8070890 2023-08-25T04:46:50.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.623+0000 7fb4af7ff700 1 -- 172.21.15.72:0/433376627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb4a80c59e0 con 0x7fb4a8070890 2023-08-25T04:46:50.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.624+0000 7fb49dffb700 1 -- 172.21.15.72:0/433376627 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb4a80c59e0 con 0x7fb4a8070890 2023-08-25T04:46:50.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 -- 172.21.15.72:0/433376627 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb48c06a0e0 msgr2=0x7fb48c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:50.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb48c06a0e0 0x7fb48c06c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb49800bee0 tx=0x7fb498013000 comp rx=0 tx=0).stop 2023-08-25T04:46:50.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 -- 172.21.15.72:0/433376627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 msgr2=0x7fb4a81f2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:50.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 0x7fb4a81f2340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400c450 tx=0x7fb4a400c760 comp rx=0 tx=0).stop 2023-08-25T04:46:50.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 -- 172.21.15.72:0/433376627 shutdown_connections 2023-08-25T04:46:50.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb48c06a0e0 0x7fb48c06c5a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4a8159ff0 0x7fb4a8154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4a8070890 0x7fb4a81f2340 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 --2- 172.21.15.72:0/433376627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4a80b0f50 0x7fb4a81ee2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 -- 172.21.15.72:0/433376627 >> 172.21.15.72:0/433376627 conn(0x7fb4a80ce9a0 msgr2=0x7fb4a80b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 -- 172.21.15.72:0/433376627 shutdown_connections 2023-08-25T04:46:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.626+0000 7fb4af7ff700 1 -- 172.21.15.72:0/433376627 wait complete. 2023-08-25T04:46:50.629 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-08-25T04:46:50.644 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:46:50.645 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:46:50.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:50.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.897+0000 7f8ec81ff700 1 Processor -- start 2023-08-25T04:46:50.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.897+0000 7f8ec81ff700 1 -- start start 2023-08-25T04:46:50.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.898+0000 7f8ec81ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8ec015d040 0x7f8ec00ca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.898+0000 7f8ec81ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ec00cd820 0x7f8ec01616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.898+0000 7f8ec81ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec00ce9f0 con 0x7f8ec006a2f0 2023-08-25T04:46:50.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.898+0000 7f8ec81ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec0161c00 con 0x7f8ec00cd820 2023-08-25T04:46:50.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.898+0000 7f8ec81ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec00cdde0 con 0x7f8ec015d040 2023-08-25T04:46:50.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.899+0000 7f8ec579a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ec00cd820 0x7f8ec01616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.899+0000 7f8ec579a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ec00cd820 0x7f8ec01616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47066/0 (socket says 172.21.15.72:47066) 2023-08-25T04:46:50.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.899+0000 7f8ec579a700 1 -- 172.21.15.72:0/3974705126 learned_addr learned my addr 172.21.15.72:0/3974705126 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:50.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.899+0000 7f8ec5f9b700 1 --2- 172.21.15.72:0/3974705126 >> v2:172.21.15.137:3300/0 conn(0x7f8ec015d040 0x7f8ec00ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.899+0000 7f8ec579a700 1 -- 172.21.15.72:0/3974705126 >> v2:172.21.15.137:3300/0 conn(0x7f8ec015d040 msgr2=0x7f8ec00ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:50.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.899+0000 7f8ec579a700 1 --2- 172.21.15.72:0/3974705126 >> v2:172.21.15.137:3300/0 conn(0x7f8ec015d040 0x7f8ec00ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.899+0000 7f8ec579a700 1 -- 172.21.15.72:0/3974705126 >> v1:172.21.15.137:6789/0 conn(0x7f8ec006a2f0 legacy=0x7f8ec00cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:50.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.899+0000 7f8ec579a700 1 -- 172.21.15.72:0/3974705126 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec00ce0c0 con 0x7f8ec00cd820 2023-08-25T04:46:50.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.899+0000 7f8ec5f9b700 1 --2- 172.21.15.72:0/3974705126 >> v2:172.21.15.137:3300/0 conn(0x7f8ec015d040 0x7f8ec00ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:50.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.899+0000 7f8ec579a700 1 --2- 172.21.15.72:0/3974705126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec00cd820 0x7f8ec01616c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8ec006d320 tx=0x7f8eb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69725e04012ced90 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:50.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec4f99700 1 -- 172.21.15.72:0/3974705126 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0004230 con 0x7f8ec00cd820 2023-08-25T04:46:50.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec4f99700 1 -- 172.21.15.72:0/3974705126 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb0004390 con 0x7f8ec00cd820 2023-08-25T04:46:50.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec4f99700 1 -- 172.21.15.72:0/3974705126 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb00036a0 con 0x7f8ec00cd820 2023-08-25T04:46:50.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec81ff700 1 -- 172.21.15.72:0/3974705126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec00cd820 msgr2=0x7f8ec01616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:50.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec81ff700 1 --2- 172.21.15.72:0/3974705126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec00cd820 0x7f8ec01616c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8ec006d320 tx=0x7f8eb0009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec81ff700 1 -- 172.21.15.72:0/3974705126 shutdown_connections 2023-08-25T04:46:50.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec81ff700 1 --2- 172.21.15.72:0/3974705126 >> v2:172.21.15.137:3300/0 conn(0x7f8ec015d040 0x7f8ec00ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec81ff700 1 --2- 172.21.15.72:0/3974705126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec00cd820 0x7f8ec01616c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec81ff700 1 -- 172.21.15.72:0/3974705126 >> 172.21.15.72:0/3974705126 conn(0x7f8ec006db30 msgr2=0x7f8ec006df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:50.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec81ff700 1 -- 172.21.15.72:0/3974705126 shutdown_connections 2023-08-25T04:46:50.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.900+0000 7f8ec81ff700 1 -- 172.21.15.72:0/3974705126 wait complete. 2023-08-25T04:46:50.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.902+0000 7f8ec81ff700 1 Processor -- start 2023-08-25T04:46:50.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.902+0000 7f8ec81ff700 1 -- start start 2023-08-25T04:46:50.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec81ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ec006a2f0 0x7f8ec00c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec81ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ec00cd820 0x7f8ec015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec81ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec015d040 0x7f8ec00b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec81ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00c7d10 con 0x7f8ec015d040 2023-08-25T04:46:50.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec81ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00c9710 con 0x7f8ec00cd820 2023-08-25T04:46:50.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec81ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00c91b0 con 0x7f8ec006a2f0 2023-08-25T04:46:50.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec679c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec015d040 0x7f8ec00b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec679c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec015d040 0x7f8ec00b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47068/0 (socket says 172.21.15.72:47068) 2023-08-25T04:46:50.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec679c700 1 -- 172.21.15.72:0/631824646 learned_addr learned my addr 172.21.15.72:0/631824646 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:50.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec5f9b700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ec006a2f0 0x7f8ec00c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.903+0000 7f8ec579a700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ec00cd820 0x7f8ec015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8ec679c700 1 -- 172.21.15.72:0/631824646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ec006a2f0 msgr2=0x7f8ec00c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:50.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8ec679c700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ec006a2f0 0x7f8ec00c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8ec679c700 1 -- 172.21.15.72:0/631824646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ec00cd820 msgr2=0x7f8ec015a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:50.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8ec679c700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ec00cd820 0x7f8ec015a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:50.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8ec679c700 1 -- 172.21.15.72:0/631824646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0009550 con 0x7f8ec015d040 2023-08-25T04:46:50.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8ec679c700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec015d040 0x7f8ec00b3f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800cc40 tx=0x7f8eb800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:50.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8eb67fc700 1 -- 172.21.15.72:0/631824646 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800ab30 con 0x7f8ec015d040 2023-08-25T04:46:50.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8eb67fc700 1 -- 172.21.15.72:0/631824646 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb800ac90 con 0x7f8ec015d040 2023-08-25T04:46:50.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8ec81ff700 1 -- 172.21.15.72:0/631824646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec00c8ed0 con 0x7f8ec015d040 2023-08-25T04:46:50.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8eb67fc700 1 -- 172.21.15.72:0/631824646 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8012420 con 0x7f8ec015d040 2023-08-25T04:46:50.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.904+0000 7f8ec81ff700 1 -- 172.21.15.72:0/631824646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec00c7930 con 0x7f8ec015d040 2023-08-25T04:46:50.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.905+0000 7f8ec81ff700 1 -- 172.21.15.72:0/631824646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec00c7e50 con 0x7f8ec015d040 2023-08-25T04:46:50.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.906+0000 7f8eb67fc700 1 -- 172.21.15.72:0/631824646 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8eb8012580 con 0x7f8ec015d040 2023-08-25T04:46:50.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.907+0000 7f8eb67fc700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8ea406a0e0 0x7f8ea406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:50.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.907+0000 7f8eb67fc700 1 -- 172.21.15.72:0/631824646 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8eb8088f70 con 0x7f8ec015d040 2023-08-25T04:46:50.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.907+0000 7f8ec5f9b700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8ea406a0e0 0x7f8ea406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:50.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.908+0000 7f8ec5f9b700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8ea406a0e0 0x7f8ea406c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc006fd0 tx=0x7f8ebc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:50.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:50.911+0000 7f8eb67fc700 1 -- 172.21.15.72:0/631824646 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8eb8054320 con 0x7f8ec015d040 2023-08-25T04:46:51.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.111+0000 7f8ec81ff700 1 -- 172.21.15.72:0/631824646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ec004e620 con 0x7f8ec015d040 2023-08-25T04:46:51.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.112+0000 7f8eb67fc700 1 -- 172.21.15.72:0/631824646 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f8eb8016020 con 0x7f8ec015d040 2023-08-25T04:46:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:51.113 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:51.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 -- 172.21.15.72:0/631824646 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8ea406a0e0 msgr2=0x7f8ea406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8ea406a0e0 0x7f8ea406c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc006fd0 tx=0x7f8ebc008040 comp rx=0 tx=0).stop 2023-08-25T04:46:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 -- 172.21.15.72:0/631824646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec015d040 msgr2=0x7f8ec00b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec015d040 0x7f8ec00b3f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800cc40 tx=0x7f8eb800cf50 comp rx=0 tx=0).stop 2023-08-25T04:46:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 -- 172.21.15.72:0/631824646 shutdown_connections 2023-08-25T04:46:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8ea406a0e0 0x7f8ea406c5a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec015d040 0x7f8ec00b3f70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ec006a2f0 0x7f8ec00c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 --2- 172.21.15.72:0/631824646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ec00cd820 0x7f8ec015a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 -- 172.21.15.72:0/631824646 >> 172.21.15.72:0/631824646 conn(0x7f8ec006db30 msgr2=0x7f8ec015b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 -- 172.21.15.72:0/631824646 shutdown_connections 2023-08-25T04:46:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.115+0000 7f8ec81ff700 1 -- 172.21.15.72:0/631824646 wait complete. 2023-08-25T04:46:51.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:51.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:51.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.335+0000 7f231d1ff700 1 Processor -- start 2023-08-25T04:46:51.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.335+0000 7f231d1ff700 1 -- start start 2023-08-25T04:46:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.336+0000 7f231d1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 0x7f23180cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.336+0000 7f231d1ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f23180cbb90 0x7f231815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.336+0000 7f231d1ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180cbfe0 con 0x7f2318150ac0 2023-08-25T04:46:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.336+0000 7f231d1ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180af490 con 0x7f23180cbb90 2023-08-25T04:46:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.336+0000 7f231d1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231815d7c0 con 0x7f2318150ea0 2023-08-25T04:46:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.337+0000 7f231659c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 0x7f23180cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.337+0000 7f231759e700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f23180cbb90 0x7f231815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.337+0000 7f2316d9d700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2318150ac0 0x7f231815def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:52398/0 (socket says 172.21.15.72:52398) 2023-08-25T04:46:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.337+0000 7f2316d9d700 1 -- 172.21.15.72:0/3032706369 learned_addr learned my addr 172.21.15.72:0/3032706369 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.337+0000 7f231659c700 1 -- 172.21.15.72:0/3032706369 >> v2:172.21.15.137:3300/0 conn(0x7f23180cbb90 msgr2=0x7f231815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.337+0000 7f231659c700 1 --2- 172.21.15.72:0/3032706369 >> v2:172.21.15.137:3300/0 conn(0x7f23180cbb90 0x7f231815a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.337+0000 7f2315d9b700 1 -- 172.21.15.72:0/3032706369 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142590599 0 0) 0x7f2308001110 con 0x7f2318150ac0 2023-08-25T04:46:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.337+0000 7f231659c700 1 -- 172.21.15.72:0/3032706369 >> v1:172.21.15.137:6789/0 conn(0x7f2318150ac0 legacy=0x7f231815def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.337+0000 7f231659c700 1 -- 172.21.15.72:0/3032706369 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180aebf0 con 0x7f2318150ea0 2023-08-25T04:46:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.337+0000 7f231659c700 1 --2- 172.21.15.72:0/3032706369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 0x7f23180cb650 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f230c009840 tx=0x7f230c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431035852e13d2d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f2315d9b700 1 -- 172.21.15.72:0/3032706369 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c011830 con 0x7f2318150ea0 2023-08-25T04:46:51.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f2315d9b700 1 -- 172.21.15.72:0/3032706369 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c011990 con 0x7f2318150ea0 2023-08-25T04:46:51.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f2315d9b700 1 -- 172.21.15.72:0/3032706369 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c011d20 con 0x7f2318150ea0 2023-08-25T04:46:51.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f231d1ff700 1 -- 172.21.15.72:0/3032706369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 msgr2=0x7f23180cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f231d1ff700 1 --2- 172.21.15.72:0/3032706369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 0x7f23180cb650 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f230c009840 tx=0x7f230c009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:51.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f231d1ff700 1 -- 172.21.15.72:0/3032706369 shutdown_connections 2023-08-25T04:46:51.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f231d1ff700 1 --2- 172.21.15.72:0/3032706369 >> v2:172.21.15.137:3300/0 conn(0x7f23180cbb90 0x7f231815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f231d1ff700 1 --2- 172.21.15.72:0/3032706369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 0x7f23180cb650 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f231d1ff700 1 -- 172.21.15.72:0/3032706369 >> 172.21.15.72:0/3032706369 conn(0x7f231806a710 msgr2=0x7f231806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:51.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f231d1ff700 1 -- 172.21.15.72:0/3032706369 shutdown_connections 2023-08-25T04:46:51.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.338+0000 7f231d1ff700 1 -- 172.21.15.72:0/3032706369 wait complete. 2023-08-25T04:46:51.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.340+0000 7f231d1ff700 1 Processor -- start 2023-08-25T04:46:51.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.340+0000 7f231d1ff700 1 -- start start 2023-08-25T04:46:51.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.341+0000 7f231d1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23180cbb90 0x7f2318158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.341+0000 7f231d1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2318150ac0 0x7f23181f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.341+0000 7f231d1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 0x7f23181f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.341+0000 7f231d1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318141de0 con 0x7f2318150ac0 2023-08-25T04:46:51.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.341+0000 7f231d1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181528d0 con 0x7f23180cbb90 2023-08-25T04:46:51.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.341+0000 7f231d1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2318141b00 con 0x7f2318150ea0 2023-08-25T04:46:51.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f231659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2318150ac0 0x7f23181f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f231659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2318150ac0 0x7f23181f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47070/0 (socket says 172.21.15.72:47070) 2023-08-25T04:46:51.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f231659c700 1 -- 172.21.15.72:0/3371860446 learned_addr learned my addr 172.21.15.72:0/3371860446 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:51.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f231759e700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 0x7f23181f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f2316d9d700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23180cbb90 0x7f2318158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f231659c700 1 -- 172.21.15.72:0/3371860446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 msgr2=0x7f23181f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f231659c700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 0x7f23181f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f231659c700 1 -- 172.21.15.72:0/3371860446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23180cbb90 msgr2=0x7f2318158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f231659c700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23180cbb90 0x7f2318158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f231659c700 1 -- 172.21.15.72:0/3371860446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0094a0 con 0x7f2318150ac0 2023-08-25T04:46:51.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f2316d9d700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23180cbb90 0x7f2318158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:51.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.342+0000 7f231659c700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2318150ac0 0x7f23181f51b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f230c014040 tx=0x7f230c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:51.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.343+0000 7f22ff7fe700 1 -- 172.21.15.72:0/3371860446 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c0036a0 con 0x7f2318150ac0 2023-08-25T04:46:51.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.343+0000 7f22ff7fe700 1 -- 172.21.15.72:0/3371860446 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c01f070 con 0x7f2318150ac0 2023-08-25T04:46:51.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.343+0000 7f231d1ff700 1 -- 172.21.15.72:0/3371860446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2318152b50 con 0x7f2318150ac0 2023-08-25T04:46:51.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.343+0000 7f22ff7fe700 1 -- 172.21.15.72:0/3371860446 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c003a20 con 0x7f2318150ac0 2023-08-25T04:46:51.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.343+0000 7f231d1ff700 1 -- 172.21.15.72:0/3371860446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2318153110 con 0x7f2318150ac0 2023-08-25T04:46:51.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.344+0000 7f231d1ff700 1 -- 172.21.15.72:0/3371860446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318072320 con 0x7f2318150ac0 2023-08-25T04:46:51.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.345+0000 7f22ff7fe700 1 -- 172.21.15.72:0/3371860446 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f230c003b80 con 0x7f2318150ac0 2023-08-25T04:46:51.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.346+0000 7f22ff7fe700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f230406a0e0 0x7f230406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.346+0000 7f22ff7fe700 1 -- 172.21.15.72:0/3371860446 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f230c021070 con 0x7f2318150ac0 2023-08-25T04:46:51.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.346+0000 7f2316d9d700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f230406a0e0 0x7f230406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.346+0000 7f2316d9d700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f230406a0e0 0x7f230406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2308000f60 tx=0x7f2308007ae0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:51.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.350+0000 7f22ff7fe700 1 -- 172.21.15.72:0/3371860446 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f230c0554d0 con 0x7f2318150ac0 2023-08-25T04:46:51.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.546+0000 7f231d1ff700 1 -- 172.21.15.72:0/3371860446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f231815d3c0 con 0x7f2318150ac0 2023-08-25T04:46:51.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.547+0000 7f22ff7fe700 1 -- 172.21.15.72:0/3371860446 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f230c0150a0 con 0x7f2318150ac0 2023-08-25T04:46:51.548 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 -- 172.21.15.72:0/3371860446 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f230406a0e0 msgr2=0x7f230406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f230406a0e0 0x7f230406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2308000f60 tx=0x7f2308007ae0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 -- 172.21.15.72:0/3371860446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2318150ac0 msgr2=0x7f23181f51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2318150ac0 0x7f23181f51b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f230c014040 tx=0x7f230c004750 comp rx=0 tx=0).stop 2023-08-25T04:46:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 -- 172.21.15.72:0/3371860446 shutdown_connections 2023-08-25T04:46:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f230406a0e0 0x7f230406c5a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2318150ea0 0x7f23181f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23180cbb90 0x7f2318158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 --2- 172.21.15.72:0/3371860446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2318150ac0 0x7f23181f51b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 -- 172.21.15.72:0/3371860446 >> 172.21.15.72:0/3371860446 conn(0x7f231806a710 msgr2=0x7f23180c19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:51.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 -- 172.21.15.72:0/3371860446 shutdown_connections 2023-08-25T04:46:51.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.549+0000 7f231d1ff700 1 -- 172.21.15.72:0/3371860446 wait complete. 2023-08-25T04:46:51.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:51.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.766+0000 7f066cdff700 1 Processor -- start 2023-08-25T04:46:51.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.766+0000 7f066cdff700 1 -- start start 2023-08-25T04:46:51.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.767+0000 7f066cdff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06680ade30 0x7f06680ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f066cdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f066815da20 0x7f0668070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f066cdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06680ca020 con 0x7f0668070ed0 2023-08-25T04:46:51.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f066cdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0668071360 con 0x7f066815da20 2023-08-25T04:46:51.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f066cdff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06680ae750 con 0x7f06680ade30 2023-08-25T04:46:51.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f065ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f066815da20 0x7f0668070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f0666d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0668070ed0 0x7f066806c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41796/0 (socket says 172.21.15.72:41796) 2023-08-25T04:46:51.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f0666d9d700 1 -- 172.21.15.72:0/3848510136 learned_addr learned my addr 172.21.15.72:0/3848510136 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:51.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f066659c700 1 --2- 172.21.15.72:0/3848510136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06680ade30 0x7f06680ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f0665d9b700 1 -- 172.21.15.72:0/3848510136 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552462951 0 0) 0x7f06680ca020 con 0x7f0668070ed0 2023-08-25T04:46:51.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f0665d9b700 1 -- 172.21.15.72:0/3848510136 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06540035b0 con 0x7f0668070ed0 2023-08-25T04:46:51.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f065ffff700 1 -- 172.21.15.72:0/3848510136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06680ade30 msgr2=0x7f06680ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:51.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f065ffff700 1 --2- 172.21.15.72:0/3848510136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06680ade30 0x7f06680ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f065ffff700 1 -- 172.21.15.72:0/3848510136 >> v1:172.21.15.72:6789/0 conn(0x7f0668070ed0 legacy=0x7f066806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.768+0000 7f065ffff700 1 -- 172.21.15.72:0/3848510136 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680ae9d0 con 0x7f066815da20 2023-08-25T04:46:51.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.769+0000 7f065ffff700 1 --2- 172.21.15.72:0/3848510136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f066815da20 0x7f0668070990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f065000a9e0 tx=0x7f065000acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed28fbec86cfd8a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:51.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.769+0000 7f0665d9b700 1 -- 172.21.15.72:0/3848510136 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000cb70 con 0x7f066815da20 2023-08-25T04:46:51.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.769+0000 7f0665d9b700 1 -- 172.21.15.72:0/3848510136 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065000ccd0 con 0x7f066815da20 2023-08-25T04:46:51.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.769+0000 7f0665d9b700 1 -- 172.21.15.72:0/3848510136 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650018620 con 0x7f066815da20 2023-08-25T04:46:51.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.769+0000 7f066cdff700 1 -- 172.21.15.72:0/3848510136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f066815da20 msgr2=0x7f0668070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.769+0000 7f066cdff700 1 --2- 172.21.15.72:0/3848510136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f066815da20 0x7f0668070990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f065000a9e0 tx=0x7f065000acf0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.769+0000 7f066cdff700 1 -- 172.21.15.72:0/3848510136 shutdown_connections 2023-08-25T04:46:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.769+0000 7f066cdff700 1 --2- 172.21.15.72:0/3848510136 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f06680ade30 0x7f06680ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.769+0000 7f066cdff700 1 --2- 172.21.15.72:0/3848510136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f066815da20 0x7f0668070990 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.769+0000 7f066cdff700 1 -- 172.21.15.72:0/3848510136 >> 172.21.15.72:0/3848510136 conn(0x7f066806a710 msgr2=0x7f066806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.770+0000 7f066cdff700 1 -- 172.21.15.72:0/3848510136 shutdown_connections 2023-08-25T04:46:51.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.770+0000 7f066cdff700 1 -- 172.21.15.72:0/3848510136 wait complete. 2023-08-25T04:46:51.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.771+0000 7f066cdff700 1 Processor -- start 2023-08-25T04:46:51.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.771+0000 7f066cdff700 1 -- start start 2023-08-25T04:46:51.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.772+0000 7f066cdff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668070ed0 0x7f06681f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.772+0000 7f066cdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06680ade30 0x7f0668157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.772+0000 7f066cdff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f066815da20 0x7f06680c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.772+0000 7f066cdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06681f2e30 con 0x7f06680ade30 2023-08-25T04:46:51.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.772+0000 7f066cdff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06680b1700 con 0x7f0668070ed0 2023-08-25T04:46:51.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.772+0000 7f066cdff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06680b19e0 con 0x7f066815da20 2023-08-25T04:46:51.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06680ade30 0x7f0668157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06680ade30 0x7f0668157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47088/0 (socket says 172.21.15.72:47088) 2023-08-25T04:46:51.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065ffff700 1 -- 172.21.15.72:0/4281854522 learned_addr learned my addr 172.21.15.72:0/4281854522 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:51.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f0666d9d700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f066815da20 0x7f06680c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f066659c700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668070ed0 0x7f06681f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065ffff700 1 -- 172.21.15.72:0/4281854522 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f066815da20 msgr2=0x7f06680c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065ffff700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f066815da20 0x7f06680c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065ffff700 1 -- 172.21.15.72:0/4281854522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668070ed0 msgr2=0x7f06681f28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065ffff700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668070ed0 0x7f06681f28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065ffff700 1 -- 172.21.15.72:0/4281854522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065000a640 con 0x7f06680ade30 2023-08-25T04:46:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f066659c700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668070ed0 0x7f06681f28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065ffff700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06680ade30 0x7f0668157830 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f065000a1c0 tx=0x7f06500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065effd700 1 -- 172.21.15.72:0/4281854522 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650003ab0 con 0x7f06680ade30 2023-08-25T04:46:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065effd700 1 -- 172.21.15.72:0/4281854522 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650003c50 con 0x7f06680ade30 2023-08-25T04:46:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f066cdff700 1 -- 172.21.15.72:0/4281854522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06680b1cc0 con 0x7f06680ade30 2023-08-25T04:46:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.773+0000 7f065effd700 1 -- 172.21.15.72:0/4281854522 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650021480 con 0x7f06680ade30 2023-08-25T04:46:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.774+0000 7f066cdff700 1 -- 172.21.15.72:0/4281854522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0668158350 con 0x7f06680ade30 2023-08-25T04:46:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.775+0000 7f066cdff700 1 -- 172.21.15.72:0/4281854522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06680b21e0 con 0x7f06680ade30 2023-08-25T04:46:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.775+0000 7f065effd700 1 -- 172.21.15.72:0/4281854522 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f06500215e0 con 0x7f06680ade30 2023-08-25T04:46:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.776+0000 7f065effd700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f064806a0e0 0x7f064806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.776+0000 7f065effd700 1 -- 172.21.15.72:0/4281854522 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0650089de0 con 0x7f06680ade30 2023-08-25T04:46:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.776+0000 7f066659c700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f064806a0e0 0x7f064806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.777+0000 7f066659c700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f064806a0e0 0x7f064806c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0658009b60 tx=0x7f0658008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.780+0000 7f065effd700 1 -- 172.21.15.72:0/4281854522 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f06680b21e0 con 0x7f06680ade30 2023-08-25T04:46:51.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.981+0000 7f066cdff700 1 -- 172.21.15.72:0/4281854522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06680b21e0 con 0x7f06680ade30 2023-08-25T04:46:51.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.982+0000 7f065effd700 1 -- 172.21.15.72:0/4281854522 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06680b21e0 con 0x7f06680ade30 2023-08-25T04:46:51.982 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:51.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 -- 172.21.15.72:0/4281854522 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f064806a0e0 msgr2=0x7f064806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f064806a0e0 0x7f064806c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0658009b60 tx=0x7f0658008040 comp rx=0 tx=0).stop 2023-08-25T04:46:51.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 -- 172.21.15.72:0/4281854522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06680ade30 msgr2=0x7f0668157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:51.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06680ade30 0x7f0668157830 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f065000a1c0 tx=0x7f06500047c0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 -- 172.21.15.72:0/4281854522 shutdown_connections 2023-08-25T04:46:51.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f064806a0e0 0x7f064806c5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f066815da20 0x7f06680c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668070ed0 0x7f06681f28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 --2- 172.21.15.72:0/4281854522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06680ade30 0x7f0668157830 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:51.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 -- 172.21.15.72:0/4281854522 >> 172.21.15.72:0/4281854522 conn(0x7f066806a710 msgr2=0x7f06680ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:51.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 -- 172.21.15.72:0/4281854522 shutdown_connections 2023-08-25T04:46:51.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:51.984+0000 7f066cdff700 1 -- 172.21.15.72:0/4281854522 wait complete. 2023-08-25T04:46:52.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:52.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.199+0000 7f98da3ff700 1 Processor -- start 2023-08-25T04:46:52.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.199+0000 7f98da3ff700 1 -- start start 2023-08-25T04:46:52.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.200+0000 7f98da3ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f98d40cb650 0x7f98d40cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98da3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d40ae2f0 0x7f98d40ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98da3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98d40c9010 0x7f98d4070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98da3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d40cbf70 con 0x7f98d40c9010 2023-08-25T04:46:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98da3ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d4164f50 con 0x7f98d40cb650 2023-08-25T04:46:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98da3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4165230 con 0x7f98d40ae2f0 2023-08-25T04:46:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d899c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98d40c9010 0x7f98d4070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d899c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98d40c9010 0x7f98d4070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47092/0 (socket says 172.21.15.72:47092) 2023-08-25T04:46:52.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d899c700 1 -- 172.21.15.72:0/462261901 learned_addr learned my addr 172.21.15.72:0/462261901 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:52.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d37fe700 1 --2- 172.21.15.72:0/462261901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d40ae2f0 0x7f98d40ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:52.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d3fff700 1 --2- 172.21.15.72:0/462261901 >> v2:172.21.15.137:3300/0 conn(0x7f98d40cb650 0x7f98d40cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:52.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d899c700 1 -- 172.21.15.72:0/462261901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d40ae2f0 msgr2=0x7f98d40ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d899c700 1 --2- 172.21.15.72:0/462261901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d40ae2f0 0x7f98d40ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d899c700 1 -- 172.21.15.72:0/462261901 >> v2:172.21.15.137:3300/0 conn(0x7f98d40cb650 msgr2=0x7f98d40cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d899c700 1 --2- 172.21.15.72:0/462261901 >> v2:172.21.15.137:3300/0 conn(0x7f98d40cb650 0x7f98d40cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d899c700 1 -- 172.21.15.72:0/462261901 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4165510 con 0x7f98d40c9010 2023-08-25T04:46:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.201+0000 7f98d3fff700 1 --2- 172.21.15.72:0/462261901 >> v2:172.21.15.137:3300/0 conn(0x7f98d40cb650 0x7f98d40cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.202+0000 7f98d899c700 1 --2- 172.21.15.72:0/462261901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40c9010 0x7f98d4070990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f98d406edb0 tx=0x7f98cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73debb7ff8567219 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.202+0000 7f98d2ffd700 1 -- 172.21.15.72:0/462261901 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00e070 con 0x7f98d40c9010 2023-08-25T04:46:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.202+0000 7f98d2ffd700 1 -- 172.21.15.72:0/462261901 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc00b910 con 0x7f98d40c9010 2023-08-25T04:46:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.202+0000 7f98d2ffd700 1 -- 172.21.15.72:0/462261901 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00bcc0 con 0x7f98d40c9010 2023-08-25T04:46:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.202+0000 7f98da3ff700 1 -- 172.21.15.72:0/462261901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40c9010 msgr2=0x7f98d4070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.202+0000 7f98da3ff700 1 --2- 172.21.15.72:0/462261901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40c9010 0x7f98d4070990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f98d406edb0 tx=0x7f98cc00b330 comp rx=0 tx=0).stop 2023-08-25T04:46:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.202+0000 7f98da3ff700 1 -- 172.21.15.72:0/462261901 shutdown_connections 2023-08-25T04:46:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.203+0000 7f98da3ff700 1 --2- 172.21.15.72:0/462261901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40c9010 0x7f98d4070990 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.203+0000 7f98da3ff700 1 --2- 172.21.15.72:0/462261901 >> v2:172.21.15.137:3300/0 conn(0x7f98d40cb650 0x7f98d40cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.203+0000 7f98da3ff700 1 --2- 172.21.15.72:0/462261901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d40ae2f0 0x7f98d40ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.203+0000 7f98da3ff700 1 -- 172.21.15.72:0/462261901 >> 172.21.15.72:0/462261901 conn(0x7f98d406a710 msgr2=0x7f98d406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.203+0000 7f98da3ff700 1 -- 172.21.15.72:0/462261901 shutdown_connections 2023-08-25T04:46:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.203+0000 7f98da3ff700 1 -- 172.21.15.72:0/462261901 wait complete. 2023-08-25T04:46:52.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.204+0000 7f98da3ff700 1 Processor -- start 2023-08-25T04:46:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.204+0000 7f98da3ff700 1 -- start start 2023-08-25T04:46:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.205+0000 7f98da3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40ae2f0 0x7f98d415a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.205+0000 7f98da3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d40c9010 0x7f98d40af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.205+0000 7f98da3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d40cb650 0x7f98d40afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.205+0000 7f98da3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40c6f60 con 0x7f98d40ae2f0 2023-08-25T04:46:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.205+0000 7f98da3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40b37d0 con 0x7f98d40c9010 2023-08-25T04:46:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.205+0000 7f98da3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d40b3ab0 con 0x7f98d40cb650 2023-08-25T04:46:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40ae2f0 0x7f98d415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40ae2f0 0x7f98d415a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47106/0 (socket says 172.21.15.72:47106) 2023-08-25T04:46:52.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d3fff700 1 -- 172.21.15.72:0/139842091 learned_addr learned my addr 172.21.15.72:0/139842091 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:52.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d899c700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d40cb650 0x7f98d40afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:52.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d37fe700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d40c9010 0x7f98d40af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:52.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d3fff700 1 -- 172.21.15.72:0/139842091 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d40cb650 msgr2=0x7f98d40afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d3fff700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d40cb650 0x7f98d40afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d3fff700 1 -- 172.21.15.72:0/139842091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d40c9010 msgr2=0x7f98d40af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d3fff700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d40c9010 0x7f98d40af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d3fff700 1 -- 172.21.15.72:0/139842091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc009b30 con 0x7f98d40ae2f0 2023-08-25T04:46:52.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d37fe700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d40c9010 0x7f98d40af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:52.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d3fff700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40ae2f0 0x7f98d415a230 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f98c400e760 tx=0x7f98c400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d0ff9700 1 -- 172.21.15.72:0/139842091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4013610 con 0x7f98d40ae2f0 2023-08-25T04:46:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.206+0000 7f98d0ff9700 1 -- 172.21.15.72:0/139842091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c4013770 con 0x7f98d40ae2f0 2023-08-25T04:46:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.207+0000 7f98da3ff700 1 -- 172.21.15.72:0/139842091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d40b3d90 con 0x7f98d40ae2f0 2023-08-25T04:46:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.207+0000 7f98d0ff9700 1 -- 172.21.15.72:0/139842091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4013b20 con 0x7f98d40ae2f0 2023-08-25T04:46:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.207+0000 7f98da3ff700 1 -- 172.21.15.72:0/139842091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d415a770 con 0x7f98d40ae2f0 2023-08-25T04:46:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.208+0000 7f98da3ff700 1 -- 172.21.15.72:0/139842091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d4072320 con 0x7f98d40ae2f0 2023-08-25T04:46:52.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.209+0000 7f98d0ff9700 1 -- 172.21.15.72:0/139842091 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f98c4013c80 con 0x7f98d40ae2f0 2023-08-25T04:46:52.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.209+0000 7f98d0ff9700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f98c006a0e0 0x7f98c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.210+0000 7f98d0ff9700 1 -- 172.21.15.72:0/139842091 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f98c4088500 con 0x7f98d40ae2f0 2023-08-25T04:46:52.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.210+0000 7f98d37fe700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f98c006a0e0 0x7f98c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:52.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.210+0000 7f98d37fe700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f98c006a0e0 0x7f98c006c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98d41f9d90 tx=0x7f98c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:52.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.213+0000 7f98d0ff9700 1 -- 172.21.15.72:0/139842091 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f98c4053820 con 0x7f98d40ae2f0 2023-08-25T04:46:52.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.412+0000 7f98da3ff700 1 -- 172.21.15.72:0/139842091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98d40c70a0 con 0x7f98d40ae2f0 2023-08-25T04:46:52.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.412+0000 7f98d0ff9700 1 -- 172.21.15.72:0/139842091 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98c4056e40 con 0x7f98d40ae2f0 2023-08-25T04:46:52.414 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:52.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 -- 172.21.15.72:0/139842091 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f98c006a0e0 msgr2=0x7f98c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f98c006a0e0 0x7f98c006c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98d41f9d90 tx=0x7f98c8008040 comp rx=0 tx=0).stop 2023-08-25T04:46:52.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 -- 172.21.15.72:0/139842091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40ae2f0 msgr2=0x7f98d415a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40ae2f0 0x7f98d415a230 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f98c400e760 tx=0x7f98c400eb20 comp rx=0 tx=0).stop 2023-08-25T04:46:52.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 -- 172.21.15.72:0/139842091 shutdown_connections 2023-08-25T04:46:52.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f98c006a0e0 0x7f98c006c5a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f98d40cb650 0x7f98d40afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d40ae2f0 0x7f98d415a230 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 --2- 172.21.15.72:0/139842091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98d40c9010 0x7f98d40af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 -- 172.21.15.72:0/139842091 >> 172.21.15.72:0/139842091 conn(0x7f98d406a710 msgr2=0x7f98d406aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:52.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 -- 172.21.15.72:0/139842091 shutdown_connections 2023-08-25T04:46:52.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.415+0000 7f98da3ff700 1 -- 172.21.15.72:0/139842091 wait complete. 2023-08-25T04:46:52.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:52.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.632+0000 7faff95ff700 1 Processor -- start 2023-08-25T04:46:52.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.633+0000 7faff95ff700 1 -- start start 2023-08-25T04:46:52.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.634+0000 7faff95ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faff40ade30 0x7faff40ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.634+0000 7faff95ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40ae750 con 0x7faff415da20 2023-08-25T04:46:52.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.634+0000 7faff95ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40ae9d0 con 0x7faff40710a0 2023-08-25T04:46:52.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.634+0000 7faff95ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff4159d70 con 0x7faff40ade30 2023-08-25T04:46:52.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.635+0000 7faff27fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faff415da20 0x7faff4070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41808/0 (socket says 172.21.15.72:41808) 2023-08-25T04:46:52.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.635+0000 7faff27fc700 1 -- 172.21.15.72:0/2443879718 learned_addr learned my addr 172.21.15.72:0/2443879718 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:52.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.635+0000 7faff2ffd700 1 --2- 172.21.15.72:0/2443879718 >> v2:172.21.15.72:3300/0 conn(0x7faff40ade30 0x7faff40ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:52.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.635+0000 7faff2ffd700 1 -- 172.21.15.72:0/2443879718 >> v1:172.21.15.137:6789/0 conn(0x7faff40710a0 legacy=0x7faff40c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.635+0000 7faff2ffd700 1 -- 172.21.15.72:0/2443879718 >> v1:172.21.15.72:6789/0 conn(0x7faff415da20 legacy=0x7faff4070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.635+0000 7faff2ffd700 1 -- 172.21.15.72:0/2443879718 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff415a050 con 0x7faff40ade30 2023-08-25T04:46:52.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.635+0000 7faff2ffd700 1 --2- 172.21.15.72:0/2443879718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40ade30 0x7faff40ae210 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009840 tx=0x7fafe4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a0a5a1a3353dbb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:52.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.636+0000 7faff1ffb700 1 -- 172.21.15.72:0/2443879718 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4011830 con 0x7faff40ade30 2023-08-25T04:46:52.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.636+0000 7faff1ffb700 1 -- 172.21.15.72:0/2443879718 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe4011990 con 0x7faff40ade30 2023-08-25T04:46:52.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.636+0000 7faff1ffb700 1 -- 172.21.15.72:0/2443879718 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4011d20 con 0x7faff40ade30 2023-08-25T04:46:52.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.636+0000 7faff95ff700 1 -- 172.21.15.72:0/2443879718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40ade30 msgr2=0x7faff40ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.636+0000 7faff95ff700 1 --2- 172.21.15.72:0/2443879718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40ade30 0x7faff40ae210 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009840 tx=0x7fafe4009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:52.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.636+0000 7faff95ff700 1 -- 172.21.15.72:0/2443879718 shutdown_connections 2023-08-25T04:46:52.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.636+0000 7faff95ff700 1 --2- 172.21.15.72:0/2443879718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40ade30 0x7faff40ae210 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.636+0000 7faff95ff700 1 -- 172.21.15.72:0/2443879718 >> 172.21.15.72:0/2443879718 conn(0x7faff406a710 msgr2=0x7faff406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:52.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.636+0000 7faff95ff700 1 -- 172.21.15.72:0/2443879718 shutdown_connections 2023-08-25T04:46:52.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.636+0000 7faff95ff700 1 -- 172.21.15.72:0/2443879718 wait complete. 2023-08-25T04:46:52.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.638+0000 7faff95ff700 1 Processor -- start 2023-08-25T04:46:52.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.638+0000 7faff95ff700 1 -- start start 2023-08-25T04:46:52.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.639+0000 7faff95ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40710a0 0x7faff4143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.639+0000 7faff95ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faff40ade30 0x7faff40c2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.639+0000 7faff95ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff415da20 0x7faff40c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.639+0000 7faff95ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40c40f0 con 0x7faff40710a0 2023-08-25T04:46:52.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.639+0000 7faff95ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff4143c70 con 0x7faff415da20 2023-08-25T04:46:52.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.639+0000 7faff95ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff40c2aa0 con 0x7faff40ade30 2023-08-25T04:46:52.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.639+0000 7faff2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40710a0 0x7faff4143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:52.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.639+0000 7faff2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40710a0 0x7faff4143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47118/0 (socket says 172.21.15.72:47118) 2023-08-25T04:46:52.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.639+0000 7faff2ffd700 1 -- 172.21.15.72:0/459746833 learned_addr learned my addr 172.21.15.72:0/459746833 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:52.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7faff2ffd700 1 -- 172.21.15.72:0/459746833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faff40ade30 msgr2=0x7faff40c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7faff2ffd700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faff40ade30 0x7faff40c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7faff2ffd700 1 -- 172.21.15.72:0/459746833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff415da20 msgr2=0x7faff40c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7faff2ffd700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff415da20 0x7faff40c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7faff2ffd700 1 -- 172.21.15.72:0/459746833 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40094a0 con 0x7faff40710a0 2023-08-25T04:46:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7faff2ffd700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40710a0 0x7faff4143730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fafe40090b0 tx=0x7fafe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7fafdb7fe700 1 -- 172.21.15.72:0/459746833 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40038a0 con 0x7faff40710a0 2023-08-25T04:46:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7fafdb7fe700 1 -- 172.21.15.72:0/459746833 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe401f070 con 0x7faff40710a0 2023-08-25T04:46:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7faff95ff700 1 -- 172.21.15.72:0/459746833 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff40c4390 con 0x7faff40710a0 2023-08-25T04:46:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7fafdb7fe700 1 -- 172.21.15.72:0/459746833 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4003c60 con 0x7faff40710a0 2023-08-25T04:46:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.640+0000 7faff95ff700 1 -- 172.21.15.72:0/459746833 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff40c4950 con 0x7faff40710a0 2023-08-25T04:46:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.641+0000 7faff95ff700 1 -- 172.21.15.72:0/459746833 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff4072320 con 0x7faff40710a0 2023-08-25T04:46:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.642+0000 7fafdb7fe700 1 -- 172.21.15.72:0/459746833 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fafe401a430 con 0x7faff40710a0 2023-08-25T04:46:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.643+0000 7fafdb7fe700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafe006a0e0 0x7fafe006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.643+0000 7fafdb7fe700 1 -- 172.21.15.72:0/459746833 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fafe4021070 con 0x7faff40710a0 2023-08-25T04:46:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.643+0000 7faff27fc700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafe006a0e0 0x7fafe006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.644+0000 7faff27fc700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafe006a0e0 0x7fafe006c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faff41470d0 tx=0x7fafe8007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:52.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.648+0000 7fafdb7fe700 1 -- 172.21.15.72:0/459746833 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fafe40557a0 con 0x7faff40710a0 2023-08-25T04:46:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.847+0000 7faff95ff700 1 -- 172.21.15.72:0/459746833 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faff40744f0 con 0x7faff40710a0 2023-08-25T04:46:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.848+0000 7fafdb7fe700 1 -- 172.21.15.72:0/459746833 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafe4058dc0 con 0x7faff40710a0 2023-08-25T04:46:52.849 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 -- 172.21.15.72:0/459746833 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafe006a0e0 msgr2=0x7fafe006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafe006a0e0 0x7fafe006c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faff41470d0 tx=0x7fafe8007ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 -- 172.21.15.72:0/459746833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40710a0 msgr2=0x7faff4143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40710a0 0x7faff4143730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fafe40090b0 tx=0x7fafe4004750 comp rx=0 tx=0).stop 2023-08-25T04:46:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 -- 172.21.15.72:0/459746833 shutdown_connections 2023-08-25T04:46:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafe006a0e0 0x7fafe006c5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff415da20 0x7faff40c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff40710a0 0x7faff4143730 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 --2- 172.21.15.72:0/459746833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faff40ade30 0x7faff40c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 -- 172.21.15.72:0/459746833 >> 172.21.15.72:0/459746833 conn(0x7faff406a710 msgr2=0x7faff40ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.850+0000 7faff95ff700 1 -- 172.21.15.72:0/459746833 shutdown_connections 2023-08-25T04:46:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:52.851+0000 7faff95ff700 1 -- 172.21.15.72:0/459746833 wait complete. 2023-08-25T04:46:52.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:53.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.070+0000 7f7bc49ff700 1 Processor -- start 2023-08-25T04:46:53.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.070+0000 7f7bc49ff700 1 -- start start 2023-08-25T04:46:53.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.072+0000 7f7bc49ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7bc00ce260 0x7f7bc0167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.072+0000 7f7bc49ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00d1580 con 0x7f7bc015d090 2023-08-25T04:46:53.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.072+0000 7f7bc49ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc015d470 con 0x7f7bc00b8aa0 2023-08-25T04:46:53.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.072+0000 7f7bc49ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00b6ec0 con 0x7f7bc00ce260 2023-08-25T04:46:53.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.072+0000 7f7bbe59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7bc015d090 0x7f7bc00d0e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56066/0 (socket says 172.21.15.72:56066) 2023-08-25T04:46:53.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.072+0000 7f7bbe59c700 1 -- 172.21.15.72:0/144456258 learned_addr learned my addr 172.21.15.72:0/144456258 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:53.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.072+0000 7f7bbed9d700 1 --2- 172.21.15.72:0/144456258 >> v2:172.21.15.137:3300/0 conn(0x7f7bc00ce260 0x7f7bc0167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.072+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718389779 0 0) 0x7f7bc00d1580 con 0x7f7bc015d090 2023-08-25T04:46:53.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.072+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bac0035b0 con 0x7f7bc015d090 2023-08-25T04:46:53.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4051015205 0 0) 0x7f7bac0035b0 con 0x7f7bc015d090 2023-08-25T04:46:53.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 >> v2:172.21.15.137:3300/0 conn(0x7f7bc00ce260 msgr2=0x7f7bc0167ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 --2- 172.21.15.72:0/144456258 >> v2:172.21.15.137:3300/0 conn(0x7f7bc00ce260 0x7f7bc0167ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 >> v1:172.21.15.137:6789/0 conn(0x7f7bc00b8aa0 legacy=0x7f7bc00cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00d17e0 con 0x7f7bc015d090 2023-08-25T04:46:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f7bb0001670 con 0x7f7bc015d090 2023-08-25T04:46:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 >> v1:172.21.15.72:6789/0 conn(0x7f7bc015d090 legacy=0x7f7bc00d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bac004850 0x7f7bac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bac005210 0x7f7bac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00b6ec0 con 0x7f7bac003a00 2023-08-25T04:46:53.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac00c0b0 con 0x7f7bac005210 2023-08-25T04:46:53.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac00c270 con 0x7f7bac004850 2023-08-25T04:46:53.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbe59c700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbed9d700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bac005210 0x7f7bac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bb7fff700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bac004850 0x7f7bac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbe59c700 1 -- 172.21.15.72:0/144456258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bac004850 msgr2=0x7f7bac004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:53.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbe59c700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bac004850 0x7f7bac004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbe59c700 1 -- 172.21.15.72:0/144456258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bac005210 msgr2=0x7f7bac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:53.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbe59c700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bac005210 0x7f7bac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbe59c700 1 -- 172.21.15.72:0/144456258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac0035b0 con 0x7f7bac003a00 2023-08-25T04:46:53.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.073+0000 7f7bbed9d700 1 -- 172.21.15.72:0/144456258 reap_dead start 2023-08-25T04:46:53.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bbe59c700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bac003e20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000c240 tx=0x7f7bac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1844dee044c227 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:53.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0007c10 con 0x7f7bac003a00 2023-08-25T04:46:53.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb000ce00 con 0x7f7bac003a00 2023-08-25T04:46:53.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bbdd9b700 1 -- 172.21.15.72:0/144456258 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0005ba0 con 0x7f7bac003a00 2023-08-25T04:46:53.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bc49ff700 1 -- 172.21.15.72:0/144456258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 msgr2=0x7f7bac003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bc49ff700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bac003e20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000c240 tx=0x7f7bac005880 comp rx=0 tx=0).stop 2023-08-25T04:46:53.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bc49ff700 1 -- 172.21.15.72:0/144456258 shutdown_connections 2023-08-25T04:46:53.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bc49ff700 1 --2- 172.21.15.72:0/144456258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bac003e20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bc49ff700 1 -- 172.21.15.72:0/144456258 >> 172.21.15.72:0/144456258 conn(0x7f7bc0071e10 msgr2=0x7f7bc0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:53.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bc49ff700 1 -- 172.21.15.72:0/144456258 shutdown_connections 2023-08-25T04:46:53.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.074+0000 7f7bc49ff700 1 -- 172.21.15.72:0/144456258 wait complete. 2023-08-25T04:46:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.076+0000 7f7bc49ff700 1 Processor -- start 2023-08-25T04:46:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.076+0000 7f7bc49ff700 1 -- start start 2023-08-25T04:46:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.077+0000 7f7bc49ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bc00b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.077+0000 7f7bc49ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bc00b3720 0x7f7bc01520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.077+0000 7f7bc49ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc00ab740 0x7f7bc00abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.077+0000 7f7bc49ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00ac100 con 0x7f7bac003a00 2023-08-25T04:46:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.077+0000 7f7bc49ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00b29f0 con 0x7f7bc00b3720 2023-08-25T04:46:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.077+0000 7f7bc49ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00b4f60 con 0x7f7bc00ab740 2023-08-25T04:46:53.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.077+0000 7f7bbe59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bc00b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bbe59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bc00b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34836/0 (socket says 172.21.15.72:34836) 2023-08-25T04:46:53.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bbe59c700 1 -- 172.21.15.72:0/654888348 learned_addr learned my addr 172.21.15.72:0/654888348 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:53.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bbed9d700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc00ab740 0x7f7bc00abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bb7fff700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bc00b3720 0x7f7bc01520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bbe59c700 1 -- 172.21.15.72:0/654888348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc00ab740 msgr2=0x7f7bc00abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bbe59c700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc00ab740 0x7f7bc00abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bbe59c700 1 -- 172.21.15.72:0/654888348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bc00b3720 msgr2=0x7f7bc01520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bbe59c700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bc00b3720 0x7f7bc01520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bbe59c700 1 -- 172.21.15.72:0/654888348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00aae00 con 0x7f7bac003a00 2023-08-25T04:46:53.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bbe59c700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bc00b4a20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00c080 tx=0x7f7bb0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:53.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bb6ffd700 1 -- 172.21.15.72:0/654888348 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0001630 con 0x7f7bac003a00 2023-08-25T04:46:53.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bb6ffd700 1 -- 172.21.15.72:0/654888348 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb00070d0 con 0x7f7bac003a00 2023-08-25T04:46:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bb6ffd700 1 -- 172.21.15.72:0/654888348 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00074a0 con 0x7f7bac003a00 2023-08-25T04:46:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.078+0000 7f7bc49ff700 1 -- 172.21.15.72:0/654888348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc00b2c40 con 0x7f7bac003a00 2023-08-25T04:46:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.079+0000 7f7bc49ff700 1 -- 172.21.15.72:0/654888348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc00b3200 con 0x7f7bac003a00 2023-08-25T04:46:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.080+0000 7f7bc49ff700 1 -- 172.21.15.72:0/654888348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc00b33c0 con 0x7f7bac003a00 2023-08-25T04:46:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.080+0000 7f7bb6ffd700 1 -- 172.21.15.72:0/654888348 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7bb0007600 con 0x7f7bac003a00 2023-08-25T04:46:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.081+0000 7f7bb6ffd700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ba006a0e0 0x7f7ba006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.081+0000 7f7bb6ffd700 1 -- 172.21.15.72:0/654888348 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7bb0089bb0 con 0x7f7bac003a00 2023-08-25T04:46:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.081+0000 7f7bb7fff700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ba006a0e0 0x7f7ba006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.082+0000 7f7bb7fff700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ba006a0e0 0x7f7ba006c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00b47b0 tx=0x7f7ba8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:53.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.086+0000 7f7bb6ffd700 1 -- 172.21.15.72:0/654888348 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7bb0055000 con 0x7f7bac003a00 2023-08-25T04:46:53.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.288+0000 7f7bc49ff700 1 -- 172.21.15.72:0/654888348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7bc006a2f0 con 0x7f7bac003a00 2023-08-25T04:46:53.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.289+0000 7f7bb6ffd700 1 -- 172.21.15.72:0/654888348 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7bb0058620 con 0x7f7bac003a00 2023-08-25T04:46:53.290 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.291+0000 7f7bc49ff700 1 -- 172.21.15.72:0/654888348 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ba006a0e0 msgr2=0x7f7ba006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.291+0000 7f7bc49ff700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ba006a0e0 0x7f7ba006c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00b47b0 tx=0x7f7ba8009040 comp rx=0 tx=0).stop 2023-08-25T04:46:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.291+0000 7f7bc49ff700 1 -- 172.21.15.72:0/654888348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 msgr2=0x7f7bc00b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.291+0000 7f7bc49ff700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bc00b4a20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00c080 tx=0x7f7bb0001a00 comp rx=0 tx=0).stop 2023-08-25T04:46:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.291+0000 7f7bc49ff700 1 -- 172.21.15.72:0/654888348 shutdown_connections 2023-08-25T04:46:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.291+0000 7f7bc49ff700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7ba006a0e0 0x7f7ba006c5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.291+0000 7f7bc49ff700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7bc00ab740 0x7f7bc00abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.291+0000 7f7bc49ff700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac003a00 0x7f7bc00b4a20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.291+0000 7f7bc49ff700 1 --2- 172.21.15.72:0/654888348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bc00b3720 0x7f7bc01520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.291+0000 7f7bc49ff700 1 -- 172.21.15.72:0/654888348 >> 172.21.15.72:0/654888348 conn(0x7f7bc0071e10 msgr2=0x7f7bc00b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.292+0000 7f7bc49ff700 1 -- 172.21.15.72:0/654888348 shutdown_connections 2023-08-25T04:46:53.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.292+0000 7f7bc49ff700 1 -- 172.21.15.72:0/654888348 wait complete. 2023-08-25T04:46:53.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:46:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.511+0000 7f720edff700 1 Processor -- start 2023-08-25T04:46:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.511+0000 7f720edff700 1 -- start start 2023-08-25T04:46:53.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.512+0000 7f720edff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 0x7f72080b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.512+0000 7f720edff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f72080b4d40 0x7f72080b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.512+0000 7f720edff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72080b51a0 con 0x7f7208160710 2023-08-25T04:46:53.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.512+0000 7f720edff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72080b7400 con 0x7f72080b4d40 2023-08-25T04:46:53.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.512+0000 7f720edff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72080b7650 con 0x7f72080d20f0 2023-08-25T04:46:53.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.512+0000 7f720d39c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f72080b4d40 0x7f72080b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.512+0000 7f720d39c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f72080b4d40 0x7f72080b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34850/0 (socket says 172.21.15.72:34850) 2023-08-25T04:46:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.512+0000 7f720d39c700 1 -- 172.21.15.72:0/1498297886 learned_addr learned my addr 172.21.15.72:0/1498297886 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.513+0000 7f7207fff700 1 --2- 172.21.15.72:0/1498297886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 0x7f72080b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.513+0000 7f720d39c700 1 -- 172.21.15.72:0/1498297886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 msgr2=0x7f72080b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.513+0000 7f720d39c700 1 --2- 172.21.15.72:0/1498297886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 0x7f72080b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.513+0000 7f720d39c700 1 -- 172.21.15.72:0/1498297886 >> v1:172.21.15.137:6789/0 conn(0x7f7208160710 legacy=0x7f72080b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.513+0000 7f720d39c700 1 -- 172.21.15.72:0/1498297886 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72080b7930 con 0x7f72080b4d40 2023-08-25T04:46:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.513+0000 7f720d39c700 1 --2- 172.21.15.72:0/1498297886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72080b4d40 0x7f72080b5eb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7200009e50 tx=0x7f720000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15baff62f8f88d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.513+0000 7f72077fe700 1 -- 172.21.15.72:0/1498297886 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000e070 con 0x7f72080b4d40 2023-08-25T04:46:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.513+0000 7f72077fe700 1 -- 172.21.15.72:0/1498297886 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720000b9c0 con 0x7f72080b4d40 2023-08-25T04:46:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.513+0000 7f72077fe700 1 -- 172.21.15.72:0/1498297886 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000bd70 con 0x7f72080b4d40 2023-08-25T04:46:53.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.514+0000 7f720edff700 1 -- 172.21.15.72:0/1498297886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72080b4d40 msgr2=0x7f72080b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.514+0000 7f720edff700 1 --2- 172.21.15.72:0/1498297886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72080b4d40 0x7f72080b5eb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7200009e50 tx=0x7f720000b330 comp rx=0 tx=0).stop 2023-08-25T04:46:53.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.514+0000 7f720edff700 1 -- 172.21.15.72:0/1498297886 shutdown_connections 2023-08-25T04:46:53.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.514+0000 7f720edff700 1 --2- 172.21.15.72:0/1498297886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72080b4d40 0x7f72080b5eb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.514+0000 7f720edff700 1 --2- 172.21.15.72:0/1498297886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 0x7f72080b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.514+0000 7f720edff700 1 -- 172.21.15.72:0/1498297886 >> 172.21.15.72:0/1498297886 conn(0x7f7208071e40 msgr2=0x7f7208072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.514+0000 7f720edff700 1 -- 172.21.15.72:0/1498297886 shutdown_connections 2023-08-25T04:46:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.514+0000 7f720edff700 1 -- 172.21.15.72:0/1498297886 wait complete. 2023-08-25T04:46:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.516+0000 7f720edff700 1 Processor -- start 2023-08-25T04:46:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.516+0000 7f720edff700 1 -- start start 2023-08-25T04:46:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720edff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72080b4d40 0x7f720814fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720edff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 0x7f720815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720edff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7208160710 0x7f720815e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720edff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72081f2580 con 0x7f7208160710 2023-08-25T04:46:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720edff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72081505b0 con 0x7f72080b4d40 2023-08-25T04:46:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720edff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72081f2760 con 0x7f72080d20f0 2023-08-25T04:46:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720d39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7208160710 0x7f720815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720d39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7208160710 0x7f720815e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34852/0 (socket says 172.21.15.72:34852) 2023-08-25T04:46:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720d39c700 1 -- 172.21.15.72:0/1349373923 learned_addr learned my addr 172.21.15.72:0/1349373923 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f7207fff700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 0x7f720815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720cb9b700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72080b4d40 0x7f720814fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720d39c700 1 -- 172.21.15.72:0/1349373923 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 msgr2=0x7f720815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.517+0000 7f720d39c700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 0x7f720815fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.518+0000 7f720d39c700 1 -- 172.21.15.72:0/1349373923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72080b4d40 msgr2=0x7f720814fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.518+0000 7f720d39c700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72080b4d40 0x7f720814fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.518+0000 7f720d39c700 1 -- 172.21.15.72:0/1349373923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200009b30 con 0x7f7208160710 2023-08-25T04:46:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.518+0000 7f7207fff700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 0x7f720815fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.518+0000 7f720d39c700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7208160710 0x7f720815e670 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7200004270 tx=0x7f7200004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.518+0000 7f72057fa700 1 -- 172.21.15.72:0/1349373923 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72000099b0 con 0x7f7208160710 2023-08-25T04:46:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.518+0000 7f72057fa700 1 -- 172.21.15.72:0/1349373923 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72000092e0 con 0x7f7208160710 2023-08-25T04:46:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.518+0000 7f720edff700 1 -- 172.21.15.72:0/1349373923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7208150070 con 0x7f7208160710 2023-08-25T04:46:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.518+0000 7f72057fa700 1 -- 172.21.15.72:0/1349373923 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720001b630 con 0x7f7208160710 2023-08-25T04:46:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.518+0000 7f720edff700 1 -- 172.21.15.72:0/1349373923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72080cb7c0 con 0x7f7208160710 2023-08-25T04:46:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.519+0000 7f720edff700 1 -- 172.21.15.72:0/1349373923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72080c9e50 con 0x7f7208160710 2023-08-25T04:46:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.520+0000 7f72057fa700 1 -- 172.21.15.72:0/1349373923 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f720001b790 con 0x7f7208160710 2023-08-25T04:46:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.521+0000 7f72057fa700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71ec06a0e0 0x7f71ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.521+0000 7f72057fa700 1 -- 172.21.15.72:0/1349373923 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f72000899c0 con 0x7f7208160710 2023-08-25T04:46:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.521+0000 7f720cb9b700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71ec06a0e0 0x7f71ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.522+0000 7f720cb9b700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71ec06a0e0 0x7f71ec06c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f71fc000f60 tx=0x7f71fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.525+0000 7f72057fa700 1 -- 172.21.15.72:0/1349373923 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f72080c9e50 con 0x7f7208160710 2023-08-25T04:46:53.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.738+0000 7f720edff700 1 -- 172.21.15.72:0/1349373923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f72080c9e50 con 0x7f7208160710 2023-08-25T04:46:53.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.739+0000 7f72057fa700 1 -- 172.21.15.72:0/1349373923 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f72080c9e50 con 0x7f7208160710 2023-08-25T04:46:53.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 -- 172.21.15.72:0/1349373923 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71ec06a0e0 msgr2=0x7f71ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71ec06a0e0 0x7f71ec06c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f71fc000f60 tx=0x7f71fc009040 comp rx=0 tx=0).stop 2023-08-25T04:46:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 -- 172.21.15.72:0/1349373923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7208160710 msgr2=0x7f720815e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7208160710 0x7f720815e670 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7200004270 tx=0x7f7200004ad0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 -- 172.21.15.72:0/1349373923 shutdown_connections 2023-08-25T04:46:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f71ec06a0e0 0x7f71ec06c5a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7208160710 0x7f720815e670 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72080b4d40 0x7f720814fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 --2- 172.21.15.72:0/1349373923 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f72080d20f0 0x7f720815fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 -- 172.21.15.72:0/1349373923 >> 172.21.15.72:0/1349373923 conn(0x7f7208071e40 msgr2=0x7f72080b6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 -- 172.21.15.72:0/1349373923 shutdown_connections 2023-08-25T04:46:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:53.741+0000 7f720edff700 1 -- 172.21.15.72:0/1349373923 wait complete. 2023-08-25T04:46:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-08-25T04:46:53.761 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi137.front.sepia.ceph.com... 2023-08-25T04:46:53.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:53.762 DEBUG:teuthology.orchestra.run.smithi137:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-08-25T04:46:53.840 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:46:53.841 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2023-08-25T04:46:53.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:46:53.841 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-25T04:46:53.905 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:46:53.906 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:46:53.953 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:46:53.953 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:46:54.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:54.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.278+0000 7f8a4e3ff700 1 Processor -- start 2023-08-25T04:46:54.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.278+0000 7f8a4e3ff700 1 -- start start 2023-08-25T04:46:54.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.279+0000 7f8a4e3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 0x7f8a4806cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.279+0000 7f8a4e3ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8a480c3f40 0x7f8a480c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.279+0000 7f8a4e3ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4806d4f0 con 0x7f8a4806e590 2023-08-25T04:46:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.279+0000 7f8a4e3ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a480c4900 con 0x7f8a480c3f40 2023-08-25T04:46:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.279+0000 7f8a4e3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4806d7d0 con 0x7f8a4815ac50 2023-08-25T04:46:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.280+0000 7f8a4c99c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8a480c3f40 0x7f8a480c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.280+0000 7f8a4c99c700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8a480c3f40 0x7f8a480c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.72:51508/0 (socket says 172.21.15.72:51508) 2023-08-25T04:46:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.280+0000 7f8a4c99c700 1 -- 172.21.15.72:0/417686442 learned_addr learned my addr 172.21.15.72:0/417686442 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.280+0000 7f8a3ffff700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8a4806e590 0x7f8a480addd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:47820/0 (socket says 172.21.15.72:47820) 2023-08-25T04:46:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.280+0000 7f8a47fff700 1 --2- 172.21.15.72:0/417686442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 0x7f8a4806cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.281+0000 7f8a47fff700 1 -- 172.21.15.72:0/417686442 >> v2:172.21.15.137:3300/0 conn(0x7f8a480c3f40 msgr2=0x7f8a480c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.281+0000 7f8a47fff700 1 --2- 172.21.15.72:0/417686442 >> v2:172.21.15.137:3300/0 conn(0x7f8a480c3f40 0x7f8a480c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.281+0000 7f8a47fff700 1 -- 172.21.15.72:0/417686442 >> v1:172.21.15.137:6789/0 conn(0x7f8a4806e590 legacy=0x7f8a480addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.281+0000 7f8a47fff700 1 -- 172.21.15.72:0/417686442 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4806dab0 con 0x7f8a4815ac50 2023-08-25T04:46:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.281+0000 7f8a4c99c700 1 --2- 172.21.15.72:0/417686442 >> v2:172.21.15.137:3300/0 conn(0x7f8a480c3f40 0x7f8a480c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.281+0000 7f8a47fff700 1 --2- 172.21.15.72:0/417686442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 0x7f8a4806cf10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009840 tx=0x7f8a38009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d14e9a27b9b0623 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.281+0000 7f8a477fe700 1 -- 172.21.15.72:0/417686442 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38011830 con 0x7f8a4815ac50 2023-08-25T04:46:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.281+0000 7f8a477fe700 1 -- 172.21.15.72:0/417686442 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a38011990 con 0x7f8a4815ac50 2023-08-25T04:46:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.281+0000 7f8a477fe700 1 -- 172.21.15.72:0/417686442 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38011d20 con 0x7f8a4815ac50 2023-08-25T04:46:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.282+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/417686442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 msgr2=0x7f8a4806cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.282+0000 7f8a4e3ff700 1 --2- 172.21.15.72:0/417686442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 0x7f8a4806cf10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009840 tx=0x7f8a38009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.282+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/417686442 shutdown_connections 2023-08-25T04:46:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.282+0000 7f8a4e3ff700 1 --2- 172.21.15.72:0/417686442 >> v2:172.21.15.137:3300/0 conn(0x7f8a480c3f40 0x7f8a480c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.282+0000 7f8a4e3ff700 1 --2- 172.21.15.72:0/417686442 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 0x7f8a4806cf10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.282+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/417686442 >> 172.21.15.72:0/417686442 conn(0x7f8a480ce990 msgr2=0x7f8a480ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.282+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/417686442 shutdown_connections 2023-08-25T04:46:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.282+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/417686442 wait complete. 2023-08-25T04:46:54.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.284+0000 7f8a4e3ff700 1 Processor -- start 2023-08-25T04:46:54.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.284+0000 7f8a4e3ff700 1 -- start start 2023-08-25T04:46:54.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a4e3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a4806e590 0x7f8a480cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a4e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a480c3f40 0x7f8a480b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a4e3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 0x7f8a480b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a4e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a481f58f0 con 0x7f8a480c3f40 2023-08-25T04:46:54.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a4e3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a481f5bd0 con 0x7f8a4806e590 2023-08-25T04:46:54.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a4e3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a481f5eb0 con 0x7f8a4815ac50 2023-08-25T04:46:54.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a480c3f40 0x7f8a480b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a480c3f40 0x7f8a480b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34854/0 (socket says 172.21.15.72:34854) 2023-08-25T04:46:54.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a3ffff700 1 -- 172.21.15.72:0/751870382 learned_addr learned my addr 172.21.15.72:0/751870382 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:54.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a47fff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a4806e590 0x7f8a480cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a4c99c700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 0x7f8a480b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a3ffff700 1 -- 172.21.15.72:0/751870382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 msgr2=0x7f8a480b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a3ffff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 0x7f8a480b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a3ffff700 1 -- 172.21.15.72:0/751870382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a4806e590 msgr2=0x7f8a480cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a3ffff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a4806e590 0x7f8a480cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.285+0000 7f8a3ffff700 1 -- 172.21.15.72:0/751870382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40009b30 con 0x7f8a480c3f40 2023-08-25T04:46:54.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.286+0000 7f8a3ffff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a480c3f40 0x7f8a480b3c60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c4f0 tx=0x7f8a3000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:54.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.286+0000 7f8a457fa700 1 -- 172.21.15.72:0/751870382 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30005cb0 con 0x7f8a480c3f40 2023-08-25T04:46:54.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.286+0000 7f8a457fa700 1 -- 172.21.15.72:0/751870382 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a30005e10 con 0x7f8a480c3f40 2023-08-25T04:46:54.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.286+0000 7f8a457fa700 1 -- 172.21.15.72:0/751870382 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300072d0 con 0x7f8a480c3f40 2023-08-25T04:46:54.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.286+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/751870382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a380094a0 con 0x7f8a480c3f40 2023-08-25T04:46:54.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.286+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/751870382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a481f6470 con 0x7f8a480c3f40 2023-08-25T04:46:54.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.287+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/751870382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a481f6630 con 0x7f8a480c3f40 2023-08-25T04:46:54.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.288+0000 7f8a457fa700 1 -- 172.21.15.72:0/751870382 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8a30007430 con 0x7f8a480c3f40 2023-08-25T04:46:54.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.289+0000 7f8a457fa700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a2806a0e0 0x7f8a2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.289+0000 7f8a457fa700 1 -- 172.21.15.72:0/751870382 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8a30087b90 con 0x7f8a480c3f40 2023-08-25T04:46:54.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.289+0000 7f8a47fff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a2806a0e0 0x7f8a2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.290+0000 7f8a47fff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a2806a0e0 0x7f8a2806c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8a38000c00 tx=0x7f8a38008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:54.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.293+0000 7f8a457fa700 1 -- 172.21.15.72:0/751870382 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8a30052f60 con 0x7f8a480c3f40 2023-08-25T04:46:54.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.490+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/751870382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a4804e620 con 0x7f8a480c3f40 2023-08-25T04:46:54.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.492+0000 7f8a457fa700 1 -- 172.21.15.72:0/751870382 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f8a30056580 con 0x7f8a480c3f40 2023-08-25T04:46:54.493 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:54.494 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:54.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.494+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/751870382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a2806a0e0 msgr2=0x7f8a2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.494+0000 7f8a4e3ff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a2806a0e0 0x7f8a2806c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8a38000c00 tx=0x7f8a38008030 comp rx=0 tx=0).stop 2023-08-25T04:46:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.494+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/751870382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a480c3f40 msgr2=0x7f8a480b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.494+0000 7f8a4e3ff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a480c3f40 0x7f8a480b3c60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c4f0 tx=0x7f8a3000c800 comp rx=0 tx=0).stop 2023-08-25T04:46:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.494+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/751870382 shutdown_connections 2023-08-25T04:46:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.494+0000 7f8a4e3ff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8a2806a0e0 0x7f8a2806c5a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.494+0000 7f8a4e3ff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8a4815ac50 0x7f8a480b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.494+0000 7f8a4e3ff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a4806e590 0x7f8a480cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.494+0000 7f8a4e3ff700 1 --2- 172.21.15.72:0/751870382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a480c3f40 0x7f8a480b3c60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.494+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/751870382 >> 172.21.15.72:0/751870382 conn(0x7f8a480ce990 msgr2=0x7f8a48070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:54.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.495+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/751870382 shutdown_connections 2023-08-25T04:46:54.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.495+0000 7f8a4e3ff700 1 -- 172.21.15.72:0/751870382 wait complete. 2023-08-25T04:46:54.515 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:54.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:54.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.717+0000 7f15827ff700 1 Processor -- start 2023-08-25T04:46:54.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.717+0000 7f15827ff700 1 -- start start 2023-08-25T04:46:54.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.718+0000 7f15827ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f157c0b4f10 0x7f157c167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.718+0000 7f15827ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c0b8d10 con 0x7f157c15d000 2023-08-25T04:46:54.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.718+0000 7f15827ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c0b6e90 con 0x7f157c0d10c0 2023-08-25T04:46:54.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.718+0000 7f15827ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c0b56f0 con 0x7f157c0b4f10 2023-08-25T04:46:54.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.718+0000 7f157bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f157c15d000 0x7f157c0b8600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56080/0 (socket says 172.21.15.72:56080) 2023-08-25T04:46:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.718+0000 7f157bfff700 1 -- 172.21.15.72:0/2751043502 learned_addr learned my addr 172.21.15.72:0/2751043502 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f1580d9c700 1 --2- 172.21.15.72:0/2751043502 >> v2:172.21.15.137:3300/0 conn(0x7f157c0b4f10 0x7f157c167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289361339 0 0) 0x7f157c0b8d10 con 0x7f157c15d000 2023-08-25T04:46:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15640035b0 con 0x7f157c15d000 2023-08-25T04:46:54.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2396609697 0 0) 0x7f15640035b0 con 0x7f157c15d000 2023-08-25T04:46:54.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 >> v2:172.21.15.137:3300/0 conn(0x7f157c0b4f10 msgr2=0x7f157c167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 --2- 172.21.15.72:0/2751043502 >> v2:172.21.15.137:3300/0 conn(0x7f157c0b4f10 0x7f157c167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 >> v1:172.21.15.137:6789/0 conn(0x7f157c0d10c0 legacy=0x7f157c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c15d3e0 con 0x7f157c15d000 2023-08-25T04:46:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f156c001670 con 0x7f157c15d000 2023-08-25T04:46:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 >> v1:172.21.15.72:6789/0 conn(0x7f157c15d000 legacy=0x7f157c0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1564003a00 0x7f1564003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1564004850 0x7f1564004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.719+0000 7f157affd700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1564005210 0x7f156400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156400c080 con 0x7f1564004850 2023-08-25T04:46:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156400c1f0 con 0x7f1564005210 2023-08-25T04:46:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156400c3b0 con 0x7f1564003a00 2023-08-25T04:46:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157b7fe700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1564004850 0x7f1564004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157bfff700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1564003a00 0x7f1564003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f1580d9c700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1564005210 0x7f156400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157b7fe700 1 -- 172.21.15.72:0/2751043502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1564003a00 msgr2=0x7f1564003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157b7fe700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1564003a00 0x7f1564003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157b7fe700 1 -- 172.21.15.72:0/2751043502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1564005210 msgr2=0x7f156400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157b7fe700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1564005210 0x7f156400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157b7fe700 1 -- 172.21.15.72:0/2751043502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640035b0 con 0x7f1564004850 2023-08-25T04:46:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157bfff700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1564003a00 0x7f1564003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f1580d9c700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1564005210 0x7f156400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f1580d9c700 1 -- 172.21.15.72:0/2751043502 reap_dead start 2023-08-25T04:46:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.720+0000 7f157b7fe700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1564004850 0x7f1564004cd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15700017c0 tx=0x7f1564005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1527d4db82414d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.721+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15700052d0 con 0x7f1564004850 2023-08-25T04:46:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.721+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1570005430 con 0x7f1564004850 2023-08-25T04:46:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.721+0000 7f157affd700 1 -- 172.21.15.72:0/2751043502 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15700038c0 con 0x7f1564004850 2023-08-25T04:46:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.721+0000 7f15827ff700 1 -- 172.21.15.72:0/2751043502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1564004850 msgr2=0x7f1564004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.721+0000 7f15827ff700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1564004850 0x7f1564004cd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15700017c0 tx=0x7f1564005880 comp rx=0 tx=0).stop 2023-08-25T04:46:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.721+0000 7f15827ff700 1 -- 172.21.15.72:0/2751043502 shutdown_connections 2023-08-25T04:46:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.721+0000 7f15827ff700 1 --2- 172.21.15.72:0/2751043502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1564004850 0x7f1564004cd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.721+0000 7f15827ff700 1 -- 172.21.15.72:0/2751043502 >> 172.21.15.72:0/2751043502 conn(0x7f157c071e10 msgr2=0x7f157c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.721+0000 7f15827ff700 1 -- 172.21.15.72:0/2751043502 shutdown_connections 2023-08-25T04:46:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.721+0000 7f15827ff700 1 -- 172.21.15.72:0/2751043502 wait complete. 2023-08-25T04:46:54.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.723+0000 7f15827ff700 1 Processor -- start 2023-08-25T04:46:54.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.723+0000 7f15827ff700 1 -- start start 2023-08-25T04:46:54.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.724+0000 7f15827ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1564004850 0x7f157c1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.724+0000 7f15827ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157c15fa40 0x7f157c15fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.724+0000 7f15827ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c0d14d0 0x7f157c0d1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.724+0000 7f15827ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0d1e90 con 0x7f157c15fa40 2023-08-25T04:46:54.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.724+0000 7f15827ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0cafd0 con 0x7f157c0d14d0 2023-08-25T04:46:54.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.724+0000 7f15827ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0ca3c0 con 0x7f1564004850 2023-08-25T04:46:54.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.724+0000 7f157b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157c15fa40 0x7f157c15fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.724+0000 7f157b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157c15fa40 0x7f157c15fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34878/0 (socket says 172.21.15.72:34878) 2023-08-25T04:46:54.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.724+0000 7f157b7fe700 1 -- 172.21.15.72:0/2936002513 learned_addr learned my addr 172.21.15.72:0/2936002513 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:54.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f157bfff700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1564004850 0x7f157c1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f1580d9c700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c0d14d0 0x7f157c0d1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f157b7fe700 1 -- 172.21.15.72:0/2936002513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1564004850 msgr2=0x7f157c1508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f157b7fe700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1564004850 0x7f157c1508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f157b7fe700 1 -- 172.21.15.72:0/2936002513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c0d14d0 msgr2=0x7f157c0d1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f157b7fe700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c0d14d0 0x7f157c0d1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f157b7fe700 1 -- 172.21.15.72:0/2936002513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0ca6a0 con 0x7f157c15fa40 2023-08-25T04:46:54.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f1580d9c700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c0d14d0 0x7f157c0d1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:54.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f157b7fe700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157c15fa40 0x7f157c15fec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1570015040 tx=0x7f1570001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:54.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f1578ff9700 1 -- 172.21.15.72:0/2936002513 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570001290 con 0x7f157c15fa40 2023-08-25T04:46:54.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f1578ff9700 1 -- 172.21.15.72:0/2936002513 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1570006860 con 0x7f157c15fa40 2023-08-25T04:46:54.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f15827ff700 1 -- 172.21.15.72:0/2936002513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157c0ca980 con 0x7f157c15fa40 2023-08-25T04:46:54.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f1578ff9700 1 -- 172.21.15.72:0/2936002513 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570006bf0 con 0x7f157c15fa40 2023-08-25T04:46:54.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.725+0000 7f15827ff700 1 -- 172.21.15.72:0/2936002513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c15edf0 con 0x7f157c15fa40 2023-08-25T04:46:54.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.726+0000 7f15827ff700 1 -- 172.21.15.72:0/2936002513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157c06a2f0 con 0x7f157c15fa40 2023-08-25T04:46:54.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.727+0000 7f1578ff9700 1 -- 172.21.15.72:0/2936002513 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1570019040 con 0x7f157c15fa40 2023-08-25T04:46:54.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.728+0000 7f1578ff9700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f156806a0e0 0x7f156806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:54.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.728+0000 7f1578ff9700 1 -- 172.21.15.72:0/2936002513 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f15700896b0 con 0x7f157c15fa40 2023-08-25T04:46:54.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.728+0000 7f157bfff700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f156806a0e0 0x7f156806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:54.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.729+0000 7f157bfff700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f156806a0e0 0x7f156806c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f156c001eb0 tx=0x7f156c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:54.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.732+0000 7f1578ff9700 1 -- 172.21.15.72:0/2936002513 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1570054a60 con 0x7f157c15fa40 2023-08-25T04:46:54.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.930+0000 7f15827ff700 1 -- 172.21.15.72:0/2936002513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f157c0cb140 con 0x7f157c15fa40 2023-08-25T04:46:54.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.930+0000 7f1578ff9700 1 -- 172.21.15.72:0/2936002513 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1570058080 con 0x7f157c15fa40 2023-08-25T04:46:54.931 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 -- 172.21.15.72:0/2936002513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f156806a0e0 msgr2=0x7f156806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f156806a0e0 0x7f156806c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f156c001eb0 tx=0x7f156c009040 comp rx=0 tx=0).stop 2023-08-25T04:46:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 -- 172.21.15.72:0/2936002513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157c15fa40 msgr2=0x7f157c15fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157c15fa40 0x7f157c15fec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1570015040 tx=0x7f1570001120 comp rx=0 tx=0).stop 2023-08-25T04:46:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 -- 172.21.15.72:0/2936002513 shutdown_connections 2023-08-25T04:46:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f156806a0e0 0x7f156806c5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c0d14d0 0x7f157c0d1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1564004850 0x7f157c1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 --2- 172.21.15.72:0/2936002513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157c15fa40 0x7f157c15fec0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 -- 172.21.15.72:0/2936002513 >> 172.21.15.72:0/2936002513 conn(0x7f157c071e10 msgr2=0x7f157c15b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 -- 172.21.15.72:0/2936002513 shutdown_connections 2023-08-25T04:46:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:54.933+0000 7f15827ff700 1 -- 172.21.15.72:0/2936002513 wait complete. 2023-08-25T04:46:54.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:55.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.152+0000 7f5c389ff700 1 Processor -- start 2023-08-25T04:46:55.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.152+0000 7f5c389ff700 1 -- start start 2023-08-25T04:46:55.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.153+0000 7f5c389ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5c340cb650 0x7f5c340cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.153+0000 7f5c389ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c340717b0 con 0x7f5c340b2c70 2023-08-25T04:46:55.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.153+0000 7f5c389ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c340b4300 con 0x7f5c340b2810 2023-08-25T04:46:55.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.153+0000 7f5c389ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c340cbf70 con 0x7f5c340cb650 2023-08-25T04:46:55.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.153+0000 7f5c32d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5c340b2c70 0x7f5c340710a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56092/0 (socket says 172.21.15.72:56092) 2023-08-25T04:46:55.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.153+0000 7f5c32d9d700 1 -- 172.21.15.72:0/1431424141 learned_addr learned my addr 172.21.15.72:0/1431424141 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:55.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.153+0000 7f5c3259c700 1 --2- 172.21.15.72:0/1431424141 >> v2:172.21.15.137:3300/0 conn(0x7f5c340cb650 0x7f5c340cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.154+0000 7f5c31d9b700 1 -- 172.21.15.72:0/1431424141 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396974207 0 0) 0x7f5c340717b0 con 0x7f5c340b2c70 2023-08-25T04:46:55.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.154+0000 7f5c31d9b700 1 -- 172.21.15.72:0/1431424141 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c200035b0 con 0x7f5c340b2c70 2023-08-25T04:46:55.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.154+0000 7f5c31d9b700 1 -- 172.21.15.72:0/1431424141 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600641895 0 0) 0x7f5c340b4300 con 0x7f5c340b2810 2023-08-25T04:46:55.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.154+0000 7f5c31d9b700 1 -- 172.21.15.72:0/1431424141 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c340717b0 con 0x7f5c340b2810 2023-08-25T04:46:55.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.154+0000 7f5c3259c700 1 -- 172.21.15.72:0/1431424141 >> v1:172.21.15.137:6789/0 conn(0x7f5c340b2810 legacy=0x7f5c34070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.154+0000 7f5c3259c700 1 -- 172.21.15.72:0/1431424141 >> v1:172.21.15.72:6789/0 conn(0x7f5c340b2c70 legacy=0x7f5c340710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.154+0000 7f5c3259c700 1 -- 172.21.15.72:0/1431424141 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340b3260 con 0x7f5c340cb650 2023-08-25T04:46:55.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.154+0000 7f5c3259c700 1 --2- 172.21.15.72:0/1431424141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c340cb650 0x7f5c340cba30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009840 tx=0x7f5c24009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da7d896b659f2c2e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:55.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.154+0000 7f5c31d9b700 1 -- 172.21.15.72:0/1431424141 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24011830 con 0x7f5c340cb650 2023-08-25T04:46:55.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.154+0000 7f5c31d9b700 1 -- 172.21.15.72:0/1431424141 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c24011990 con 0x7f5c340cb650 2023-08-25T04:46:55.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.155+0000 7f5c31d9b700 1 -- 172.21.15.72:0/1431424141 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24011d20 con 0x7f5c340cb650 2023-08-25T04:46:55.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.155+0000 7f5c389ff700 1 -- 172.21.15.72:0/1431424141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c340cb650 msgr2=0x7f5c340cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.155+0000 7f5c389ff700 1 --2- 172.21.15.72:0/1431424141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c340cb650 0x7f5c340cba30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009840 tx=0x7f5c24009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:55.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.155+0000 7f5c389ff700 1 -- 172.21.15.72:0/1431424141 shutdown_connections 2023-08-25T04:46:55.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.155+0000 7f5c389ff700 1 --2- 172.21.15.72:0/1431424141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c340cb650 0x7f5c340cba30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.155+0000 7f5c389ff700 1 -- 172.21.15.72:0/1431424141 >> 172.21.15.72:0/1431424141 conn(0x7f5c3406a710 msgr2=0x7f5c3406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:55.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.155+0000 7f5c389ff700 1 -- 172.21.15.72:0/1431424141 shutdown_connections 2023-08-25T04:46:55.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.155+0000 7f5c389ff700 1 -- 172.21.15.72:0/1431424141 wait complete. 2023-08-25T04:46:55.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.157+0000 7f5c389ff700 1 Processor -- start 2023-08-25T04:46:55.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.157+0000 7f5c389ff700 1 -- start start 2023-08-25T04:46:55.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c389ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c340b2810 0x7f5c340c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c389ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c340b2c70 0x7f5c34154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c389ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c340cb650 0x7f5c340c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c389ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3415b130 con 0x7f5c340b2c70 2023-08-25T04:46:55.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c389ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c341553e0 con 0x7f5c340b2810 2023-08-25T04:46:55.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c389ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c340c6400 con 0x7f5c340cb650 2023-08-25T04:46:55.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c2bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c340b2c70 0x7f5c34154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c2bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c340b2c70 0x7f5c34154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34884/0 (socket says 172.21.15.72:34884) 2023-08-25T04:46:55.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c2bfff700 1 -- 172.21.15.72:0/982700921 learned_addr learned my addr 172.21.15.72:0/982700921 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:55.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c3259c700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c340b2810 0x7f5c340c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c32d9d700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c340cb650 0x7f5c340c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c2bfff700 1 -- 172.21.15.72:0/982700921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c340cb650 msgr2=0x7f5c340c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c2bfff700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c340cb650 0x7f5c340c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c2bfff700 1 -- 172.21.15.72:0/982700921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c340b2810 msgr2=0x7f5c340c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c2bfff700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c340b2810 0x7f5c340c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c2bfff700 1 -- 172.21.15.72:0/982700921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c240094a0 con 0x7f5c340b2c70 2023-08-25T04:46:55.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.158+0000 7f5c3259c700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c340b2810 0x7f5c340c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:55.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.159+0000 7f5c2bfff700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c340b2c70 0x7f5c34154ea0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00c520 tx=0x7f5c1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:55.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.159+0000 7f5c2affd700 1 -- 172.21.15.72:0/982700921 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c0052d0 con 0x7f5c340b2c70 2023-08-25T04:46:55.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.159+0000 7f5c2affd700 1 -- 172.21.15.72:0/982700921 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1c005430 con 0x7f5c340b2c70 2023-08-25T04:46:55.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.159+0000 7f5c2affd700 1 -- 172.21.15.72:0/982700921 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c0038c0 con 0x7f5c340b2c70 2023-08-25T04:46:55.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.159+0000 7f5c389ff700 1 -- 172.21.15.72:0/982700921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c340c66e0 con 0x7f5c340b2c70 2023-08-25T04:46:55.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.159+0000 7f5c389ff700 1 -- 172.21.15.72:0/982700921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c340c5fd0 con 0x7f5c340b2c70 2023-08-25T04:46:55.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.160+0000 7f5c389ff700 1 -- 172.21.15.72:0/982700921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3415b270 con 0x7f5c340b2c70 2023-08-25T04:46:55.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.161+0000 7f5c2affd700 1 -- 172.21.15.72:0/982700921 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5c1c003a20 con 0x7f5c340b2c70 2023-08-25T04:46:55.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.162+0000 7f5c2affd700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c1406a0e0 0x7f5c1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.162+0000 7f5c2affd700 1 -- 172.21.15.72:0/982700921 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5c1c087d80 con 0x7f5c340b2c70 2023-08-25T04:46:55.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.162+0000 7f5c3259c700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c1406a0e0 0x7f5c1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.163+0000 7f5c3259c700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c1406a0e0 0x7f5c1406c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009fd0 tx=0x7f5c2401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:55.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.166+0000 7f5c2affd700 1 -- 172.21.15.72:0/982700921 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5c3415b270 con 0x7f5c340b2c70 2023-08-25T04:46:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.360+0000 7f5c389ff700 1 -- 172.21.15.72:0/982700921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c3415b270 con 0x7f5c340b2c70 2023-08-25T04:46:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.361+0000 7f5c2affd700 1 -- 172.21.15.72:0/982700921 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c1c017020 con 0x7f5c340b2c70 2023-08-25T04:46:55.362 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:55.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.363+0000 7f5c389ff700 1 -- 172.21.15.72:0/982700921 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c1406a0e0 msgr2=0x7f5c1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.363+0000 7f5c389ff700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c1406a0e0 0x7f5c1406c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009fd0 tx=0x7f5c2401c040 comp rx=0 tx=0).stop 2023-08-25T04:46:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.363+0000 7f5c389ff700 1 -- 172.21.15.72:0/982700921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c340b2c70 msgr2=0x7f5c34154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.363+0000 7f5c389ff700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c340b2c70 0x7f5c34154ea0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00c520 tx=0x7f5c1c00c8e0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.363+0000 7f5c389ff700 1 -- 172.21.15.72:0/982700921 shutdown_connections 2023-08-25T04:46:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.363+0000 7f5c389ff700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5c1406a0e0 0x7f5c1406c5a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.363+0000 7f5c389ff700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5c340cb650 0x7f5c340c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.363+0000 7f5c389ff700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c340b2810 0x7f5c340c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.363+0000 7f5c389ff700 1 --2- 172.21.15.72:0/982700921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c340b2c70 0x7f5c34154ea0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.363+0000 7f5c389ff700 1 -- 172.21.15.72:0/982700921 >> 172.21.15.72:0/982700921 conn(0x7f5c3406a710 msgr2=0x7f5c340ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.364+0000 7f5c389ff700 1 -- 172.21.15.72:0/982700921 shutdown_connections 2023-08-25T04:46:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.364+0000 7f5c389ff700 1 -- 172.21.15.72:0/982700921 wait complete. 2023-08-25T04:46:55.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:55.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.580+0000 7f3811dff700 1 Processor -- start 2023-08-25T04:46:55.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.580+0000 7f3811dff700 1 -- start start 2023-08-25T04:46:55.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.582+0000 7f3811dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f380c15d000 0x7f380c0b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.582+0000 7f3811dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c0b6e90 con 0x7f380c0b4f10 2023-08-25T04:46:55.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.582+0000 7f3811dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c15d3e0 con 0x7f380c0d10c0 2023-08-25T04:46:55.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.582+0000 7f3811dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0b56f0 con 0x7f380c15d000 2023-08-25T04:46:55.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.582+0000 7f380bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f380c0b4f10 0x7f380c0b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56102/0 (socket says 172.21.15.72:56102) 2023-08-25T04:46:55.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.582+0000 7f380bfff700 1 -- 172.21.15.72:0/1709614115 learned_addr learned my addr 172.21.15.72:0/1709614115 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.582+0000 7f380b7fe700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f380c15d000 0x7f380c0b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.582+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508067195 0 0) 0x7f380c0b6e90 con 0x7f380c0b4f10 2023-08-25T04:46:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.582+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37f80035b0 con 0x7f380c0b4f10 2023-08-25T04:46:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506584668 0 0) 0x7f380c15d3e0 con 0x7f380c0d10c0 2023-08-25T04:46:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f380c0b6e90 con 0x7f380c0d10c0 2023-08-25T04:46:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 259667280 0 0) 0x7f37f80035b0 con 0x7f380c0b4f10 2023-08-25T04:46:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f380c15d000 msgr2=0x7f380c0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f380c15d000 0x7f380c0b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 >> v1:172.21.15.137:6789/0 conn(0x7f380c0d10c0 legacy=0x7f380c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c0b6280 con 0x7f380c0b4f10 2023-08-25T04:46:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f38040019f0 con 0x7f380c0b4f10 2023-08-25T04:46:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 >> v1:172.21.15.72:6789/0 conn(0x7f380c0b4f10 legacy=0x7f380c0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f8003bc0 0x7f37f8003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37f8004850 0x7f37f8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f380c15d000 0x7f37f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f800bac0 con 0x7f37f8003bc0 2023-08-25T04:46:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f800bc00 con 0x7f37f8004850 2023-08-25T04:46:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f800bdc0 con 0x7f380c15d000 2023-08-25T04:46:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380b7fe700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f8003bc0 0x7f37f8003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f3803fff700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37f8004850 0x7f37f8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380bfff700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f380c15d000 0x7f37f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.583+0000 7f380b7fe700 1 -- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f380c15d000 msgr2=0x7f37f8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:55.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.584+0000 7f380b7fe700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f380c15d000 0x7f37f8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.584+0000 7f380b7fe700 1 -- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37f8004850 msgr2=0x7f37f8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.584+0000 7f380b7fe700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37f8004850 0x7f37f8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.584+0000 7f380b7fe700 1 -- 172.21.15.72:0/1709614115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f80035b0 con 0x7f37f8003bc0 2023-08-25T04:46:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.584+0000 7f3803fff700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37f8004850 0x7f37f8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:55.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.584+0000 7f380bfff700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f380c15d000 0x7f37f8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:55.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.584+0000 7f380b7fe700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f8003bc0 0x7f37f8003fc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009b60 tx=0x7f37f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b413920c151bf5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:55.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.584+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc00e6c0 con 0x7f37f8003bc0 2023-08-25T04:46:55.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.584+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc00e820 con 0x7f37f8003bc0 2023-08-25T04:46:55.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.584+0000 7f380affd700 1 -- 172.21.15.72:0/1709614115 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc00eb90 con 0x7f37f8003bc0 2023-08-25T04:46:55.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.585+0000 7f3811dff700 1 -- 172.21.15.72:0/1709614115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f8003bc0 msgr2=0x7f37f8003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.585+0000 7f3811dff700 1 --2- 172.21.15.72:0/1709614115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f8003bc0 0x7f37f8003fc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009b60 tx=0x7f37f8005880 comp rx=0 tx=0).stop 2023-08-25T04:46:55.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.585+0000 7f380bfff700 1 -- 172.21.15.72:0/1709614115 reap_dead start 2023-08-25T04:46:55.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.585+0000 7f3811dff700 1 -- 172.21.15.72:0/1709614115 shutdown_connections 2023-08-25T04:46:55.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.585+0000 7f3811dff700 1 -- 172.21.15.72:0/1709614115 >> 172.21.15.72:0/1709614115 conn(0x7f380c071e10 msgr2=0x7f380c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:55.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.585+0000 7f3811dff700 1 -- 172.21.15.72:0/1709614115 shutdown_connections 2023-08-25T04:46:55.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.585+0000 7f3811dff700 1 -- 172.21.15.72:0/1709614115 wait complete. 2023-08-25T04:46:55.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.587+0000 7f3811dff700 1 Processor -- start 2023-08-25T04:46:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.587+0000 7f3811dff700 1 -- start start 2023-08-25T04:46:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3811dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37f8003bc0 0x7f380c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3811dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c0b27e0 0x7f380c0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3811dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f380c15d5d0 0x7f380c15da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3811dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0b31a0 con 0x7f380c0b27e0 2023-08-25T04:46:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3811dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c15eb80 con 0x7f380c15d5d0 2023-08-25T04:46:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3811dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c1527c0 con 0x7f37f8003bc0 2023-08-25T04:46:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3803fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c0b27e0 0x7f380c0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3803fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c0b27e0 0x7f380c0b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34894/0 (socket says 172.21.15.72:34894) 2023-08-25T04:46:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3803fff700 1 -- 172.21.15.72:0/2498439363 learned_addr learned my addr 172.21.15.72:0/2498439363 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f380b7fe700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37f8003bc0 0x7f380c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f380bfff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f380c15d5d0 0x7f380c15da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3803fff700 1 -- 172.21.15.72:0/2498439363 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37f8003bc0 msgr2=0x7f380c152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3803fff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37f8003bc0 0x7f380c152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3803fff700 1 -- 172.21.15.72:0/2498439363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f380c15d5d0 msgr2=0x7f380c15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3803fff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f380c15d5d0 0x7f380c15da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f3803fff700 1 -- 172.21.15.72:0/2498439363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c15e2e0 con 0x7f380c0b27e0 2023-08-25T04:46:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.588+0000 7f380bfff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f380c15d5d0 0x7f380c15da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.589+0000 7f3803fff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c0b27e0 0x7f380c0b2c60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f37f400e7b0 tx=0x7f37f400eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.589+0000 7f3808ff9700 1 -- 172.21.15.72:0/2498439363 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4017070 con 0x7f380c0b27e0 2023-08-25T04:46:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.589+0000 7f3808ff9700 1 -- 172.21.15.72:0/2498439363 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40052e0 con 0x7f380c0b27e0 2023-08-25T04:46:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.589+0000 7f3808ff9700 1 -- 172.21.15.72:0/2498439363 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4005450 con 0x7f380c0b27e0 2023-08-25T04:46:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.589+0000 7f3811dff700 1 -- 172.21.15.72:0/2498439363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c15e5c0 con 0x7f380c0b27e0 2023-08-25T04:46:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.589+0000 7f3811dff700 1 -- 172.21.15.72:0/2498439363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c0cb530 con 0x7f380c0b27e0 2023-08-25T04:46:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.590+0000 7f3811dff700 1 -- 172.21.15.72:0/2498439363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c0b4d80 con 0x7f380c0b27e0 2023-08-25T04:46:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.591+0000 7f3808ff9700 1 -- 172.21.15.72:0/2498439363 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f37f4006860 con 0x7f380c0b27e0 2023-08-25T04:46:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.592+0000 7f3808ff9700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f37ec06a110 0x7f37ec06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:55.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.592+0000 7f3808ff9700 1 -- 172.21.15.72:0/2498439363 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f37f4087f00 con 0x7f380c0b27e0 2023-08-25T04:46:55.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.592+0000 7f380b7fe700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f37ec06a110 0x7f37ec06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:55.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.593+0000 7f380b7fe700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f37ec06a110 0x7f37ec06c5d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37fc000c00 tx=0x7f37fc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:55.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.596+0000 7f3808ff9700 1 -- 172.21.15.72:0/2498439363 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f37f40532c0 con 0x7f380c0b27e0 2023-08-25T04:46:55.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.796+0000 7f3811dff700 1 -- 172.21.15.72:0/2498439363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f380c0cb390 con 0x7f380c0b27e0 2023-08-25T04:46:55.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.796+0000 7f3808ff9700 1 -- 172.21.15.72:0/2498439363 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f380c0cb390 con 0x7f380c0b27e0 2023-08-25T04:46:55.798 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:55.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 -- 172.21.15.72:0/2498439363 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f37ec06a110 msgr2=0x7f37ec06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f37ec06a110 0x7f37ec06c5d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37fc000c00 tx=0x7f37fc008030 comp rx=0 tx=0).stop 2023-08-25T04:46:55.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 -- 172.21.15.72:0/2498439363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c0b27e0 msgr2=0x7f380c0b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:55.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c0b27e0 0x7f380c0b2c60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f37f400e7b0 tx=0x7f37f400eb70 comp rx=0 tx=0).stop 2023-08-25T04:46:55.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 -- 172.21.15.72:0/2498439363 shutdown_connections 2023-08-25T04:46:55.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f37ec06a110 0x7f37ec06c5d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f380c15d5d0 0x7f380c15da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f37f8003bc0 0x7f380c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 --2- 172.21.15.72:0/2498439363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f380c0b27e0 0x7f380c0b2c60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:55.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 -- 172.21.15.72:0/2498439363 >> 172.21.15.72:0/2498439363 conn(0x7f380c071e10 msgr2=0x7f380c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:55.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 -- 172.21.15.72:0/2498439363 shutdown_connections 2023-08-25T04:46:55.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:55.799+0000 7f3811dff700 1 -- 172.21.15.72:0/2498439363 wait complete. 2023-08-25T04:46:55.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:56.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.019+0000 7f85363ff700 1 Processor -- start 2023-08-25T04:46:56.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.020+0000 7f85363ff700 1 -- start start 2023-08-25T04:46:56.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f85363ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f853015d000 0x7f85300b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f85363ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85300b6e90 con 0x7f85300d10c0 2023-08-25T04:46:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f85363ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853015d3e0 con 0x7f85300b4f10 2023-08-25T04:46:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f85363ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300b56f0 con 0x7f853015d000 2023-08-25T04:46:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f8527fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f85300d10c0 0x7f85300b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56106/0 (socket says 172.21.15.72:56106) 2023-08-25T04:46:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f852ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f853015d000 0x7f85300b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f8527fff700 1 -- 172.21.15.72:0/765393981 learned_addr learned my addr 172.21.15.72:0/765393981 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f852ffff700 1 -- 172.21.15.72:0/765393981 >> v1:172.21.15.137:6789/0 conn(0x7f85300b4f10 legacy=0x7f85300b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f852ffff700 1 -- 172.21.15.72:0/765393981 >> v1:172.21.15.72:6789/0 conn(0x7f85300d10c0 legacy=0x7f85300b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f852ffff700 1 -- 172.21.15.72:0/765393981 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300b6280 con 0x7f853015d000 2023-08-25T04:46:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.021+0000 7f852f7fe700 1 -- 172.21.15.72:0/765393981 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353327290 0 0) 0x7f85300b6e90 con 0x7f85300d10c0 2023-08-25T04:46:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.022+0000 7f852ffff700 1 --2- 172.21.15.72:0/765393981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f853015d000 0x7f85300b8600 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8520009840 tx=0x7f8520009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14a5963ab3e73e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.022+0000 7f852f7fe700 1 -- 172.21.15.72:0/765393981 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520004230 con 0x7f853015d000 2023-08-25T04:46:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.022+0000 7f852f7fe700 1 -- 172.21.15.72:0/765393981 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520004390 con 0x7f853015d000 2023-08-25T04:46:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.022+0000 7f852f7fe700 1 -- 172.21.15.72:0/765393981 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85200036a0 con 0x7f853015d000 2023-08-25T04:46:56.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.022+0000 7f85363ff700 1 -- 172.21.15.72:0/765393981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f853015d000 msgr2=0x7f85300b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.022+0000 7f85363ff700 1 --2- 172.21.15.72:0/765393981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f853015d000 0x7f85300b8600 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8520009840 tx=0x7f8520009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:56.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.023+0000 7f85363ff700 1 -- 172.21.15.72:0/765393981 shutdown_connections 2023-08-25T04:46:56.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.023+0000 7f85363ff700 1 --2- 172.21.15.72:0/765393981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f853015d000 0x7f85300b8600 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.023+0000 7f85363ff700 1 -- 172.21.15.72:0/765393981 >> 172.21.15.72:0/765393981 conn(0x7f8530071e10 msgr2=0x7f8530072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:56.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.023+0000 7f85363ff700 1 -- 172.21.15.72:0/765393981 shutdown_connections 2023-08-25T04:46:56.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.023+0000 7f85363ff700 1 -- 172.21.15.72:0/765393981 wait complete. 2023-08-25T04:46:56.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.024+0000 7f85363ff700 1 Processor -- start 2023-08-25T04:46:56.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.024+0000 7f85363ff700 1 -- start start 2023-08-25T04:46:56.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.025+0000 7f85363ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85300b4f10 0x7f8530152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.025+0000 7f85363ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85300d10c0 0x7f85300c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.025+0000 7f85363ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f853015d000 0x7f85300d2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.025+0000 7f85363ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300c7640 con 0x7f85300b4f10 2023-08-25T04:46:56.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.025+0000 7f85363ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300c7920 con 0x7f85300d10c0 2023-08-25T04:46:56.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.025+0000 7f85363ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85300c7c00 con 0x7f853015d000 2023-08-25T04:46:56.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f852ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85300b4f10 0x7f8530152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f852ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85300b4f10 0x7f8530152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34914/0 (socket says 172.21.15.72:34914) 2023-08-25T04:46:56.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f852ffff700 1 -- 172.21.15.72:0/613244687 learned_addr learned my addr 172.21.15.72:0/613244687 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:56.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f8527fff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85300d10c0 0x7f85300c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f853499c700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f853015d000 0x7f85300d2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f852ffff700 1 -- 172.21.15.72:0/613244687 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f853015d000 msgr2=0x7f85300d2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f852ffff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f853015d000 0x7f85300d2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f852ffff700 1 -- 172.21.15.72:0/613244687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85300d10c0 msgr2=0x7f85300c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f852ffff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85300d10c0 0x7f85300c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f852ffff700 1 -- 172.21.15.72:0/613244687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85200094a0 con 0x7f85300b4f10 2023-08-25T04:46:56.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.026+0000 7f852ffff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85300b4f10 0x7f8530152210 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8520000c00 tx=0x7f8520004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:56.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.027+0000 7f852d7fa700 1 -- 172.21.15.72:0/613244687 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520011630 con 0x7f85300b4f10 2023-08-25T04:46:56.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.027+0000 7f852d7fa700 1 -- 172.21.15.72:0/613244687 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852001e070 con 0x7f85300b4f10 2023-08-25T04:46:56.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.027+0000 7f85363ff700 1 -- 172.21.15.72:0/613244687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300c7ee0 con 0x7f85300b4f10 2023-08-25T04:46:56.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.027+0000 7f852d7fa700 1 -- 172.21.15.72:0/613244687 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85200119f0 con 0x7f85300b4f10 2023-08-25T04:46:56.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.027+0000 7f85363ff700 1 -- 172.21.15.72:0/613244687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8530152750 con 0x7f85300b4f10 2023-08-25T04:46:56.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.028+0000 7f85363ff700 1 -- 172.21.15.72:0/613244687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8530154340 con 0x7f85300b4f10 2023-08-25T04:46:56.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.028+0000 7f852d7fa700 1 -- 172.21.15.72:0/613244687 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8520011b50 con 0x7f85300b4f10 2023-08-25T04:46:56.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.029+0000 7f852d7fa700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f851006a0e0 0x7f851006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.029+0000 7f852d7fa700 1 -- 172.21.15.72:0/613244687 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8520089cb0 con 0x7f85300b4f10 2023-08-25T04:46:56.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.030+0000 7f8527fff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f851006a0e0 0x7f851006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.030+0000 7f8527fff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f851006a0e0 0x7f851006c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8518007fd0 tx=0x7f8518007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:56.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.034+0000 7f852d7fa700 1 -- 172.21.15.72:0/613244687 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8530154340 con 0x7f85300b4f10 2023-08-25T04:46:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.227+0000 7f85363ff700 1 -- 172.21.15.72:0/613244687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8530154720 con 0x7f85300b4f10 2023-08-25T04:46:56.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.228+0000 7f852d7fa700 1 -- 172.21.15.72:0/613244687 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8530154720 con 0x7f85300b4f10 2023-08-25T04:46:56.230 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:56.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 -- 172.21.15.72:0/613244687 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f851006a0e0 msgr2=0x7f851006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f851006a0e0 0x7f851006c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8518007fd0 tx=0x7f8518007c20 comp rx=0 tx=0).stop 2023-08-25T04:46:56.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 -- 172.21.15.72:0/613244687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85300b4f10 msgr2=0x7f8530152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85300b4f10 0x7f8530152210 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8520000c00 tx=0x7f8520004750 comp rx=0 tx=0).stop 2023-08-25T04:46:56.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 -- 172.21.15.72:0/613244687 shutdown_connections 2023-08-25T04:46:56.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f851006a0e0 0x7f851006c5a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f853015d000 0x7f85300d2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85300b4f10 0x7f8530152210 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 --2- 172.21.15.72:0/613244687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85300d10c0 0x7f85300c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 -- 172.21.15.72:0/613244687 >> 172.21.15.72:0/613244687 conn(0x7f8530071e10 msgr2=0x7f85300b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 -- 172.21.15.72:0/613244687 shutdown_connections 2023-08-25T04:46:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.231+0000 7f85363ff700 1 -- 172.21.15.72:0/613244687 wait complete. 2023-08-25T04:46:56.250 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:56.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.448+0000 7fc1983ff700 1 Processor -- start 2023-08-25T04:46:56.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.448+0000 7fc1983ff700 1 -- start start 2023-08-25T04:46:56.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.449+0000 7fc1983ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1900c71b0 0x7fc1900cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.449+0000 7fc1983ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1900cd4f0 0x7fc1900cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.449+0000 7fc1983ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1900cdeb0 0x7fc19006b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.449+0000 7fc1983ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900cba40 con 0x7fc1900cd4f0 2023-08-25T04:46:56.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.449+0000 7fc1983ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900d04f0 con 0x7fc1900c71b0 2023-08-25T04:46:56.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.449+0000 7fc1983ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900ce340 con 0x7fc1900cdeb0 2023-08-25T04:46:56.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.449+0000 7fc19599a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1900cd4f0 0x7fc1900cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc19599a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1900cd4f0 0x7fc1900cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34924/0 (socket says 172.21.15.72:34924) 2023-08-25T04:46:56.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc19599a700 1 -- 172.21.15.72:0/763814825 learned_addr learned my addr 172.21.15.72:0/763814825 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:56.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc19699c700 1 --2- 172.21.15.72:0/763814825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1900cdeb0 0x7fc19006b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc19619b700 1 --2- 172.21.15.72:0/763814825 >> v2:172.21.15.137:3300/0 conn(0x7fc1900c71b0 0x7fc1900cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc19599a700 1 -- 172.21.15.72:0/763814825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1900cdeb0 msgr2=0x7fc19006b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:56.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc19599a700 1 --2- 172.21.15.72:0/763814825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1900cdeb0 0x7fc19006b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc19599a700 1 -- 172.21.15.72:0/763814825 >> v2:172.21.15.137:3300/0 conn(0x7fc1900c71b0 msgr2=0x7fc1900cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:56.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc19599a700 1 --2- 172.21.15.72:0/763814825 >> v2:172.21.15.137:3300/0 conn(0x7fc1900c71b0 0x7fc1900cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc19599a700 1 -- 172.21.15.72:0/763814825 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1900d0210 con 0x7fc1900cd4f0 2023-08-25T04:46:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc19599a700 1 --2- 172.21.15.72:0/763814825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900cd4f0 0x7fc1900cd970 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc19006ea10 tx=0x7fc180009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6983e4dd7e3f3501 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc195199700 1 -- 172.21.15.72:0/763814825 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000b870 con 0x7fc1900cd4f0 2023-08-25T04:46:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc195199700 1 -- 172.21.15.72:0/763814825 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18000b9d0 con 0x7fc1900cd4f0 2023-08-25T04:46:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.450+0000 7fc195199700 1 -- 172.21.15.72:0/763814825 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000bd60 con 0x7fc1900cd4f0 2023-08-25T04:46:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.451+0000 7fc1983ff700 1 -- 172.21.15.72:0/763814825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900cd4f0 msgr2=0x7fc1900cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.451+0000 7fc1983ff700 1 --2- 172.21.15.72:0/763814825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900cd4f0 0x7fc1900cd970 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc19006ea10 tx=0x7fc180009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.451+0000 7fc1983ff700 1 -- 172.21.15.72:0/763814825 shutdown_connections 2023-08-25T04:46:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.451+0000 7fc1983ff700 1 --2- 172.21.15.72:0/763814825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1900cdeb0 0x7fc19006b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.451+0000 7fc1983ff700 1 --2- 172.21.15.72:0/763814825 >> v2:172.21.15.137:3300/0 conn(0x7fc1900c71b0 0x7fc1900cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.451+0000 7fc1983ff700 1 --2- 172.21.15.72:0/763814825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900cd4f0 0x7fc1900cd970 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.451+0000 7fc1983ff700 1 -- 172.21.15.72:0/763814825 >> 172.21.15.72:0/763814825 conn(0x7fc1900d0c70 msgr2=0x7fc1900d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.451+0000 7fc1983ff700 1 -- 172.21.15.72:0/763814825 shutdown_connections 2023-08-25T04:46:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.451+0000 7fc1983ff700 1 -- 172.21.15.72:0/763814825 wait complete. 2023-08-25T04:46:56.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.453+0000 7fc1983ff700 1 Processor -- start 2023-08-25T04:46:56.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.453+0000 7fc1983ff700 1 -- start start 2023-08-25T04:46:56.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc1983ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900c71b0 0x7fc19015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc1983ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1900cd4f0 0x7fc19015d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc1983ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1900cdeb0 0x7fc19015a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc1983ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015dde0 con 0x7fc1900c71b0 2023-08-25T04:46:56.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc1983ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015a870 con 0x7fc1900cdeb0 2023-08-25T04:46:56.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc1983ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015ce00 con 0x7fc1900cd4f0 2023-08-25T04:46:56.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900c71b0 0x7fc19015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900c71b0 0x7fc19015bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34940/0 (socket says 172.21.15.72:34940) 2023-08-25T04:46:56.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19619b700 1 -- 172.21.15.72:0/2927006070 learned_addr learned my addr 172.21.15.72:0/2927006070 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:56.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19699c700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1900cdeb0 0x7fc19015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19599a700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1900cd4f0 0x7fc19015d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19619b700 1 -- 172.21.15.72:0/2927006070 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1900cd4f0 msgr2=0x7fc19015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19619b700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1900cd4f0 0x7fc19015d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19619b700 1 -- 172.21.15.72:0/2927006070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1900cdeb0 msgr2=0x7fc19015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19619b700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1900cdeb0 0x7fc19015a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19619b700 1 -- 172.21.15.72:0/2927006070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180009550 con 0x7fc1900c71b0 2023-08-25T04:46:56.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.454+0000 7fc19699c700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1900cdeb0 0x7fc19015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:56.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.455+0000 7fc19619b700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900c71b0 0x7fc19015bb60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00d800 tx=0x7fc18c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.455+0000 7fc186ffd700 1 -- 172.21.15.72:0/2927006070 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0125f0 con 0x7fc1900c71b0 2023-08-25T04:46:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.455+0000 7fc186ffd700 1 -- 172.21.15.72:0/2927006070 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c012750 con 0x7fc1900c71b0 2023-08-25T04:46:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.455+0000 7fc186ffd700 1 -- 172.21.15.72:0/2927006070 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c012ae0 con 0x7fc1900c71b0 2023-08-25T04:46:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.455+0000 7fc1983ff700 1 -- 172.21.15.72:0/2927006070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19015c1f0 con 0x7fc1900c71b0 2023-08-25T04:46:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.455+0000 7fc1983ff700 1 -- 172.21.15.72:0/2927006070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19015c7b0 con 0x7fc1900c71b0 2023-08-25T04:46:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.456+0000 7fc1983ff700 1 -- 172.21.15.72:0/2927006070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19009ebb0 con 0x7fc1900c71b0 2023-08-25T04:46:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.457+0000 7fc186ffd700 1 -- 172.21.15.72:0/2927006070 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc18c012c40 con 0x7fc1900c71b0 2023-08-25T04:46:56.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.458+0000 7fc186ffd700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc17406a0e0 0x7fc17406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.458+0000 7fc186ffd700 1 -- 172.21.15.72:0/2927006070 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc18c088c20 con 0x7fc1900c71b0 2023-08-25T04:46:56.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.458+0000 7fc19599a700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc17406a0e0 0x7fc17406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.458+0000 7fc19599a700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc17406a0e0 0x7fc17406c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc190070ce0 tx=0x7fc180008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:56.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.462+0000 7fc186ffd700 1 -- 172.21.15.72:0/2927006070 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc18c053f40 con 0x7fc1900c71b0 2023-08-25T04:46:56.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.655+0000 7fc1983ff700 1 -- 172.21.15.72:0/2927006070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc1900744f0 con 0x7fc1900c71b0 2023-08-25T04:46:56.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.655+0000 7fc186ffd700 1 -- 172.21.15.72:0/2927006070 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc18c057560 con 0x7fc1900c71b0 2023-08-25T04:46:56.656 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 -- 172.21.15.72:0/2927006070 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc17406a0e0 msgr2=0x7fc17406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc17406a0e0 0x7fc17406c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc190070ce0 tx=0x7fc180008030 comp rx=0 tx=0).stop 2023-08-25T04:46:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 -- 172.21.15.72:0/2927006070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900c71b0 msgr2=0x7fc19015bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900c71b0 0x7fc19015bb60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00d800 tx=0x7fc18c00dbc0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 -- 172.21.15.72:0/2927006070 shutdown_connections 2023-08-25T04:46:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc17406a0e0 0x7fc17406c5a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1900cdeb0 0x7fc19015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1900c71b0 0x7fc19015bb60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 --2- 172.21.15.72:0/2927006070 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1900cd4f0 0x7fc19015d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 -- 172.21.15.72:0/2927006070 >> 172.21.15.72:0/2927006070 conn(0x7fc1900d0c70 msgr2=0x7fc19006ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:56.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 -- 172.21.15.72:0/2927006070 shutdown_connections 2023-08-25T04:46:56.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.658+0000 7fc1983ff700 1 -- 172.21.15.72:0/2927006070 wait complete. 2023-08-25T04:46:56.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:46:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.875+0000 7ff84f1ff700 1 Processor -- start 2023-08-25T04:46:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.876+0000 7ff84f1ff700 1 -- start start 2023-08-25T04:46:56.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff84f1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff84815ab40 0x7ff8480b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff84f1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff84815af20 0x7ff848070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff84f1ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff848070dd0 0x7ff84806d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff84f1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff848071240 con 0x7ff84815af20 2023-08-25T04:46:56.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff84f1ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8480b2120 con 0x7ff848070dd0 2023-08-25T04:46:56.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff84f1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480af1e0 con 0x7ff84815ab40 2023-08-25T04:46:56.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff847fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff84815af20 0x7ff848070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff847fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff84815af20 0x7ff848070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34948/0 (socket says 172.21.15.72:34948) 2023-08-25T04:46:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff847fff700 1 -- 172.21.15.72:0/2961408906 learned_addr learned my addr 172.21.15.72:0/2961408906 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff847fff700 1 -- 172.21.15.72:0/2961408906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff84815ab40 msgr2=0x7ff8480b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff847fff700 1 --2- 172.21.15.72:0/2961408906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff84815ab40 0x7ff8480b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff847fff700 1 -- 172.21.15.72:0/2961408906 >> v2:172.21.15.137:3300/0 conn(0x7ff848070dd0 msgr2=0x7ff84806d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff847fff700 1 --2- 172.21.15.72:0/2961408906 >> v2:172.21.15.137:3300/0 conn(0x7ff848070dd0 0x7ff84806d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.877+0000 7ff847fff700 1 -- 172.21.15.72:0/2961408906 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480ae5d0 con 0x7ff84815af20 2023-08-25T04:46:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.878+0000 7ff847fff700 1 --2- 172.21.15.72:0/2961408906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84815af20 0x7ff848070890 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff84806ee80 tx=0x7ff834009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519870b517be8d9d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.878+0000 7ff8477fe700 1 -- 172.21.15.72:0/2961408906 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400b860 con 0x7ff84815af20 2023-08-25T04:46:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.878+0000 7ff8477fe700 1 -- 172.21.15.72:0/2961408906 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83400b9c0 con 0x7ff84815af20 2023-08-25T04:46:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.878+0000 7ff8477fe700 1 -- 172.21.15.72:0/2961408906 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400bd50 con 0x7ff84815af20 2023-08-25T04:46:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.878+0000 7ff84f1ff700 1 -- 172.21.15.72:0/2961408906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84815af20 msgr2=0x7ff848070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.878+0000 7ff84f1ff700 1 --2- 172.21.15.72:0/2961408906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84815af20 0x7ff848070890 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff84806ee80 tx=0x7ff834009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.879+0000 7ff84f1ff700 1 -- 172.21.15.72:0/2961408906 shutdown_connections 2023-08-25T04:46:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.879+0000 7ff84f1ff700 1 --2- 172.21.15.72:0/2961408906 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff84815ab40 0x7ff8480b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.879+0000 7ff84f1ff700 1 --2- 172.21.15.72:0/2961408906 >> v2:172.21.15.137:3300/0 conn(0x7ff848070dd0 0x7ff84806d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.879+0000 7ff84f1ff700 1 --2- 172.21.15.72:0/2961408906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84815af20 0x7ff848070890 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.879+0000 7ff84f1ff700 1 -- 172.21.15.72:0/2961408906 >> 172.21.15.72:0/2961408906 conn(0x7ff8480ce9a0 msgr2=0x7ff8480ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.879+0000 7ff84f1ff700 1 -- 172.21.15.72:0/2961408906 shutdown_connections 2023-08-25T04:46:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.879+0000 7ff84f1ff700 1 -- 172.21.15.72:0/2961408906 wait complete. 2023-08-25T04:46:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.880+0000 7ff84f1ff700 1 Processor -- start 2023-08-25T04:46:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.880+0000 7ff84f1ff700 1 -- start start 2023-08-25T04:46:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.881+0000 7ff84f1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848070dd0 0x7ff8481efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.881+0000 7ff84f1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff84815ab40 0x7ff8481542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.881+0000 7ff84f1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff84815af20 0x7ff848154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.881+0000 7ff84f1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84815e1c0 con 0x7ff848070dd0 2023-08-25T04:46:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.881+0000 7ff84f1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84815d540 con 0x7ff84815ab40 2023-08-25T04:46:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.881+0000 7ff84f1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84815d820 con 0x7ff84815af20 2023-08-25T04:46:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff84cf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848070dd0 0x7ff8481efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff84cf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848070dd0 0x7ff8481efac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34962/0 (socket says 172.21.15.72:34962) 2023-08-25T04:46:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff84cf9b700 1 -- 172.21.15.72:0/505283656 learned_addr learned my addr 172.21.15.72:0/505283656 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff84d79c700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff84815af20 0x7ff848154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff847fff700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff84815ab40 0x7ff8481542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff84cf9b700 1 -- 172.21.15.72:0/505283656 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff84815af20 msgr2=0x7ff848154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff84cf9b700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff84815af20 0x7ff848154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff84cf9b700 1 -- 172.21.15.72:0/505283656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff84815ab40 msgr2=0x7ff8481542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff84cf9b700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff84815ab40 0x7ff8481542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff84cf9b700 1 -- 172.21.15.72:0/505283656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834009550 con 0x7ff848070dd0 2023-08-25T04:46:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.882+0000 7ff84cf9b700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848070dd0 0x7ff8481efac0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00b530 tx=0x7ff83c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.883+0000 7ff8457fa700 1 -- 172.21.15.72:0/505283656 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c011830 con 0x7ff848070dd0 2023-08-25T04:46:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.883+0000 7ff8457fa700 1 -- 172.21.15.72:0/505283656 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c0119b0 con 0x7ff848070dd0 2023-08-25T04:46:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.883+0000 7ff8457fa700 1 -- 172.21.15.72:0/505283656 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c011d60 con 0x7ff848070dd0 2023-08-25T04:46:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.883+0000 7ff84f1ff700 1 -- 172.21.15.72:0/505283656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84815db00 con 0x7ff848070dd0 2023-08-25T04:46:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.883+0000 7ff84f1ff700 1 -- 172.21.15.72:0/505283656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8481f0000 con 0x7ff848070dd0 2023-08-25T04:46:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.884+0000 7ff84f1ff700 1 -- 172.21.15.72:0/505283656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8481f01f0 con 0x7ff848070dd0 2023-08-25T04:46:56.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.885+0000 7ff8457fa700 1 -- 172.21.15.72:0/505283656 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff83c01a400 con 0x7ff848070dd0 2023-08-25T04:46:56.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.886+0000 7ff8457fa700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff82c06a0e0 0x7ff82c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:56.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.886+0000 7ff8457fa700 1 -- 172.21.15.72:0/505283656 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff83c088940 con 0x7ff848070dd0 2023-08-25T04:46:56.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.886+0000 7ff847fff700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff82c06a0e0 0x7ff82c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:56.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.887+0000 7ff847fff700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff82c06a0e0 0x7ff82c06c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff834000c00 tx=0x7ff834008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:56.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:56.890+0000 7ff8457fa700 1 -- 172.21.15.72:0/505283656 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff83c053cf0 con 0x7ff848070dd0 2023-08-25T04:46:57.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.106+0000 7ff84f1ff700 1 -- 172.21.15.72:0/505283656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff8480722d0 con 0x7ff848070dd0 2023-08-25T04:46:57.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.107+0000 7ff8457fa700 1 -- 172.21.15.72:0/505283656 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff83c057310 con 0x7ff848070dd0 2023-08-25T04:46:57.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 -- 172.21.15.72:0/505283656 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff82c06a0e0 msgr2=0x7ff82c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff82c06a0e0 0x7ff82c06c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff834000c00 tx=0x7ff834008030 comp rx=0 tx=0).stop 2023-08-25T04:46:57.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 -- 172.21.15.72:0/505283656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848070dd0 msgr2=0x7ff8481efac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848070dd0 0x7ff8481efac0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00b530 tx=0x7ff83c00b8f0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 -- 172.21.15.72:0/505283656 shutdown_connections 2023-08-25T04:46:57.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff82c06a0e0 0x7ff82c06c5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff84815af20 0x7ff848154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848070dd0 0x7ff8481efac0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 --2- 172.21.15.72:0/505283656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff84815ab40 0x7ff8481542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 -- 172.21.15.72:0/505283656 >> 172.21.15.72:0/505283656 conn(0x7ff8480ce9a0 msgr2=0x7ff8480cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:57.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 -- 172.21.15.72:0/505283656 shutdown_connections 2023-08-25T04:46:57.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.109+0000 7ff84f1ff700 1 -- 172.21.15.72:0/505283656 wait complete. 2023-08-25T04:46:57.113 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-08-25T04:46:57.128 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:46:57.128 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:46:57.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:46:57.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.408+0000 7fd9521ff700 1 Processor -- start 2023-08-25T04:46:57.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.408+0000 7fd9521ff700 1 -- start start 2023-08-25T04:46:57.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.409+0000 7fd9521ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd94c15d240 0x7fd94c0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd9521ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd94c0cbd60 0x7fd94c0cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd9521ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0cb2a0 con 0x7fd94c0cf970 2023-08-25T04:46:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd9521ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0cfe80 con 0x7fd94c0cbd60 2023-08-25T04:46:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd9521ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0d0160 con 0x7fd94c15d240 2023-08-25T04:46:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd94affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd94c0cf970 0x7fd94c0cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56108/0 (socket says 172.21.15.72:56108) 2023-08-25T04:46:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd94affd700 1 -- 172.21.15.72:0/1050671467 learned_addr learned my addr 172.21.15.72:0/1050671467 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd94bfff700 1 --2- 172.21.15.72:0/1050671467 >> v2:172.21.15.72:3300/0 conn(0x7fd94c0cbd60 0x7fd94c0cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd94b7fe700 1 --2- 172.21.15.72:0/1050671467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd94c15d240 0x7fd94c0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd94a7fc700 1 -- 172.21.15.72:0/1050671467 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254111297 0 0) 0x7fd94c0cb2a0 con 0x7fd94c0cf970 2023-08-25T04:46:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd94a7fc700 1 -- 172.21.15.72:0/1050671467 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9340035b0 con 0x7fd94c0cf970 2023-08-25T04:46:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd94bfff700 1 -- 172.21.15.72:0/1050671467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd94c15d240 msgr2=0x7fd94c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd94bfff700 1 --2- 172.21.15.72:0/1050671467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd94c15d240 0x7fd94c0cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd94bfff700 1 -- 172.21.15.72:0/1050671467 >> v1:172.21.15.72:6789/0 conn(0x7fd94c0cf970 legacy=0x7fd94c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.410+0000 7fd94bfff700 1 -- 172.21.15.72:0/1050671467 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0cb560 con 0x7fd94c0cbd60 2023-08-25T04:46:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.411+0000 7fd94bfff700 1 --2- 172.21.15.72:0/1050671467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cbd60 0x7fd94c0cc1f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd944009d90 tx=0x7fd94400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f03f8bdbf86345 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:57.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.411+0000 7fd94a7fc700 1 -- 172.21.15.72:0/1050671467 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94400e070 con 0x7fd94c0cbd60 2023-08-25T04:46:57.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.411+0000 7fd94a7fc700 1 -- 172.21.15.72:0/1050671467 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94400bb20 con 0x7fd94c0cbd60 2023-08-25T04:46:57.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.411+0000 7fd94a7fc700 1 -- 172.21.15.72:0/1050671467 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944012430 con 0x7fd94c0cbd60 2023-08-25T04:46:57.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.411+0000 7fd9521ff700 1 -- 172.21.15.72:0/1050671467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cbd60 msgr2=0x7fd94c0cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.411+0000 7fd9521ff700 1 --2- 172.21.15.72:0/1050671467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cbd60 0x7fd94c0cc1f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd944009d90 tx=0x7fd94400b330 comp rx=0 tx=0).stop 2023-08-25T04:46:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.411+0000 7fd9521ff700 1 -- 172.21.15.72:0/1050671467 shutdown_connections 2023-08-25T04:46:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.411+0000 7fd9521ff700 1 --2- 172.21.15.72:0/1050671467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cbd60 0x7fd94c0cc1f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.412+0000 7fd9521ff700 1 --2- 172.21.15.72:0/1050671467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd94c15d240 0x7fd94c0cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.412+0000 7fd9521ff700 1 -- 172.21.15.72:0/1050671467 >> 172.21.15.72:0/1050671467 conn(0x7fd94c0d0c50 msgr2=0x7fd94c0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.412+0000 7fd9521ff700 1 -- 172.21.15.72:0/1050671467 shutdown_connections 2023-08-25T04:46:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.412+0000 7fd9521ff700 1 -- 172.21.15.72:0/1050671467 wait complete. 2023-08-25T04:46:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.413+0000 7fd9521ff700 1 Processor -- start 2023-08-25T04:46:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.413+0000 7fd9521ff700 1 -- start start 2023-08-25T04:46:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.414+0000 7fd9521ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd94c0cbd60 0x7fd94c0c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.414+0000 7fd9521ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cf970 0x7fd94c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.414+0000 7fd9521ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd94c15d240 0x7fd94c06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.414+0000 7fd9521ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c14e7c0 con 0x7fd94c0cf970 2023-08-25T04:46:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.414+0000 7fd9521ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c148880 con 0x7fd94c15d240 2023-08-25T04:46:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.414+0000 7fd9521ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0c7650 con 0x7fd94c0cbd60 2023-08-25T04:46:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cf970 0x7fd94c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cf970 0x7fd94c06f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34978/0 (socket says 172.21.15.72:34978) 2023-08-25T04:46:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94affd700 1 -- 172.21.15.72:0/791592297 learned_addr learned my addr 172.21.15.72:0/791592297 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94bfff700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd94c15d240 0x7fd94c06f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94b7fe700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd94c0cbd60 0x7fd94c0c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94affd700 1 -- 172.21.15.72:0/791592297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd94c0cbd60 msgr2=0x7fd94c0c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94affd700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd94c0cbd60 0x7fd94c0c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94affd700 1 -- 172.21.15.72:0/791592297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd94c15d240 msgr2=0x7fd94c06f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94affd700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd94c15d240 0x7fd94c06f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94affd700 1 -- 172.21.15.72:0/791592297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944009a70 con 0x7fd94c0cf970 2023-08-25T04:46:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd94affd700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cf970 0x7fd94c06f280 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c700 tx=0x7fd94000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd933fff700 1 -- 172.21.15.72:0/791592297 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940005d70 con 0x7fd94c0cf970 2023-08-25T04:46:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.415+0000 7fd933fff700 1 -- 172.21.15.72:0/791592297 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9400070d0 con 0x7fd94c0cf970 2023-08-25T04:46:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.416+0000 7fd9521ff700 1 -- 172.21.15.72:0/791592297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c1f6b80 con 0x7fd94c0cf970 2023-08-25T04:46:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.416+0000 7fd933fff700 1 -- 172.21.15.72:0/791592297 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940007460 con 0x7fd94c0cf970 2023-08-25T04:46:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.416+0000 7fd9521ff700 1 -- 172.21.15.72:0/791592297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c1f60a0 con 0x7fd94c0cf970 2023-08-25T04:46:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.417+0000 7fd9521ff700 1 -- 172.21.15.72:0/791592297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c04e620 con 0x7fd94c0cf970 2023-08-25T04:46:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.418+0000 7fd933fff700 1 -- 172.21.15.72:0/791592297 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd9400075c0 con 0x7fd94c0cf970 2023-08-25T04:46:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.418+0000 7fd933fff700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd93806a0e0 0x7fd93806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.419+0000 7fd933fff700 1 -- 172.21.15.72:0/791592297 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd940087e70 con 0x7fd94c0cf970 2023-08-25T04:46:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.419+0000 7fd94b7fe700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd93806a0e0 0x7fd93806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.419+0000 7fd94b7fe700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd93806a0e0 0x7fd93806c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009b70 tx=0x7fd93c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.423+0000 7fd933fff700 1 -- 172.21.15.72:0/791592297 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd940053230 con 0x7fd94c0cf970 2023-08-25T04:46:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.628+0000 7fd9521ff700 1 -- 172.21.15.72:0/791592297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd94c06cf90 con 0x7fd94c0cf970 2023-08-25T04:46:57.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.630+0000 7fd933fff700 1 -- 172.21.15.72:0/791592297 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7fd940056850 con 0x7fd94c0cf970 2023-08-25T04:46:57.631 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:46:57.631 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:46:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 -- 172.21.15.72:0/791592297 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd93806a0e0 msgr2=0x7fd93806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd93806a0e0 0x7fd93806c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009b70 tx=0x7fd93c008040 comp rx=0 tx=0).stop 2023-08-25T04:46:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 -- 172.21.15.72:0/791592297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cf970 msgr2=0x7fd94c06f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cf970 0x7fd94c06f280 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c700 tx=0x7fd94000cac0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 -- 172.21.15.72:0/791592297 shutdown_connections 2023-08-25T04:46:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd93806a0e0 0x7fd93806c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd94c15d240 0x7fd94c06f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd94c0cbd60 0x7fd94c0c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 --2- 172.21.15.72:0/791592297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd94c0cf970 0x7fd94c06f280 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 -- 172.21.15.72:0/791592297 >> 172.21.15.72:0/791592297 conn(0x7fd94c0d0c50 msgr2=0x7fd94c070200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 -- 172.21.15.72:0/791592297 shutdown_connections 2023-08-25T04:46:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.632+0000 7fd9521ff700 1 -- 172.21.15.72:0/791592297 wait complete. 2023-08-25T04:46:57.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:46:57.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:46:57.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.852+0000 7fcd489ff700 1 Processor -- start 2023-08-25T04:46:57.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.853+0000 7fcd489ff700 1 -- start start 2023-08-25T04:46:57.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd489ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440ade30 0x7fcd440ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd489ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcd440710a0 0x7fcd440c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd489ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd440ae750 con 0x7fcd4415da20 2023-08-25T04:46:57.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd489ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd440ae9d0 con 0x7fcd440710a0 2023-08-25T04:46:57.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd489ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44159d70 con 0x7fcd440ade30 2023-08-25T04:46:57.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd3bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcd4415da20 0x7fcd44070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56116/0 (socket says 172.21.15.72:56116) 2023-08-25T04:46:57.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd3bfff700 1 -- 172.21.15.72:0/4011607162 learned_addr learned my addr 172.21.15.72:0/4011607162 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:57.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd4259c700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440ade30 0x7fcd440ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd42d9d700 1 --2- 172.21.15.72:0/4011607162 >> v2:172.21.15.137:3300/0 conn(0x7fcd440710a0 0x7fcd440c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415394022 0 0) 0x7fcd440ae750 con 0x7fcd4415da20 2023-08-25T04:46:57.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.854+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd300035b0 con 0x7fcd4415da20 2023-08-25T04:46:57.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 565758501 0 0) 0x7fcd300035b0 con 0x7fcd4415da20 2023-08-25T04:46:57.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440ade30 msgr2=0x7fcd440ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:57.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440ade30 0x7fcd440ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 >> v2:172.21.15.137:3300/0 conn(0x7fcd440710a0 msgr2=0x7fcd440c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:57.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 --2- 172.21.15.72:0/4011607162 >> v2:172.21.15.137:3300/0 conn(0x7fcd440710a0 0x7fcd440c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4415a050 con 0x7fcd4415da20 2023-08-25T04:46:57.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fcd2c001670 con 0x7fcd4415da20 2023-08-25T04:46:57.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd42d9d700 1 --2- 172.21.15.72:0/4011607162 >> v2:172.21.15.137:3300/0 conn(0x7fcd440710a0 0x7fcd440c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:57.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 >> v1:172.21.15.72:6789/0 conn(0x7fcd4415da20 legacy=0x7fcd44070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd30003a00 0x7fcd30003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440ade30 0x7fcd30004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd30004d90 0x7fcd30005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440ae9d0 con 0x7fcd30004d90 2023-08-25T04:46:57.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44159d70 con 0x7fcd30003a00 2023-08-25T04:46:57.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3000dc20 con 0x7fcd440ade30 2023-08-25T04:46:57.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.855+0000 7fcd42d9d700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd30004d90 0x7fcd30005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd4259c700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd30003a00 0x7fcd30003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd42d9d700 1 -- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440ade30 msgr2=0x7fcd30004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:57.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd3bfff700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440ade30 0x7fcd30004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd42d9d700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440ade30 0x7fcd30004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd42d9d700 1 -- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd30003a00 msgr2=0x7fcd30003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:57.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd42d9d700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd30003a00 0x7fcd30003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd42d9d700 1 -- 172.21.15.72:0/4011607162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300035b0 con 0x7fcd30004d90 2023-08-25T04:46:57.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd4259c700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd30003a00 0x7fcd30003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:57.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd3bfff700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440ade30 0x7fcd30004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:57.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd42d9d700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd30004d90 0x7fcd30005210 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406def0 tx=0x7fcd30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94363054929df70 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:57.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c00ed90 con 0x7fcd30004d90 2023-08-25T04:46:57.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c00f040 con 0x7fcd30004d90 2023-08-25T04:46:57.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.856+0000 7fcd41d9b700 1 -- 172.21.15.72:0/4011607162 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0146a0 con 0x7fcd30004d90 2023-08-25T04:46:57.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.857+0000 7fcd489ff700 1 -- 172.21.15.72:0/4011607162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd30004d90 msgr2=0x7fcd30005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.857+0000 7fcd489ff700 1 --2- 172.21.15.72:0/4011607162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd30004d90 0x7fcd30005210 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406def0 tx=0x7fcd30005880 comp rx=0 tx=0).stop 2023-08-25T04:46:57.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.857+0000 7fcd42d9d700 1 -- 172.21.15.72:0/4011607162 reap_dead start 2023-08-25T04:46:57.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.857+0000 7fcd489ff700 1 -- 172.21.15.72:0/4011607162 shutdown_connections 2023-08-25T04:46:57.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.857+0000 7fcd489ff700 1 -- 172.21.15.72:0/4011607162 >> 172.21.15.72:0/4011607162 conn(0x7fcd4406a710 msgr2=0x7fcd4406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:57.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.857+0000 7fcd489ff700 1 -- 172.21.15.72:0/4011607162 shutdown_connections 2023-08-25T04:46:57.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.857+0000 7fcd489ff700 1 -- 172.21.15.72:0/4011607162 wait complete. 2023-08-25T04:46:57.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.858+0000 7fcd489ff700 1 Processor -- start 2023-08-25T04:46:57.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.859+0000 7fcd489ff700 1 -- start start 2023-08-25T04:46:57.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd489ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd30004d90 0x7fcd44155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd489ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440c4fc0 0x7fcd440b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd489ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd4415bca0 0x7fcd4415c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd489ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4415c690 con 0x7fcd4415bca0 2023-08-25T04:46:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd489ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440b2f40 con 0x7fcd30004d90 2023-08-25T04:46:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd489ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440b2170 con 0x7fcd440c4fc0 2023-08-25T04:46:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd42d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd4415bca0 0x7fcd4415c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd42d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd4415bca0 0x7fcd4415c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34998/0 (socket says 172.21.15.72:34998) 2023-08-25T04:46:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd42d9d700 1 -- 172.21.15.72:0/2401037639 learned_addr learned my addr 172.21.15.72:0/2401037639 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd4259c700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd30004d90 0x7fcd44155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd3bfff700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440c4fc0 0x7fcd440b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd42d9d700 1 -- 172.21.15.72:0/2401037639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440c4fc0 msgr2=0x7fcd440b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd42d9d700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440c4fc0 0x7fcd440b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd42d9d700 1 -- 172.21.15.72:0/2401037639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd30004d90 msgr2=0x7fcd44155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:57.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd42d9d700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd30004d90 0x7fcd44155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:57.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.860+0000 7fcd42d9d700 1 -- 172.21.15.72:0/2401037639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440c5440 con 0x7fcd4415bca0 2023-08-25T04:46:57.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.861+0000 7fcd42d9d700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd4415bca0 0x7fcd4415c150 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00b010 tx=0x7fcd3c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:57.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.861+0000 7fcd3affd700 1 -- 172.21.15.72:0/2401037639 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c007000 con 0x7fcd4415bca0 2023-08-25T04:46:57.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.861+0000 7fcd3affd700 1 -- 172.21.15.72:0/2401037639 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c003e30 con 0x7fcd4415bca0 2023-08-25T04:46:57.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.861+0000 7fcd3affd700 1 -- 172.21.15.72:0/2401037639 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c014c40 con 0x7fcd4415bca0 2023-08-25T04:46:57.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.861+0000 7fcd489ff700 1 -- 172.21.15.72:0/2401037639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd440b1e90 con 0x7fcd4415bca0 2023-08-25T04:46:57.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.861+0000 7fcd489ff700 1 -- 172.21.15.72:0/2401037639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd440b03e0 con 0x7fcd4415bca0 2023-08-25T04:46:57.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.862+0000 7fcd489ff700 1 -- 172.21.15.72:0/2401037639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd44072320 con 0x7fcd4415bca0 2023-08-25T04:46:57.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.863+0000 7fcd3affd700 1 -- 172.21.15.72:0/2401037639 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd3c024020 con 0x7fcd4415bca0 2023-08-25T04:46:57.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.864+0000 7fcd3affd700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcd2406a0e0 0x7fcd2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:57.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.864+0000 7fcd3affd700 1 -- 172.21.15.72:0/2401037639 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcd3c08a1b0 con 0x7fcd4415bca0 2023-08-25T04:46:57.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.864+0000 7fcd4259c700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcd2406a0e0 0x7fcd2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:57.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.865+0000 7fcd4259c700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcd2406a0e0 0x7fcd2406c5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009bf0 tx=0x7fcd34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:57.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:57.869+0000 7fcd3affd700 1 -- 172.21.15.72:0/2401037639 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcd3c055680 con 0x7fcd4415bca0 2023-08-25T04:46:58.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.066+0000 7fcd489ff700 1 -- 172.21.15.72:0/2401037639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcd440744f0 con 0x7fcd4415bca0 2023-08-25T04:46:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.066+0000 7fcd3affd700 1 -- 172.21.15.72:0/2401037639 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcd3c058ca0 con 0x7fcd4415bca0 2023-08-25T04:46:58.070 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:46:58.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.068+0000 7fcd489ff700 1 -- 172.21.15.72:0/2401037639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcd2406a0e0 msgr2=0x7fcd2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.068+0000 7fcd489ff700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcd2406a0e0 0x7fcd2406c5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009bf0 tx=0x7fcd34008040 comp rx=0 tx=0).stop 2023-08-25T04:46:58.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.069+0000 7fcd489ff700 1 -- 172.21.15.72:0/2401037639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd4415bca0 msgr2=0x7fcd4415c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.069+0000 7fcd489ff700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd4415bca0 0x7fcd4415c150 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00b010 tx=0x7fcd3c009750 comp rx=0 tx=0).stop 2023-08-25T04:46:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.069+0000 7fcd489ff700 1 -- 172.21.15.72:0/2401037639 shutdown_connections 2023-08-25T04:46:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.069+0000 7fcd489ff700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcd2406a0e0 0x7fcd2406c5a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.069+0000 7fcd489ff700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd4415bca0 0x7fcd4415c150 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.069+0000 7fcd489ff700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd30004d90 0x7fcd44155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.069+0000 7fcd489ff700 1 --2- 172.21.15.72:0/2401037639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd440c4fc0 0x7fcd440b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.069+0000 7fcd489ff700 1 -- 172.21.15.72:0/2401037639 >> 172.21.15.72:0/2401037639 conn(0x7fcd4406a710 msgr2=0x7fcd440cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.069+0000 7fcd489ff700 1 -- 172.21.15.72:0/2401037639 shutdown_connections 2023-08-25T04:46:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.069+0000 7fcd489ff700 1 -- 172.21.15.72:0/2401037639 wait complete. 2023-08-25T04:46:58.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:46:58.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.285+0000 7f15ce9ff700 1 Processor -- start 2023-08-25T04:46:58.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.285+0000 7f15ce9ff700 1 -- start start 2023-08-25T04:46:58.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.286+0000 7f15ce9ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f15c815d000 0x7f15c80b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.286+0000 7f15ce9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 0x7f15c80b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.286+0000 7f15ce9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c80b5190 con 0x7f15c80b4d40 2023-08-25T04:46:58.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.286+0000 7f15ce9ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c80b56f0 con 0x7f15c815d000 2023-08-25T04:46:58.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.286+0000 7f15ce9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80b6e90 con 0x7f15c80d10c0 2023-08-25T04:46:58.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.286+0000 7f15ccf9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f15c80b4d40 0x7f15c8160af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56122/0 (socket says 172.21.15.72:56122) 2023-08-25T04:46:58.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15ccf9c700 1 -- 172.21.15.72:0/2628869469 learned_addr learned my addr 172.21.15.72:0/2628869469 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:46:58.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15c77fe700 1 --2- 172.21.15.72:0/2628869469 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 0x7f15c80b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15c7fff700 1 --2- 172.21.15.72:0/2628869469 >> v2:172.21.15.137:3300/0 conn(0x7f15c815d000 0x7f15c80b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15c6ffd700 1 -- 172.21.15.72:0/2628869469 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088087656 0 0) 0x7f15c0001490 con 0x7f15c80b4d40 2023-08-25T04:46:58.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15c6ffd700 1 -- 172.21.15.72:0/2628869469 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b00035b0 con 0x7f15c80b4d40 2023-08-25T04:46:58.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15c6ffd700 1 -- 172.21.15.72:0/2628869469 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2998857566 0 0) 0x7f15b00035b0 con 0x7f15c80b4d40 2023-08-25T04:46:58.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15c77fe700 1 -- 172.21.15.72:0/2628869469 >> v2:172.21.15.137:3300/0 conn(0x7f15c815d000 msgr2=0x7f15c80b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:58.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15c77fe700 1 --2- 172.21.15.72:0/2628869469 >> v2:172.21.15.137:3300/0 conn(0x7f15c815d000 0x7f15c80b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15c77fe700 1 -- 172.21.15.72:0/2628869469 >> v1:172.21.15.72:6789/0 conn(0x7f15c80b4d40 legacy=0x7f15c8160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15c77fe700 1 -- 172.21.15.72:0/2628869469 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c815d3e0 con 0x7f15c80d10c0 2023-08-25T04:46:58.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.287+0000 7f15c7fff700 1 --2- 172.21.15.72:0/2628869469 >> v2:172.21.15.137:3300/0 conn(0x7f15c815d000 0x7f15c80b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:46:58.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.288+0000 7f15c77fe700 1 --2- 172.21.15.72:0/2628869469 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 0x7f15c80b4800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009840 tx=0x7f15bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2deb3aa6a502da07 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:58.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.288+0000 7f15c6ffd700 1 -- 172.21.15.72:0/2628869469 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0001b80 con 0x7f15c80d10c0 2023-08-25T04:46:58.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.288+0000 7f15c6ffd700 1 -- 172.21.15.72:0/2628869469 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc004030 con 0x7f15c80d10c0 2023-08-25T04:46:58.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.288+0000 7f15c6ffd700 1 -- 172.21.15.72:0/2628869469 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0043c0 con 0x7f15c80d10c0 2023-08-25T04:46:58.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.288+0000 7f15ce9ff700 1 -- 172.21.15.72:0/2628869469 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 msgr2=0x7f15c80b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.288+0000 7f15ce9ff700 1 --2- 172.21.15.72:0/2628869469 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 0x7f15c80b4800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009840 tx=0x7f15bc009b50 comp rx=0 tx=0).stop 2023-08-25T04:46:58.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.288+0000 7f15ce9ff700 1 -- 172.21.15.72:0/2628869469 shutdown_connections 2023-08-25T04:46:58.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.288+0000 7f15ce9ff700 1 --2- 172.21.15.72:0/2628869469 >> v2:172.21.15.137:3300/0 conn(0x7f15c815d000 0x7f15c80b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.288+0000 7f15ce9ff700 1 --2- 172.21.15.72:0/2628869469 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 0x7f15c80b4800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.288+0000 7f15ce9ff700 1 -- 172.21.15.72:0/2628869469 >> 172.21.15.72:0/2628869469 conn(0x7f15c8071e10 msgr2=0x7f15c8072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:58.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.289+0000 7f15ce9ff700 1 -- 172.21.15.72:0/2628869469 shutdown_connections 2023-08-25T04:46:58.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.289+0000 7f15ce9ff700 1 -- 172.21.15.72:0/2628869469 wait complete. 2023-08-25T04:46:58.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.290+0000 7f15ce9ff700 1 Processor -- start 2023-08-25T04:46:58.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.290+0000 7f15ce9ff700 1 -- start start 2023-08-25T04:46:58.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.291+0000 7f15ce9ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15c80b4d40 0x7f15c814eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.291+0000 7f15ce9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 0x7f15c814cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.291+0000 7f15ce9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c815d000 0x7f15c814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.291+0000 7f15ce9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c814f400 con 0x7f15c815d000 2023-08-25T04:46:58.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.291+0000 7f15ce9ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c814a7a0 con 0x7f15c80b4d40 2023-08-25T04:46:58.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.291+0000 7f15ce9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c814d460 con 0x7f15c80d10c0 2023-08-25T04:46:58.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.291+0000 7f15ccf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c815d000 0x7f15c814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15ccf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c815d000 0x7f15c814f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35014/0 (socket says 172.21.15.72:35014) 2023-08-25T04:46:58.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15ccf9c700 1 -- 172.21.15.72:0/1689974226 learned_addr learned my addr 172.21.15.72:0/1689974226 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:58.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15c77fe700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 0x7f15c814cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15c7fff700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15c80b4d40 0x7f15c814eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15ccf9c700 1 -- 172.21.15.72:0/1689974226 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 msgr2=0x7f15c814cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15ccf9c700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 0x7f15c814cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15ccf9c700 1 -- 172.21.15.72:0/1689974226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15c80b4d40 msgr2=0x7f15c814eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15ccf9c700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15c80b4d40 0x7f15c814eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15ccf9c700 1 -- 172.21.15.72:0/1689974226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80094a0 con 0x7f15c815d000 2023-08-25T04:46:58.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15c7fff700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15c80b4d40 0x7f15c814eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:58.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15ccf9c700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c815d000 0x7f15c814f580 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f15c000cca0 tx=0x7f15c000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:58.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15c4ff9700 1 -- 172.21.15.72:0/1689974226 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c000cea0 con 0x7f15c815d000 2023-08-25T04:46:58.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15c4ff9700 1 -- 172.21.15.72:0/1689974226 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c000ade0 con 0x7f15c815d000 2023-08-25T04:46:58.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15ce9ff700 1 -- 172.21.15.72:0/1689974226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc0094a0 con 0x7f15c815d000 2023-08-25T04:46:58.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.292+0000 7f15c4ff9700 1 -- 172.21.15.72:0/1689974226 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c00072f0 con 0x7f15c815d000 2023-08-25T04:46:58.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.293+0000 7f15ce9ff700 1 -- 172.21.15.72:0/1689974226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c8149bd0 con 0x7f15c815d000 2023-08-25T04:46:58.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.294+0000 7f15ce9ff700 1 -- 172.21.15.72:0/1689974226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c806a2f0 con 0x7f15c815d000 2023-08-25T04:46:58.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.295+0000 7f15c4ff9700 1 -- 172.21.15.72:0/1689974226 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f15c0007450 con 0x7f15c815d000 2023-08-25T04:46:58.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.295+0000 7f15c4ff9700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f15b406a0e0 0x7f15b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.296+0000 7f15c4ff9700 1 -- 172.21.15.72:0/1689974226 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f15c0088680 con 0x7f15c815d000 2023-08-25T04:46:58.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.296+0000 7f15c7fff700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f15b406a0e0 0x7f15b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.296+0000 7f15c7fff700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f15b406a0e0 0x7f15b406c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009c50 tx=0x7f15b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:58.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.300+0000 7f15c4ff9700 1 -- 172.21.15.72:0/1689974226 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f15c0053a40 con 0x7f15c815d000 2023-08-25T04:46:58.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.494+0000 7f15ce9ff700 1 -- 172.21.15.72:0/1689974226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15c80b5190 con 0x7f15c815d000 2023-08-25T04:46:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.495+0000 7f15c4ff9700 1 -- 172.21.15.72:0/1689974226 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15c80b5190 con 0x7f15c815d000 2023-08-25T04:46:58.496 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:46:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 -- 172.21.15.72:0/1689974226 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f15b406a0e0 msgr2=0x7f15b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f15b406a0e0 0x7f15b406c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009c50 tx=0x7f15b8008040 comp rx=0 tx=0).stop 2023-08-25T04:46:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 -- 172.21.15.72:0/1689974226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c815d000 msgr2=0x7f15c814f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c815d000 0x7f15c814f580 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f15c000cca0 tx=0x7f15c000a340 comp rx=0 tx=0).stop 2023-08-25T04:46:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 -- 172.21.15.72:0/1689974226 shutdown_connections 2023-08-25T04:46:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f15b406a0e0 0x7f15b406c5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c815d000 0x7f15c814f580 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15c80b4d40 0x7f15c814eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 --2- 172.21.15.72:0/1689974226 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f15c80d10c0 0x7f15c814cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 -- 172.21.15.72:0/1689974226 >> 172.21.15.72:0/1689974226 conn(0x7f15c8071e10 msgr2=0x7f15c80b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:58.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 -- 172.21.15.72:0/1689974226 shutdown_connections 2023-08-25T04:46:58.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.497+0000 7f15ce9ff700 1 -- 172.21.15.72:0/1689974226 wait complete. 2023-08-25T04:46:58.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:46:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.717+0000 7f5a1b9ff700 1 Processor -- start 2023-08-25T04:46:58.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.717+0000 7f5a1b9ff700 1 -- start start 2023-08-25T04:46:58.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.718+0000 7f5a1b9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a140b2810 0x7f5a140b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.718+0000 7f5a1b9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140add40 0x7f5a140ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.718+0000 7f5a1b9ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a140b4300 con 0x7f5a140cb650 2023-08-25T04:46:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.718+0000 7f5a1b9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a140b3260 con 0x7f5a140b2810 2023-08-25T04:46:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.718+0000 7f5a1b9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140b3540 con 0x7f5a140add40 2023-08-25T04:46:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.718+0000 7f5a18f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a140b2810 0x7f5a140b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.718+0000 7f5a18f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a140b2810 0x7f5a140b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35024/0 (socket says 172.21.15.72:35024) 2023-08-25T04:46:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.718+0000 7f5a18f9a700 1 -- 172.21.15.72:0/425292356 learned_addr learned my addr 172.21.15.72:0/425292356 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.718+0000 7f5a19f9c700 1 --2- 172.21.15.72:0/425292356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140add40 0x7f5a140ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.719+0000 7f5a18f9a700 1 -- 172.21.15.72:0/425292356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140add40 msgr2=0x7f5a140ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.719+0000 7f5a18f9a700 1 --2- 172.21.15.72:0/425292356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140add40 0x7f5a140ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.719+0000 7f5a18f9a700 1 -- 172.21.15.72:0/425292356 >> v1:172.21.15.137:6789/0 conn(0x7f5a140cb650 legacy=0x7f5a140cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.719+0000 7f5a18f9a700 1 -- 172.21.15.72:0/425292356 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140b3820 con 0x7f5a140b2810 2023-08-25T04:46:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.719+0000 7f5a18f9a700 1 --2- 172.21.15.72:0/425292356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140b2810 0x7f5a140b2c70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5a040098f0 tx=0x7f5a04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49033111bd0bc3f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:58.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.719+0000 7f5a0bfff700 1 -- 172.21.15.72:0/425292356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04011830 con 0x7f5a140b2810 2023-08-25T04:46:58.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.719+0000 7f5a0bfff700 1 -- 172.21.15.72:0/425292356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a04011990 con 0x7f5a140b2810 2023-08-25T04:46:58.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.719+0000 7f5a0bfff700 1 -- 172.21.15.72:0/425292356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04011d20 con 0x7f5a140b2810 2023-08-25T04:46:58.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.720+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/425292356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140b2810 msgr2=0x7f5a140b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.720+0000 7f5a1b9ff700 1 --2- 172.21.15.72:0/425292356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140b2810 0x7f5a140b2c70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5a040098f0 tx=0x7f5a04009c00 comp rx=0 tx=0).stop 2023-08-25T04:46:58.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.720+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/425292356 shutdown_connections 2023-08-25T04:46:58.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.720+0000 7f5a1b9ff700 1 --2- 172.21.15.72:0/425292356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140add40 0x7f5a140ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.720+0000 7f5a1b9ff700 1 --2- 172.21.15.72:0/425292356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140b2810 0x7f5a140b2c70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.720+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/425292356 >> 172.21.15.72:0/425292356 conn(0x7f5a1406a710 msgr2=0x7f5a1406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:58.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.720+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/425292356 shutdown_connections 2023-08-25T04:46:58.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.720+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/425292356 wait complete. 2023-08-25T04:46:58.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.722+0000 7f5a1b9ff700 1 Processor -- start 2023-08-25T04:46:58.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.722+0000 7f5a1b9ff700 1 -- start start 2023-08-25T04:46:58.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1b9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140add40 0x7f5a1415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1b9ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a140b2810 0x7f5a1415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1b9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140cb650 0x7f5a1415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1b9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140c3380 con 0x7f5a140add40 2023-08-25T04:46:58.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1b9ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1414f8a0 con 0x7f5a140b2810 2023-08-25T04:46:58.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1b9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140c24b0 con 0x7f5a140cb650 2023-08-25T04:46:58.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140add40 0x7f5a1415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140add40 0x7f5a1415d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35034/0 (socket says 172.21.15.72:35034) 2023-08-25T04:46:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1979b700 1 -- 172.21.15.72:0/3993451117 learned_addr learned my addr 172.21.15.72:0/3993451117 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a19f9c700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140cb650 0x7f5a1415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a18f9a700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a140b2810 0x7f5a1415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1979b700 1 -- 172.21.15.72:0/3993451117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140cb650 msgr2=0x7f5a1415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1979b700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140cb650 0x7f5a1415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1979b700 1 -- 172.21.15.72:0/3993451117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a140b2810 msgr2=0x7f5a1415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1979b700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a140b2810 0x7f5a1415c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1979b700 1 -- 172.21.15.72:0/3993451117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04009550 con 0x7f5a140add40 2023-08-25T04:46:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a19f9c700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140cb650 0x7f5a1415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a18f9a700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a140b2810 0x7f5a1415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:46:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.723+0000 7f5a1979b700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140add40 0x7f5a1415d3a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000c450 tx=0x7f5a1000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.724+0000 7f5a09ffb700 1 -- 172.21.15.72:0/3993451117 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100052d0 con 0x7f5a140add40 2023-08-25T04:46:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.724+0000 7f5a09ffb700 1 -- 172.21.15.72:0/3993451117 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a10005430 con 0x7f5a140add40 2023-08-25T04:46:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.724+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/3993451117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1415cd50 con 0x7f5a140add40 2023-08-25T04:46:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.724+0000 7f5a09ffb700 1 -- 172.21.15.72:0/3993451117 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100038c0 con 0x7f5a140add40 2023-08-25T04:46:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.724+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/3993451117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a140c2700 con 0x7f5a140add40 2023-08-25T04:46:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.725+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/3993451117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a14072320 con 0x7f5a140add40 2023-08-25T04:46:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.726+0000 7f5a09ffb700 1 -- 172.21.15.72:0/3993451117 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5a10003a20 con 0x7f5a140add40 2023-08-25T04:46:58.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.727+0000 7f5a09ffb700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f59f806a0e0 0x7f59f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:58.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.727+0000 7f5a09ffb700 1 -- 172.21.15.72:0/3993451117 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5a10087d60 con 0x7f5a140add40 2023-08-25T04:46:58.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.727+0000 7f5a18f9a700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f59f806a0e0 0x7f59f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:58.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.728+0000 7f5a18f9a700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f59f806a0e0 0x7f59f806c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009c40 tx=0x7f5a04008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.731+0000 7f5a09ffb700 1 -- 172.21.15.72:0/3993451117 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5a10053110 con 0x7f5a140add40 2023-08-25T04:46:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.929+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/3993451117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a140b2fa0 con 0x7f5a140add40 2023-08-25T04:46:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.930+0000 7f5a09ffb700 1 -- 172.21.15.72:0/3993451117 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a10056730 con 0x7f5a140add40 2023-08-25T04:46:58.931 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.932+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/3993451117 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f59f806a0e0 msgr2=0x7f59f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.932+0000 7f5a1b9ff700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f59f806a0e0 0x7f59f806c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009c40 tx=0x7f5a04008030 comp rx=0 tx=0).stop 2023-08-25T04:46:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.932+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/3993451117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140add40 msgr2=0x7f5a1415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.932+0000 7f5a1b9ff700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140add40 0x7f5a1415d3a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000c450 tx=0x7f5a1000c810 comp rx=0 tx=0).stop 2023-08-25T04:46:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.933+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/3993451117 shutdown_connections 2023-08-25T04:46:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.933+0000 7f5a1b9ff700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f59f806a0e0 0x7f59f806c5a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.933+0000 7f5a1b9ff700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a140cb650 0x7f5a1415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.933+0000 7f5a1b9ff700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a140add40 0x7f5a1415d3a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.933+0000 7f5a1b9ff700 1 --2- 172.21.15.72:0/3993451117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a140b2810 0x7f5a1415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.933+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/3993451117 >> 172.21.15.72:0/3993451117 conn(0x7f5a1406a710 msgr2=0x7f5a140cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.933+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/3993451117 shutdown_connections 2023-08-25T04:46:58.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:58.933+0000 7f5a1b9ff700 1 -- 172.21.15.72:0/3993451117 wait complete. 2023-08-25T04:46:58.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:46:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.149+0000 7f05735ff700 1 Processor -- start 2023-08-25T04:46:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.150+0000 7f05735ff700 1 -- start start 2023-08-25T04:46:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f05735ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 0x7f056c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f05735ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f056c0cbb90 0x7f056c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f05735ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c0cbfe0 con 0x7f056c150ac0 2023-08-25T04:46:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f05735ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c0af490 con 0x7f056c0cbb90 2023-08-25T04:46:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f05735ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c15d7c0 con 0x7f056c150ea0 2023-08-25T04:46:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f0571b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f056c0cbb90 0x7f056c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f0571b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f056c0cbb90 0x7f056c15a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35040/0 (socket says 172.21.15.72:35040) 2023-08-25T04:46:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f0571b9c700 1 -- 172.21.15.72:0/911441307 learned_addr learned my addr 172.21.15.72:0/911441307 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f0570b9a700 1 --2- 172.21.15.72:0/911441307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 0x7f056c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f0571b9c700 1 -- 172.21.15.72:0/911441307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 msgr2=0x7f056c0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f0571b9c700 1 --2- 172.21.15.72:0/911441307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 0x7f056c0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f0571b9c700 1 -- 172.21.15.72:0/911441307 >> v1:172.21.15.137:6789/0 conn(0x7f056c150ac0 legacy=0x7f056c15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f0571b9c700 1 -- 172.21.15.72:0/911441307 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0aebf0 con 0x7f056c0cbb90 2023-08-25T04:46:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.151+0000 7f0570b9a700 1 --2- 172.21.15.72:0/911441307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 0x7f056c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:46:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.152+0000 7f0571b9c700 1 --2- 172.21.15.72:0/911441307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 0x7f056c15a180 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0564009e50 tx=0x7f056400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afbb13cf875ccbd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.152+0000 7f0563fff700 1 -- 172.21.15.72:0/911441307 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056400e070 con 0x7f056c0cbb90 2023-08-25T04:46:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.152+0000 7f0563fff700 1 -- 172.21.15.72:0/911441307 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0564003a20 con 0x7f056c0cbb90 2023-08-25T04:46:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.152+0000 7f0563fff700 1 -- 172.21.15.72:0/911441307 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564003dd0 con 0x7f056c0cbb90 2023-08-25T04:46:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.152+0000 7f05735ff700 1 -- 172.21.15.72:0/911441307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 msgr2=0x7f056c15a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.152+0000 7f05735ff700 1 --2- 172.21.15.72:0/911441307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 0x7f056c15a180 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0564009e50 tx=0x7f056400b330 comp rx=0 tx=0).stop 2023-08-25T04:46:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.153+0000 7f05735ff700 1 -- 172.21.15.72:0/911441307 shutdown_connections 2023-08-25T04:46:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.153+0000 7f05735ff700 1 --2- 172.21.15.72:0/911441307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 0x7f056c15a180 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.153+0000 7f05735ff700 1 --2- 172.21.15.72:0/911441307 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 0x7f056c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.153+0000 7f05735ff700 1 -- 172.21.15.72:0/911441307 >> 172.21.15.72:0/911441307 conn(0x7f056c06a710 msgr2=0x7f056c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:59.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.153+0000 7f05735ff700 1 -- 172.21.15.72:0/911441307 shutdown_connections 2023-08-25T04:46:59.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.153+0000 7f05735ff700 1 -- 172.21.15.72:0/911441307 wait complete. 2023-08-25T04:46:59.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.154+0000 7f05735ff700 1 Processor -- start 2023-08-25T04:46:59.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.155+0000 7f05735ff700 1 -- start start 2023-08-25T04:46:59.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.155+0000 7f05735ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 0x7f056c14b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.155+0000 7f05735ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f056c150ac0 0x7f056c0c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f05735ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 0x7f056c158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f05735ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c14b5f0 con 0x7f056c0cbb90 2023-08-25T04:46:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f05735ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0c4590 con 0x7f056c150ac0 2023-08-25T04:46:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f05735ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c14ec90 con 0x7f056c150ea0 2023-08-25T04:46:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f057139b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 0x7f056c14b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f057139b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 0x7f056c14b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35054/0 (socket says 172.21.15.72:35054) 2023-08-25T04:46:59.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f057139b700 1 -- 172.21.15.72:0/222301849 learned_addr learned my addr 172.21.15.72:0/222301849 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:59.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f0570b9a700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f056c150ac0 0x7f056c0c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f0571b9c700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 0x7f056c158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f057139b700 1 -- 172.21.15.72:0/222301849 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 msgr2=0x7f056c158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:59.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f057139b700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 0x7f056c158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f057139b700 1 -- 172.21.15.72:0/222301849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f056c150ac0 msgr2=0x7f056c0c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:59.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f057139b700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f056c150ac0 0x7f056c0c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.156+0000 7f057139b700 1 -- 172.21.15.72:0/222301849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564009b30 con 0x7f056c0cbb90 2023-08-25T04:46:59.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.157+0000 7f057139b700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 0x7f056c14b0b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f056800c500 tx=0x7f056800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:59.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.157+0000 7f0561ffb700 1 -- 172.21.15.72:0/222301849 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568011790 con 0x7f056c0cbb90 2023-08-25T04:46:59.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.157+0000 7f0561ffb700 1 -- 172.21.15.72:0/222301849 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05680118f0 con 0x7f056c0cbb90 2023-08-25T04:46:59.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.157+0000 7f0561ffb700 1 -- 172.21.15.72:0/222301849 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568011ca0 con 0x7f056c0cbb90 2023-08-25T04:46:59.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.157+0000 7f05735ff700 1 -- 172.21.15.72:0/222301849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c152df0 con 0x7f056c0cbb90 2023-08-25T04:46:59.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.157+0000 7f05735ff700 1 -- 172.21.15.72:0/222301849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c1533b0 con 0x7f056c0cbb90 2023-08-25T04:46:59.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.158+0000 7f05735ff700 1 -- 172.21.15.72:0/222301849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c0c4870 con 0x7f056c0cbb90 2023-08-25T04:46:59.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.159+0000 7f0561ffb700 1 -- 172.21.15.72:0/222301849 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f056801c460 con 0x7f056c0cbb90 2023-08-25T04:46:59.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.160+0000 7f0561ffb700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f055006a0e0 0x7f055006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.160+0000 7f0561ffb700 1 -- 172.21.15.72:0/222301849 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0568088560 con 0x7f056c0cbb90 2023-08-25T04:46:59.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.160+0000 7f0570b9a700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f055006a0e0 0x7f055006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.161+0000 7f0570b9a700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f055006a0e0 0x7f055006c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f056c1f57d0 tx=0x7f055c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:59.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.164+0000 7f0561ffb700 1 -- 172.21.15.72:0/222301849 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0568053920 con 0x7f056c0cbb90 2023-08-25T04:46:59.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.359+0000 7f05735ff700 1 -- 172.21.15.72:0/222301849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f056c072320 con 0x7f056c0cbb90 2023-08-25T04:46:59.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.359+0000 7f0561ffb700 1 -- 172.21.15.72:0/222301849 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0568056f40 con 0x7f056c0cbb90 2023-08-25T04:46:59.361 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:46:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 -- 172.21.15.72:0/222301849 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f055006a0e0 msgr2=0x7f055006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f055006a0e0 0x7f055006c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f056c1f57d0 tx=0x7f055c008040 comp rx=0 tx=0).stop 2023-08-25T04:46:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 -- 172.21.15.72:0/222301849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 msgr2=0x7f056c14b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 0x7f056c14b0b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f056800c500 tx=0x7f056800c810 comp rx=0 tx=0).stop 2023-08-25T04:46:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 -- 172.21.15.72:0/222301849 shutdown_connections 2023-08-25T04:46:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f055006a0e0 0x7f055006c5a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f056c150ea0 0x7f056c158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0cbb90 0x7f056c14b0b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 --2- 172.21.15.72:0/222301849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f056c150ac0 0x7f056c0c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 -- 172.21.15.72:0/222301849 >> 172.21.15.72:0/222301849 conn(0x7f056c06a710 msgr2=0x7f056c06aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 -- 172.21.15.72:0/222301849 shutdown_connections 2023-08-25T04:46:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.362+0000 7f05735ff700 1 -- 172.21.15.72:0/222301849 wait complete. 2023-08-25T04:46:59.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:46:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.579+0000 7fba8a7ff700 1 Processor -- start 2023-08-25T04:46:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.579+0000 7fba8a7ff700 1 -- start start 2023-08-25T04:46:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.580+0000 7fba8a7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba8415d000 0x7fba840b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.580+0000 7fba8a7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba840d10c0 0x7fba840b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.580+0000 7fba8a7ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba840b4d40 0x7fba84160af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.580+0000 7fba8a7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba840b56f0 con 0x7fba840d10c0 2023-08-25T04:46:59.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.580+0000 7fba8a7ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba840b5190 con 0x7fba840b4d40 2023-08-25T04:46:59.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.580+0000 7fba8a7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba840b6e90 con 0x7fba8415d000 2023-08-25T04:46:59.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.580+0000 7fba837fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba840d10c0 0x7fba840b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba83fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba8415d000 0x7fba840b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba837fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba840d10c0 0x7fba840b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35066/0 (socket says 172.21.15.72:35066) 2023-08-25T04:46:59.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba837fe700 1 -- 172.21.15.72:0/961524064 learned_addr learned my addr 172.21.15.72:0/961524064 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:59.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba88d9c700 1 --2- 172.21.15.72:0/961524064 >> v2:172.21.15.137:3300/0 conn(0x7fba840b4d40 0x7fba84160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba837fe700 1 -- 172.21.15.72:0/961524064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba8415d000 msgr2=0x7fba840b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:59.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba837fe700 1 --2- 172.21.15.72:0/961524064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba8415d000 0x7fba840b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba837fe700 1 -- 172.21.15.72:0/961524064 >> v2:172.21.15.137:3300/0 conn(0x7fba840b4d40 msgr2=0x7fba84160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:46:59.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba837fe700 1 --2- 172.21.15.72:0/961524064 >> v2:172.21.15.137:3300/0 conn(0x7fba840b4d40 0x7fba84160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba837fe700 1 -- 172.21.15.72:0/961524064 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8415d3e0 con 0x7fba840d10c0 2023-08-25T04:46:59.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba837fe700 1 --2- 172.21.15.72:0/961524064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba840d10c0 0x7fba840b4800 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fba840c9de0 tx=0x7fba78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52897e82384ab server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:59.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.581+0000 7fba82ffd700 1 -- 172.21.15.72:0/961524064 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78011830 con 0x7fba840d10c0 2023-08-25T04:46:59.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba82ffd700 1 -- 172.21.15.72:0/961524064 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba78011990 con 0x7fba840d10c0 2023-08-25T04:46:59.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba82ffd700 1 -- 172.21.15.72:0/961524064 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78011d20 con 0x7fba840d10c0 2023-08-25T04:46:59.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba8a7ff700 1 -- 172.21.15.72:0/961524064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba840d10c0 msgr2=0x7fba840b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:59.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba8a7ff700 1 --2- 172.21.15.72:0/961524064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba840d10c0 0x7fba840b4800 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fba840c9de0 tx=0x7fba78009bd0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba8a7ff700 1 -- 172.21.15.72:0/961524064 shutdown_connections 2023-08-25T04:46:59.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba8a7ff700 1 --2- 172.21.15.72:0/961524064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba8415d000 0x7fba840b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba8a7ff700 1 --2- 172.21.15.72:0/961524064 >> v2:172.21.15.137:3300/0 conn(0x7fba840b4d40 0x7fba84160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba8a7ff700 1 --2- 172.21.15.72:0/961524064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba840d10c0 0x7fba840b4800 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba8a7ff700 1 -- 172.21.15.72:0/961524064 >> 172.21.15.72:0/961524064 conn(0x7fba84071e10 msgr2=0x7fba84072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:59.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba8a7ff700 1 -- 172.21.15.72:0/961524064 shutdown_connections 2023-08-25T04:46:59.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.582+0000 7fba8a7ff700 1 -- 172.21.15.72:0/961524064 wait complete. 2023-08-25T04:46:59.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.584+0000 7fba8a7ff700 1 Processor -- start 2023-08-25T04:46:59.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.584+0000 7fba8a7ff700 1 -- start start 2023-08-25T04:46:59.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.585+0000 7fba8a7ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba840b4d40 0x7fba84142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.585+0000 7fba8a7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba840d10c0 0x7fba841f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.585+0000 7fba8a7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba8415d000 0x7fba84152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.585+0000 7fba8a7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8415efe0 con 0x7fba8415d000 2023-08-25T04:46:59.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.585+0000 7fba8a7ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba84155fd0 con 0x7fba840b4d40 2023-08-25T04:46:59.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.585+0000 7fba8a7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8415e640 con 0x7fba840d10c0 2023-08-25T04:46:59.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.585+0000 7fba88d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba8415d000 0x7fba84152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.585+0000 7fba88d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba8415d000 0x7fba84152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35070/0 (socket says 172.21.15.72:35070) 2023-08-25T04:46:59.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.585+0000 7fba88d9c700 1 -- 172.21.15.72:0/856784006 learned_addr learned my addr 172.21.15.72:0/856784006 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:46:59.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba88d9c700 1 -- 172.21.15.72:0/856784006 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba840d10c0 msgr2=0x7fba841f1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:59.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba88d9c700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba840d10c0 0x7fba841f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba88d9c700 1 -- 172.21.15.72:0/856784006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba840b4d40 msgr2=0x7fba84142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:59.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba88d9c700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba840b4d40 0x7fba84142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba88d9c700 1 -- 172.21.15.72:0/856784006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78009550 con 0x7fba8415d000 2023-08-25T04:46:59.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba88d9c700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba8415d000 0x7fba84152d60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00efc0 tx=0x7fba7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:59.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba80ff9700 1 -- 172.21.15.72:0/856784006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c00cd40 con 0x7fba8415d000 2023-08-25T04:46:59.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba80ff9700 1 -- 172.21.15.72:0/856784006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c00f040 con 0x7fba8415d000 2023-08-25T04:46:59.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba8a7ff700 1 -- 172.21.15.72:0/856784006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8415e920 con 0x7fba8415d000 2023-08-25T04:46:59.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba80ff9700 1 -- 172.21.15.72:0/856784006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0146c0 con 0x7fba8415d000 2023-08-25T04:46:59.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.586+0000 7fba8a7ff700 1 -- 172.21.15.72:0/856784006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba841430a0 con 0x7fba8415d000 2023-08-25T04:46:59.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.587+0000 7fba8a7ff700 1 -- 172.21.15.72:0/856784006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8406a2f0 con 0x7fba8415d000 2023-08-25T04:46:59.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.588+0000 7fba80ff9700 1 -- 172.21.15.72:0/856784006 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fba7c014820 con 0x7fba8415d000 2023-08-25T04:46:59.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.589+0000 7fba80ff9700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba7006a0e0 0x7fba7006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:46:59.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.589+0000 7fba80ff9700 1 -- 172.21.15.72:0/856784006 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fba7c089220 con 0x7fba8415d000 2023-08-25T04:46:59.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.589+0000 7fba83fff700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba7006a0e0 0x7fba7006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:46:59.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.590+0000 7fba83fff700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba7006a0e0 0x7fba7006c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fba74009a40 tx=0x7fba74009500 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:46:59.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.593+0000 7fba80ff9700 1 -- 172.21.15.72:0/856784006 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fba7c058060 con 0x7fba8415d000 2023-08-25T04:46:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.793+0000 7fba8a7ff700 1 -- 172.21.15.72:0/856784006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fba8415f120 con 0x7fba8415d000 2023-08-25T04:46:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.793+0000 7fba80ff9700 1 -- 172.21.15.72:0/856784006 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fba7c00cea0 con 0x7fba8415d000 2023-08-25T04:46:59.795 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:46:59.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 -- 172.21.15.72:0/856784006 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba7006a0e0 msgr2=0x7fba7006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:59.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba7006a0e0 0x7fba7006c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fba74009a40 tx=0x7fba74009500 comp rx=0 tx=0).stop 2023-08-25T04:46:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 -- 172.21.15.72:0/856784006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba8415d000 msgr2=0x7fba84152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:46:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba8415d000 0x7fba84152d60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00efc0 tx=0x7fba7c00c3a0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 -- 172.21.15.72:0/856784006 shutdown_connections 2023-08-25T04:46:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba7006a0e0 0x7fba7006c5a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba8415d000 0x7fba84152d60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba840b4d40 0x7fba84142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 --2- 172.21.15.72:0/856784006 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fba840d10c0 0x7fba841f1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:46:59.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 -- 172.21.15.72:0/856784006 >> 172.21.15.72:0/856784006 conn(0x7fba84071e10 msgr2=0x7fba840b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:46:59.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 -- 172.21.15.72:0/856784006 shutdown_connections 2023-08-25T04:46:59.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:46:59.796+0000 7fba8a7ff700 1 -- 172.21.15.72:0/856784006 wait complete. 2023-08-25T04:46:59.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:47:00.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.013+0000 7ff16cfff700 1 Processor -- start 2023-08-25T04:47:00.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.014+0000 7ff16cfff700 1 -- start start 2023-08-25T04:47:00.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff16cfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff168160710 0x7ff1680b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff16cfff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff1680b4c80 0x7ff1680b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff16cfff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1680b7400 con 0x7ff1680b4800 2023-08-25T04:47:00.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff16cfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1680b8d30 con 0x7ff168160710 2023-08-25T04:47:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff16cfff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1680b5110 con 0x7ff1680b4c80 2023-08-25T04:47:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff16659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff168160710 0x7ff1680b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff16659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff168160710 0x7ff1680b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35074/0 (socket says 172.21.15.72:35074) 2023-08-25T04:47:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff16659c700 1 -- 172.21.15.72:0/4258220311 learned_addr learned my addr 172.21.15.72:0/4258220311 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff166d9d700 1 --2- 172.21.15.72:0/4258220311 >> v2:172.21.15.137:3300/0 conn(0x7ff1680b4c80 0x7ff1680b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff16659c700 1 -- 172.21.15.72:0/4258220311 >> v2:172.21.15.137:3300/0 conn(0x7ff1680b4c80 msgr2=0x7ff1680b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.015+0000 7ff16659c700 1 --2- 172.21.15.72:0/4258220311 >> v2:172.21.15.137:3300/0 conn(0x7ff1680b4c80 0x7ff1680b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.016+0000 7ff16659c700 1 -- 172.21.15.72:0/4258220311 >> v1:172.21.15.137:6789/0 conn(0x7ff1680b4800 legacy=0x7ff1680d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.016+0000 7ff16659c700 1 -- 172.21.15.72:0/4258220311 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680b7650 con 0x7ff168160710 2023-08-25T04:47:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.016+0000 7ff16659c700 1 --2- 172.21.15.72:0/4258220311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff168160710 0x7ff1680b87f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff1680cd460 tx=0x7ff158009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc26933aa086743 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.016+0000 7ff165d9b700 1 -- 172.21.15.72:0/4258220311 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15800b870 con 0x7ff168160710 2023-08-25T04:47:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.016+0000 7ff165d9b700 1 -- 172.21.15.72:0/4258220311 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15800b9d0 con 0x7ff168160710 2023-08-25T04:47:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.016+0000 7ff165d9b700 1 -- 172.21.15.72:0/4258220311 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15800bd60 con 0x7ff168160710 2023-08-25T04:47:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.016+0000 7ff16cfff700 1 -- 172.21.15.72:0/4258220311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff168160710 msgr2=0x7ff1680b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.016+0000 7ff16cfff700 1 --2- 172.21.15.72:0/4258220311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff168160710 0x7ff1680b87f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff1680cd460 tx=0x7ff158009bd0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.017+0000 7ff16cfff700 1 -- 172.21.15.72:0/4258220311 shutdown_connections 2023-08-25T04:47:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.017+0000 7ff16cfff700 1 --2- 172.21.15.72:0/4258220311 >> v2:172.21.15.137:3300/0 conn(0x7ff1680b4c80 0x7ff1680b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.017+0000 7ff16cfff700 1 --2- 172.21.15.72:0/4258220311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff168160710 0x7ff1680b87f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.017+0000 7ff16cfff700 1 -- 172.21.15.72:0/4258220311 >> 172.21.15.72:0/4258220311 conn(0x7ff168071e40 msgr2=0x7ff168072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.017+0000 7ff16cfff700 1 -- 172.21.15.72:0/4258220311 shutdown_connections 2023-08-25T04:47:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.017+0000 7ff16cfff700 1 -- 172.21.15.72:0/4258220311 wait complete. 2023-08-25T04:47:00.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.018+0000 7ff16cfff700 1 Processor -- start 2023-08-25T04:47:00.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.019+0000 7ff16cfff700 1 -- start start 2023-08-25T04:47:00.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.019+0000 7ff16cfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff1680b4800 0x7ff1680cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff16cfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1680b4c80 0x7ff168156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff16cfff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff168160710 0x7ff168159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff16cfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1681f5e30 con 0x7ff1680b4c80 2023-08-25T04:47:00.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff16cfff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1681f6110 con 0x7ff168160710 2023-08-25T04:47:00.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff16cfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1681f63f0 con 0x7ff1680b4800 2023-08-25T04:47:00.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff15ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1680b4c80 0x7ff168156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:00.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff15ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1680b4c80 0x7ff168156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35078/0 (socket says 172.21.15.72:35078) 2023-08-25T04:47:00.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff15ffff700 1 -- 172.21.15.72:0/2202774945 learned_addr learned my addr 172.21.15.72:0/2202774945 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:00.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff15ffff700 1 -- 172.21.15.72:0/2202774945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff1680b4800 msgr2=0x7ff1680cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff15ffff700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff1680b4800 0x7ff1680cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff15ffff700 1 -- 172.21.15.72:0/2202774945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff168160710 msgr2=0x7ff168159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff15ffff700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff168160710 0x7ff168159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff15ffff700 1 -- 172.21.15.72:0/2202774945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158009550 con 0x7ff1680b4c80 2023-08-25T04:47:00.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.020+0000 7ff15ffff700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1680b4c80 0x7ff168156620 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c450 tx=0x7ff15000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:00.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.021+0000 7ff15effd700 1 -- 172.21.15.72:0/2202774945 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500052d0 con 0x7ff1680b4c80 2023-08-25T04:47:00.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.021+0000 7ff15effd700 1 -- 172.21.15.72:0/2202774945 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150005430 con 0x7ff1680b4c80 2023-08-25T04:47:00.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.021+0000 7ff15effd700 1 -- 172.21.15.72:0/2202774945 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500038c0 con 0x7ff1680b4c80 2023-08-25T04:47:00.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.021+0000 7ff16cfff700 1 -- 172.21.15.72:0/2202774945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1681f66d0 con 0x7ff1680b4c80 2023-08-25T04:47:00.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.021+0000 7ff16cfff700 1 -- 172.21.15.72:0/2202774945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1681f6c90 con 0x7ff1680b4c80 2023-08-25T04:47:00.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.022+0000 7ff16cfff700 1 -- 172.21.15.72:0/2202774945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1680cb080 con 0x7ff1680b4c80 2023-08-25T04:47:00.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.023+0000 7ff15effd700 1 -- 172.21.15.72:0/2202774945 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff150003a20 con 0x7ff1680b4c80 2023-08-25T04:47:00.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.023+0000 7ff15effd700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff14806a0e0 0x7ff14806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.024+0000 7ff15effd700 1 -- 172.21.15.72:0/2202774945 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff150087ba0 con 0x7ff1680b4c80 2023-08-25T04:47:00.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.024+0000 7ff16659c700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff14806a0e0 0x7ff14806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:00.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.024+0000 7ff16659c700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff14806a0e0 0x7ff14806c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff158000c00 tx=0x7ff158010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:00.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.028+0000 7ff15effd700 1 -- 172.21.15.72:0/2202774945 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff1680cb080 con 0x7ff1680b4c80 2023-08-25T04:47:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.239+0000 7ff16cfff700 1 -- 172.21.15.72:0/2202774945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff1680cb080 con 0x7ff1680b4c80 2023-08-25T04:47:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.240+0000 7ff15effd700 1 -- 172.21.15.72:0/2202774945 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff1680cb080 con 0x7ff1680b4c80 2023-08-25T04:47:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 -- 172.21.15.72:0/2202774945 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff14806a0e0 msgr2=0x7ff14806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff14806a0e0 0x7ff14806c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff158000c00 tx=0x7ff158010000 comp rx=0 tx=0).stop 2023-08-25T04:47:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 -- 172.21.15.72:0/2202774945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1680b4c80 msgr2=0x7ff168156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1680b4c80 0x7ff168156620 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c450 tx=0x7ff15000c810 comp rx=0 tx=0).stop 2023-08-25T04:47:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 -- 172.21.15.72:0/2202774945 shutdown_connections 2023-08-25T04:47:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff14806a0e0 0x7ff14806c5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff168160710 0x7ff168159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff1680b4800 0x7ff1680cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 --2- 172.21.15.72:0/2202774945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1680b4c80 0x7ff168156620 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 -- 172.21.15.72:0/2202774945 >> 172.21.15.72:0/2202774945 conn(0x7ff168071e40 msgr2=0x7ff168072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 -- 172.21.15.72:0/2202774945 shutdown_connections 2023-08-25T04:47:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.242+0000 7ff16cfff700 1 -- 172.21.15.72:0/2202774945 wait complete. 2023-08-25T04:47:00.246 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-08-25T04:47:00.261 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-08-25T04:47:00.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:00.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-08-25T04:47:00.331 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:00.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-25T04:47:00.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:00.333 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-25T04:47:00.380 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:47:00.381 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:47:00.435 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:47:00.436 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:47:00.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:47:00.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.678+0000 7efc277ff700 1 Processor -- start 2023-08-25T04:47:00.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.679+0000 7efc277ff700 1 -- start start 2023-08-25T04:47:00.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.680+0000 7efc277ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efc200d0df0 0x7efc200d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.680+0000 7efc277ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc200d1fe0 con 0x7efc200cda40 2023-08-25T04:47:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.680+0000 7efc277ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc200d13d0 con 0x7efc2015ce60 2023-08-25T04:47:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.680+0000 7efc277ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc200d16b0 con 0x7efc200d0df0 2023-08-25T04:47:00.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.680+0000 7efc24d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efc200d0df0 0x7efc200d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:00.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.680+0000 7efc25d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efc200cda40 0x7efc200b5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56126/0 (socket says 172.21.15.72:56126) 2023-08-25T04:47:00.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.680+0000 7efc25d9c700 1 -- 172.21.15.72:0/3598985014 learned_addr learned my addr 172.21.15.72:0/3598985014 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:00.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.680+0000 7efc17fff700 1 -- 172.21.15.72:0/3598985014 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060520345 0 0) 0x7efc200d1fe0 con 0x7efc200cda40 2023-08-25T04:47:00.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.681+0000 7efc24d9a700 1 -- 172.21.15.72:0/3598985014 >> v1:172.21.15.137:6789/0 conn(0x7efc2015ce60 legacy=0x7efc200b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.681+0000 7efc24d9a700 1 -- 172.21.15.72:0/3598985014 >> v1:172.21.15.72:6789/0 conn(0x7efc200cda40 legacy=0x7efc200b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.681+0000 7efc24d9a700 1 -- 172.21.15.72:0/3598985014 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc200d1990 con 0x7efc200d0df0 2023-08-25T04:47:00.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.681+0000 7efc24d9a700 1 --2- 172.21.15.72:0/3598985014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc200d0df0 0x7efc200d2470 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efc10009840 tx=0x7efc10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd29e05fbbef1d0a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:00.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.681+0000 7efc17fff700 1 -- 172.21.15.72:0/3598985014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10011830 con 0x7efc200d0df0 2023-08-25T04:47:00.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.681+0000 7efc17fff700 1 -- 172.21.15.72:0/3598985014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10011990 con 0x7efc200d0df0 2023-08-25T04:47:00.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.681+0000 7efc17fff700 1 -- 172.21.15.72:0/3598985014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10011d20 con 0x7efc200d0df0 2023-08-25T04:47:00.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.681+0000 7efc277ff700 1 -- 172.21.15.72:0/3598985014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc200d0df0 msgr2=0x7efc200d2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.681+0000 7efc277ff700 1 --2- 172.21.15.72:0/3598985014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc200d0df0 0x7efc200d2470 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efc10009840 tx=0x7efc10009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.682+0000 7efc277ff700 1 -- 172.21.15.72:0/3598985014 shutdown_connections 2023-08-25T04:47:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.682+0000 7efc277ff700 1 --2- 172.21.15.72:0/3598985014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc200d0df0 0x7efc200d2470 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.682+0000 7efc277ff700 1 -- 172.21.15.72:0/3598985014 >> 172.21.15.72:0/3598985014 conn(0x7efc20071e10 msgr2=0x7efc20072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.682+0000 7efc277ff700 1 -- 172.21.15.72:0/3598985014 shutdown_connections 2023-08-25T04:47:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.682+0000 7efc277ff700 1 -- 172.21.15.72:0/3598985014 wait complete. 2023-08-25T04:47:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.683+0000 7efc277ff700 1 Processor -- start 2023-08-25T04:47:00.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.683+0000 7efc277ff700 1 -- start start 2023-08-25T04:47:00.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.684+0000 7efc277ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc200cda40 0x7efc20158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.684+0000 7efc277ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc200d0df0 0x7efc2015f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.684+0000 7efc277ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2015ce60 0x7efc2015faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.684+0000 7efc277ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2015f140 con 0x7efc2015ce60 2023-08-25T04:47:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.684+0000 7efc277ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2015e7a0 con 0x7efc200d0df0 2023-08-25T04:47:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.684+0000 7efc277ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2015ea80 con 0x7efc200cda40 2023-08-25T04:47:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc25d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2015ce60 0x7efc2015faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc25d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2015ce60 0x7efc2015faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35094/0 (socket says 172.21.15.72:35094) 2023-08-25T04:47:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc25d9c700 1 -- 172.21.15.72:0/4193699982 learned_addr learned my addr 172.21.15.72:0/4193699982 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc24d9a700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc200d0df0 0x7efc2015f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc2559b700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc200cda40 0x7efc20158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:00.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc25d9c700 1 -- 172.21.15.72:0/4193699982 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc200cda40 msgr2=0x7efc20158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc25d9c700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc200cda40 0x7efc20158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc25d9c700 1 -- 172.21.15.72:0/4193699982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc200d0df0 msgr2=0x7efc2015f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc25d9c700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc200d0df0 0x7efc2015f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc25d9c700 1 -- 172.21.15.72:0/4193699982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc100094a0 con 0x7efc2015ce60 2023-08-25T04:47:00.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.685+0000 7efc25d9c700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2015ce60 0x7efc2015faa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efc1800cba0 tx=0x7efc1800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:00.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.686+0000 7efc15ffb700 1 -- 172.21.15.72:0/4193699982 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800aaa0 con 0x7efc2015ce60 2023-08-25T04:47:00.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.686+0000 7efc15ffb700 1 -- 172.21.15.72:0/4193699982 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1800ac20 con 0x7efc2015ce60 2023-08-25T04:47:00.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.686+0000 7efc15ffb700 1 -- 172.21.15.72:0/4193699982 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc180070d0 con 0x7efc2015ce60 2023-08-25T04:47:00.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.686+0000 7efc277ff700 1 -- 172.21.15.72:0/4193699982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2015ed60 con 0x7efc2015ce60 2023-08-25T04:47:00.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.686+0000 7efc277ff700 1 -- 172.21.15.72:0/4193699982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc20159240 con 0x7efc2015ce60 2023-08-25T04:47:00.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.687+0000 7efc277ff700 1 -- 172.21.15.72:0/4193699982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2015f280 con 0x7efc2015ce60 2023-08-25T04:47:00.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.688+0000 7efc15ffb700 1 -- 172.21.15.72:0/4193699982 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efc18007230 con 0x7efc2015ce60 2023-08-25T04:47:00.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.689+0000 7efc15ffb700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc0406a0e0 0x7efc0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:00.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.689+0000 7efc15ffb700 1 -- 172.21.15.72:0/4193699982 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efc180883b0 con 0x7efc2015ce60 2023-08-25T04:47:00.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.689+0000 7efc2559b700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc0406a0e0 0x7efc0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:00.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.690+0000 7efc2559b700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc0406a0e0 0x7efc0406c5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc1c007fd0 tx=0x7efc1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:00.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.694+0000 7efc15ffb700 1 -- 172.21.15.72:0/4193699982 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efc2015f280 con 0x7efc2015ce60 2023-08-25T04:47:00.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.895+0000 7efc277ff700 1 -- 172.21.15.72:0/4193699982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc2015f280 con 0x7efc2015ce60 2023-08-25T04:47:00.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.896+0000 7efc15ffb700 1 -- 172.21.15.72:0/4193699982 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7efc2015f280 con 0x7efc2015ce60 2023-08-25T04:47:00.897 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:00.898 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:47:00.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.898+0000 7efc277ff700 1 -- 172.21.15.72:0/4193699982 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc0406a0e0 msgr2=0x7efc0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.898+0000 7efc277ff700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc0406a0e0 0x7efc0406c5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc1c007fd0 tx=0x7efc1c009040 comp rx=0 tx=0).stop 2023-08-25T04:47:00.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.898+0000 7efc277ff700 1 -- 172.21.15.72:0/4193699982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2015ce60 msgr2=0x7efc2015faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:00.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.898+0000 7efc277ff700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2015ce60 0x7efc2015faa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efc1800cba0 tx=0x7efc1800ceb0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.898+0000 7efc277ff700 1 -- 172.21.15.72:0/4193699982 shutdown_connections 2023-08-25T04:47:00.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.898+0000 7efc277ff700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7efc0406a0e0 0x7efc0406c5a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.898+0000 7efc277ff700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2015ce60 0x7efc2015faa0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.898+0000 7efc277ff700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc200cda40 0x7efc20158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.898+0000 7efc277ff700 1 --2- 172.21.15.72:0/4193699982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc200d0df0 0x7efc2015f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.898+0000 7efc277ff700 1 -- 172.21.15.72:0/4193699982 >> 172.21.15.72:0/4193699982 conn(0x7efc20071e10 msgr2=0x7efc200c88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.899+0000 7efc277ff700 1 -- 172.21.15.72:0/4193699982 shutdown_connections 2023-08-25T04:47:00.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:00.899+0000 7efc277ff700 1 -- 172.21.15.72:0/4193699982 wait complete. 2023-08-25T04:47:00.918 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:47:00.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:47:01.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.117+0000 7f54fb3ff700 1 Processor -- start 2023-08-25T04:47:01.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.117+0000 7f54fb3ff700 1 -- start start 2023-08-25T04:47:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54fb3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54f415d000 0x7f54f40b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54fb3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 0x7f54f40b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54fb3ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f40b5190 con 0x7f54f40b4d40 2023-08-25T04:47:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54fb3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f40b56f0 con 0x7f54f415d000 2023-08-25T04:47:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54fb3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40b6e90 con 0x7f54f40d10c0 2023-08-25T04:47:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54f919b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54f415d000 0x7f54f40b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54f919b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54f415d000 0x7f54f40b8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35108/0 (socket says 172.21.15.72:35108) 2023-08-25T04:47:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54f919b700 1 -- 172.21.15.72:0/3751966155 learned_addr learned my addr 172.21.15.72:0/3751966155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54f899a700 1 --2- 172.21.15.72:0/3751966155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 0x7f54f40b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54f919b700 1 -- 172.21.15.72:0/3751966155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 msgr2=0x7f54f40b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54f919b700 1 --2- 172.21.15.72:0/3751966155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 0x7f54f40b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54f919b700 1 -- 172.21.15.72:0/3751966155 >> v1:172.21.15.137:6789/0 conn(0x7f54f40b4d40 legacy=0x7f54f4160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54f919b700 1 -- 172.21.15.72:0/3751966155 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f415d3e0 con 0x7f54f415d000 2023-08-25T04:47:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.119+0000 7f54f899a700 1 --2- 172.21.15.72:0/3751966155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 0x7f54f40b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.120+0000 7f54f919b700 1 --2- 172.21.15.72:0/3751966155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f415d000 0x7f54f40b8600 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f54f00098f0 tx=0x7f54f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cc18d975b88a68 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.120+0000 7f54ebfff700 1 -- 172.21.15.72:0/3751966155 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0004230 con 0x7f54f415d000 2023-08-25T04:47:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.120+0000 7f54ebfff700 1 -- 172.21.15.72:0/3751966155 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0004390 con 0x7f54f415d000 2023-08-25T04:47:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.120+0000 7f54ebfff700 1 -- 172.21.15.72:0/3751966155 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f00036a0 con 0x7f54f415d000 2023-08-25T04:47:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.120+0000 7f54fb3ff700 1 -- 172.21.15.72:0/3751966155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f415d000 msgr2=0x7f54f40b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.120+0000 7f54fb3ff700 1 --2- 172.21.15.72:0/3751966155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f415d000 0x7f54f40b8600 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f54f00098f0 tx=0x7f54f0009c00 comp rx=0 tx=0).stop 2023-08-25T04:47:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.121+0000 7f54fb3ff700 1 -- 172.21.15.72:0/3751966155 shutdown_connections 2023-08-25T04:47:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.121+0000 7f54fb3ff700 1 --2- 172.21.15.72:0/3751966155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f415d000 0x7f54f40b8600 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.121+0000 7f54fb3ff700 1 --2- 172.21.15.72:0/3751966155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 0x7f54f40b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.121+0000 7f54fb3ff700 1 -- 172.21.15.72:0/3751966155 >> 172.21.15.72:0/3751966155 conn(0x7f54f4071e10 msgr2=0x7f54f4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.121+0000 7f54fb3ff700 1 -- 172.21.15.72:0/3751966155 shutdown_connections 2023-08-25T04:47:01.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.121+0000 7f54fb3ff700 1 -- 172.21.15.72:0/3751966155 wait complete. 2023-08-25T04:47:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.122+0000 7f54fb3ff700 1 Processor -- start 2023-08-25T04:47:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.122+0000 7f54fb3ff700 1 -- start start 2023-08-25T04:47:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.123+0000 7f54fb3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40b4d40 0x7f54f40c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.123+0000 7f54fb3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 0x7f54f41f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.123+0000 7f54fb3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f415d000 0x7f54f41f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.123+0000 7f54fb3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40c9780 con 0x7f54f40b4d40 2023-08-25T04:47:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.123+0000 7f54fb3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f415aaa0 con 0x7f54f415d000 2023-08-25T04:47:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.123+0000 7f54fb3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f41f28e0 con 0x7f54f40d10c0 2023-08-25T04:47:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f919b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40b4d40 0x7f54f40c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f919b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40b4d40 0x7f54f40c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35110/0 (socket says 172.21.15.72:35110) 2023-08-25T04:47:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f919b700 1 -- 172.21.15.72:0/2843160608 learned_addr learned my addr 172.21.15.72:0/2843160608 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f899a700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 0x7f54f41f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f999c700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f415d000 0x7f54f41f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f919b700 1 -- 172.21.15.72:0/2843160608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 msgr2=0x7f54f41f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f919b700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 0x7f54f41f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f919b700 1 -- 172.21.15.72:0/2843160608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f415d000 msgr2=0x7f54f41f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f919b700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f415d000 0x7f54f41f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f919b700 1 -- 172.21.15.72:0/2843160608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f0009550 con 0x7f54f40b4d40 2023-08-25T04:47:01.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f999c700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f415d000 0x7f54f41f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:01.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.124+0000 7f54f919b700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40b4d40 0x7f54f40c9240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f54f40d3ae0 tx=0x7f54f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:01.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.125+0000 7f54e9ffb700 1 -- 172.21.15.72:0/2843160608 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f000b860 con 0x7f54f40b4d40 2023-08-25T04:47:01.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.125+0000 7f54e9ffb700 1 -- 172.21.15.72:0/2843160608 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f000b9c0 con 0x7f54f40b4d40 2023-08-25T04:47:01.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.125+0000 7f54fb3ff700 1 -- 172.21.15.72:0/2843160608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f41f25e0 con 0x7f54f40b4d40 2023-08-25T04:47:01.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.125+0000 7f54e9ffb700 1 -- 172.21.15.72:0/2843160608 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f000bd70 con 0x7f54f40b4d40 2023-08-25T04:47:01.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.125+0000 7f54fb3ff700 1 -- 172.21.15.72:0/2843160608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f415a0d0 con 0x7f54f40b4d40 2023-08-25T04:47:01.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.126+0000 7f54fb3ff700 1 -- 172.21.15.72:0/2843160608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f406a2f0 con 0x7f54f40b4d40 2023-08-25T04:47:01.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.127+0000 7f54e9ffb700 1 -- 172.21.15.72:0/2843160608 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f54f001b440 con 0x7f54f40b4d40 2023-08-25T04:47:01.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.127+0000 7f54e9ffb700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f54d806a0e0 0x7f54d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.128+0000 7f54e9ffb700 1 -- 172.21.15.72:0/2843160608 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f54f008a050 con 0x7f54f40b4d40 2023-08-25T04:47:01.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.128+0000 7f54f899a700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f54d806a0e0 0x7f54d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.128+0000 7f54f899a700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f54d806a0e0 0x7f54d806c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f54f40c6280 tx=0x7f54e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:01.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.132+0000 7f54e9ffb700 1 -- 172.21.15.72:0/2843160608 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f54f00554a0 con 0x7f54f40b4d40 2023-08-25T04:47:01.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.332+0000 7f54fb3ff700 1 -- 172.21.15.72:0/2843160608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54f40b5190 con 0x7f54f40b4d40 2023-08-25T04:47:01.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.332+0000 7f54e9ffb700 1 -- 172.21.15.72:0/2843160608 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54f001f020 con 0x7f54f40b4d40 2023-08-25T04:47:01.334 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:47:01.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 -- 172.21.15.72:0/2843160608 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f54d806a0e0 msgr2=0x7f54d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f54d806a0e0 0x7f54d806c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f54f40c6280 tx=0x7f54e4008040 comp rx=0 tx=0).stop 2023-08-25T04:47:01.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 -- 172.21.15.72:0/2843160608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40b4d40 msgr2=0x7f54f40c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40b4d40 0x7f54f40c9240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f54f40d3ae0 tx=0x7f54f0004750 comp rx=0 tx=0).stop 2023-08-25T04:47:01.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 -- 172.21.15.72:0/2843160608 shutdown_connections 2023-08-25T04:47:01.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f54d806a0e0 0x7f54d806c5a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f54f415d000 0x7f54f41f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40b4d40 0x7f54f40c9240 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 --2- 172.21.15.72:0/2843160608 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54f40d10c0 0x7f54f41f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 -- 172.21.15.72:0/2843160608 >> 172.21.15.72:0/2843160608 conn(0x7f54f4071e10 msgr2=0x7f54f40b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:01.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 -- 172.21.15.72:0/2843160608 shutdown_connections 2023-08-25T04:47:01.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.335+0000 7f54fb3ff700 1 -- 172.21.15.72:0/2843160608 wait complete. 2023-08-25T04:47:01.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:47:01.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.555+0000 7f5e46fff700 1 Processor -- start 2023-08-25T04:47:01.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.555+0000 7f5e46fff700 1 -- start start 2023-08-25T04:47:01.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.556+0000 7f5e46fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e4006b7a0 0x7f5e4006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.556+0000 7f5e46fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400cba40 con 0x7f5e400c71b0 2023-08-25T04:47:01.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.556+0000 7f5e46fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400d04f0 con 0x7f5e4006c160 2023-08-25T04:47:01.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.556+0000 7f5e46fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4006c5f0 con 0x7f5e4006b7a0 2023-08-25T04:47:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.556+0000 7f5e44d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e400c71b0 0x7f5e400cf9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56128/0 (socket says 172.21.15.72:56128) 2023-08-25T04:47:01.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.556+0000 7f5e44d9b700 1 -- 172.21.15.72:0/444586031 learned_addr learned my addr 172.21.15.72:0/444586031 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:01.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3ffff700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e4006b7a0 0x7f5e4006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229777646 0 0) 0x7f5e400cba40 con 0x7f5e400c71b0 2023-08-25T04:47:01.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e300035b0 con 0x7f5e400c71b0 2023-08-25T04:47:01.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064311185 0 0) 0x7f5e400d04f0 con 0x7f5e4006c160 2023-08-25T04:47:01.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e400cba40 con 0x7f5e4006c160 2023-08-25T04:47:01.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3021692800 0 0) 0x7f5e300035b0 con 0x7f5e400c71b0 2023-08-25T04:47:01.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e4006b7a0 msgr2=0x7f5e4006bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:01.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e4006b7a0 0x7f5e4006bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 >> v1:172.21.15.137:6789/0 conn(0x7f5e4006c160 legacy=0x7f5e4015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400d0210 con 0x7f5e400c71b0 2023-08-25T04:47:01.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f5e34001670 con 0x7f5e400c71b0 2023-08-25T04:47:01.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 >> v1:172.21.15.72:6789/0 conn(0x7f5e400c71b0 legacy=0x7f5e400cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 0x7f5e30003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e30004850 0x7f5e30004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e4006b7a0 0x7f5e30005310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4006c5f0 con 0x7f5e30003bc0 2023-08-25T04:47:01.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3000bc10 con 0x7f5e30004850 2023-08-25T04:47:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.557+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3000bdd0 con 0x7f5e4006b7a0 2023-08-25T04:47:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e44d9b700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 0x7f5e30003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e3ffff700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e30004850 0x7f5e30004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e4559c700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e4006b7a0 0x7f5e30005310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e44d9b700 1 -- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e4006b7a0 msgr2=0x7f5e30005310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e44d9b700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e4006b7a0 0x7f5e30005310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e44d9b700 1 -- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e30004850 msgr2=0x7f5e30004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:01.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e44d9b700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e30004850 0x7f5e30004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e44d9b700 1 -- 172.21.15.72:0/444586031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300035b0 con 0x7f5e30003bc0 2023-08-25T04:47:01.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e44d9b700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 0x7f5e30003fc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c160 tx=0x7f5e30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa78cf82b91fd7ed server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:01.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400cca0 con 0x7f5e30003bc0 2023-08-25T04:47:01.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400ce20 con 0x7f5e30003bc0 2023-08-25T04:47:01.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.558+0000 7f5e3f7fe700 1 -- 172.21.15.72:0/444586031 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34005ba0 con 0x7f5e30003bc0 2023-08-25T04:47:01.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.559+0000 7f5e46fff700 1 -- 172.21.15.72:0/444586031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 msgr2=0x7f5e30003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.559+0000 7f5e46fff700 1 --2- 172.21.15.72:0/444586031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 0x7f5e30003fc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c160 tx=0x7f5e30005880 comp rx=0 tx=0).stop 2023-08-25T04:47:01.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.559+0000 7f5e4559c700 1 -- 172.21.15.72:0/444586031 reap_dead start 2023-08-25T04:47:01.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.559+0000 7f5e46fff700 1 -- 172.21.15.72:0/444586031 shutdown_connections 2023-08-25T04:47:01.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.559+0000 7f5e46fff700 1 -- 172.21.15.72:0/444586031 >> 172.21.15.72:0/444586031 conn(0x7f5e400d0c70 msgr2=0x7f5e400d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:01.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.559+0000 7f5e46fff700 1 -- 172.21.15.72:0/444586031 shutdown_connections 2023-08-25T04:47:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.559+0000 7f5e46fff700 1 -- 172.21.15.72:0/444586031 wait complete. 2023-08-25T04:47:01.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.561+0000 7f5e46fff700 1 Processor -- start 2023-08-25T04:47:01.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.561+0000 7f5e46fff700 1 -- start start 2023-08-25T04:47:01.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.562+0000 7f5e46fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 0x7f5e400c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.562+0000 7f5e46fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e400c4e70 0x7f5e401d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.562+0000 7f5e46fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e400c52f0 0x7f5e401d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.562+0000 7f5e46fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401e5a50 con 0x7f5e30003bc0 2023-08-25T04:47:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.562+0000 7f5e46fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401e4b60 con 0x7f5e400c52f0 2023-08-25T04:47:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.562+0000 7f5e46fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401e4e40 con 0x7f5e400c4e70 2023-08-25T04:47:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.562+0000 7f5e44d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 0x7f5e400c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.562+0000 7f5e44d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 0x7f5e400c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35126/0 (socket says 172.21.15.72:35126) 2023-08-25T04:47:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.562+0000 7f5e44d9b700 1 -- 172.21.15.72:0/948244414 learned_addr learned my addr 172.21.15.72:0/948244414 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e44d9b700 1 -- 172.21.15.72:0/948244414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e400c4e70 msgr2=0x7f5e401d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e44d9b700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e400c4e70 0x7f5e401d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e44d9b700 1 -- 172.21.15.72:0/948244414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e400c52f0 msgr2=0x7f5e401d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e44d9b700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e400c52f0 0x7f5e401d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e44d9b700 1 -- 172.21.15.72:0/948244414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e401e5120 con 0x7f5e30003bc0 2023-08-25T04:47:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e44d9b700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 0x7f5e400c5ae0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c750 tx=0x7f5e34001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e3d7fa700 1 -- 172.21.15.72:0/948244414 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340070d0 con 0x7f5e30003bc0 2023-08-25T04:47:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e3d7fa700 1 -- 172.21.15.72:0/948244414 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e34007230 con 0x7f5e30003bc0 2023-08-25T04:47:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e3d7fa700 1 -- 172.21.15.72:0/948244414 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340075a0 con 0x7f5e30003bc0 2023-08-25T04:47:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e46fff700 1 -- 172.21.15.72:0/948244414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e401e5400 con 0x7f5e30003bc0 2023-08-25T04:47:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.563+0000 7f5e46fff700 1 -- 172.21.15.72:0/948244414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e400c6020 con 0x7f5e30003bc0 2023-08-25T04:47:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.564+0000 7f5e46fff700 1 -- 172.21.15.72:0/948244414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e401e5d30 con 0x7f5e30003bc0 2023-08-25T04:47:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.565+0000 7f5e3d7fa700 1 -- 172.21.15.72:0/948244414 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5e34019030 con 0x7f5e30003bc0 2023-08-25T04:47:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.566+0000 7f5e3d7fa700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2406a0e0 0x7f5e2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.566+0000 7f5e3d7fa700 1 -- 172.21.15.72:0/948244414 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5e34089980 con 0x7f5e30003bc0 2023-08-25T04:47:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.567+0000 7f5e3ffff700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2406a0e0 0x7f5e2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.567+0000 7f5e3ffff700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2406a0e0 0x7f5e2406c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e400cc6c0 tx=0x7f5e2c009670 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:01.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.570+0000 7f5e3d7fa700 1 -- 172.21.15.72:0/948244414 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5e34054d30 con 0x7f5e30003bc0 2023-08-25T04:47:01.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.768+0000 7f5e46fff700 1 -- 172.21.15.72:0/948244414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e4009ebb0 con 0x7f5e30003bc0 2023-08-25T04:47:01.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.768+0000 7f5e3d7fa700 1 -- 172.21.15.72:0/948244414 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e34058350 con 0x7f5e30003bc0 2023-08-25T04:47:01.770 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:47:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 -- 172.21.15.72:0/948244414 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2406a0e0 msgr2=0x7f5e2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2406a0e0 0x7f5e2406c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e400cc6c0 tx=0x7f5e2c009670 comp rx=0 tx=0).stop 2023-08-25T04:47:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 -- 172.21.15.72:0/948244414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 msgr2=0x7f5e400c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 0x7f5e400c5ae0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c750 tx=0x7f5e34001930 comp rx=0 tx=0).stop 2023-08-25T04:47:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 -- 172.21.15.72:0/948244414 shutdown_connections 2023-08-25T04:47:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e2406a0e0 0x7f5e2406c5a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e400c52f0 0x7f5e401d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e30003bc0 0x7f5e400c5ae0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 --2- 172.21.15.72:0/948244414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e400c4e70 0x7f5e401d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 -- 172.21.15.72:0/948244414 >> 172.21.15.72:0/948244414 conn(0x7f5e400d0c70 msgr2=0x7f5e401e40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 -- 172.21.15.72:0/948244414 shutdown_connections 2023-08-25T04:47:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.771+0000 7f5e46fff700 1 -- 172.21.15.72:0/948244414 wait complete. 2023-08-25T04:47:01.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:47:01.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:01.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.989+0000 7f39d0bff700 1 Processor -- start 2023-08-25T04:47:01.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.989+0000 7f39d0bff700 1 -- start start 2023-08-25T04:47:01.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.990+0000 7f39d0bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39cc0b2810 0x7f39cc0b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.990+0000 7f39d0bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39cc0add40 0x7f39cc0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.990+0000 7f39d0bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0b4300 con 0x7f39cc0cb650 2023-08-25T04:47:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.990+0000 7f39d0bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39cc0b3260 con 0x7f39cc0b2810 2023-08-25T04:47:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.990+0000 7f39d0bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0b3540 con 0x7f39cc0add40 2023-08-25T04:47:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.991+0000 7f39c9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39cc0b2810 0x7f39cc0b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.991+0000 7f39ca59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f39cc0cb650 0x7f39cc0cba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56134/0 (socket says 172.21.15.72:56134) 2023-08-25T04:47:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.991+0000 7f39ca59c700 1 -- 172.21.15.72:0/1627866401 learned_addr learned my addr 172.21.15.72:0/1627866401 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.991+0000 7f39cad9d700 1 --2- 172.21.15.72:0/1627866401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39cc0add40 0x7f39cc0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.991+0000 7f39c9d9b700 1 -- 172.21.15.72:0/1627866401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39cc0add40 msgr2=0x7f39cc0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.991+0000 7f39c9d9b700 1 --2- 172.21.15.72:0/1627866401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39cc0add40 0x7f39cc0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.991+0000 7f39c9d9b700 1 -- 172.21.15.72:0/1627866401 >> v1:172.21.15.72:6789/0 conn(0x7f39cc0cb650 legacy=0x7f39cc0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.991+0000 7f39c9d9b700 1 -- 172.21.15.72:0/1627866401 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc0b3820 con 0x7f39cc0b2810 2023-08-25T04:47:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.991+0000 7f39c959a700 1 -- 172.21.15.72:0/1627866401 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430853106 0 0) 0x7f39cc0b4300 con 0x7f39cc0cb650 2023-08-25T04:47:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.991+0000 7f39c9d9b700 1 --2- 172.21.15.72:0/1627866401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0b2810 0x7f39cc0b2c70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009840 tx=0x7f39c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab9ece95dfa5510 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39c959a700 1 -- 172.21.15.72:0/1627866401 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0011830 con 0x7f39cc0b2810 2023-08-25T04:47:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39c959a700 1 -- 172.21.15.72:0/1627866401 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c0011990 con 0x7f39cc0b2810 2023-08-25T04:47:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39c959a700 1 -- 172.21.15.72:0/1627866401 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0011d20 con 0x7f39cc0b2810 2023-08-25T04:47:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39d0bff700 1 -- 172.21.15.72:0/1627866401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0b2810 msgr2=0x7f39cc0b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39d0bff700 1 --2- 172.21.15.72:0/1627866401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0b2810 0x7f39cc0b2c70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009840 tx=0x7f39c0009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39d0bff700 1 -- 172.21.15.72:0/1627866401 shutdown_connections 2023-08-25T04:47:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39d0bff700 1 --2- 172.21.15.72:0/1627866401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39cc0add40 0x7f39cc0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39d0bff700 1 --2- 172.21.15.72:0/1627866401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0b2810 0x7f39cc0b2c70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39d0bff700 1 -- 172.21.15.72:0/1627866401 >> 172.21.15.72:0/1627866401 conn(0x7f39cc06a710 msgr2=0x7f39cc06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39d0bff700 1 -- 172.21.15.72:0/1627866401 shutdown_connections 2023-08-25T04:47:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.992+0000 7f39d0bff700 1 -- 172.21.15.72:0/1627866401 wait complete. 2023-08-25T04:47:01.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.994+0000 7f39d0bff700 1 Processor -- start 2023-08-25T04:47:01.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.994+0000 7f39d0bff700 1 -- start start 2023-08-25T04:47:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.995+0000 7f39d0bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39cc0add40 0x7f39cc15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.995+0000 7f39d0bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39cc0b2810 0x7f39cc1f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.995+0000 7f39d0bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0cb650 0x7f39cc0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.995+0000 7f39d0bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0ab990 con 0x7f39cc0cb650 2023-08-25T04:47:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.995+0000 7f39d0bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0c9010 con 0x7f39cc0b2810 2023-08-25T04:47:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.995+0000 7f39d0bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc15cf20 con 0x7f39cc0add40 2023-08-25T04:47:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.995+0000 7f39cad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0cb650 0x7f39cc0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.995+0000 7f39cad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0cb650 0x7f39cc0ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35138/0 (socket says 172.21.15.72:35138) 2023-08-25T04:47:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.996+0000 7f39cad9d700 1 -- 172.21.15.72:0/2424158803 learned_addr learned my addr 172.21.15.72:0/2424158803 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.996+0000 7f39ca59c700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39cc0add40 0x7f39cc15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.996+0000 7f39c9d9b700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39cc0b2810 0x7f39cc1f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.996+0000 7f39cad9d700 1 -- 172.21.15.72:0/2424158803 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39cc0add40 msgr2=0x7f39cc15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.996+0000 7f39cad9d700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39cc0add40 0x7f39cc15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.996+0000 7f39cad9d700 1 -- 172.21.15.72:0/2424158803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39cc0b2810 msgr2=0x7f39cc1f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.996+0000 7f39cad9d700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39cc0b2810 0x7f39cc1f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.996+0000 7f39cad9d700 1 -- 172.21.15.72:0/2424158803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c00094a0 con 0x7f39cc0cb650 2023-08-25T04:47:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.996+0000 7f39cad9d700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0cb650 0x7f39cc0ca590 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f39c4007e40 tx=0x7f39c400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.996+0000 7f39baffd700 1 -- 172.21.15.72:0/2424158803 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400ed30 con 0x7f39cc0cb650 2023-08-25T04:47:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.997+0000 7f39baffd700 1 -- 172.21.15.72:0/2424158803 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c4014420 con 0x7f39cc0cb650 2023-08-25T04:47:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.997+0000 7f39d0bff700 1 -- 172.21.15.72:0/2424158803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc15d200 con 0x7f39cc0cb650 2023-08-25T04:47:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.997+0000 7f39baffd700 1 -- 172.21.15.72:0/2424158803 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c40147d0 con 0x7f39cc0cb650 2023-08-25T04:47:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.997+0000 7f39d0bff700 1 -- 172.21.15.72:0/2424158803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc15d4e0 con 0x7f39cc0cb650 2023-08-25T04:47:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:01.998+0000 7f39d0bff700 1 -- 172.21.15.72:0/2424158803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc0abe40 con 0x7f39cc0cb650 2023-08-25T04:47:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.000+0000 7f39baffd700 1 -- 172.21.15.72:0/2424158803 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f39c4014930 con 0x7f39cc0cb650 2023-08-25T04:47:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.000+0000 7f39baffd700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f39ac06a0e0 0x7f39ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.001+0000 7f39baffd700 1 -- 172.21.15.72:0/2424158803 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f39c4088fd0 con 0x7f39cc0cb650 2023-08-25T04:47:02.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.001+0000 7f39ca59c700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f39ac06a0e0 0x7f39ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.001+0000 7f39ca59c700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f39ac06a0e0 0x7f39ac06c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39bc000f60 tx=0x7f39bc007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.006+0000 7f39baffd700 1 -- 172.21.15.72:0/2424158803 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f39cc0abe40 con 0x7f39cc0cb650 2023-08-25T04:47:02.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.206+0000 7f39d0bff700 1 -- 172.21.15.72:0/2424158803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39cc0abe40 con 0x7f39cc0cb650 2023-08-25T04:47:02.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.207+0000 7f39baffd700 1 -- 172.21.15.72:0/2424158803 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39cc0abe40 con 0x7f39cc0cb650 2023-08-25T04:47:02.208 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:47:02.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 -- 172.21.15.72:0/2424158803 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f39ac06a0e0 msgr2=0x7f39ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f39ac06a0e0 0x7f39ac06c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39bc000f60 tx=0x7f39bc007e70 comp rx=0 tx=0).stop 2023-08-25T04:47:02.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 -- 172.21.15.72:0/2424158803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0cb650 msgr2=0x7f39cc0ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0cb650 0x7f39cc0ca590 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f39c4007e40 tx=0x7f39c400e3c0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 -- 172.21.15.72:0/2424158803 shutdown_connections 2023-08-25T04:47:02.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f39ac06a0e0 0x7f39ac06c5a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39cc0cb650 0x7f39cc0ca590 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39cc0add40 0x7f39cc15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 --2- 172.21.15.72:0/2424158803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39cc0b2810 0x7f39cc1f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 -- 172.21.15.72:0/2424158803 >> 172.21.15.72:0/2424158803 conn(0x7f39cc06a710 msgr2=0x7f39cc0ae1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:02.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 -- 172.21.15.72:0/2424158803 shutdown_connections 2023-08-25T04:47:02.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.209+0000 7f39d0bff700 1 -- 172.21.15.72:0/2424158803 wait complete. 2023-08-25T04:47:02.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:47:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.425+0000 7fbd3e5ff700 1 Processor -- start 2023-08-25T04:47:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.425+0000 7fbd3e5ff700 1 -- start start 2023-08-25T04:47:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.426+0000 7fbd3e5ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbd3806b7a0 0x7fbd3806bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.426+0000 7fbd3e5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd3806c160 0x7fbd3815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.426+0000 7fbd3e5ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd380cba40 con 0x7fbd380c71b0 2023-08-25T04:47:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.426+0000 7fbd3e5ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd380d04f0 con 0x7fbd3806b7a0 2023-08-25T04:47:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.426+0000 7fbd3e5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3806c5f0 con 0x7fbd3806c160 2023-08-25T04:47:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd3cb9c700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd3806c160 0x7fbd3815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd377fe700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbd3806b7a0 0x7fbd3806bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd37fff700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbd380c71b0 0x7fbd380cf9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:47898/0 (socket says 172.21.15.72:47898) 2023-08-25T04:47:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd37fff700 1 -- 172.21.15.72:0/3214866364 learned_addr learned my addr 172.21.15.72:0/3214866364 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd3cb9c700 1 -- 172.21.15.72:0/3214866364 >> v2:172.21.15.137:3300/0 conn(0x7fbd3806b7a0 msgr2=0x7fbd3806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd36ffd700 1 -- 172.21.15.72:0/3214866364 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939593259 0 0) 0x7fbd380cba40 con 0x7fbd380c71b0 2023-08-25T04:47:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd3cb9c700 1 --2- 172.21.15.72:0/3214866364 >> v2:172.21.15.137:3300/0 conn(0x7fbd3806b7a0 0x7fbd3806bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd3cb9c700 1 -- 172.21.15.72:0/3214866364 >> v1:172.21.15.137:6789/0 conn(0x7fbd380c71b0 legacy=0x7fbd380cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd3cb9c700 1 -- 172.21.15.72:0/3214866364 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380d0210 con 0x7fbd3806c160 2023-08-25T04:47:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd377fe700 1 --2- 172.21.15.72:0/3214866364 >> v2:172.21.15.137:3300/0 conn(0x7fbd3806b7a0 0x7fbd3806bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.427+0000 7fbd3cb9c700 1 --2- 172.21.15.72:0/3214866364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd3806c160 0x7fbd3815c8e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009d90 tx=0x7fbd3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61ee2815ad5c4369 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd36ffd700 1 -- 172.21.15.72:0/3214866364 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3000e070 con 0x7fbd3806c160 2023-08-25T04:47:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd36ffd700 1 -- 172.21.15.72:0/3214866364 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3000bb20 con 0x7fbd3806c160 2023-08-25T04:47:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd36ffd700 1 -- 172.21.15.72:0/3214866364 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30012430 con 0x7fbd3806c160 2023-08-25T04:47:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/3214866364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd3806c160 msgr2=0x7fbd3815c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd3e5ff700 1 --2- 172.21.15.72:0/3214866364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd3806c160 0x7fbd3815c8e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009d90 tx=0x7fbd3000b330 comp rx=0 tx=0).stop 2023-08-25T04:47:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/3214866364 shutdown_connections 2023-08-25T04:47:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd3e5ff700 1 --2- 172.21.15.72:0/3214866364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd3806c160 0x7fbd3815c8e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd3e5ff700 1 --2- 172.21.15.72:0/3214866364 >> v2:172.21.15.137:3300/0 conn(0x7fbd3806b7a0 0x7fbd3806bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/3214866364 >> 172.21.15.72:0/3214866364 conn(0x7fbd380d0c70 msgr2=0x7fbd380d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/3214866364 shutdown_connections 2023-08-25T04:47:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.428+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/3214866364 wait complete. 2023-08-25T04:47:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.430+0000 7fbd3e5ff700 1 Processor -- start 2023-08-25T04:47:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.430+0000 7fbd3e5ff700 1 -- start start 2023-08-25T04:47:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.431+0000 7fbd3e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd3806b7a0 0x7fbd3809e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.431+0000 7fbd3e5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd3806c160 0x7fbd381e73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.431+0000 7fbd3e5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd380c71b0 0x7fbd380cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.431+0000 7fbd3e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd381db740 con 0x7fbd3806b7a0 2023-08-25T04:47:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.431+0000 7fbd3e5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd381e4d00 con 0x7fbd3806c160 2023-08-25T04:47:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.431+0000 7fbd3e5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd381e4fe0 con 0x7fbd380c71b0 2023-08-25T04:47:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd37fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd3806b7a0 0x7fbd3809e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd37fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd3806b7a0 0x7fbd3809e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35142/0 (socket says 172.21.15.72:35142) 2023-08-25T04:47:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd37fff700 1 -- 172.21.15.72:0/713073571 learned_addr learned my addr 172.21.15.72:0/713073571 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd37fff700 1 -- 172.21.15.72:0/713073571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd380c71b0 msgr2=0x7fbd380cbed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:47:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd37fff700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd380c71b0 0x7fbd380cbed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd37fff700 1 -- 172.21.15.72:0/713073571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd3806c160 msgr2=0x7fbd381e73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd37fff700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd3806c160 0x7fbd381e73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd37fff700 1 -- 172.21.15.72:0/713073571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c0094a0 con 0x7fbd3806b7a0 2023-08-25T04:47:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd37fff700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd3806b7a0 0x7fbd3809e1a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800c550 tx=0x7fbd2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd34ff9700 1 -- 172.21.15.72:0/713073571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28004c80 con 0x7fbd3806b7a0 2023-08-25T04:47:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd34ff9700 1 -- 172.21.15.72:0/713073571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd28004e00 con 0x7fbd3806b7a0 2023-08-25T04:47:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/713073571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd30009a70 con 0x7fbd3806b7a0 2023-08-25T04:47:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.432+0000 7fbd34ff9700 1 -- 172.21.15.72:0/713073571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28007310 con 0x7fbd3806b7a0 2023-08-25T04:47:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.433+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/713073571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd381e55a0 con 0x7fbd3806b7a0 2023-08-25T04:47:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.433+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/713073571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3809ebb0 con 0x7fbd3806b7a0 2023-08-25T04:47:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.434+0000 7fbd34ff9700 1 -- 172.21.15.72:0/713073571 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbd28007470 con 0x7fbd3806b7a0 2023-08-25T04:47:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.435+0000 7fbd34ff9700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd2406a0e0 0x7fbd2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.435+0000 7fbd34ff9700 1 -- 172.21.15.72:0/713073571 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbd28088680 con 0x7fbd3806b7a0 2023-08-25T04:47:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.436+0000 7fbd377fe700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd2406a0e0 0x7fbd2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.436+0000 7fbd377fe700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd2406a0e0 0x7fbd2406c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c006f10 tx=0x7fbd2c006e60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.440+0000 7fbd34ff9700 1 -- 172.21.15.72:0/713073571 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbd280539a0 con 0x7fbd3806b7a0 2023-08-25T04:47:02.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.637+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/713073571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd380744f0 con 0x7fbd3806b7a0 2023-08-25T04:47:02.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.638+0000 7fbd34ff9700 1 -- 172.21.15.72:0/713073571 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd28056fc0 con 0x7fbd3806b7a0 2023-08-25T04:47:02.640 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:47:02.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/713073571 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd2406a0e0 msgr2=0x7fbd2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd2406a0e0 0x7fbd2406c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c006f10 tx=0x7fbd2c006e60 comp rx=0 tx=0).stop 2023-08-25T04:47:02.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/713073571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd3806b7a0 msgr2=0x7fbd3809e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd3806b7a0 0x7fbd3809e1a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800c550 tx=0x7fbd2800c910 comp rx=0 tx=0).stop 2023-08-25T04:47:02.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/713073571 shutdown_connections 2023-08-25T04:47:02.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd2406a0e0 0x7fbd2406c5a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd380c71b0 0x7fbd380cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd3806b7a0 0x7fbd3809e1a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 --2- 172.21.15.72:0/713073571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd3806c160 0x7fbd381e73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/713073571 >> 172.21.15.72:0/713073571 conn(0x7fbd380d0c70 msgr2=0x7fbd381e3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:02.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.640+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/713073571 shutdown_connections 2023-08-25T04:47:02.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.641+0000 7fbd3e5ff700 1 -- 172.21.15.72:0/713073571 wait complete. 2023-08-25T04:47:02.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:47:02.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.859+0000 7f02b1dff700 1 Processor -- start 2023-08-25T04:47:02.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.859+0000 7f02b1dff700 1 -- start start 2023-08-25T04:47:02.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.860+0000 7f02b1dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac150ac0 0x7f02ac15def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.860+0000 7f02b1dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f02ac0cbd60 0x7f02ac15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.860+0000 7f02b1dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ac0aebf0 con 0x7f02ac150ea0 2023-08-25T04:47:02.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.860+0000 7f02b1dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02ac0af490 con 0x7f02ac0cbd60 2023-08-25T04:47:02.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.860+0000 7f02b1dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac15d7c0 con 0x7f02ac150ac0 2023-08-25T04:47:02.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.860+0000 7f02aaffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f02ac150ea0 0x7f02ac0cb650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46438/0 (socket says 172.21.15.72:46438) 2023-08-25T04:47:02.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.860+0000 7f02aaffd700 1 -- 172.21.15.72:0/4188995376 learned_addr learned my addr 172.21.15.72:0/4188995376 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.860+0000 7f02abfff700 1 --2- 172.21.15.72:0/4188995376 >> v2:172.21.15.72:3300/0 conn(0x7f02ac0cbd60 0x7f02ac15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02ab7fe700 1 --2- 172.21.15.72:0/4188995376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac150ac0 0x7f02ac15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02aa7fc700 1 -- 172.21.15.72:0/4188995376 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096091107 0 0) 0x7f02ac0aebf0 con 0x7f02ac150ea0 2023-08-25T04:47:02.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02aa7fc700 1 -- 172.21.15.72:0/4188995376 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02940035b0 con 0x7f02ac150ea0 2023-08-25T04:47:02.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02abfff700 1 -- 172.21.15.72:0/4188995376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac150ac0 msgr2=0x7f02ac15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:02.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02abfff700 1 --2- 172.21.15.72:0/4188995376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac150ac0 0x7f02ac15def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02abfff700 1 -- 172.21.15.72:0/4188995376 >> v1:172.21.15.72:6789/0 conn(0x7f02ac150ea0 legacy=0x7f02ac0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02abfff700 1 -- 172.21.15.72:0/4188995376 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac0aeed0 con 0x7f02ac0cbd60 2023-08-25T04:47:02.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02abfff700 1 --2- 172.21.15.72:0/4188995376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 0x7f02ac15a180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009d90 tx=0x7f02a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67aba8eacf434c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:02.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02aa7fc700 1 -- 172.21.15.72:0/4188995376 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400e070 con 0x7f02ac0cbd60 2023-08-25T04:47:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02aa7fc700 1 -- 172.21.15.72:0/4188995376 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a400bb20 con 0x7f02ac0cbd60 2023-08-25T04:47:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.861+0000 7f02aa7fc700 1 -- 172.21.15.72:0/4188995376 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a4012430 con 0x7f02ac0cbd60 2023-08-25T04:47:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.862+0000 7f02b1dff700 1 -- 172.21.15.72:0/4188995376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 msgr2=0x7f02ac15a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.862+0000 7f02b1dff700 1 --2- 172.21.15.72:0/4188995376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 0x7f02ac15a180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009d90 tx=0x7f02a400b330 comp rx=0 tx=0).stop 2023-08-25T04:47:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.862+0000 7f02b1dff700 1 -- 172.21.15.72:0/4188995376 shutdown_connections 2023-08-25T04:47:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.862+0000 7f02b1dff700 1 --2- 172.21.15.72:0/4188995376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 0x7f02ac15a180 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.862+0000 7f02b1dff700 1 --2- 172.21.15.72:0/4188995376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac150ac0 0x7f02ac15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.862+0000 7f02b1dff700 1 -- 172.21.15.72:0/4188995376 >> 172.21.15.72:0/4188995376 conn(0x7f02ac06a710 msgr2=0x7f02ac06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:02.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.862+0000 7f02b1dff700 1 -- 172.21.15.72:0/4188995376 shutdown_connections 2023-08-25T04:47:02.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.862+0000 7f02b1dff700 1 -- 172.21.15.72:0/4188995376 wait complete. 2023-08-25T04:47:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.864+0000 7f02b1dff700 1 Processor -- start 2023-08-25T04:47:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.864+0000 7f02b1dff700 1 -- start start 2023-08-25T04:47:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02b1dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 0x7f02ac0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02b1dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac150ac0 0x7f02ac0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02b1dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac150ea0 0x7f02ac14ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02b1dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0b4520 con 0x7f02ac0cbd60 2023-08-25T04:47:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02b1dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0b3c80 con 0x7f02ac150ea0 2023-08-25T04:47:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02b1dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac0b3f60 con 0x7f02ac150ac0 2023-08-25T04:47:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02ab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 0x7f02ac0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02ab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 0x7f02ac0c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40206/0 (socket says 172.21.15.72:40206) 2023-08-25T04:47:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02ab7fe700 1 -- 172.21.15.72:0/3674648996 learned_addr learned my addr 172.21.15.72:0/3674648996 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02ab7fe700 1 -- 172.21.15.72:0/3674648996 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac150ac0 msgr2=0x7f02ac0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02ab7fe700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac150ac0 0x7f02ac0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02ab7fe700 1 -- 172.21.15.72:0/3674648996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac150ea0 msgr2=0x7f02ac14ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02ab7fe700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac150ea0 0x7f02ac14ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.865+0000 7f02ab7fe700 1 -- 172.21.15.72:0/3674648996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a4009a70 con 0x7f02ac0cbd60 2023-08-25T04:47:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.866+0000 7f02ab7fe700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 0x7f02ac0c4d00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f029c00e810 tx=0x7f029c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.866+0000 7f0293fff700 1 -- 172.21.15.72:0/3674648996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c013610 con 0x7f02ac0cbd60 2023-08-25T04:47:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.866+0000 7f0293fff700 1 -- 172.21.15.72:0/3674648996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c013770 con 0x7f02ac0cbd60 2023-08-25T04:47:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.866+0000 7f0293fff700 1 -- 172.21.15.72:0/3674648996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c013b20 con 0x7f02ac0cbd60 2023-08-25T04:47:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.866+0000 7f02b1dff700 1 -- 172.21.15.72:0/3674648996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac0b4240 con 0x7f02ac0cbd60 2023-08-25T04:47:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.866+0000 7f02b1dff700 1 -- 172.21.15.72:0/3674648996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac0c5240 con 0x7f02ac0cbd60 2023-08-25T04:47:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.867+0000 7f02b1dff700 1 -- 172.21.15.72:0/3674648996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ac0c22c0 con 0x7f02ac0cbd60 2023-08-25T04:47:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.868+0000 7f0293fff700 1 -- 172.21.15.72:0/3674648996 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f029c013c80 con 0x7f02ac0cbd60 2023-08-25T04:47:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.869+0000 7f0293fff700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f029806a0e0 0x7f029806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.870+0000 7f0293fff700 1 -- 172.21.15.72:0/3674648996 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f029c088580 con 0x7f02ac0cbd60 2023-08-25T04:47:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.870+0000 7f02aaffd700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f029806a0e0 0x7f029806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.870+0000 7f02aaffd700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f029806a0e0 0x7f029806c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0ad510 tx=0x7f02a00079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:02.874+0000 7f0293fff700 1 -- 172.21.15.72:0/3674648996 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f029c053950 con 0x7f02ac0cbd60 2023-08-25T04:47:03.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.070+0000 7f02b1dff700 1 -- 172.21.15.72:0/3674648996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f02ac0c28d0 con 0x7f02ac0cbd60 2023-08-25T04:47:03.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.070+0000 7f0293fff700 1 -- 172.21.15.72:0/3674648996 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f029c056f70 con 0x7f02ac0cbd60 2023-08-25T04:47:03.072 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:47:03.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 -- 172.21.15.72:0/3674648996 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f029806a0e0 msgr2=0x7f029806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f029806a0e0 0x7f029806c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0ad510 tx=0x7f02a00079c0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 -- 172.21.15.72:0/3674648996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 msgr2=0x7f02ac0c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 0x7f02ac0c4d00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f029c00e810 tx=0x7f029c00ebd0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 -- 172.21.15.72:0/3674648996 shutdown_connections 2023-08-25T04:47:03.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f029806a0e0 0x7f029806c5a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02ac150ea0 0x7f02ac14ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02ac0cbd60 0x7f02ac0c4d00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 --2- 172.21.15.72:0/3674648996 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f02ac150ac0 0x7f02ac0ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 -- 172.21.15.72:0/3674648996 >> 172.21.15.72:0/3674648996 conn(0x7f02ac06a710 msgr2=0x7f02ac159590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:03.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 -- 172.21.15.72:0/3674648996 shutdown_connections 2023-08-25T04:47:03.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.073+0000 7f02b1dff700 1 -- 172.21.15.72:0/3674648996 wait complete. 2023-08-25T04:47:03.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:47:03.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.288+0000 7fad2fdff700 1 Processor -- start 2023-08-25T04:47:03.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.288+0000 7fad2fdff700 1 -- start start 2023-08-25T04:47:03.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.289+0000 7fad2fdff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad280b2ff0 0x7fad280ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.289+0000 7fad2fdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad280b1870 con 0x7fad28070890 2023-08-25T04:47:03.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.289+0000 7fad2fdff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad280b46a0 con 0x7fad28159ff0 2023-08-25T04:47:03.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.289+0000 7fad2fdff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad28070de0 con 0x7fad280b2ff0 2023-08-25T04:47:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2d39a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fad28070890 0x7fad280ae550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46448/0 (socket says 172.21.15.72:46448) 2023-08-25T04:47:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2d39a700 1 -- 172.21.15.72:0/2252281802 learned_addr learned my addr 172.21.15.72:0/2252281802 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27503591 0 0) 0x7fad280b1870 con 0x7fad28070890 2023-08-25T04:47:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2e39c700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad280b2ff0 0x7fad280ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad140035b0 con 0x7fad28070890 2023-08-25T04:47:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310925428 0 0) 0x7fad140035b0 con 0x7fad28070890 2023-08-25T04:47:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad280b2ff0 msgr2=0x7fad280ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad280b2ff0 0x7fad280ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 >> v1:172.21.15.137:6789/0 conn(0x7fad28159ff0 legacy=0x7fad280b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280710c0 con 0x7fad28070890 2023-08-25T04:47:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fad18001670 con 0x7fad28070890 2023-08-25T04:47:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 >> v1:172.21.15.72:6789/0 conn(0x7fad28070890 legacy=0x7fad280ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad280b2ff0 0x7fad14003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14004000 0x7fad14004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.290+0000 7fad2cb99700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad14004d90 0x7fad14005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad28070de0 con 0x7fad14004000 2023-08-25T04:47:03.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1400bb50 con 0x7fad14004d90 2023-08-25T04:47:03.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1400bd10 con 0x7fad280b2ff0 2023-08-25T04:47:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2d39a700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14004000 0x7fad14004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2e39c700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad14004d90 0x7fad14005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2db9b700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad280b2ff0 0x7fad14003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2d39a700 1 -- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad280b2ff0 msgr2=0x7fad14003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2d39a700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad280b2ff0 0x7fad14003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2d39a700 1 -- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad14004d90 msgr2=0x7fad14005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2d39a700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad14004d90 0x7fad14005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.291+0000 7fad2d39a700 1 -- 172.21.15.72:0/2252281802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad140035b0 con 0x7fad14004000 2023-08-25T04:47:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2d39a700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14004000 0x7fad14004850 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c160 tx=0x7fad14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716ffa1b175bd968 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18007b70 con 0x7fad14004000 2023-08-25T04:47:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1800cc60 con 0x7fad14004000 2023-08-25T04:47:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2cb99700 1 -- 172.21.15.72:0/2252281802 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18005960 con 0x7fad14004000 2023-08-25T04:47:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2fdff700 1 -- 172.21.15.72:0/2252281802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14004000 msgr2=0x7fad14004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2fdff700 1 --2- 172.21.15.72:0/2252281802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad14004000 0x7fad14004850 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c160 tx=0x7fad14005880 comp rx=0 tx=0).stop 2023-08-25T04:47:03.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2e39c700 1 -- 172.21.15.72:0/2252281802 reap_dead start 2023-08-25T04:47:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2fdff700 1 -- 172.21.15.72:0/2252281802 shutdown_connections 2023-08-25T04:47:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2fdff700 1 -- 172.21.15.72:0/2252281802 >> 172.21.15.72:0/2252281802 conn(0x7fad280ce9a0 msgr2=0x7fad280ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2fdff700 1 -- 172.21.15.72:0/2252281802 shutdown_connections 2023-08-25T04:47:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.292+0000 7fad2fdff700 1 -- 172.21.15.72:0/2252281802 wait complete. 2023-08-25T04:47:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.294+0000 7fad2fdff700 1 Processor -- start 2023-08-25T04:47:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.294+0000 7fad2fdff700 1 -- start start 2023-08-25T04:47:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.295+0000 7fad2fdff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad14004000 0x7fad2815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.295+0000 7fad2fdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad281520b0 0x7fad280c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.295+0000 7fad2fdff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad28151b60 0x7fad280cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.295+0000 7fad2fdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad281519d0 con 0x7fad281520b0 2023-08-25T04:47:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.295+0000 7fad2fdff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad280c52e0 con 0x7fad28151b60 2023-08-25T04:47:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.295+0000 7fad2fdff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2815cf60 con 0x7fad14004000 2023-08-25T04:47:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.295+0000 7fad2d39a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad281520b0 0x7fad280c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2d39a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad281520b0 0x7fad280c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40228/0 (socket says 172.21.15.72:40228) 2023-08-25T04:47:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2d39a700 1 -- 172.21.15.72:0/2877929166 learned_addr learned my addr 172.21.15.72:0/2877929166 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2e39c700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad28151b60 0x7fad280cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2db9b700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad14004000 0x7fad2815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2d39a700 1 -- 172.21.15.72:0/2877929166 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad14004000 msgr2=0x7fad2815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2d39a700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad14004000 0x7fad2815ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2d39a700 1 -- 172.21.15.72:0/2877929166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad28151b60 msgr2=0x7fad280cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2d39a700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad28151b60 0x7fad280cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2d39a700 1 -- 172.21.15.72:0/2877929166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280c4a40 con 0x7fad281520b0 2023-08-25T04:47:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2d39a700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad281520b0 0x7fad280c2a70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c750 tx=0x7fad18001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad1e7fc700 1 -- 172.21.15.72:0/2877929166 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18004c80 con 0x7fad281520b0 2023-08-25T04:47:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad1e7fc700 1 -- 172.21.15.72:0/2877929166 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad18004e00 con 0x7fad281520b0 2023-08-25T04:47:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad1e7fc700 1 -- 172.21.15.72:0/2877929166 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18007310 con 0x7fad281520b0 2023-08-25T04:47:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.296+0000 7fad2fdff700 1 -- 172.21.15.72:0/2877929166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad280c4d20 con 0x7fad281520b0 2023-08-25T04:47:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.297+0000 7fad2fdff700 1 -- 172.21.15.72:0/2877929166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad280c2550 con 0x7fad281520b0 2023-08-25T04:47:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.297+0000 7fad2fdff700 1 -- 172.21.15.72:0/2877929166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad280c2710 con 0x7fad281520b0 2023-08-25T04:47:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.298+0000 7fad1e7fc700 1 -- 172.21.15.72:0/2877929166 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fad18019070 con 0x7fad281520b0 2023-08-25T04:47:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.299+0000 7fad1e7fc700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fad0c06a0e0 0x7fad0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.299+0000 7fad1e7fc700 1 -- 172.21.15.72:0/2877929166 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fad18088d50 con 0x7fad281520b0 2023-08-25T04:47:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.299+0000 7fad2db9b700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fad0c06a0e0 0x7fad0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.300+0000 7fad2db9b700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fad0c06a0e0 0x7fad0c06c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fad24000c00 tx=0x7fad24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.304+0000 7fad1e7fc700 1 -- 172.21.15.72:0/2877929166 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fad180bb990 con 0x7fad281520b0 2023-08-25T04:47:03.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.514+0000 7fad2fdff700 1 -- 172.21.15.72:0/2877929166 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fad280c28c0 con 0x7fad281520b0 2023-08-25T04:47:03.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.515+0000 7fad1e7fc700 1 -- 172.21.15.72:0/2877929166 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fad18088030 con 0x7fad281520b0 2023-08-25T04:47:03.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 -- 172.21.15.72:0/2877929166 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fad0c06a0e0 msgr2=0x7fad0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fad0c06a0e0 0x7fad0c06c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fad24000c00 tx=0x7fad24009040 comp rx=0 tx=0).stop 2023-08-25T04:47:03.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 -- 172.21.15.72:0/2877929166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad281520b0 msgr2=0x7fad280c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad281520b0 0x7fad280c2a70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c750 tx=0x7fad18001930 comp rx=0 tx=0).stop 2023-08-25T04:47:03.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 -- 172.21.15.72:0/2877929166 shutdown_connections 2023-08-25T04:47:03.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fad0c06a0e0 0x7fad0c06c5a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad28151b60 0x7fad280cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad14004000 0x7fad2815ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 --2- 172.21.15.72:0/2877929166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad281520b0 0x7fad280c2a70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 -- 172.21.15.72:0/2877929166 >> 172.21.15.72:0/2877929166 conn(0x7fad280ce9a0 msgr2=0x7fad281592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:03.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 -- 172.21.15.72:0/2877929166 shutdown_connections 2023-08-25T04:47:03.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.517+0000 7fad2fdff700 1 -- 172.21.15.72:0/2877929166 wait complete. 2023-08-25T04:47:03.521 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-08-25T04:47:03.536 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-08-25T04:47:03.536 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:47:03.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:47:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.784+0000 7fe2243ff700 1 Processor -- start 2023-08-25T04:47:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.785+0000 7fe2243ff700 1 -- start start 2023-08-25T04:47:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.786+0000 7fe2243ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe21c159b90 0x7fe21c0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.786+0000 7fe2243ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 0x7fe21c0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.786+0000 7fe2243ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c0c48f0 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.786+0000 7fe2243ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c0c5470 con 0x7fe21c159b90 2023-08-25T04:47:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.786+0000 7fe2243ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c159f70 con 0x7fe21c0b0ab0 2023-08-25T04:47:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.786+0000 7fe22299c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe21c0ce1f0 0x7fe21c0c3850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46462/0 (socket says 172.21.15.72:46462) 2023-08-25T04:47:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.786+0000 7fe22299c700 1 -- 172.21.15.72:0/3020217692 learned_addr learned my addr 172.21.15.72:0/3020217692 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.786+0000 7fe22199a700 1 --2- 172.21.15.72:0/3020217692 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 0x7fe21c0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.786+0000 7fe22219b700 1 --2- 172.21.15.72:0/3020217692 >> v2:172.21.15.137:3300/0 conn(0x7fe21c159b90 0x7fe21c0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.787+0000 7fe221199700 1 -- 172.21.15.72:0/3020217692 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889938561 0 0) 0x7fe21c0c48f0 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.787+0000 7fe221199700 1 -- 172.21.15.72:0/3020217692 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2080035b0 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.787+0000 7fe22219b700 1 -- 172.21.15.72:0/3020217692 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 msgr2=0x7fe21c0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.787+0000 7fe22219b700 1 --2- 172.21.15.72:0/3020217692 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 0x7fe21c0cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.787+0000 7fe22219b700 1 -- 172.21.15.72:0/3020217692 >> v1:172.21.15.72:6789/0 conn(0x7fe21c0ce1f0 legacy=0x7fe21c0c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.787+0000 7fe22219b700 1 -- 172.21.15.72:0/3020217692 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0c4b40 con 0x7fe21c159b90 2023-08-25T04:47:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.787+0000 7fe22199a700 1 --2- 172.21.15.72:0/3020217692 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 0x7fe21c0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.787+0000 7fe22219b700 1 --2- 172.21.15.72:0/3020217692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe21c159b90 0x7fe21c0b0570 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe218009840 tx=0x7fe218009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=220d9734cc4e38e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.787+0000 7fe221199700 1 -- 172.21.15.72:0/3020217692 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe218011830 con 0x7fe21c159b90 2023-08-25T04:47:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.788+0000 7fe221199700 1 -- 172.21.15.72:0/3020217692 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe218011990 con 0x7fe21c159b90 2023-08-25T04:47:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.788+0000 7fe221199700 1 -- 172.21.15.72:0/3020217692 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe218011d20 con 0x7fe21c159b90 2023-08-25T04:47:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.788+0000 7fe2243ff700 1 -- 172.21.15.72:0/3020217692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe21c159b90 msgr2=0x7fe21c0b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.788+0000 7fe2243ff700 1 --2- 172.21.15.72:0/3020217692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe21c159b90 0x7fe21c0b0570 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe218009840 tx=0x7fe218009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.788+0000 7fe2243ff700 1 -- 172.21.15.72:0/3020217692 shutdown_connections 2023-08-25T04:47:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.788+0000 7fe2243ff700 1 --2- 172.21.15.72:0/3020217692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe21c159b90 0x7fe21c0b0570 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.788+0000 7fe2243ff700 1 --2- 172.21.15.72:0/3020217692 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 0x7fe21c0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.788+0000 7fe2243ff700 1 -- 172.21.15.72:0/3020217692 >> 172.21.15.72:0/3020217692 conn(0x7fe21c0ce990 msgr2=0x7fe21c0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.788+0000 7fe2243ff700 1 -- 172.21.15.72:0/3020217692 shutdown_connections 2023-08-25T04:47:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.788+0000 7fe2243ff700 1 -- 172.21.15.72:0/3020217692 wait complete. 2023-08-25T04:47:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.790+0000 7fe2243ff700 1 Processor -- start 2023-08-25T04:47:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.790+0000 7fe2243ff700 1 -- start start 2023-08-25T04:47:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe2243ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 0x7fe21c14e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe2243ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe21c0ce1f0 0x7fe21c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe2243ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe21c159b90 0x7fe21c15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe2243ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0b26a0 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe2243ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0c6750 con 0x7fe21c159b90 2023-08-25T04:47:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe2243ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0b20e0 con 0x7fe21c0b0ab0 2023-08-25T04:47:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe22199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe21c0ce1f0 0x7fe21c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe22199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe21c0ce1f0 0x7fe21c15c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40234/0 (socket says 172.21.15.72:40234) 2023-08-25T04:47:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe22199a700 1 -- 172.21.15.72:0/3913843505 learned_addr learned my addr 172.21.15.72:0/3913843505 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe22219b700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 0x7fe21c14e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.791+0000 7fe22299c700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe21c159b90 0x7fe21c15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe22199a700 1 -- 172.21.15.72:0/3913843505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 msgr2=0x7fe21c14e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe22199a700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 0x7fe21c14e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe22199a700 1 -- 172.21.15.72:0/3913843505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe21c159b90 msgr2=0x7fe21c15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe22199a700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe21c159b90 0x7fe21c15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe22199a700 1 -- 172.21.15.72:0/3913843505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0094a0 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe22299c700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe21c159b90 0x7fe21c15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe22199a700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe21c0ce1f0 0x7fe21c15c610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00ebe0 tx=0x7fe20c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe212ffd700 1 -- 172.21.15.72:0/3913843505 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c009800 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe212ffd700 1 -- 172.21.15.72:0/3913843505 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20c00c910 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe2243ff700 1 -- 172.21.15.72:0/3913843505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2180094a0 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe212ffd700 1 -- 172.21.15.72:0/3913843505 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c00cc80 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.792+0000 7fe2243ff700 1 -- 172.21.15.72:0/3913843505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c0c69f0 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.793+0000 7fe2243ff700 1 -- 172.21.15.72:0/3913843505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21c04e620 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.794+0000 7fe212ffd700 1 -- 172.21.15.72:0/3913843505 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe20c013470 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.796+0000 7fe212ffd700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe20006a0e0 0x7fe20006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.796+0000 7fe212ffd700 1 -- 172.21.15.72:0/3913843505 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe20c088a20 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.796+0000 7fe22219b700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe20006a0e0 0x7fe20006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.796+0000 7fe22219b700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe20006a0e0 0x7fe20006c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe218000c00 tx=0x7fe21801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.800+0000 7fe212ffd700 1 -- 172.21.15.72:0/3913843505 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe20c057860 con 0x7fe21c0ce1f0 2023-08-25T04:47:03.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:03.999+0000 7fe2243ff700 1 -- 172.21.15.72:0/3913843505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe21c158e60 con 0x7fe21c0ce1f0 2023-08-25T04:47:04.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.000+0000 7fe212ffd700 1 -- 172.21.15.72:0/3913843505 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7fe20c0573f0 con 0x7fe21c0ce1f0 2023-08-25T04:47:04.001 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:04.002 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:47:04.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 -- 172.21.15.72:0/3913843505 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe20006a0e0 msgr2=0x7fe20006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe20006a0e0 0x7fe20006c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe218000c00 tx=0x7fe21801c040 comp rx=0 tx=0).stop 2023-08-25T04:47:04.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 -- 172.21.15.72:0/3913843505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe21c0ce1f0 msgr2=0x7fe21c15c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe21c0ce1f0 0x7fe21c15c610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00ebe0 tx=0x7fe20c00eef0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 -- 172.21.15.72:0/3913843505 shutdown_connections 2023-08-25T04:47:04.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe20006a0e0 0x7fe20006c5a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe21c159b90 0x7fe21c15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe21c0b0ab0 0x7fe21c14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 --2- 172.21.15.72:0/3913843505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe21c0ce1f0 0x7fe21c15c610 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 -- 172.21.15.72:0/3913843505 >> 172.21.15.72:0/3913843505 conn(0x7fe21c0ce990 msgr2=0x7fe21c1585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 -- 172.21.15.72:0/3913843505 shutdown_connections 2023-08-25T04:47:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.002+0000 7fe2243ff700 1 -- 172.21.15.72:0/3913843505 wait complete. 2023-08-25T04:47:04.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:47:04.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:47:04.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.220+0000 7fafe85ff700 1 Processor -- start 2023-08-25T04:47:04.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.220+0000 7fafe85ff700 1 -- start start 2023-08-25T04:47:04.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.221+0000 7fafe85ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fafe00d10c0 0x7fafe00b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.221+0000 7fafe85ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafe00b4d40 0x7fafe00b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.221+0000 7fafe85ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe00b8d10 con 0x7fafe015d000 2023-08-25T04:47:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe85ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe00b56f0 con 0x7fafe00b4d40 2023-08-25T04:47:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe85ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe00b6e90 con 0x7fafe00d10c0 2023-08-25T04:47:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe6b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafe00b4d40 0x7fafe00b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe6b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafe00b4d40 0x7fafe00b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40248/0 (socket says 172.21.15.72:40248) 2023-08-25T04:47:04.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe6b9c700 1 -- 172.21.15.72:0/4288441637 learned_addr learned my addr 172.21.15.72:0/4288441637 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:04.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe5b9a700 1 --2- 172.21.15.72:0/4288441637 >> v2:172.21.15.137:3300/0 conn(0x7fafe00d10c0 0x7fafe00b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe6b9c700 1 -- 172.21.15.72:0/4288441637 >> v2:172.21.15.137:3300/0 conn(0x7fafe00d10c0 msgr2=0x7fafe00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe6b9c700 1 --2- 172.21.15.72:0/4288441637 >> v2:172.21.15.137:3300/0 conn(0x7fafe00d10c0 0x7fafe00b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe6b9c700 1 -- 172.21.15.72:0/4288441637 >> v1:172.21.15.137:6789/0 conn(0x7fafe015d000 legacy=0x7fafe00b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe6b9c700 1 -- 172.21.15.72:0/4288441637 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe00b5170 con 0x7fafe00b4d40 2023-08-25T04:47:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.222+0000 7fafe6b9c700 1 --2- 172.21.15.72:0/4288441637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe00b4d40 0x7fafe00b7320 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fafe0160a50 tx=0x7fafd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede5d243df0b59d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe5399700 1 -- 172.21.15.72:0/4288441637 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd800e070 con 0x7fafe00b4d40 2023-08-25T04:47:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe5399700 1 -- 172.21.15.72:0/4288441637 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd800b9c0 con 0x7fafe00b4d40 2023-08-25T04:47:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe5399700 1 -- 172.21.15.72:0/4288441637 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd800bd70 con 0x7fafe00b4d40 2023-08-25T04:47:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe85ff700 1 -- 172.21.15.72:0/4288441637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe00b4d40 msgr2=0x7fafe00b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe85ff700 1 --2- 172.21.15.72:0/4288441637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe00b4d40 0x7fafe00b7320 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fafe0160a50 tx=0x7fafd800b330 comp rx=0 tx=0).stop 2023-08-25T04:47:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe85ff700 1 -- 172.21.15.72:0/4288441637 shutdown_connections 2023-08-25T04:47:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe85ff700 1 --2- 172.21.15.72:0/4288441637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe00b4d40 0x7fafe00b7320 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe85ff700 1 --2- 172.21.15.72:0/4288441637 >> v2:172.21.15.137:3300/0 conn(0x7fafe00d10c0 0x7fafe00b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe85ff700 1 -- 172.21.15.72:0/4288441637 >> 172.21.15.72:0/4288441637 conn(0x7fafe0071e10 msgr2=0x7fafe0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe85ff700 1 -- 172.21.15.72:0/4288441637 shutdown_connections 2023-08-25T04:47:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.223+0000 7fafe85ff700 1 -- 172.21.15.72:0/4288441637 wait complete. 2023-08-25T04:47:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.225+0000 7fafe85ff700 1 Processor -- start 2023-08-25T04:47:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.225+0000 7fafe85ff700 1 -- start start 2023-08-25T04:47:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.226+0000 7fafe85ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafe00b4d40 0x7fafe01594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.226+0000 7fafe85ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafe00d10c0 0x7fafe00a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.226+0000 7fafe85ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe015d000 0x7fafe00a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.226+0000 7fafe85ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01f5480 con 0x7fafe015d000 2023-08-25T04:47:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.226+0000 7fafe85ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01f4800 con 0x7fafe00b4d40 2023-08-25T04:47:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.226+0000 7fafe85ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01f4ae0 con 0x7fafe00d10c0 2023-08-25T04:47:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.226+0000 7fafe6b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe015d000 0x7fafe00a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.226+0000 7fafe6b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe015d000 0x7fafe00a9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40264/0 (socket says 172.21.15.72:40264) 2023-08-25T04:47:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.226+0000 7fafe6b9c700 1 -- 172.21.15.72:0/1182712612 learned_addr learned my addr 172.21.15.72:0/1182712612 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafe639b700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafe00b4d40 0x7fafe01594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafe5b9a700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafe00d10c0 0x7fafe00a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafe6b9c700 1 -- 172.21.15.72:0/1182712612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafe00d10c0 msgr2=0x7fafe00a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafe6b9c700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafe00d10c0 0x7fafe00a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafe6b9c700 1 -- 172.21.15.72:0/1182712612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafe00b4d40 msgr2=0x7fafe01594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafe6b9c700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafe00b4d40 0x7fafe01594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafe6b9c700 1 -- 172.21.15.72:0/1182712612 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8009b30 con 0x7fafe015d000 2023-08-25T04:47:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafe6b9c700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe015d000 0x7fafe00a9e90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fafe00d3ae0 tx=0x7fafd8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafd6ffd700 1 -- 172.21.15.72:0/1182712612 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8004880 con 0x7fafe015d000 2023-08-25T04:47:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafd6ffd700 1 -- 172.21.15.72:0/1182712612 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd80092e0 con 0x7fafe015d000 2023-08-25T04:47:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafe85ff700 1 -- 172.21.15.72:0/1182712612 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe01f4dc0 con 0x7fafe015d000 2023-08-25T04:47:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.227+0000 7fafd6ffd700 1 -- 172.21.15.72:0/1182712612 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd801c660 con 0x7fafe015d000 2023-08-25T04:47:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.228+0000 7fafe85ff700 1 -- 172.21.15.72:0/1182712612 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe0159a30 con 0x7fafe015d000 2023-08-25T04:47:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.229+0000 7fafe85ff700 1 -- 172.21.15.72:0/1182712612 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe01f55c0 con 0x7fafe015d000 2023-08-25T04:47:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.229+0000 7fafd6ffd700 1 -- 172.21.15.72:0/1182712612 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fafd801c7c0 con 0x7fafe015d000 2023-08-25T04:47:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.230+0000 7fafd6ffd700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafc406a0e0 0x7fafc406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.230+0000 7fafd6ffd700 1 -- 172.21.15.72:0/1182712612 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fafd808a4c0 con 0x7fafe015d000 2023-08-25T04:47:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.231+0000 7fafe639b700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafc406a0e0 0x7fafc406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.231+0000 7fafe639b700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafc406a0e0 0x7fafc406c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007fd0 tx=0x7fafdc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:04.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.235+0000 7fafd6ffd700 1 -- 172.21.15.72:0/1182712612 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fafe01f55c0 con 0x7fafe015d000 2023-08-25T04:47:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.428+0000 7fafe85ff700 1 -- 172.21.15.72:0/1182712612 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fafe01f55c0 con 0x7fafe015d000 2023-08-25T04:47:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.428+0000 7fafd6ffd700 1 -- 172.21.15.72:0/1182712612 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fafe01f55c0 con 0x7fafe015d000 2023-08-25T04:47:04.536 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:47:04.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 -- 172.21.15.72:0/1182712612 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafc406a0e0 msgr2=0x7fafc406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafc406a0e0 0x7fafc406c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007fd0 tx=0x7fafdc009040 comp rx=0 tx=0).stop 2023-08-25T04:47:04.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 -- 172.21.15.72:0/1182712612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe015d000 msgr2=0x7fafe00a9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe015d000 0x7fafe00a9e90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fafe00d3ae0 tx=0x7fafd8004ad0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 -- 172.21.15.72:0/1182712612 shutdown_connections 2023-08-25T04:47:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fafc406a0e0 0x7fafc406c5a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafe015d000 0x7fafe00a9e90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafe00b4d40 0x7fafe01594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 --2- 172.21.15.72:0/1182712612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafe00d10c0 0x7fafe00a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 -- 172.21.15.72:0/1182712612 >> 172.21.15.72:0/1182712612 conn(0x7fafe0071e10 msgr2=0x7fafe00b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.430+0000 7fafe85ff700 1 -- 172.21.15.72:0/1182712612 shutdown_connections 2023-08-25T04:47:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.431+0000 7fafe85ff700 1 -- 172.21.15.72:0/1182712612 wait complete. 2023-08-25T04:47:04.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:47:04.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.745+0000 7f28df9ff700 1 Processor -- start 2023-08-25T04:47:04.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.746+0000 7f28df9ff700 1 -- start start 2023-08-25T04:47:04.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.747+0000 7f28df9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d80ade30 0x7f28d80ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.747+0000 7f28df9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28d815da20 0x7f28d8070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.747+0000 7f28df9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d80ca020 con 0x7f28d8070ed0 2023-08-25T04:47:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.747+0000 7f28df9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d8071360 con 0x7f28d815da20 2023-08-25T04:47:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.747+0000 7f28df9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80ae750 con 0x7f28d80ade30 2023-08-25T04:47:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.748+0000 7f28ddf9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f28d8070ed0 0x7f28d806c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46466/0 (socket says 172.21.15.72:46466) 2023-08-25T04:47:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.748+0000 7f28ddf9c700 1 -- 172.21.15.72:0/2232943319 learned_addr learned my addr 172.21.15.72:0/2232943319 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.748+0000 7f28dcf9a700 1 --2- 172.21.15.72:0/2232943319 >> v2:172.21.15.72:3300/0 conn(0x7f28d815da20 0x7f28d8070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.748+0000 7f28dd79b700 1 --2- 172.21.15.72:0/2232943319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d80ade30 0x7f28d80ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.748+0000 7f28cffff700 1 -- 172.21.15.72:0/2232943319 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360868862 0 0) 0x7f28d80ca020 con 0x7f28d8070ed0 2023-08-25T04:47:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.748+0000 7f28dcf9a700 1 -- 172.21.15.72:0/2232943319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d80ade30 msgr2=0x7f28d80ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.748+0000 7f28dcf9a700 1 --2- 172.21.15.72:0/2232943319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d80ade30 0x7f28d80ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.748+0000 7f28dcf9a700 1 -- 172.21.15.72:0/2232943319 >> v1:172.21.15.72:6789/0 conn(0x7f28d8070ed0 legacy=0x7f28d806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.748+0000 7f28dcf9a700 1 -- 172.21.15.72:0/2232943319 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d80ae9d0 con 0x7f28d815da20 2023-08-25T04:47:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.748+0000 7f28dcf9a700 1 --2- 172.21.15.72:0/2232943319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d815da20 0x7f28d8070990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009840 tx=0x7f28c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb74d34f17e9e305 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28cffff700 1 -- 172.21.15.72:0/2232943319 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8011830 con 0x7f28d815da20 2023-08-25T04:47:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28cffff700 1 -- 172.21.15.72:0/2232943319 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c8011990 con 0x7f28d815da20 2023-08-25T04:47:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28cffff700 1 -- 172.21.15.72:0/2232943319 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8011d20 con 0x7f28d815da20 2023-08-25T04:47:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28df9ff700 1 -- 172.21.15.72:0/2232943319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d815da20 msgr2=0x7f28d8070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28df9ff700 1 --2- 172.21.15.72:0/2232943319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d815da20 0x7f28d8070990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009840 tx=0x7f28c8009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28df9ff700 1 -- 172.21.15.72:0/2232943319 shutdown_connections 2023-08-25T04:47:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28df9ff700 1 --2- 172.21.15.72:0/2232943319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d80ade30 0x7f28d80ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28df9ff700 1 --2- 172.21.15.72:0/2232943319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d815da20 0x7f28d8070990 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28df9ff700 1 -- 172.21.15.72:0/2232943319 >> 172.21.15.72:0/2232943319 conn(0x7f28d806a710 msgr2=0x7f28d806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28df9ff700 1 -- 172.21.15.72:0/2232943319 shutdown_connections 2023-08-25T04:47:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.749+0000 7f28df9ff700 1 -- 172.21.15.72:0/2232943319 wait complete. 2023-08-25T04:47:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.751+0000 7f28df9ff700 1 Processor -- start 2023-08-25T04:47:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.751+0000 7f28df9ff700 1 -- start start 2023-08-25T04:47:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.752+0000 7f28df9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d8070ed0 0x7f28d815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.752+0000 7f28df9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d80ade30 0x7f28d8150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.752+0000 7f28df9ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d815da20 0x7f28d80b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.752+0000 7f28df9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d815b210 con 0x7f28d80ade30 2023-08-25T04:47:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.752+0000 7f28df9ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d815b4f0 con 0x7f28d815da20 2023-08-25T04:47:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.752+0000 7f28df9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d815b7d0 con 0x7f28d8070ed0 2023-08-25T04:47:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.752+0000 7f28dcf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d80ade30 0x7f28d8150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.752+0000 7f28dcf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d80ade30 0x7f28d8150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40278/0 (socket says 172.21.15.72:40278) 2023-08-25T04:47:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.752+0000 7f28dcf9a700 1 -- 172.21.15.72:0/1566430188 learned_addr learned my addr 172.21.15.72:0/1566430188 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28dcf9a700 1 -- 172.21.15.72:0/1566430188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d8070ed0 msgr2=0x7f28d815c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28ddf9c700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d815da20 0x7f28d80b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28dd79b700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d8070ed0 0x7f28d815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28dcf9a700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d8070ed0 0x7f28d815c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28dcf9a700 1 -- 172.21.15.72:0/1566430188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d815da20 msgr2=0x7f28d80b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28dcf9a700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d815da20 0x7f28d80b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28dcf9a700 1 -- 172.21.15.72:0/1566430188 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80094a0 con 0x7f28d80ade30 2023-08-25T04:47:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28dd79b700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d8070ed0 0x7f28d815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28ddf9c700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d815da20 0x7f28d80b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28dcf9a700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d80ade30 0x7f28d8150800 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f28c8014040 tx=0x7f28c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:04.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28cdffb700 1 -- 172.21.15.72:0/1566430188 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c80038a0 con 0x7f28d80ade30 2023-08-25T04:47:04.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28cdffb700 1 -- 172.21.15.72:0/1566430188 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c801e070 con 0x7f28d80ade30 2023-08-25T04:47:04.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28cdffb700 1 -- 172.21.15.72:0/1566430188 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8003c20 con 0x7f28d80ade30 2023-08-25T04:47:04.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.753+0000 7f28df9ff700 1 -- 172.21.15.72:0/1566430188 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d815bab0 con 0x7f28d80ade30 2023-08-25T04:47:04.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.754+0000 7f28df9ff700 1 -- 172.21.15.72:0/1566430188 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d815c7f0 con 0x7f28d80ade30 2023-08-25T04:47:04.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.754+0000 7f28df9ff700 1 -- 172.21.15.72:0/1566430188 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d815bfd0 con 0x7f28d80ade30 2023-08-25T04:47:04.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.755+0000 7f28cdffb700 1 -- 172.21.15.72:0/1566430188 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f28c802d450 con 0x7f28d80ade30 2023-08-25T04:47:04.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.756+0000 7f28cdffb700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f28bc06a0e0 0x7f28bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.756+0000 7f28cdffb700 1 -- 172.21.15.72:0/1566430188 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f28c80899c0 con 0x7f28d80ade30 2023-08-25T04:47:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.756+0000 7f28dd79b700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f28bc06a0e0 0x7f28bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.757+0000 7f28dd79b700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f28bc06a0e0 0x7f28bc06c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f28d400aa90 tx=0x7f28d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.760+0000 7f28cdffb700 1 -- 172.21.15.72:0/1566430188 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f28d815bfd0 con 0x7f28d80ade30 2023-08-25T04:47:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.962+0000 7f28df9ff700 1 -- 172.21.15.72:0/1566430188 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28d815bfd0 con 0x7f28d80ade30 2023-08-25T04:47:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.962+0000 7f28cdffb700 1 -- 172.21.15.72:0/1566430188 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28d815bfd0 con 0x7f28d80ade30 2023-08-25T04:47:04.964 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:47:04.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 -- 172.21.15.72:0/1566430188 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f28bc06a0e0 msgr2=0x7f28bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f28bc06a0e0 0x7f28bc06c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f28d400aa90 tx=0x7f28d4008040 comp rx=0 tx=0).stop 2023-08-25T04:47:04.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 -- 172.21.15.72:0/1566430188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d80ade30 msgr2=0x7f28d8150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:04.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d80ade30 0x7f28d8150800 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f28c8014040 tx=0x7f28c8004750 comp rx=0 tx=0).stop 2023-08-25T04:47:04.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 -- 172.21.15.72:0/1566430188 shutdown_connections 2023-08-25T04:47:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f28bc06a0e0 0x7f28bc06c5a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28d815da20 0x7f28d80b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f28d8070ed0 0x7f28d815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 --2- 172.21.15.72:0/1566430188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28d80ade30 0x7f28d8150800 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 -- 172.21.15.72:0/1566430188 >> 172.21.15.72:0/1566430188 conn(0x7f28d806a710 msgr2=0x7f28d80b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 -- 172.21.15.72:0/1566430188 shutdown_connections 2023-08-25T04:47:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:04.965+0000 7f28df9ff700 1 -- 172.21.15.72:0/1566430188 wait complete. 2023-08-25T04:47:04.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:47:05.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.181+0000 7fbedf1ff700 1 Processor -- start 2023-08-25T04:47:05.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.182+0000 7fbedf1ff700 1 -- start start 2023-08-25T04:47:05.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.183+0000 7fbedf1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbed815d000 0x7fbed80b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:05.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.183+0000 7fbedf1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed80b6e90 con 0x7fbed80b4f10 2023-08-25T04:47:05.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.183+0000 7fbedf1ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed815d3e0 con 0x7fbed80d10c0 2023-08-25T04:47:05.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.183+0000 7fbedf1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed80b56f0 con 0x7fbed815d000 2023-08-25T04:47:05.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.183+0000 7fbedcf9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbed815d000 0x7fbed80b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:05.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.183+0000 7fbedd79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbed80b4f10 0x7fbed80b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46470/0 (socket says 172.21.15.72:46470) 2023-08-25T04:47:05.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.183+0000 7fbedd79c700 1 -- 172.21.15.72:0/1881707055 learned_addr learned my addr 172.21.15.72:0/1881707055 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:05.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.184+0000 7fbedcf9b700 1 -- 172.21.15.72:0/1881707055 >> v1:172.21.15.137:6789/0 conn(0x7fbed80d10c0 legacy=0x7fbed80b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.184+0000 7fbedcf9b700 1 -- 172.21.15.72:0/1881707055 >> v1:172.21.15.72:6789/0 conn(0x7fbed80b4f10 legacy=0x7fbed80b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.184+0000 7fbedcf9b700 1 -- 172.21.15.72:0/1881707055 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed80b6280 con 0x7fbed815d000 2023-08-25T04:47:05.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.184+0000 7fbedcf9b700 1 --2- 172.21.15.72:0/1881707055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed815d000 0x7fbed80b8600 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009840 tx=0x7fbecc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b9b7447079be7c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:05.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.184+0000 7fbed77fe700 1 -- 172.21.15.72:0/1881707055 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc011830 con 0x7fbed815d000 2023-08-25T04:47:05.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.184+0000 7fbed77fe700 1 -- 172.21.15.72:0/1881707055 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc011990 con 0x7fbed815d000 2023-08-25T04:47:05.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.184+0000 7fbed77fe700 1 -- 172.21.15.72:0/1881707055 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc011d20 con 0x7fbed815d000 2023-08-25T04:47:05.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.185+0000 7fbedf1ff700 1 -- 172.21.15.72:0/1881707055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed815d000 msgr2=0x7fbed80b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.185+0000 7fbedf1ff700 1 --2- 172.21.15.72:0/1881707055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed815d000 0x7fbed80b8600 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009840 tx=0x7fbecc009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:05.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.185+0000 7fbedf1ff700 1 -- 172.21.15.72:0/1881707055 shutdown_connections 2023-08-25T04:47:05.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.185+0000 7fbedf1ff700 1 --2- 172.21.15.72:0/1881707055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed815d000 0x7fbed80b8600 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.185+0000 7fbedf1ff700 1 -- 172.21.15.72:0/1881707055 >> 172.21.15.72:0/1881707055 conn(0x7fbed8071e10 msgr2=0x7fbed8072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:05.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.185+0000 7fbedf1ff700 1 -- 172.21.15.72:0/1881707055 shutdown_connections 2023-08-25T04:47:05.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.185+0000 7fbedf1ff700 1 -- 172.21.15.72:0/1881707055 wait complete. 2023-08-25T04:47:05.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.187+0000 7fbedf1ff700 1 Processor -- start 2023-08-25T04:47:05.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.187+0000 7fbedf1ff700 1 -- start start 2023-08-25T04:47:05.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.188+0000 7fbedf1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed80b4f10 0x7fbed815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:05.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.188+0000 7fbedf1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed80d10c0 0x7fbed8152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:05.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.188+0000 7fbedf1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed815d000 0x7fbed80cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:05.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbedf1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80c8da0 con 0x7fbed80d10c0 2023-08-25T04:47:05.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbedf1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80c9080 con 0x7fbed80b4f10 2023-08-25T04:47:05.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbedf1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80c9360 con 0x7fbed815d000 2023-08-25T04:47:05.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbed7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed80d10c0 0x7fbed8152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:05.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbed7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed80d10c0 0x7fbed8152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40292/0 (socket says 172.21.15.72:40292) 2023-08-25T04:47:05.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbed7fff700 1 -- 172.21.15.72:0/506510395 learned_addr learned my addr 172.21.15.72:0/506510395 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:05.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbedd79c700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed815d000 0x7fbed80cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:05.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbedcf9b700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed80b4f10 0x7fbed815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:05.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbed7fff700 1 -- 172.21.15.72:0/506510395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed815d000 msgr2=0x7fbed80cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbed7fff700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed815d000 0x7fbed80cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbed7fff700 1 -- 172.21.15.72:0/506510395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed80b4f10 msgr2=0x7fbed815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbed7fff700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed80b4f10 0x7fbed815ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.189+0000 7fbed7fff700 1 -- 172.21.15.72:0/506510395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0094a0 con 0x7fbed80d10c0 2023-08-25T04:47:05.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.190+0000 7fbed7fff700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed80d10c0 0x7fbed8152430 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c4e0 tx=0x7fbec400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:05.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.190+0000 7fbed57fa700 1 -- 172.21.15.72:0/506510395 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40052d0 con 0x7fbed80d10c0 2023-08-25T04:47:05.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.190+0000 7fbed57fa700 1 -- 172.21.15.72:0/506510395 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4005430 con 0x7fbed80d10c0 2023-08-25T04:47:05.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.190+0000 7fbedf1ff700 1 -- 172.21.15.72:0/506510395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed815d670 con 0x7fbed80d10c0 2023-08-25T04:47:05.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.190+0000 7fbed57fa700 1 -- 172.21.15.72:0/506510395 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40038c0 con 0x7fbed80d10c0 2023-08-25T04:47:05.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.190+0000 7fbedf1ff700 1 -- 172.21.15.72:0/506510395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed80c9640 con 0x7fbed80d10c0 2023-08-25T04:47:05.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.191+0000 7fbedf1ff700 1 -- 172.21.15.72:0/506510395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed815d8b0 con 0x7fbed80d10c0 2023-08-25T04:47:05.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.192+0000 7fbed57fa700 1 -- 172.21.15.72:0/506510395 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbec4003a20 con 0x7fbed80d10c0 2023-08-25T04:47:05.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.193+0000 7fbed57fa700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbebc06a0e0 0x7fbebc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:05.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.193+0000 7fbed57fa700 1 -- 172.21.15.72:0/506510395 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbec4087e00 con 0x7fbed80d10c0 2023-08-25T04:47:05.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.193+0000 7fbedcf9b700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbebc06a0e0 0x7fbebc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:05.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.194+0000 7fbedcf9b700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbebc06a0e0 0x7fbebc06c5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0090b0 tx=0x7fbecc01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:05.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.197+0000 7fbed57fa700 1 -- 172.21.15.72:0/506510395 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbed815d8b0 con 0x7fbed80d10c0 2023-08-25T04:47:05.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.397+0000 7fbedf1ff700 1 -- 172.21.15.72:0/506510395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbed806a2f0 con 0x7fbed80d10c0 2023-08-25T04:47:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.397+0000 7fbed57fa700 1 -- 172.21.15.72:0/506510395 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbec4053120 con 0x7fbed80d10c0 2023-08-25T04:47:05.398 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:47:05.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.399+0000 7fbedf1ff700 1 -- 172.21.15.72:0/506510395 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbebc06a0e0 msgr2=0x7fbebc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.399+0000 7fbedf1ff700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbebc06a0e0 0x7fbebc06c5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0090b0 tx=0x7fbecc01c040 comp rx=0 tx=0).stop 2023-08-25T04:47:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.399+0000 7fbedf1ff700 1 -- 172.21.15.72:0/506510395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed80d10c0 msgr2=0x7fbed8152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.399+0000 7fbedf1ff700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed80d10c0 0x7fbed8152430 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c4e0 tx=0x7fbec400c8a0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.400+0000 7fbedf1ff700 1 -- 172.21.15.72:0/506510395 shutdown_connections 2023-08-25T04:47:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.400+0000 7fbedf1ff700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbebc06a0e0 0x7fbebc06c5a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.400+0000 7fbedf1ff700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbed815d000 0x7fbed80cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.400+0000 7fbedf1ff700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbed80b4f10 0x7fbed815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.400+0000 7fbedf1ff700 1 --2- 172.21.15.72:0/506510395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed80d10c0 0x7fbed8152430 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.400+0000 7fbedf1ff700 1 -- 172.21.15.72:0/506510395 >> 172.21.15.72:0/506510395 conn(0x7fbed8071e10 msgr2=0x7fbed80b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.400+0000 7fbedf1ff700 1 -- 172.21.15.72:0/506510395 shutdown_connections 2023-08-25T04:47:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.400+0000 7fbedf1ff700 1 -- 172.21.15.72:0/506510395 wait complete. 2023-08-25T04:47:05.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:47:05.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.620+0000 7fb8c83ff700 1 Processor -- start 2023-08-25T04:47:05.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.620+0000 7fb8c83ff700 1 -- start start 2023-08-25T04:47:05.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.621+0000 7fb8c83ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb8c00b4f10 0x7fb8c0167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:05.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.621+0000 7fb8c83ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c00b8d10 con 0x7fb8c00d10c0 2023-08-25T04:47:05.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.621+0000 7fb8c83ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c00b6e90 con 0x7fb8c015d000 2023-08-25T04:47:05.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.621+0000 7fb8c83ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00b56f0 con 0x7fb8c00b4f10 2023-08-25T04:47:05.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.622+0000 7fb8c599a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb8c00d10c0 0x7fb8c00b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46474/0 (socket says 172.21.15.72:46474) 2023-08-25T04:47:05.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.622+0000 7fb8c599a700 1 -- 172.21.15.72:0/2974543467 learned_addr learned my addr 172.21.15.72:0/2974543467 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:05.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.622+0000 7fb8c699c700 1 --2- 172.21.15.72:0/2974543467 >> v2:172.21.15.137:3300/0 conn(0x7fb8c00b4f10 0x7fb8c0167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:05.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.622+0000 7fb8c5199700 1 -- 172.21.15.72:0/2974543467 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298362930 0 0) 0x7fb8c00b8d10 con 0x7fb8c00d10c0 2023-08-25T04:47:05.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.622+0000 7fb8c5199700 1 -- 172.21.15.72:0/2974543467 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ac0035b0 con 0x7fb8c00d10c0 2023-08-25T04:47:05.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.622+0000 7fb8c699c700 1 -- 172.21.15.72:0/2974543467 >> v1:172.21.15.137:6789/0 conn(0x7fb8c015d000 legacy=0x7fb8c00b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.622+0000 7fb8c699c700 1 -- 172.21.15.72:0/2974543467 >> v1:172.21.15.72:6789/0 conn(0x7fb8c00d10c0 legacy=0x7fb8c00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.622+0000 7fb8c699c700 1 -- 172.21.15.72:0/2974543467 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c015d3e0 con 0x7fb8c00b4f10 2023-08-25T04:47:05.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.623+0000 7fb8c699c700 1 --2- 172.21.15.72:0/2974543467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c00b4f10 0x7fb8c0167be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009d90 tx=0x7fb8b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f071c423b844a588 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:05.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.623+0000 7fb8c5199700 1 -- 172.21.15.72:0/2974543467 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800e070 con 0x7fb8c00b4f10 2023-08-25T04:47:05.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.623+0000 7fb8c5199700 1 -- 172.21.15.72:0/2974543467 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b800bb20 con 0x7fb8c00b4f10 2023-08-25T04:47:05.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.623+0000 7fb8c5199700 1 -- 172.21.15.72:0/2974543467 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8012430 con 0x7fb8c00b4f10 2023-08-25T04:47:05.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.623+0000 7fb8c83ff700 1 -- 172.21.15.72:0/2974543467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c00b4f10 msgr2=0x7fb8c0167be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.623+0000 7fb8c83ff700 1 --2- 172.21.15.72:0/2974543467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c00b4f10 0x7fb8c0167be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009d90 tx=0x7fb8b800b330 comp rx=0 tx=0).stop 2023-08-25T04:47:05.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.623+0000 7fb8c83ff700 1 -- 172.21.15.72:0/2974543467 shutdown_connections 2023-08-25T04:47:05.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.623+0000 7fb8c83ff700 1 --2- 172.21.15.72:0/2974543467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c00b4f10 0x7fb8c0167be0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.623+0000 7fb8c83ff700 1 -- 172.21.15.72:0/2974543467 >> 172.21.15.72:0/2974543467 conn(0x7fb8c0071e10 msgr2=0x7fb8c0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:05.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.624+0000 7fb8c83ff700 1 -- 172.21.15.72:0/2974543467 shutdown_connections 2023-08-25T04:47:05.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.624+0000 7fb8c83ff700 1 -- 172.21.15.72:0/2974543467 wait complete. 2023-08-25T04:47:05.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.625+0000 7fb8c83ff700 1 Processor -- start 2023-08-25T04:47:05.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.625+0000 7fb8c83ff700 1 -- start start 2023-08-25T04:47:05.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.626+0000 7fb8c83ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c00b4f10 0x7fb8c00c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:05.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.626+0000 7fb8c83ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8c00d10c0 0x7fb8c01f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:05.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.626+0000 7fb8c83ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c015d000 0x7fb8c00c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:05.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.626+0000 7fb8c83ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00cafd0 con 0x7fb8c015d000 2023-08-25T04:47:05.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.626+0000 7fb8c83ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c015f310 con 0x7fb8c00b4f10 2023-08-25T04:47:05.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.626+0000 7fb8c83ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c015f5f0 con 0x7fb8c00d10c0 2023-08-25T04:47:05.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c015d000 0x7fb8c00c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:05.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c015d000 0x7fb8c00c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40302/0 (socket says 172.21.15.72:40302) 2023-08-25T04:47:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c699c700 1 -- 172.21.15.72:0/1451658216 learned_addr learned my addr 172.21.15.72:0/1451658216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c599a700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8c00d10c0 0x7fb8c01f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c619b700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c00b4f10 0x7fb8c00c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c699c700 1 -- 172.21.15.72:0/1451658216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8c00d10c0 msgr2=0x7fb8c01f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c699c700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8c00d10c0 0x7fb8c01f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c699c700 1 -- 172.21.15.72:0/1451658216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c00b4f10 msgr2=0x7fb8c00c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c699c700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c00b4f10 0x7fb8c00c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c699c700 1 -- 172.21.15.72:0/1451658216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8009a70 con 0x7fb8c015d000 2023-08-25T04:47:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8c699c700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c015d000 0x7fb8c00c7030 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8013000 tx=0x7fb8b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.627+0000 7fb8b6ffd700 1 -- 172.21.15.72:0/1451658216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8012430 con 0x7fb8c015d000 2023-08-25T04:47:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.628+0000 7fb8b6ffd700 1 -- 172.21.15.72:0/1451658216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b8020070 con 0x7fb8c015d000 2023-08-25T04:47:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.628+0000 7fb8c83ff700 1 -- 172.21.15.72:0/1451658216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c015f8d0 con 0x7fb8c015d000 2023-08-25T04:47:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.628+0000 7fb8b6ffd700 1 -- 172.21.15.72:0/1451658216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8004280 con 0x7fb8c015d000 2023-08-25T04:47:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.628+0000 7fb8c83ff700 1 -- 172.21.15.72:0/1451658216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c00c9670 con 0x7fb8c015d000 2023-08-25T04:47:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.629+0000 7fb8c83ff700 1 -- 172.21.15.72:0/1451658216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c006a2f0 con 0x7fb8c015d000 2023-08-25T04:47:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.629+0000 7fb8b6ffd700 1 -- 172.21.15.72:0/1451658216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb8b80043e0 con 0x7fb8c015d000 2023-08-25T04:47:05.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.630+0000 7fb8b6ffd700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb8a406a0e0 0x7fb8a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:05.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.630+0000 7fb8b6ffd700 1 -- 172.21.15.72:0/1451658216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8b8022070 con 0x7fb8c015d000 2023-08-25T04:47:05.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.631+0000 7fb8c619b700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb8a406a0e0 0x7fb8a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:05.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.631+0000 7fb8c619b700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb8a406a0e0 0x7fb8a406c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc000f60 tx=0x7fb8bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.635+0000 7fb8b6ffd700 1 -- 172.21.15.72:0/1451658216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb8b8055a20 con 0x7fb8c015d000 2023-08-25T04:47:05.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.829+0000 7fb8c83ff700 1 -- 172.21.15.72:0/1451658216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8c008a000 con 0x7fb8c015d000 2023-08-25T04:47:05.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.830+0000 7fb8b6ffd700 1 -- 172.21.15.72:0/1451658216 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8b8059040 con 0x7fb8c015d000 2023-08-25T04:47:05.831 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:47:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 -- 172.21.15.72:0/1451658216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb8a406a0e0 msgr2=0x7fb8a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb8a406a0e0 0x7fb8a406c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc000f60 tx=0x7fb8bc009040 comp rx=0 tx=0).stop 2023-08-25T04:47:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 -- 172.21.15.72:0/1451658216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c015d000 msgr2=0x7fb8c00c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c015d000 0x7fb8c00c7030 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8013000 tx=0x7fb8b8004ad0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 -- 172.21.15.72:0/1451658216 shutdown_connections 2023-08-25T04:47:05.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb8a406a0e0 0x7fb8a406c5a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c015d000 0x7fb8c00c7030 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8c00b4f10 0x7fb8c00c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 --2- 172.21.15.72:0/1451658216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb8c00d10c0 0x7fb8c01f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:05.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 -- 172.21.15.72:0/1451658216 >> 172.21.15.72:0/1451658216 conn(0x7fb8c0071e10 msgr2=0x7fb8c00b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:05.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 -- 172.21.15.72:0/1451658216 shutdown_connections 2023-08-25T04:47:05.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:05.832+0000 7fb8c83ff700 1 -- 172.21.15.72:0/1451658216 wait complete. 2023-08-25T04:47:05.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:47:06.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.050+0000 7f4ef21ff700 1 Processor -- start 2023-08-25T04:47:06.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.050+0000 7f4ef21ff700 1 -- start start 2023-08-25T04:47:06.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.051+0000 7f4ef21ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0cb650 0x7f4eec0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.051+0000 7f4ef21ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4eec0b2810 0x7f4eec070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.051+0000 7f4ef21ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eec0b2c90 0x7f4eec070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.051+0000 7f4ef21ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec0b4300 con 0x7f4eec0b2c90 2023-08-25T04:47:06.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.051+0000 7f4ef21ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec0cbf70 con 0x7f4eec0b2810 2023-08-25T04:47:06.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.051+0000 7f4ef21ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0b3260 con 0x7f4eec0cb650 2023-08-25T04:47:06.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eebfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eec0b2c90 0x7f4eec070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eebfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eec0b2c90 0x7f4eec070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40304/0 (socket says 172.21.15.72:40304) 2023-08-25T04:47:06.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eebfff700 1 -- 172.21.15.72:0/3712416490 learned_addr learned my addr 172.21.15.72:0/3712416490 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:06.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eeaffd700 1 --2- 172.21.15.72:0/3712416490 >> v2:172.21.15.137:3300/0 conn(0x7f4eec0b2810 0x7f4eec070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eeb7fe700 1 --2- 172.21.15.72:0/3712416490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0cb650 0x7f4eec0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eebfff700 1 -- 172.21.15.72:0/3712416490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0cb650 msgr2=0x7f4eec0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:06.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eebfff700 1 --2- 172.21.15.72:0/3712416490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0cb650 0x7f4eec0cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eebfff700 1 -- 172.21.15.72:0/3712416490 >> v2:172.21.15.137:3300/0 conn(0x7f4eec0b2810 msgr2=0x7f4eec070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:06.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eebfff700 1 --2- 172.21.15.72:0/3712416490 >> v2:172.21.15.137:3300/0 conn(0x7f4eec0b2810 0x7f4eec070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eebfff700 1 -- 172.21.15.72:0/3712416490 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0b3540 con 0x7f4eec0b2c90 2023-08-25T04:47:06.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.052+0000 7f4eebfff700 1 --2- 172.21.15.72:0/3712416490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 0x7f4eec070ed0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0ce830 tx=0x7f4ee400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5107f03e7c6dc23 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:06.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4eea7fc700 1 -- 172.21.15.72:0/3712416490 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400e070 con 0x7f4eec0b2c90 2023-08-25T04:47:06.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4eea7fc700 1 -- 172.21.15.72:0/3712416490 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee400b9c0 con 0x7f4eec0b2c90 2023-08-25T04:47:06.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4eea7fc700 1 -- 172.21.15.72:0/3712416490 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400bd70 con 0x7f4eec0b2c90 2023-08-25T04:47:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4ef21ff700 1 -- 172.21.15.72:0/3712416490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 msgr2=0x7f4eec070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4ef21ff700 1 --2- 172.21.15.72:0/3712416490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 0x7f4eec070ed0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0ce830 tx=0x7f4ee400b330 comp rx=0 tx=0).stop 2023-08-25T04:47:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4ef21ff700 1 -- 172.21.15.72:0/3712416490 shutdown_connections 2023-08-25T04:47:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4ef21ff700 1 --2- 172.21.15.72:0/3712416490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0cb650 0x7f4eec0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4ef21ff700 1 --2- 172.21.15.72:0/3712416490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 0x7f4eec070ed0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4ef21ff700 1 --2- 172.21.15.72:0/3712416490 >> v2:172.21.15.137:3300/0 conn(0x7f4eec0b2810 0x7f4eec070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4ef21ff700 1 -- 172.21.15.72:0/3712416490 >> 172.21.15.72:0/3712416490 conn(0x7f4eec06a710 msgr2=0x7f4eec06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4ef21ff700 1 -- 172.21.15.72:0/3712416490 shutdown_connections 2023-08-25T04:47:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.053+0000 7f4ef21ff700 1 -- 172.21.15.72:0/3712416490 wait complete. 2023-08-25T04:47:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.055+0000 7f4ef21ff700 1 Processor -- start 2023-08-25T04:47:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.055+0000 7f4ef21ff700 1 -- start start 2023-08-25T04:47:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.056+0000 7f4ef21ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0b2810 0x7f4eec150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.056+0000 7f4ef21ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 0x7f4eec0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.056+0000 7f4ef21ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eec0cb650 0x7f4eec0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.056+0000 7f4ef21ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec1f5720 con 0x7f4eec0b2c90 2023-08-25T04:47:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.056+0000 7f4ef21ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec1f62a0 con 0x7f4eec0cb650 2023-08-25T04:47:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.056+0000 7f4ef21ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec1f5970 con 0x7f4eec0b2810 2023-08-25T04:47:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.056+0000 7f4eeaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 0x7f4eec0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.056+0000 7f4eeaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 0x7f4eec0c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40314/0 (socket says 172.21.15.72:40314) 2023-08-25T04:47:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.056+0000 7f4eeaffd700 1 -- 172.21.15.72:0/1582579074 learned_addr learned my addr 172.21.15.72:0/1582579074 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4eeb7fe700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0b2810 0x7f4eec150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4eebfff700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eec0cb650 0x7f4eec0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4eeaffd700 1 -- 172.21.15.72:0/1582579074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0b2810 msgr2=0x7f4eec150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4eeaffd700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0b2810 0x7f4eec150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4eeaffd700 1 -- 172.21.15.72:0/1582579074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eec0cb650 msgr2=0x7f4eec0c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4eeaffd700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eec0cb650 0x7f4eec0c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4eeaffd700 1 -- 172.21.15.72:0/1582579074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4009b30 con 0x7f4eec0b2c90 2023-08-25T04:47:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4eeb7fe700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0b2810 0x7f4eec150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4eebfff700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eec0cb650 0x7f4eec0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4eeaffd700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 0x7f4eec0c9830 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000d830 tx=0x7f4ee000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4ed3fff700 1 -- 172.21.15.72:0/1582579074 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee00125f0 con 0x7f4eec0b2c90 2023-08-25T04:47:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4ed3fff700 1 -- 172.21.15.72:0/1582579074 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee0012750 con 0x7f4eec0b2c90 2023-08-25T04:47:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4ef21ff700 1 -- 172.21.15.72:0/1582579074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec1f5c50 con 0x7f4eec0b2c90 2023-08-25T04:47:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4ed3fff700 1 -- 172.21.15.72:0/1582579074 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0012b00 con 0x7f4eec0b2c90 2023-08-25T04:47:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.057+0000 7f4ef21ff700 1 -- 172.21.15.72:0/1582579074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec151100 con 0x7f4eec0b2c90 2023-08-25T04:47:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.058+0000 7f4ef21ff700 1 -- 172.21.15.72:0/1582579074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec1512c0 con 0x7f4eec0b2c90 2023-08-25T04:47:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.059+0000 7f4ed3fff700 1 -- 172.21.15.72:0/1582579074 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ee0012c60 con 0x7f4eec0b2c90 2023-08-25T04:47:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.060+0000 7f4ed3fff700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ed806a0e0 0x7f4ed806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.060+0000 7f4ed3fff700 1 -- 172.21.15.72:0/1582579074 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4ee0088c90 con 0x7f4eec0b2c90 2023-08-25T04:47:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.060+0000 7f4eeb7fe700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ed806a0e0 0x7f4ed806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.061+0000 7f4eeb7fe700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ed806a0e0 0x7f4ed806c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0ca580 tx=0x7f4edc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.064+0000 7f4ed3fff700 1 -- 172.21.15.72:0/1582579074 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4ee0053ff0 con 0x7f4eec0b2c90 2023-08-25T04:47:06.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.258+0000 7f4ef21ff700 1 -- 172.21.15.72:0/1582579074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4eec072320 con 0x7f4eec0b2c90 2023-08-25T04:47:06.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.259+0000 7f4ed3fff700 1 -- 172.21.15.72:0/1582579074 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4ee0057610 con 0x7f4eec0b2c90 2023-08-25T04:47:06.260 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:47:06.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 -- 172.21.15.72:0/1582579074 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ed806a0e0 msgr2=0x7f4ed806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:06.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ed806a0e0 0x7f4ed806c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0ca580 tx=0x7f4edc008040 comp rx=0 tx=0).stop 2023-08-25T04:47:06.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 -- 172.21.15.72:0/1582579074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 msgr2=0x7f4eec0c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:06.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 0x7f4eec0c9830 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000d830 tx=0x7f4ee000dbf0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 -- 172.21.15.72:0/1582579074 shutdown_connections 2023-08-25T04:47:06.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f4ed806a0e0 0x7f4ed806c5a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4eec0cb650 0x7f4eec0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4eec0b2810 0x7f4eec150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 --2- 172.21.15.72:0/1582579074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eec0b2c90 0x7f4eec0c9830 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 -- 172.21.15.72:0/1582579074 >> 172.21.15.72:0/1582579074 conn(0x7f4eec06a710 msgr2=0x7f4eec06db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:06.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 -- 172.21.15.72:0/1582579074 shutdown_connections 2023-08-25T04:47:06.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.261+0000 7f4ef21ff700 1 -- 172.21.15.72:0/1582579074 wait complete. 2023-08-25T04:47:06.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:47:06.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.476+0000 7fbd25dff700 1 Processor -- start 2023-08-25T04:47:06.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.476+0000 7fbd25dff700 1 -- start start 2023-08-25T04:47:06.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.477+0000 7fbd25dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd20159ff0 0x7fbd200ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.477+0000 7fbd25dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbd20070890 0x7fbd200b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.477+0000 7fbd25dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd200b0d80 0x7fbd200c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.477+0000 7fbd25dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200b1870 con 0x7fbd20159ff0 2023-08-25T04:47:06.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd25dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200b46a0 con 0x7fbd20070890 2023-08-25T04:47:06.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd25dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20070de0 con 0x7fbd200b0d80 2023-08-25T04:47:06.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd20159ff0 0x7fbd200ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd20159ff0 0x7fbd200ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40320/0 (socket says 172.21.15.72:40320) 2023-08-25T04:47:06.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1f7fe700 1 -- 172.21.15.72:0/1842756734 learned_addr learned my addr 172.21.15.72:0/1842756734 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:06.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1effd700 1 --2- 172.21.15.72:0/1842756734 >> v2:172.21.15.137:3300/0 conn(0x7fbd20070890 0x7fbd200b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1ffff700 1 --2- 172.21.15.72:0/1842756734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd200b0d80 0x7fbd200c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1f7fe700 1 -- 172.21.15.72:0/1842756734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd200b0d80 msgr2=0x7fbd200c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:06.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1f7fe700 1 --2- 172.21.15.72:0/1842756734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd200b0d80 0x7fbd200c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1f7fe700 1 -- 172.21.15.72:0/1842756734 >> v2:172.21.15.137:3300/0 conn(0x7fbd20070890 msgr2=0x7fbd200b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:06.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1f7fe700 1 --2- 172.21.15.72:0/1842756734 >> v2:172.21.15.137:3300/0 conn(0x7fbd20070890 0x7fbd200b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1f7fe700 1 -- 172.21.15.72:0/1842756734 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd200710c0 con 0x7fbd20159ff0 2023-08-25T04:47:06.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1ffff700 1 --2- 172.21.15.72:0/1842756734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd200b0d80 0x7fbd200c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:06.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.478+0000 7fbd1effd700 1 --2- 172.21.15.72:0/1842756734 >> v2:172.21.15.137:3300/0 conn(0x7fbd20070890 0x7fbd200b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:06.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd1f7fe700 1 --2- 172.21.15.72:0/1842756734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd20159ff0 0x7fbd200ca980 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbd20072100 tx=0x7fbd1000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda7779e84a285a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:06.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd1e7fc700 1 -- 172.21.15.72:0/1842756734 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1000dd30 con 0x7fbd20159ff0 2023-08-25T04:47:06.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd1e7fc700 1 -- 172.21.15.72:0/1842756734 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1000de90 con 0x7fbd20159ff0 2023-08-25T04:47:06.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd1e7fc700 1 -- 172.21.15.72:0/1842756734 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10010690 con 0x7fbd20159ff0 2023-08-25T04:47:06.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd25dff700 1 -- 172.21.15.72:0/1842756734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd20159ff0 msgr2=0x7fbd200ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:06.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd25dff700 1 --2- 172.21.15.72:0/1842756734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd20159ff0 0x7fbd200ca980 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbd20072100 tx=0x7fbd1000be70 comp rx=0 tx=0).stop 2023-08-25T04:47:06.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd25dff700 1 -- 172.21.15.72:0/1842756734 shutdown_connections 2023-08-25T04:47:06.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd25dff700 1 --2- 172.21.15.72:0/1842756734 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd200b0d80 0x7fbd200c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd25dff700 1 --2- 172.21.15.72:0/1842756734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd20159ff0 0x7fbd200ca980 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd25dff700 1 --2- 172.21.15.72:0/1842756734 >> v2:172.21.15.137:3300/0 conn(0x7fbd20070890 0x7fbd200b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.479+0000 7fbd25dff700 1 -- 172.21.15.72:0/1842756734 >> 172.21.15.72:0/1842756734 conn(0x7fbd200ce9a0 msgr2=0x7fbd200ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:06.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.480+0000 7fbd25dff700 1 -- 172.21.15.72:0/1842756734 shutdown_connections 2023-08-25T04:47:06.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.480+0000 7fbd25dff700 1 -- 172.21.15.72:0/1842756734 wait complete. 2023-08-25T04:47:06.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.481+0000 7fbd25dff700 1 Processor -- start 2023-08-25T04:47:06.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.481+0000 7fbd25dff700 1 -- start start 2023-08-25T04:47:06.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.482+0000 7fbd25dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd20070890 0x7fbd201f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.482+0000 7fbd25dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd200b0d80 0x7fbd200c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.482+0000 7fbd25dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd20159ff0 0x7fbd200cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.482+0000 7fbd25dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015d700 con 0x7fbd200b0d80 2023-08-25T04:47:06.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.482+0000 7fbd25dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd201f2b80 con 0x7fbd20159ff0 2023-08-25T04:47:06.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.482+0000 7fbd25dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd201f2e60 con 0x7fbd20070890 2023-08-25T04:47:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.482+0000 7fbd1effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd200b0d80 0x7fbd200c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.482+0000 7fbd1effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd200b0d80 0x7fbd200c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40336/0 (socket says 172.21.15.72:40336) 2023-08-25T04:47:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd1effd700 1 -- 172.21.15.72:0/3156537855 learned_addr learned my addr 172.21.15.72:0/3156537855 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd1f7fe700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd20070890 0x7fbd201f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd1ffff700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd20159ff0 0x7fbd200cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd1effd700 1 -- 172.21.15.72:0/3156537855 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd20070890 msgr2=0x7fbd201f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:06.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd1effd700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd20070890 0x7fbd201f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd1effd700 1 -- 172.21.15.72:0/3156537855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd20159ff0 msgr2=0x7fbd200cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd1effd700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd20159ff0 0x7fbd200cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd1effd700 1 -- 172.21.15.72:0/3156537855 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1000b7f0 con 0x7fbd200b0d80 2023-08-25T04:47:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd1effd700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd200b0d80 0x7fbd200c7cf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400d800 tx=0x7fbd1400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd07fff700 1 -- 172.21.15.72:0/3156537855 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14004030 con 0x7fbd200b0d80 2023-08-25T04:47:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd07fff700 1 -- 172.21.15.72:0/3156537855 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd14004190 con 0x7fbd200b0d80 2023-08-25T04:47:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd07fff700 1 -- 172.21.15.72:0/3156537855 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14004520 con 0x7fbd200b0d80 2023-08-25T04:47:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.483+0000 7fbd25dff700 1 -- 172.21.15.72:0/3156537855 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd201f3140 con 0x7fbd200b0d80 2023-08-25T04:47:06.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.484+0000 7fbd25dff700 1 -- 172.21.15.72:0/3156537855 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd201f5bc0 con 0x7fbd200b0d80 2023-08-25T04:47:06.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.484+0000 7fbd25dff700 1 -- 172.21.15.72:0/3156537855 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd200722d0 con 0x7fbd200b0d80 2023-08-25T04:47:06.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.485+0000 7fbd07fff700 1 -- 172.21.15.72:0/3156537855 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbd140036a0 con 0x7fbd200b0d80 2023-08-25T04:47:06.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.486+0000 7fbd07fff700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd0c06a0e0 0x7fbd0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:06.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.486+0000 7fbd07fff700 1 -- 172.21.15.72:0/3156537855 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbd14088ec0 con 0x7fbd200b0d80 2023-08-25T04:47:06.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.487+0000 7fbd1f7fe700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd0c06a0e0 0x7fbd0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:06.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.487+0000 7fbd1f7fe700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd0c06a0e0 0x7fbd0c06c5a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000beb0 tx=0x7fbd10012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:06.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.491+0000 7fbd07fff700 1 -- 172.21.15.72:0/3156537855 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbd14057c70 con 0x7fbd200b0d80 2023-08-25T04:47:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.701+0000 7fbd25dff700 1 -- 172.21.15.72:0/3156537855 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbd200744f0 con 0x7fbd200b0d80 2023-08-25T04:47:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.701+0000 7fbd07fff700 1 -- 172.21.15.72:0/3156537855 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbd14057800 con 0x7fbd200b0d80 2023-08-25T04:47:06.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 -- 172.21.15.72:0/3156537855 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd0c06a0e0 msgr2=0x7fbd0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:06.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd0c06a0e0 0x7fbd0c06c5a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000beb0 tx=0x7fbd10012000 comp rx=0 tx=0).stop 2023-08-25T04:47:06.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 -- 172.21.15.72:0/3156537855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd200b0d80 msgr2=0x7fbd200c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:06.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd200b0d80 0x7fbd200c7cf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400d800 tx=0x7fbd1400dbc0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 -- 172.21.15.72:0/3156537855 shutdown_connections 2023-08-25T04:47:06.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbd0c06a0e0 0x7fbd0c06c5a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd20159ff0 0x7fbd200cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbd20070890 0x7fbd201f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 --2- 172.21.15.72:0/3156537855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd200b0d80 0x7fbd200c7cf0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:06.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 -- 172.21.15.72:0/3156537855 >> 172.21.15.72:0/3156537855 conn(0x7fbd200ce9a0 msgr2=0x7fbd200cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:06.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 -- 172.21.15.72:0/3156537855 shutdown_connections 2023-08-25T04:47:06.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:06.704+0000 7fbd25dff700 1 -- 172.21.15.72:0/3156537855 wait complete. 2023-08-25T04:47:06.707 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-08-25T04:47:06.722 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi137.front.sepia.ceph.com... 2023-08-25T04:47:06.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:06.723 DEBUG:teuthology.orchestra.run.smithi137:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-08-25T04:47:06.799 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:06.799 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2023-08-25T04:47:06.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:06.800 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-25T04:47:06.848 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T04:47:06.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:47:07.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.044+0000 7f83895ff700 1 Processor -- start 2023-08-25T04:47:07.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.044+0000 7f83895ff700 1 -- start start 2023-08-25T04:47:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83895ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83840b3ac0 0x7f83840ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83895ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83840adcf0 0x7f838415b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83895ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83840b1a10 con 0x7f8384159b00 2023-08-25T04:47:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83895ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840b1cf0 con 0x7f83840b3ac0 2023-08-25T04:47:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83895ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840b1fd0 con 0x7f83840adcf0 2023-08-25T04:47:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83827fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83840b3ac0 0x7f83840ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83827fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83840b3ac0 0x7f83840ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40348/0 (socket says 172.21.15.72:40348) 2023-08-25T04:47:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83827fc700 1 -- 172.21.15.72:0/75467189 learned_addr learned my addr 172.21.15.72:0/75467189 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83837fe700 1 --2- 172.21.15.72:0/75467189 >> v2:172.21.15.137:3300/0 conn(0x7f83840adcf0 0x7f838415b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83827fc700 1 -- 172.21.15.72:0/75467189 >> v2:172.21.15.137:3300/0 conn(0x7f83840adcf0 msgr2=0x7f838415b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83827fc700 1 --2- 172.21.15.72:0/75467189 >> v2:172.21.15.137:3300/0 conn(0x7f83840adcf0 0x7f838415b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83827fc700 1 -- 172.21.15.72:0/75467189 >> v1:172.21.15.137:6789/0 conn(0x7f8384159b00 legacy=0x7f83840b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83827fc700 1 -- 172.21.15.72:0/75467189 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83840b22b0 con 0x7f83840b3ac0 2023-08-25T04:47:07.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.046+0000 7f83837fe700 1 --2- 172.21.15.72:0/75467189 >> v2:172.21.15.137:3300/0 conn(0x7f83840adcf0 0x7f838415b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:07.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.047+0000 7f83827fc700 1 --2- 172.21.15.72:0/75467189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840b3ac0 0x7f83840ad7b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f838406e760 tx=0x7f837800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d694c3f22754b26 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:07.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.047+0000 7f8381ffb700 1 -- 172.21.15.72:0/75467189 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837800dd30 con 0x7f83840b3ac0 2023-08-25T04:47:07.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.047+0000 7f8381ffb700 1 -- 172.21.15.72:0/75467189 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837800de90 con 0x7f83840b3ac0 2023-08-25T04:47:07.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.047+0000 7f8381ffb700 1 -- 172.21.15.72:0/75467189 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378010690 con 0x7f83840b3ac0 2023-08-25T04:47:07.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.047+0000 7f83895ff700 1 -- 172.21.15.72:0/75467189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840b3ac0 msgr2=0x7f83840ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.047+0000 7f83895ff700 1 --2- 172.21.15.72:0/75467189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840b3ac0 0x7f83840ad7b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f838406e760 tx=0x7f837800be70 comp rx=0 tx=0).stop 2023-08-25T04:47:07.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.047+0000 7f83895ff700 1 -- 172.21.15.72:0/75467189 shutdown_connections 2023-08-25T04:47:07.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.047+0000 7f83895ff700 1 --2- 172.21.15.72:0/75467189 >> v2:172.21.15.137:3300/0 conn(0x7f83840adcf0 0x7f838415b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.047+0000 7f83895ff700 1 --2- 172.21.15.72:0/75467189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840b3ac0 0x7f83840ad7b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.047+0000 7f83895ff700 1 -- 172.21.15.72:0/75467189 >> 172.21.15.72:0/75467189 conn(0x7f838406a2f0 msgr2=0x7f838406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:07.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.048+0000 7f83895ff700 1 -- 172.21.15.72:0/75467189 shutdown_connections 2023-08-25T04:47:07.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.048+0000 7f83895ff700 1 -- 172.21.15.72:0/75467189 wait complete. 2023-08-25T04:47:07.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.049+0000 7f83895ff700 1 Processor -- start 2023-08-25T04:47:07.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.049+0000 7f83895ff700 1 -- start start 2023-08-25T04:47:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.050+0000 7f83895ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840adcf0 0x7f83841f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.050+0000 7f83895ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83840b3ac0 0x7f838415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.050+0000 7f83895ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8384159b00 0x7f83841ef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.050+0000 7f83895ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841f6910 con 0x7f83840adcf0 2023-08-25T04:47:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.050+0000 7f83895ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841f2770 con 0x7f8384159b00 2023-08-25T04:47:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.050+0000 7f83895ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83841f2a50 con 0x7f83840b3ac0 2023-08-25T04:47:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f8382ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840adcf0 0x7f83841f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f8382ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840adcf0 0x7f83841f63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40360/0 (socket says 172.21.15.72:40360) 2023-08-25T04:47:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f8382ffd700 1 -- 172.21.15.72:0/8347086 learned_addr learned my addr 172.21.15.72:0/8347086 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f8382ffd700 1 -- 172.21.15.72:0/8347086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83840b3ac0 msgr2=0x7f838415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f8382ffd700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83840b3ac0 0x7f838415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f8382ffd700 1 -- 172.21.15.72:0/8347086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8384159b00 msgr2=0x7f83841ef4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f8382ffd700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8384159b00 0x7f83841ef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f8382ffd700 1 -- 172.21.15.72:0/8347086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837800b7f0 con 0x7f83840adcf0 2023-08-25T04:47:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f8382ffd700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840adcf0 0x7f83841f63d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f837400c450 tx=0x7f837400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f836b7fe700 1 -- 172.21.15.72:0/8347086 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83740052d0 con 0x7f83840adcf0 2023-08-25T04:47:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f836b7fe700 1 -- 172.21.15.72:0/8347086 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374005430 con 0x7f83840adcf0 2023-08-25T04:47:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f836b7fe700 1 -- 172.21.15.72:0/8347086 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83740038c0 con 0x7f83840adcf0 2023-08-25T04:47:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.051+0000 7f83895ff700 1 -- 172.21.15.72:0/8347086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83841f2d30 con 0x7f83840adcf0 2023-08-25T04:47:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.052+0000 7f83895ff700 1 -- 172.21.15.72:0/8347086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83841f32f0 con 0x7f83840adcf0 2023-08-25T04:47:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.052+0000 7f83895ff700 1 -- 172.21.15.72:0/8347086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838404e620 con 0x7f83840adcf0 2023-08-25T04:47:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.053+0000 7f836b7fe700 1 -- 172.21.15.72:0/8347086 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8374003a20 con 0x7f83840adcf0 2023-08-25T04:47:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.055+0000 7f836b7fe700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f837006a0e0 0x7f837006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.055+0000 7f836b7fe700 1 -- 172.21.15.72:0/8347086 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8374087c30 con 0x7f83840adcf0 2023-08-25T04:47:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.055+0000 7f83827fc700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f837006a0e0 0x7f837006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.055+0000 7f83827fc700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f837006a0e0 0x7f837006c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f83840adc90 tx=0x7f837800bf90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:07.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.059+0000 7f836b7fe700 1 -- 172.21.15.72:0/8347086 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8374052ff0 con 0x7f83840adcf0 2023-08-25T04:47:07.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.300+0000 7f83895ff700 1 -- 172.21.15.72:0/8347086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8384152c20 con 0x7f83840adcf0 2023-08-25T04:47:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.301+0000 7f836b7fe700 1 -- 172.21.15.72:0/8347086 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f8374056610 con 0x7f83840adcf0 2023-08-25T04:47:07.302 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:07.302 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:45:32.715423+0000","modified":"2023-08-25T04:45:57.525662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:47:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.303+0000 7f83895ff700 1 -- 172.21.15.72:0/8347086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f837006a0e0 msgr2=0x7f837006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.303+0000 7f83895ff700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f837006a0e0 0x7f837006c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f83840adc90 tx=0x7f837800bf90 comp rx=0 tx=0).stop 2023-08-25T04:47:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.303+0000 7f83895ff700 1 -- 172.21.15.72:0/8347086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840adcf0 msgr2=0x7f83841f63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.303+0000 7f83895ff700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840adcf0 0x7f83841f63d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f837400c450 tx=0x7f837400c810 comp rx=0 tx=0).stop 2023-08-25T04:47:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.303+0000 7f83895ff700 1 -- 172.21.15.72:0/8347086 shutdown_connections 2023-08-25T04:47:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.303+0000 7f83895ff700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f837006a0e0 0x7f837006c5a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.303+0000 7f83895ff700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8384159b00 0x7f83841ef4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.303+0000 7f83895ff700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83840adcf0 0x7f83841f63d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.303+0000 7f83895ff700 1 --2- 172.21.15.72:0/8347086 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83840b3ac0 0x7f838415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.303+0000 7f83895ff700 1 -- 172.21.15.72:0/8347086 >> 172.21.15.72:0/8347086 conn(0x7f838406a2f0 msgr2=0x7f83840712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:07.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.304+0000 7f83895ff700 1 -- 172.21.15.72:0/8347086 shutdown_connections 2023-08-25T04:47:07.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.304+0000 7f83895ff700 1 -- 172.21.15.72:0/8347086 wait complete. 2023-08-25T04:47:07.306 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-08-25T04:47:07.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:47:07.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.517+0000 7f08149ff700 1 Processor -- start 2023-08-25T04:47:07.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.518+0000 7f08149ff700 1 -- start start 2023-08-25T04:47:07.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.519+0000 7f08149ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f081015d240 0x7f08100cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.519+0000 7f08149ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08100cf970 0x7f08100cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.519+0000 7f08149ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 0x7f081006b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.519+0000 7f08149ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100cb2a0 con 0x7f08100cf970 2023-08-25T04:47:07.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.519+0000 7f08149ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100cfe80 con 0x7f081015d240 2023-08-25T04:47:07.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.519+0000 7f08149ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08100d0160 con 0x7f08100cdf50 2023-08-25T04:47:07.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.519+0000 7f080dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08100cf970 0x7f08100cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.519+0000 7f080dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08100cf970 0x7f08100cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40366/0 (socket says 172.21.15.72:40366) 2023-08-25T04:47:07.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.519+0000 7f080dd9b700 1 -- 172.21.15.72:0/2643534104 learned_addr learned my addr 172.21.15.72:0/2643534104 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:07.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080e59c700 1 --2- 172.21.15.72:0/2643534104 >> v2:172.21.15.137:3300/0 conn(0x7f081015d240 0x7f08100cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080dd9b700 1 -- 172.21.15.72:0/2643534104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 msgr2=0x7f081006b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:07.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.519+0000 7f080ed9d700 1 --2- 172.21.15.72:0/2643534104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 0x7f081006b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080dd9b700 1 --2- 172.21.15.72:0/2643534104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 0x7f081006b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080dd9b700 1 -- 172.21.15.72:0/2643534104 >> v2:172.21.15.137:3300/0 conn(0x7f081015d240 msgr2=0x7f08100cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:07.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080dd9b700 1 --2- 172.21.15.72:0/2643534104 >> v2:172.21.15.137:3300/0 conn(0x7f081015d240 0x7f08100cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080dd9b700 1 -- 172.21.15.72:0/2643534104 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100cb560 con 0x7f08100cf970 2023-08-25T04:47:07.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080ed9d700 1 --2- 172.21.15.72:0/2643534104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 0x7f081006b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:07.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080e59c700 1 --2- 172.21.15.72:0/2643534104 >> v2:172.21.15.137:3300/0 conn(0x7f081015d240 0x7f08100cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:07.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080dd9b700 1 --2- 172.21.15.72:0/2643534104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08100cf970 0x7f08100cda10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f081008acf0 tx=0x7f0804009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88603bed2a7df0f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:07.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080d59a700 1 -- 172.21.15.72:0/2643534104 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400b870 con 0x7f08100cf970 2023-08-25T04:47:07.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080d59a700 1 -- 172.21.15.72:0/2643534104 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080400b9d0 con 0x7f08100cf970 2023-08-25T04:47:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.520+0000 7f080d59a700 1 -- 172.21.15.72:0/2643534104 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400bd60 con 0x7f08100cf970 2023-08-25T04:47:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.521+0000 7f08149ff700 1 -- 172.21.15.72:0/2643534104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08100cf970 msgr2=0x7f08100cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.521+0000 7f08149ff700 1 --2- 172.21.15.72:0/2643534104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08100cf970 0x7f08100cda10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f081008acf0 tx=0x7f0804009bd0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.521+0000 7f08149ff700 1 -- 172.21.15.72:0/2643534104 shutdown_connections 2023-08-25T04:47:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.521+0000 7f08149ff700 1 --2- 172.21.15.72:0/2643534104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 0x7f081006b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.521+0000 7f08149ff700 1 --2- 172.21.15.72:0/2643534104 >> v2:172.21.15.137:3300/0 conn(0x7f081015d240 0x7f08100cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.521+0000 7f08149ff700 1 --2- 172.21.15.72:0/2643534104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08100cf970 0x7f08100cda10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.521+0000 7f08149ff700 1 -- 172.21.15.72:0/2643534104 >> 172.21.15.72:0/2643534104 conn(0x7f08100d0c50 msgr2=0x7f08100d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:07.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.521+0000 7f08149ff700 1 -- 172.21.15.72:0/2643534104 shutdown_connections 2023-08-25T04:47:07.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.521+0000 7f08149ff700 1 -- 172.21.15.72:0/2643534104 wait complete. 2023-08-25T04:47:07.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.522+0000 7f08149ff700 1 Processor -- start 2023-08-25T04:47:07.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.523+0000 7f08149ff700 1 -- start start 2023-08-25T04:47:07.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.523+0000 7f08149ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 0x7f081015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f08149ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08100cf970 0x7f081015ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f08149ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f081015d240 0x7f081006b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f08149ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08101f28e0 con 0x7f081015d240 2023-08-25T04:47:07.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f08149ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08101f2ba0 con 0x7f08100cf970 2023-08-25T04:47:07.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f08149ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08101f2e80 con 0x7f08100cdf50 2023-08-25T04:47:07.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f081015d240 0x7f081006b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f081015d240 0x7f081006b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40376/0 (socket says 172.21.15.72:40376) 2023-08-25T04:47:07.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080ed9d700 1 -- 172.21.15.72:0/2784842463 learned_addr learned my addr 172.21.15.72:0/2784842463 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:07.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080dd9b700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08100cf970 0x7f081015ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080e59c700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 0x7f081015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080ed9d700 1 -- 172.21.15.72:0/2784842463 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 msgr2=0x7f081015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080ed9d700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 0x7f081015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080ed9d700 1 -- 172.21.15.72:0/2784842463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08100cf970 msgr2=0x7f081015ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080ed9d700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08100cf970 0x7f081015ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080ed9d700 1 -- 172.21.15.72:0/2784842463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804009550 con 0x7f081015d240 2023-08-25T04:47:07.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080e59c700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 0x7f081015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:07.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080dd9b700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08100cf970 0x7f081015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:07.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.524+0000 7f080ed9d700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f081015d240 0x7f081006b400 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f080800cd50 tx=0x7f080800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:07.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.525+0000 7f07feffd700 1 -- 172.21.15.72:0/2784842463 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080800f480 con 0x7f081015d240 2023-08-25T04:47:07.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.525+0000 7f07feffd700 1 -- 172.21.15.72:0/2784842463 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080800f600 con 0x7f081015d240 2023-08-25T04:47:07.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.525+0000 7f08149ff700 1 -- 172.21.15.72:0/2784842463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08101f3160 con 0x7f081015d240 2023-08-25T04:47:07.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.525+0000 7f07feffd700 1 -- 172.21.15.72:0/2784842463 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080800f9b0 con 0x7f081015d240 2023-08-25T04:47:07.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.525+0000 7f08149ff700 1 -- 172.21.15.72:0/2784842463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081015aa50 con 0x7f081015d240 2023-08-25T04:47:07.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.526+0000 7f08149ff700 1 -- 172.21.15.72:0/2784842463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081004e620 con 0x7f081015d240 2023-08-25T04:47:07.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.527+0000 7f07feffd700 1 -- 172.21.15.72:0/2784842463 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f080800b040 con 0x7f081015d240 2023-08-25T04:47:07.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.528+0000 7f07feffd700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f07f006a0e0 0x7f07f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.528+0000 7f07feffd700 1 -- 172.21.15.72:0/2784842463 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f08080891f0 con 0x7f081015d240 2023-08-25T04:47:07.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.528+0000 7f080e59c700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f07f006a0e0 0x7f07f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.529+0000 7f080e59c700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f07f006a0e0 0x7f07f006c5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0800006fd0 tx=0x7f0800008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:07.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.532+0000 7f07feffd700 1 -- 172.21.15.72:0/2784842463 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0808054510 con 0x7f081015d240 2023-08-25T04:47:07.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.731+0000 7f08149ff700 1 -- 172.21.15.72:0/2784842463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08100cea70 con 0x7f081015d240 2023-08-25T04:47:07.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.732+0000 7f07feffd700 1 -- 172.21.15.72:0/2784842463 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f0808057b30 con 0x7f081015d240 2023-08-25T04:47:07.734 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:07.734 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:47:07.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 -- 172.21.15.72:0/2784842463 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f07f006a0e0 msgr2=0x7f07f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f07f006a0e0 0x7f07f006c5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0800006fd0 tx=0x7f0800008040 comp rx=0 tx=0).stop 2023-08-25T04:47:07.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 -- 172.21.15.72:0/2784842463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f081015d240 msgr2=0x7f081006b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f081015d240 0x7f081006b400 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f080800cd50 tx=0x7f080800a560 comp rx=0 tx=0).stop 2023-08-25T04:47:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 -- 172.21.15.72:0/2784842463 shutdown_connections 2023-08-25T04:47:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f07f006a0e0 0x7f07f006c5a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f081015d240 0x7f081006b400 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08100cdf50 0x7f081015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 --2- 172.21.15.72:0/2784842463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08100cf970 0x7f081015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 -- 172.21.15.72:0/2784842463 >> 172.21.15.72:0/2784842463 conn(0x7f08100d0c50 msgr2=0x7f08100cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:07.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 -- 172.21.15.72:0/2784842463 shutdown_connections 2023-08-25T04:47:07.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.735+0000 7f08149ff700 1 -- 172.21.15.72:0/2784842463 wait complete. 2023-08-25T04:47:07.754 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:45:31.153894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:45:31.731180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-25T04:45:35.484731+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-25T04:47:07.755 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:47:07.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.955+0000 7f415efff700 1 Processor -- start 2023-08-25T04:47:07.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.955+0000 7f415efff700 1 -- start start 2023-08-25T04:47:07.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.956+0000 7f415efff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41580b4f10 0x7f4158167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f415efff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41580b8d10 con 0x7f41580d10c0 2023-08-25T04:47:07.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f415efff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41580b6e90 con 0x7f415815d000 2023-08-25T04:47:07.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f415efff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41580b56f0 con 0x7f41580b4f10 2023-08-25T04:47:07.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f4157fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f41580d10c0 0x7f41580b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46486/0 (socket says 172.21.15.72:46486) 2023-08-25T04:47:07.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f4157fff700 1 -- 172.21.15.72:0/4135482649 learned_addr learned my addr 172.21.15.72:0/4135482649 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:07.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f415d59c700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41580b4f10 0x7f4158167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729183213 0 0) 0x7f41580b8d10 con 0x7f41580d10c0 2023-08-25T04:47:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41480035b0 con 0x7f41580d10c0 2023-08-25T04:47:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939278182 0 0) 0x7f41580b6e90 con 0x7f415815d000 2023-08-25T04:47:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41580b8d10 con 0x7f415815d000 2023-08-25T04:47:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1938949246 0 0) 0x7f41480035b0 con 0x7f41580d10c0 2023-08-25T04:47:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41580b4f10 msgr2=0x7f4158167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f41577fe700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41580b4f10 0x7f4158167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 >> v1:172.21.15.137:6789/0 conn(0x7f415815d000 legacy=0x7f41580b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.957+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415815d3e0 con 0x7f41580d10c0 2023-08-25T04:47:07.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f4144001670 con 0x7f41580d10c0 2023-08-25T04:47:07.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 >> v1:172.21.15.72:6789/0 conn(0x7f41580d10c0 legacy=0x7f41580b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f41577fe700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4148003bc0 0x7f4148003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f41577fe700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41580b4f10 0x7f4148004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f41577fe700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4148004d90 0x7f4148005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414800bac0 con 0x7f4148004d90 2023-08-25T04:47:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414800bc00 con 0x7f4148003bc0 2023-08-25T04:47:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414800bdc0 con 0x7f41580b4f10 2023-08-25T04:47:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f415d59c700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4148004d90 0x7f4148005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f415cd9b700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4148003bc0 0x7f4148003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f4157fff700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41580b4f10 0x7f4148004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f415d59c700 1 -- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41580b4f10 msgr2=0x7f4148004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f415d59c700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41580b4f10 0x7f4148004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f415d59c700 1 -- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4148003bc0 msgr2=0x7f4148003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f415d59c700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4148003bc0 0x7f4148003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.958+0000 7f415d59c700 1 -- 172.21.15.72:0/4135482649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480035b0 con 0x7f4148004d90 2023-08-25T04:47:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f415d59c700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4148004d90 0x7f4148005210 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f41580c9c30 tx=0x7f4148005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d18f03cac31da9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000ebd0 con 0x7f4148004d90 2023-08-25T04:47:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000f040 con 0x7f4148004d90 2023-08-25T04:47:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f41577fe700 1 -- 172.21.15.72:0/4135482649 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150014480 con 0x7f4148004d90 2023-08-25T04:47:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f415efff700 1 -- 172.21.15.72:0/4135482649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4148004d90 msgr2=0x7f4148005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f415efff700 1 --2- 172.21.15.72:0/4135482649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4148004d90 0x7f4148005210 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f41580c9c30 tx=0x7f4148005880 comp rx=0 tx=0).stop 2023-08-25T04:47:07.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f415d59c700 1 -- 172.21.15.72:0/4135482649 reap_dead start 2023-08-25T04:47:07.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f415efff700 1 -- 172.21.15.72:0/4135482649 shutdown_connections 2023-08-25T04:47:07.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f415efff700 1 -- 172.21.15.72:0/4135482649 >> 172.21.15.72:0/4135482649 conn(0x7f4158071e10 msgr2=0x7f4158072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:07.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f415efff700 1 -- 172.21.15.72:0/4135482649 shutdown_connections 2023-08-25T04:47:07.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.959+0000 7f415efff700 1 -- 172.21.15.72:0/4135482649 wait complete. 2023-08-25T04:47:07.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.961+0000 7f415efff700 1 Processor -- start 2023-08-25T04:47:07.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.961+0000 7f415efff700 1 -- start start 2023-08-25T04:47:07.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.962+0000 7f415efff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4148004d90 0x7f41581f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.962+0000 7f415efff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41581f3560 0x7f41580b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.962+0000 7f415efff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41580b3d70 0x7f415815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.962+0000 7f415efff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580b4200 con 0x7f41580b3d70 2023-08-25T04:47:07.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.962+0000 7f415efff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41581f0550 con 0x7f4148004d90 2023-08-25T04:47:07.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.962+0000 7f415efff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4158151f80 con 0x7f41581f3560 2023-08-25T04:47:07.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.962+0000 7f415d59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41580b3d70 0x7f415815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.962+0000 7f415d59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41580b3d70 0x7f415815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40390/0 (socket says 172.21.15.72:40390) 2023-08-25T04:47:07.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.962+0000 7f415d59c700 1 -- 172.21.15.72:0/711155483 learned_addr learned my addr 172.21.15.72:0/711155483 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f4157fff700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41581f3560 0x7f41580b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f415cd9b700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4148004d90 0x7f41581f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f415d59c700 1 -- 172.21.15.72:0/711155483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41581f3560 msgr2=0x7f41580b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f415d59c700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41581f3560 0x7f41580b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f415d59c700 1 -- 172.21.15.72:0/711155483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4148004d90 msgr2=0x7f41581f0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f415d59c700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4148004d90 0x7f41581f0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:07.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f415d59c700 1 -- 172.21.15.72:0/711155483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4158152260 con 0x7f41580b3d70 2023-08-25T04:47:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f415cd9b700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4148004d90 0x7f41581f0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f415d59c700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41580b3d70 0x7f415815d5d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4150016040 tx=0x7f4150009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f41557fa700 1 -- 172.21.15.72:0/711155483 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150003c20 con 0x7f41580b3d70 2023-08-25T04:47:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f41557fa700 1 -- 172.21.15.72:0/711155483 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4150021070 con 0x7f41580b3d70 2023-08-25T04:47:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f415efff700 1 -- 172.21.15.72:0/711155483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4158152540 con 0x7f41580b3d70 2023-08-25T04:47:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f41557fa700 1 -- 172.21.15.72:0/711155483 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150014690 con 0x7f41580b3d70 2023-08-25T04:47:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.963+0000 7f415efff700 1 -- 172.21.15.72:0/711155483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4158152b00 con 0x7f41580b3d70 2023-08-25T04:47:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.964+0000 7f415efff700 1 -- 172.21.15.72:0/711155483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415806a2f0 con 0x7f41580b3d70 2023-08-25T04:47:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.965+0000 7f41557fa700 1 -- 172.21.15.72:0/711155483 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f41500147f0 con 0x7f41580b3d70 2023-08-25T04:47:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.966+0000 7f41557fa700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413c06a0e0 0x7f413c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.966+0000 7f41557fa700 1 -- 172.21.15.72:0/711155483 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f41500894f0 con 0x7f41580b3d70 2023-08-25T04:47:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.967+0000 7f415cd9b700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413c06a0e0 0x7f413c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:07.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.967+0000 7f415cd9b700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413c06a0e0 0x7f413c06c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f414c007fd0 tx=0x7f414c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:07.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:07.971+0000 7f41557fa700 1 -- 172.21.15.72:0/711155483 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4150054820 con 0x7f41580b3d70 2023-08-25T04:47:08.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.166+0000 7f415efff700 1 -- 172.21.15.72:0/711155483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f415808a000 con 0x7f41580b3d70 2023-08-25T04:47:08.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.167+0000 7f41557fa700 1 -- 172.21.15.72:0/711155483 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4150057e40 con 0x7f41580b3d70 2023-08-25T04:47:08.168 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:47:08.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 -- 172.21.15.72:0/711155483 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413c06a0e0 msgr2=0x7f413c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:08.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413c06a0e0 0x7f413c06c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f414c007fd0 tx=0x7f414c009040 comp rx=0 tx=0).stop 2023-08-25T04:47:08.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 -- 172.21.15.72:0/711155483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41580b3d70 msgr2=0x7f415815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41580b3d70 0x7f415815d5d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4150016040 tx=0x7f4150009750 comp rx=0 tx=0).stop 2023-08-25T04:47:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 -- 172.21.15.72:0/711155483 shutdown_connections 2023-08-25T04:47:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f413c06a0e0 0x7f413c06c5a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41580b3d70 0x7f415815d5d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4148004d90 0x7f41581f0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 --2- 172.21.15.72:0/711155483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41581f3560 0x7f41580b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 -- 172.21.15.72:0/711155483 >> 172.21.15.72:0/711155483 conn(0x7f4158071e10 msgr2=0x7f41580d2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:08.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 -- 172.21.15.72:0/711155483 shutdown_connections 2023-08-25T04:47:08.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.169+0000 7f415efff700 1 -- 172.21.15.72:0/711155483 wait complete. 2023-08-25T04:47:08.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:47:08.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.386+0000 7fc1449ff700 1 Processor -- start 2023-08-25T04:47:08.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.387+0000 7fc1449ff700 1 -- start start 2023-08-25T04:47:08.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc1449ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc140150ac0 0x7fc14015def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc1449ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1400cbd60 0x7fc14015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc1449ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1400aebf0 con 0x7fc140150ea0 2023-08-25T04:47:08.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc1449ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1400af490 con 0x7fc140150ac0 2023-08-25T04:47:08.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc1449ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14015d7c0 con 0x7fc1400cbd60 2023-08-25T04:47:08.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc13e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc140150ac0 0x7fc14015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc13e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc140150ac0 0x7fc14015def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40404/0 (socket says 172.21.15.72:40404) 2023-08-25T04:47:08.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc13e59c700 1 -- 172.21.15.72:0/1972730178 learned_addr learned my addr 172.21.15.72:0/1972730178 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:08.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc13ed9d700 1 --2- 172.21.15.72:0/1972730178 >> v2:172.21.15.137:3300/0 conn(0x7fc1400cbd60 0x7fc14015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc13e59c700 1 -- 172.21.15.72:0/1972730178 >> v2:172.21.15.137:3300/0 conn(0x7fc1400cbd60 msgr2=0x7fc14015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:08.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc13e59c700 1 --2- 172.21.15.72:0/1972730178 >> v2:172.21.15.137:3300/0 conn(0x7fc1400cbd60 0x7fc14015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.388+0000 7fc13e59c700 1 -- 172.21.15.72:0/1972730178 >> v1:172.21.15.137:6789/0 conn(0x7fc140150ea0 legacy=0x7fc1400cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:08.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.389+0000 7fc13e59c700 1 -- 172.21.15.72:0/1972730178 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400aeed0 con 0x7fc140150ac0 2023-08-25T04:47:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.389+0000 7fc13e59c700 1 --2- 172.21.15.72:0/1972730178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc140150ac0 0x7fc14015def0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc140154820 tx=0x7fc13000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c31228f2ae585ae server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.389+0000 7fc13dd9b700 1 -- 172.21.15.72:0/1972730178 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000dd30 con 0x7fc140150ac0 2023-08-25T04:47:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.389+0000 7fc13dd9b700 1 -- 172.21.15.72:0/1972730178 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13000de90 con 0x7fc140150ac0 2023-08-25T04:47:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.389+0000 7fc13dd9b700 1 -- 172.21.15.72:0/1972730178 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130010690 con 0x7fc140150ac0 2023-08-25T04:47:08.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.390+0000 7fc1449ff700 1 -- 172.21.15.72:0/1972730178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc140150ac0 msgr2=0x7fc14015def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:08.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.390+0000 7fc1449ff700 1 --2- 172.21.15.72:0/1972730178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc140150ac0 0x7fc14015def0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc140154820 tx=0x7fc13000be70 comp rx=0 tx=0).stop 2023-08-25T04:47:08.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.390+0000 7fc1449ff700 1 -- 172.21.15.72:0/1972730178 shutdown_connections 2023-08-25T04:47:08.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.390+0000 7fc1449ff700 1 --2- 172.21.15.72:0/1972730178 >> v2:172.21.15.137:3300/0 conn(0x7fc1400cbd60 0x7fc14015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.390+0000 7fc1449ff700 1 --2- 172.21.15.72:0/1972730178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc140150ac0 0x7fc14015def0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.390+0000 7fc1449ff700 1 -- 172.21.15.72:0/1972730178 >> 172.21.15.72:0/1972730178 conn(0x7fc14006a710 msgr2=0x7fc14006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:08.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.390+0000 7fc1449ff700 1 -- 172.21.15.72:0/1972730178 shutdown_connections 2023-08-25T04:47:08.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.390+0000 7fc1449ff700 1 -- 172.21.15.72:0/1972730178 wait complete. 2023-08-25T04:47:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.391+0000 7fc1449ff700 1 Processor -- start 2023-08-25T04:47:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.392+0000 7fc1449ff700 1 -- start start 2023-08-25T04:47:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc1449ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1400cbd60 0x7fc14014f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc1449ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc140150ac0 0x7fc140153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc1449ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc140150ea0 0x7fc1400b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc1449ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1401421e0 con 0x7fc1400cbd60 2023-08-25T04:47:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc1449ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140154260 con 0x7fc140150ea0 2023-08-25T04:47:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc1449ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400c37e0 con 0x7fc140150ac0 2023-08-25T04:47:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc13e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1400cbd60 0x7fc14014f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc13e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1400cbd60 0x7fc14014f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40412/0 (socket says 172.21.15.72:40412) 2023-08-25T04:47:08.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc13e59c700 1 -- 172.21.15.72:0/3188453336 learned_addr learned my addr 172.21.15.72:0/3188453336 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc13ed9d700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc140150ea0 0x7fc1400b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc137fff700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc140150ac0 0x7fc140153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc13e59c700 1 -- 172.21.15.72:0/3188453336 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc140150ac0 msgr2=0x7fc140153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc13e59c700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc140150ac0 0x7fc140153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc13e59c700 1 -- 172.21.15.72:0/3188453336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc140150ea0 msgr2=0x7fc1400b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc13e59c700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc140150ea0 0x7fc1400b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc13e59c700 1 -- 172.21.15.72:0/3188453336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13000b7f0 con 0x7fc1400cbd60 2023-08-25T04:47:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.393+0000 7fc13e59c700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1400cbd60 0x7fc14014f120 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc130000c00 tx=0x7fc130004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.394+0000 7fc136ffd700 1 -- 172.21.15.72:0/3188453336 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130003da0 con 0x7fc1400cbd60 2023-08-25T04:47:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.394+0000 7fc136ffd700 1 -- 172.21.15.72:0/3188453336 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc130010470 con 0x7fc1400cbd60 2023-08-25T04:47:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.394+0000 7fc136ffd700 1 -- 172.21.15.72:0/3188453336 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130010820 con 0x7fc1400cbd60 2023-08-25T04:47:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.394+0000 7fc1449ff700 1 -- 172.21.15.72:0/3188453336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1400c3aa0 con 0x7fc1400cbd60 2023-08-25T04:47:08.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.394+0000 7fc1449ff700 1 -- 172.21.15.72:0/3188453336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1400c4060 con 0x7fc1400cbd60 2023-08-25T04:47:08.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.395+0000 7fc1449ff700 1 -- 172.21.15.72:0/3188453336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc140072320 con 0x7fc1400cbd60 2023-08-25T04:47:08.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.396+0000 7fc136ffd700 1 -- 172.21.15.72:0/3188453336 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc130019400 con 0x7fc1400cbd60 2023-08-25T04:47:08.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.397+0000 7fc136ffd700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc12006a0e0 0x7fc12006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.397+0000 7fc136ffd700 1 -- 172.21.15.72:0/3188453336 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc130089e10 con 0x7fc1400cbd60 2023-08-25T04:47:08.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.397+0000 7fc137fff700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc12006a0e0 0x7fc12006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.397+0000 7fc137fff700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc12006a0e0 0x7fc12006c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc140151460 tx=0x7fc128009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:08.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.401+0000 7fc136ffd700 1 -- 172.21.15.72:0/3188453336 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc13008d030 con 0x7fc1400cbd60 2023-08-25T04:47:08.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.596+0000 7fc1449ff700 1 -- 172.21.15.72:0/3188453336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1400744f0 con 0x7fc1400cbd60 2023-08-25T04:47:08.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.596+0000 7fc136ffd700 1 -- 172.21.15.72:0/3188453336 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1300551c0 con 0x7fc1400cbd60 2023-08-25T04:47:08.598 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:47:08.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.598+0000 7fc1449ff700 1 -- 172.21.15.72:0/3188453336 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc12006a0e0 msgr2=0x7fc12006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:08.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.598+0000 7fc1449ff700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc12006a0e0 0x7fc12006c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc140151460 tx=0x7fc128009040 comp rx=0 tx=0).stop 2023-08-25T04:47:08.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.598+0000 7fc1449ff700 1 -- 172.21.15.72:0/3188453336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1400cbd60 msgr2=0x7fc14014f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:08.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.598+0000 7fc1449ff700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1400cbd60 0x7fc14014f120 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc130000c00 tx=0x7fc130004750 comp rx=0 tx=0).stop 2023-08-25T04:47:08.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.598+0000 7fc1449ff700 1 -- 172.21.15.72:0/3188453336 shutdown_connections 2023-08-25T04:47:08.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.598+0000 7fc1449ff700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc12006a0e0 0x7fc12006c5a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.598+0000 7fc1449ff700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc140150ea0 0x7fc1400b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.598+0000 7fc1449ff700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1400cbd60 0x7fc14014f120 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.598+0000 7fc1449ff700 1 --2- 172.21.15.72:0/3188453336 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc140150ac0 0x7fc140153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.598+0000 7fc1449ff700 1 -- 172.21.15.72:0/3188453336 >> 172.21.15.72:0/3188453336 conn(0x7fc14006a710 msgr2=0x7fc1400c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:08.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.599+0000 7fc1449ff700 1 -- 172.21.15.72:0/3188453336 shutdown_connections 2023-08-25T04:47:08.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.599+0000 7fc1449ff700 1 -- 172.21.15.72:0/3188453336 wait complete. 2023-08-25T04:47:08.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:47:08.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.816+0000 7f9edc7ff700 1 Processor -- start 2023-08-25T04:47:08.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.816+0000 7f9edc7ff700 1 -- start start 2023-08-25T04:47:08.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.817+0000 7f9edc7ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9ed4150ac0 0x7f9ed415def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.817+0000 7f9edc7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ed4150ea0 0x7f9ed40cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.817+0000 7f9edc7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ed415e430 0x7f9ed40cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.817+0000 7f9edc7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed40af490 con 0x7f9ed4150ea0 2023-08-25T04:47:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.817+0000 7f9edc7ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed415d7c0 con 0x7f9ed4150ac0 2023-08-25T04:47:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.817+0000 7f9edc7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40aebf0 con 0x7f9ed415e430 2023-08-25T04:47:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.817+0000 7f9ed9d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ed4150ea0 0x7f9ed40cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ed4150ea0 0x7f9ed40cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40428/0 (socket says 172.21.15.72:40428) 2023-08-25T04:47:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9d9a700 1 -- 172.21.15.72:0/278612981 learned_addr learned my addr 172.21.15.72:0/278612981 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:08.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9edad9c700 1 --2- 172.21.15.72:0/278612981 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ed415e430 0x7f9ed40cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9eda59b700 1 --2- 172.21.15.72:0/278612981 >> v2:172.21.15.137:3300/0 conn(0x7f9ed4150ac0 0x7f9ed415def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9d9a700 1 -- 172.21.15.72:0/278612981 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ed415e430 msgr2=0x7f9ed40cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:08.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9d9a700 1 --2- 172.21.15.72:0/278612981 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ed415e430 0x7f9ed40cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9d9a700 1 -- 172.21.15.72:0/278612981 >> v2:172.21.15.137:3300/0 conn(0x7f9ed4150ac0 msgr2=0x7f9ed415def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:08.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9d9a700 1 --2- 172.21.15.72:0/278612981 >> v2:172.21.15.137:3300/0 conn(0x7f9ed4150ac0 0x7f9ed415def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9d9a700 1 -- 172.21.15.72:0/278612981 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40aeed0 con 0x7f9ed4150ea0 2023-08-25T04:47:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9d9a700 1 --2- 172.21.15.72:0/278612981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 0x7f9ed40cb650 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4071af0 tx=0x7f9ec4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1f6ca7dfb0b645 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9599700 1 -- 172.21.15.72:0/278612981 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4011830 con 0x7f9ed4150ea0 2023-08-25T04:47:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9599700 1 -- 172.21.15.72:0/278612981 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec4011990 con 0x7f9ed4150ea0 2023-08-25T04:47:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.818+0000 7f9ed9599700 1 -- 172.21.15.72:0/278612981 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4011d20 con 0x7f9ed4150ea0 2023-08-25T04:47:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.819+0000 7f9edc7ff700 1 -- 172.21.15.72:0/278612981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 msgr2=0x7f9ed40cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.819+0000 7f9edc7ff700 1 --2- 172.21.15.72:0/278612981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 0x7f9ed40cb650 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4071af0 tx=0x7f9ec4009bd0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.819+0000 7f9edc7ff700 1 -- 172.21.15.72:0/278612981 shutdown_connections 2023-08-25T04:47:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.819+0000 7f9edc7ff700 1 --2- 172.21.15.72:0/278612981 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ed415e430 0x7f9ed40cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.819+0000 7f9edc7ff700 1 --2- 172.21.15.72:0/278612981 >> v2:172.21.15.137:3300/0 conn(0x7f9ed4150ac0 0x7f9ed415def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.819+0000 7f9edc7ff700 1 --2- 172.21.15.72:0/278612981 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 0x7f9ed40cb650 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.819+0000 7f9edc7ff700 1 -- 172.21.15.72:0/278612981 >> 172.21.15.72:0/278612981 conn(0x7f9ed406a710 msgr2=0x7f9ed406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.819+0000 7f9edc7ff700 1 -- 172.21.15.72:0/278612981 shutdown_connections 2023-08-25T04:47:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.819+0000 7f9edc7ff700 1 -- 172.21.15.72:0/278612981 wait complete. 2023-08-25T04:47:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.821+0000 7f9edc7ff700 1 Processor -- start 2023-08-25T04:47:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.821+0000 7f9edc7ff700 1 -- start start 2023-08-25T04:47:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.822+0000 7f9edc7ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ed4150ac0 0x7f9ed41f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.822+0000 7f9edc7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 0x7f9ed40acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.822+0000 7f9edc7ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ed415e430 0x7f9ed4145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.822+0000 7f9edc7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4145910 con 0x7f9ed4150ea0 2023-08-25T04:47:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.822+0000 7f9edc7ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4144d00 con 0x7f9ed4150ac0 2023-08-25T04:47:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.822+0000 7f9edc7ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4144fe0 con 0x7f9ed415e430 2023-08-25T04:47:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.822+0000 7f9ed9d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 0x7f9ed40acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.822+0000 7f9ed9d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 0x7f9ed40acfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40434/0 (socket says 172.21.15.72:40434) 2023-08-25T04:47:08.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.822+0000 7f9ed9d9a700 1 -- 172.21.15.72:0/3217353693 learned_addr learned my addr 172.21.15.72:0/3217353693 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.822+0000 7f9eda59b700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ed4150ac0 0x7f9ed41f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9ed9d9a700 1 -- 172.21.15.72:0/3217353693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ed415e430 msgr2=0x7f9ed4145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9ed9d9a700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ed415e430 0x7f9ed4145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9ed9d9a700 1 -- 172.21.15.72:0/3217353693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ed4150ac0 msgr2=0x7f9ed41f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9ed9d9a700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ed4150ac0 0x7f9ed41f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9ed9d9a700 1 -- 172.21.15.72:0/3217353693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009550 con 0x7f9ed4150ea0 2023-08-25T04:47:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9eda59b700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ed4150ac0 0x7f9ed41f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9ed9d9a700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 0x7f9ed40acfe0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4000c00 tx=0x7f9ec4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9ecaffd700 1 -- 172.21.15.72:0/3217353693 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4004300 con 0x7f9ed4150ea0 2023-08-25T04:47:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9ecaffd700 1 -- 172.21.15.72:0/3217353693 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec401f070 con 0x7f9ed4150ea0 2023-08-25T04:47:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9edc7ff700 1 -- 172.21.15.72:0/3217353693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed41452c0 con 0x7f9ed4150ea0 2023-08-25T04:47:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9ecaffd700 1 -- 172.21.15.72:0/3217353693 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40036a0 con 0x7f9ed4150ea0 2023-08-25T04:47:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.823+0000 7f9edc7ff700 1 -- 172.21.15.72:0/3217353693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed41f23c0 con 0x7f9ed4150ea0 2023-08-25T04:47:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.824+0000 7f9edc7ff700 1 -- 172.21.15.72:0/3217353693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed4145ac0 con 0x7f9ed4150ea0 2023-08-25T04:47:08.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.825+0000 7f9ecaffd700 1 -- 172.21.15.72:0/3217353693 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ec4021030 con 0x7f9ed4150ea0 2023-08-25T04:47:08.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.826+0000 7f9ecaffd700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9eb806a0e0 0x7f9eb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:08.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.826+0000 7f9ecaffd700 1 -- 172.21.15.72:0/3217353693 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9ec4089a50 con 0x7f9ed4150ea0 2023-08-25T04:47:08.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.826+0000 7f9eda59b700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9eb806a0e0 0x7f9eb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:08.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.827+0000 7f9eda59b700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9eb806a0e0 0x7f9eb806c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009b60 tx=0x7f9ed0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:08.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:08.830+0000 7f9ecaffd700 1 -- 172.21.15.72:0/3217353693 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9ed4145ac0 con 0x7f9ed4150ea0 2023-08-25T04:47:09.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.027+0000 7f9edc7ff700 1 -- 172.21.15.72:0/3217353693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ed4072320 con 0x7f9ed4150ea0 2023-08-25T04:47:09.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.027+0000 7f9ecaffd700 1 -- 172.21.15.72:0/3217353693 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ec4054e00 con 0x7f9ed4150ea0 2023-08-25T04:47:09.029 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:47:09.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 -- 172.21.15.72:0/3217353693 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9eb806a0e0 msgr2=0x7f9eb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9eb806a0e0 0x7f9eb806c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009b60 tx=0x7f9ed0008040 comp rx=0 tx=0).stop 2023-08-25T04:47:09.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 -- 172.21.15.72:0/3217353693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 msgr2=0x7f9ed40acfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 0x7f9ed40acfe0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4000c00 tx=0x7f9ec4004750 comp rx=0 tx=0).stop 2023-08-25T04:47:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 -- 172.21.15.72:0/3217353693 shutdown_connections 2023-08-25T04:47:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f9eb806a0e0 0x7f9eb806c5a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ed415e430 0x7f9ed4145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ed4150ac0 0x7f9ed41f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 --2- 172.21.15.72:0/3217353693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ed4150ea0 0x7f9ed40acfe0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 -- 172.21.15.72:0/3217353693 >> 172.21.15.72:0/3217353693 conn(0x7f9ed406a710 msgr2=0x7f9ed415a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 -- 172.21.15.72:0/3217353693 shutdown_connections 2023-08-25T04:47:09.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.030+0000 7f9edc7ff700 1 -- 172.21.15.72:0/3217353693 wait complete. 2023-08-25T04:47:09.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:47:09.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.250+0000 7f7b463ff700 1 Processor -- start 2023-08-25T04:47:09.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.250+0000 7f7b463ff700 1 -- start start 2023-08-25T04:47:09.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.251+0000 7f7b463ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7b4015d000 0x7f7b400b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.251+0000 7f7b463ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b400b4f10 0x7f7b400b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b463ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b400b6e90 con 0x7f7b400d10c0 2023-08-25T04:47:09.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b463ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400b56f0 con 0x7f7b400b4f10 2023-08-25T04:47:09.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b463ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4015d3e0 con 0x7f7b4015d000 2023-08-25T04:47:09.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b4499c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b400b4f10 0x7f7b400b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b4499c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b400b4f10 0x7f7b400b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40448/0 (socket says 172.21.15.72:40448) 2023-08-25T04:47:09.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b4499c700 1 -- 172.21.15.72:0/3633048066 learned_addr learned my addr 172.21.15.72:0/3633048066 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:09.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b3ffff700 1 --2- 172.21.15.72:0/3633048066 >> v2:172.21.15.137:3300/0 conn(0x7f7b4015d000 0x7f7b400b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b4499c700 1 -- 172.21.15.72:0/3633048066 >> v2:172.21.15.137:3300/0 conn(0x7f7b4015d000 msgr2=0x7f7b400b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:09.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b4499c700 1 --2- 172.21.15.72:0/3633048066 >> v2:172.21.15.137:3300/0 conn(0x7f7b4015d000 0x7f7b400b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b4499c700 1 -- 172.21.15.72:0/3633048066 >> v1:172.21.15.137:6789/0 conn(0x7f7b400d10c0 legacy=0x7f7b400b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.252+0000 7f7b4499c700 1 -- 172.21.15.72:0/3633048066 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400b6280 con 0x7f7b400b4f10 2023-08-25T04:47:09.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b4499c700 1 --2- 172.21.15.72:0/3633048066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 0x7f7b400b7320 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7b400d08e0 tx=0x7f7b3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75c422c168a5d94 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:09.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b3effd700 1 -- 172.21.15.72:0/3633048066 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800e070 con 0x7f7b400b4f10 2023-08-25T04:47:09.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b3effd700 1 -- 172.21.15.72:0/3633048066 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3800b9c0 con 0x7f7b400b4f10 2023-08-25T04:47:09.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b3effd700 1 -- 172.21.15.72:0/3633048066 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800bd70 con 0x7f7b400b4f10 2023-08-25T04:47:09.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b463ff700 1 -- 172.21.15.72:0/3633048066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 msgr2=0x7f7b400b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b463ff700 1 --2- 172.21.15.72:0/3633048066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 0x7f7b400b7320 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7b400d08e0 tx=0x7f7b3800b330 comp rx=0 tx=0).stop 2023-08-25T04:47:09.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b463ff700 1 -- 172.21.15.72:0/3633048066 shutdown_connections 2023-08-25T04:47:09.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b463ff700 1 --2- 172.21.15.72:0/3633048066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 0x7f7b400b7320 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b463ff700 1 --2- 172.21.15.72:0/3633048066 >> v2:172.21.15.137:3300/0 conn(0x7f7b4015d000 0x7f7b400b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b463ff700 1 -- 172.21.15.72:0/3633048066 >> 172.21.15.72:0/3633048066 conn(0x7f7b40071e10 msgr2=0x7f7b40072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:09.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.253+0000 7f7b463ff700 1 -- 172.21.15.72:0/3633048066 shutdown_connections 2023-08-25T04:47:09.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.254+0000 7f7b463ff700 1 -- 172.21.15.72:0/3633048066 wait complete. 2023-08-25T04:47:09.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.256+0000 7f7b463ff700 1 Processor -- start 2023-08-25T04:47:09.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.256+0000 7f7b463ff700 1 -- start start 2023-08-25T04:47:09.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.257+0000 7f7b463ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 0x7f7b401f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.257+0000 7f7b463ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b400d10c0 0x7f7b401f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.257+0000 7f7b463ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b4015d000 0x7f7b401f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.257+0000 7f7b463ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400ccd60 con 0x7f7b400b4f10 2023-08-25T04:47:09.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.257+0000 7f7b463ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400cc450 con 0x7f7b4015d000 2023-08-25T04:47:09.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.257+0000 7f7b463ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400ca2a0 con 0x7f7b400d10c0 2023-08-25T04:47:09.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 0x7f7b401f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 0x7f7b401f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40456/0 (socket says 172.21.15.72:40456) 2023-08-25T04:47:09.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3ffff700 1 -- 172.21.15.72:0/810407258 learned_addr learned my addr 172.21.15.72:0/810407258 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:09.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b4499c700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b4015d000 0x7f7b401f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3f7fe700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b400d10c0 0x7f7b401f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3ffff700 1 -- 172.21.15.72:0/810407258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b400d10c0 msgr2=0x7f7b401f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3ffff700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b400d10c0 0x7f7b401f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3ffff700 1 -- 172.21.15.72:0/810407258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b4015d000 msgr2=0x7f7b401f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3ffff700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b4015d000 0x7f7b401f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3ffff700 1 -- 172.21.15.72:0/810407258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38009b30 con 0x7f7b400b4f10 2023-08-25T04:47:09.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3f7fe700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b400d10c0 0x7f7b401f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:09.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b4499c700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b4015d000 0x7f7b401f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:09.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3ffff700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 0x7f7b401f5390 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000d830 tx=0x7f7b3000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:09.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3cff9700 1 -- 172.21.15.72:0/810407258 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300125f0 con 0x7f7b400b4f10 2023-08-25T04:47:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b3cff9700 1 -- 172.21.15.72:0/810407258 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b30012750 con 0x7f7b400b4f10 2023-08-25T04:47:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.258+0000 7f7b463ff700 1 -- 172.21.15.72:0/810407258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b400cc6a0 con 0x7f7b400b4f10 2023-08-25T04:47:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.259+0000 7f7b3cff9700 1 -- 172.21.15.72:0/810407258 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30012b00 con 0x7f7b400b4f10 2023-08-25T04:47:09.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.259+0000 7f7b463ff700 1 -- 172.21.15.72:0/810407258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b401f58d0 con 0x7f7b400b4f10 2023-08-25T04:47:09.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.260+0000 7f7b463ff700 1 -- 172.21.15.72:0/810407258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b400ccfd0 con 0x7f7b400b4f10 2023-08-25T04:47:09.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.260+0000 7f7b3cff9700 1 -- 172.21.15.72:0/810407258 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b30012c60 con 0x7f7b400b4f10 2023-08-25T04:47:09.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.261+0000 7f7b3cff9700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b2c06a0e0 0x7f7b2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.261+0000 7f7b3cff9700 1 -- 172.21.15.72:0/810407258 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7b30088bd0 con 0x7f7b400b4f10 2023-08-25T04:47:09.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.261+0000 7f7b3f7fe700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b2c06a0e0 0x7f7b2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.262+0000 7f7b3f7fe700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b2c06a0e0 0x7f7b2c06c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7b401605d0 tx=0x7f7b34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:09.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.265+0000 7f7b3cff9700 1 -- 172.21.15.72:0/810407258 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7b30054020 con 0x7f7b400b4f10 2023-08-25T04:47:09.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.460+0000 7f7b463ff700 1 -- 172.21.15.72:0/810407258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b4006a2f0 con 0x7f7b400b4f10 2023-08-25T04:47:09.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.461+0000 7f7b3cff9700 1 -- 172.21.15.72:0/810407258 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b30057640 con 0x7f7b400b4f10 2023-08-25T04:47:09.466 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-25T04:47:09.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 -- 172.21.15.72:0/810407258 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b2c06a0e0 msgr2=0x7f7b2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b2c06a0e0 0x7f7b2c06c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7b401605d0 tx=0x7f7b34009040 comp rx=0 tx=0).stop 2023-08-25T04:47:09.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 -- 172.21.15.72:0/810407258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 msgr2=0x7f7b401f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 0x7f7b401f5390 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000d830 tx=0x7f7b3000dbf0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 -- 172.21.15.72:0/810407258 shutdown_connections 2023-08-25T04:47:09.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b2c06a0e0 0x7f7b2c06c5a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b4015d000 0x7f7b401f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b400b4f10 0x7f7b401f5390 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 --2- 172.21.15.72:0/810407258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b400d10c0 0x7f7b401f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 -- 172.21.15.72:0/810407258 >> 172.21.15.72:0/810407258 conn(0x7f7b40071e10 msgr2=0x7f7b400b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 -- 172.21.15.72:0/810407258 shutdown_connections 2023-08-25T04:47:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.463+0000 7f7b463ff700 1 -- 172.21.15.72:0/810407258 wait complete. 2023-08-25T04:47:09.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-25T04:47:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.686+0000 7f3e50fff700 1 Processor -- start 2023-08-25T04:47:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.687+0000 7f3e50fff700 1 -- start start 2023-08-25T04:47:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.688+0000 7f3e50fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e4c0d10c0 0x7f3e4c0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.688+0000 7f3e50fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e4c0b4d40 0x7f3e4c0b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.688+0000 7f3e50fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0b8d10 con 0x7f3e4c15d000 2023-08-25T04:47:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.688+0000 7f3e50fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0b56f0 con 0x7f3e4c0d10c0 2023-08-25T04:47:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.688+0000 7f3e50fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0b6e90 con 0x7f3e4c0b4d40 2023-08-25T04:47:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.688+0000 7f3e43fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e4c0d10c0 0x7f3e4c0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.688+0000 7f3e43fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e4c0d10c0 0x7f3e4c0b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40468/0 (socket says 172.21.15.72:40468) 2023-08-25T04:47:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.688+0000 7f3e4ad9d700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e4c0b4d40 0x7f3e4c0b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.688+0000 7f3e43fff700 1 -- 172.21.15.72:0/3058616331 learned_addr learned my addr 172.21.15.72:0/3058616331 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.689+0000 7f3e43fff700 1 -- 172.21.15.72:0/3058616331 >> v2:172.21.15.137:3300/0 conn(0x7f3e4c0b4d40 msgr2=0x7f3e4c0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.689+0000 7f3e43fff700 1 --2- 172.21.15.72:0/3058616331 >> v2:172.21.15.137:3300/0 conn(0x7f3e4c0b4d40 0x7f3e4c0b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.689+0000 7f3e43fff700 1 -- 172.21.15.72:0/3058616331 >> v1:172.21.15.137:6789/0 conn(0x7f3e4c15d000 legacy=0x7f3e4c0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.689+0000 7f3e43fff700 1 -- 172.21.15.72:0/3058616331 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0b5170 con 0x7f3e4c0d10c0 2023-08-25T04:47:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.689+0000 7f3e43fff700 1 --2- 172.21.15.72:0/3058616331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c0d10c0 0x7f3e4c0b4800 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0c9c10 tx=0x7f3e34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f145655c4466a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.689+0000 7f3e49d9b700 1 -- 172.21.15.72:0/3058616331 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34011830 con 0x7f3e4c0d10c0 2023-08-25T04:47:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.689+0000 7f3e49d9b700 1 -- 172.21.15.72:0/3058616331 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e34011990 con 0x7f3e4c0d10c0 2023-08-25T04:47:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.689+0000 7f3e49d9b700 1 -- 172.21.15.72:0/3058616331 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34011d20 con 0x7f3e4c0d10c0 2023-08-25T04:47:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.690+0000 7f3e50fff700 1 -- 172.21.15.72:0/3058616331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c0d10c0 msgr2=0x7f3e4c0b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.690+0000 7f3e50fff700 1 --2- 172.21.15.72:0/3058616331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c0d10c0 0x7f3e4c0b4800 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0c9c10 tx=0x7f3e34009bd0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.690+0000 7f3e50fff700 1 -- 172.21.15.72:0/3058616331 shutdown_connections 2023-08-25T04:47:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.690+0000 7f3e50fff700 1 --2- 172.21.15.72:0/3058616331 >> v2:172.21.15.137:3300/0 conn(0x7f3e4c0b4d40 0x7f3e4c0b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.690+0000 7f3e50fff700 1 --2- 172.21.15.72:0/3058616331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c0d10c0 0x7f3e4c0b4800 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.690+0000 7f3e50fff700 1 -- 172.21.15.72:0/3058616331 >> 172.21.15.72:0/3058616331 conn(0x7f3e4c071e10 msgr2=0x7f3e4c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.690+0000 7f3e50fff700 1 -- 172.21.15.72:0/3058616331 shutdown_connections 2023-08-25T04:47:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.690+0000 7f3e50fff700 1 -- 172.21.15.72:0/3058616331 wait complete. 2023-08-25T04:47:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.692+0000 7f3e50fff700 1 Processor -- start 2023-08-25T04:47:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.692+0000 7f3e50fff700 1 -- start start 2023-08-25T04:47:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e50fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e4c0b4d40 0x7f3e4c152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e50fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e4c0d10c0 0x7f3e4c0aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e50fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c15d000 0x7f3e4c14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e50fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0aaa00 con 0x7f3e4c15d000 2023-08-25T04:47:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e50fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0c8390 con 0x7f3e4c0b4d40 2023-08-25T04:47:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e50fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0c7a60 con 0x7f3e4c0d10c0 2023-08-25T04:47:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e4ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c15d000 0x7f3e4c14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e4ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c15d000 0x7f3e4c14c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40470/0 (socket says 172.21.15.72:40470) 2023-08-25T04:47:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e4ad9d700 1 -- 172.21.15.72:0/2028484827 learned_addr learned my addr 172.21.15.72:0/2028484827 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e4a59c700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e4c0b4d40 0x7f3e4c152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e43fff700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e4c0d10c0 0x7f3e4c0aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e4ad9d700 1 -- 172.21.15.72:0/2028484827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e4c0d10c0 msgr2=0x7f3e4c0aa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e4ad9d700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e4c0d10c0 0x7f3e4c0aa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e4ad9d700 1 -- 172.21.15.72:0/2028484827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e4c0b4d40 msgr2=0x7f3e4c152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e4ad9d700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e4c0b4d40 0x7f3e4c152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e4ad9d700 1 -- 172.21.15.72:0/2028484827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009550 con 0x7f3e4c15d000 2023-08-25T04:47:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.693+0000 7f3e4a59c700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e4c0b4d40 0x7f3e4c152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.694+0000 7f3e4ad9d700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c15d000 0x7f3e4c14c9d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400efc0 tx=0x7f3e4400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.694+0000 7f3e42ffd700 1 -- 172.21.15.72:0/2028484827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400cd40 con 0x7f3e4c15d000 2023-08-25T04:47:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.694+0000 7f3e42ffd700 1 -- 172.21.15.72:0/2028484827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400f040 con 0x7f3e4c15d000 2023-08-25T04:47:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.694+0000 7f3e42ffd700 1 -- 172.21.15.72:0/2028484827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e440146c0 con 0x7f3e4c15d000 2023-08-25T04:47:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.694+0000 7f3e50fff700 1 -- 172.21.15.72:0/2028484827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0c7d40 con 0x7f3e4c15d000 2023-08-25T04:47:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.694+0000 7f3e50fff700 1 -- 172.21.15.72:0/2028484827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0aa6d0 con 0x7f3e4c15d000 2023-08-25T04:47:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.695+0000 7f3e50fff700 1 -- 172.21.15.72:0/2028484827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c0c8520 con 0x7f3e4c15d000 2023-08-25T04:47:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.696+0000 7f3e42ffd700 1 -- 172.21.15.72:0/2028484827 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3e44014820 con 0x7f3e4c15d000 2023-08-25T04:47:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.697+0000 7f3e42ffd700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3e2c06a0e0 0x7f3e2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.697+0000 7f3e42ffd700 1 -- 172.21.15.72:0/2028484827 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3e44089310 con 0x7f3e4c15d000 2023-08-25T04:47:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.697+0000 7f3e4a59c700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3e2c06a0e0 0x7f3e2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.698+0000 7f3e4a59c700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3e2c06a0e0 0x7f3e2c06c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c000f60 tx=0x7f3e3c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.701+0000 7f3e42ffd700 1 -- 172.21.15.72:0/2028484827 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3e440580c0 con 0x7f3e4c15d000 2023-08-25T04:47:09.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.899+0000 7f3e50fff700 1 -- 172.21.15.72:0/2028484827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3e4c06a2f0 con 0x7f3e4c15d000 2023-08-25T04:47:09.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.899+0000 7f3e42ffd700 1 -- 172.21.15.72:0/2028484827 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3e4400cea0 con 0x7f3e4c15d000 2023-08-25T04:47:09.901 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-08-25T04:47:09.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 -- 172.21.15.72:0/2028484827 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3e2c06a0e0 msgr2=0x7f3e2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3e2c06a0e0 0x7f3e2c06c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c000f60 tx=0x7f3e3c009040 comp rx=0 tx=0).stop 2023-08-25T04:47:09.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 -- 172.21.15.72:0/2028484827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c15d000 msgr2=0x7f3e4c14c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:09.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c15d000 0x7f3e4c14c9d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400efc0 tx=0x7f3e4400c3a0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 -- 172.21.15.72:0/2028484827 shutdown_connections 2023-08-25T04:47:09.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f3e2c06a0e0 0x7f3e2c06c5a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e4c15d000 0x7f3e4c14c9d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e4c0b4d40 0x7f3e4c152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 --2- 172.21.15.72:0/2028484827 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e4c0d10c0 0x7f3e4c0aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:09.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 -- 172.21.15.72:0/2028484827 >> 172.21.15.72:0/2028484827 conn(0x7f3e4c071e10 msgr2=0x7f3e4c0b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:09.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 -- 172.21.15.72:0/2028484827 shutdown_connections 2023-08-25T04:47:09.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:09.902+0000 7f3e50fff700 1 -- 172.21.15.72:0/2028484827 wait complete. 2023-08-25T04:47:09.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:47:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.121+0000 7fc2a79ff700 1 Processor -- start 2023-08-25T04:47:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.121+0000 7fc2a79ff700 1 -- start start 2023-08-25T04:47:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.123+0000 7fc2a79ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2a0070fa0 0x7fc2a015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.123+0000 7fc2a79ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc2a00adc00 0x7fc2a015d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.123+0000 7fc2a79ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a00c44f0 con 0x7fc2a0159410 2023-08-25T04:47:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.123+0000 7fc2a79ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a00c40d0 con 0x7fc2a0070fa0 2023-08-25T04:47:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.123+0000 7fc2a79ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a00ae150 con 0x7fc2a00adc00 2023-08-25T04:47:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.123+0000 7fc2a4f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2a0070fa0 0x7fc2a015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.123+0000 7fc2a4f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2a0070fa0 0x7fc2a015ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40486/0 (socket says 172.21.15.72:40486) 2023-08-25T04:47:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.123+0000 7fc2a4f9a700 1 -- 172.21.15.72:0/1856531347 learned_addr learned my addr 172.21.15.72:0/1856531347 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.123+0000 7fc2a5f9c700 1 --2- 172.21.15.72:0/1856531347 >> v2:172.21.15.137:3300/0 conn(0x7fc2a00adc00 0x7fc2a015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.124+0000 7fc2a4f9a700 1 -- 172.21.15.72:0/1856531347 >> v2:172.21.15.137:3300/0 conn(0x7fc2a00adc00 msgr2=0x7fc2a015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.124+0000 7fc2a4f9a700 1 --2- 172.21.15.72:0/1856531347 >> v2:172.21.15.137:3300/0 conn(0x7fc2a00adc00 0x7fc2a015d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.124+0000 7fc2a4f9a700 1 -- 172.21.15.72:0/1856531347 >> v1:172.21.15.137:6789/0 conn(0x7fc2a0159410 legacy=0x7fc2a0070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.124+0000 7fc2a4f9a700 1 -- 172.21.15.72:0/1856531347 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a00c3a10 con 0x7fc2a0070fa0 2023-08-25T04:47:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.124+0000 7fc2a4f9a700 1 --2- 172.21.15.72:0/1856531347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a0070fa0 0x7fc2a015ce20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00b1390 tx=0x7fc29000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f18ad9bfe2f71 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.124+0000 7fc297fff700 1 -- 172.21.15.72:0/1856531347 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000dbe0 con 0x7fc2a0070fa0 2023-08-25T04:47:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.124+0000 7fc297fff700 1 -- 172.21.15.72:0/1856531347 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29000dd40 con 0x7fc2a0070fa0 2023-08-25T04:47:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.124+0000 7fc297fff700 1 -- 172.21.15.72:0/1856531347 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290004270 con 0x7fc2a0070fa0 2023-08-25T04:47:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.125+0000 7fc2a79ff700 1 -- 172.21.15.72:0/1856531347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a0070fa0 msgr2=0x7fc2a015ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.125+0000 7fc2a79ff700 1 --2- 172.21.15.72:0/1856531347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a0070fa0 0x7fc2a015ce20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00b1390 tx=0x7fc29000be70 comp rx=0 tx=0).stop 2023-08-25T04:47:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.125+0000 7fc2a79ff700 1 -- 172.21.15.72:0/1856531347 shutdown_connections 2023-08-25T04:47:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.125+0000 7fc2a79ff700 1 --2- 172.21.15.72:0/1856531347 >> v2:172.21.15.137:3300/0 conn(0x7fc2a00adc00 0x7fc2a015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.125+0000 7fc2a79ff700 1 --2- 172.21.15.72:0/1856531347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a0070fa0 0x7fc2a015ce20 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.125+0000 7fc2a79ff700 1 -- 172.21.15.72:0/1856531347 >> 172.21.15.72:0/1856531347 conn(0x7fc2a00ce990 msgr2=0x7fc2a00ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:10.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.125+0000 7fc2a79ff700 1 -- 172.21.15.72:0/1856531347 shutdown_connections 2023-08-25T04:47:10.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.125+0000 7fc2a79ff700 1 -- 172.21.15.72:0/1856531347 wait complete. 2023-08-25T04:47:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.126+0000 7fc2a79ff700 1 Processor -- start 2023-08-25T04:47:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.127+0000 7fc2a79ff700 1 -- start start 2023-08-25T04:47:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.127+0000 7fc2a79ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2a0070fa0 0x7fc2a014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a79ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a00adc00 0x7fc2a00b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a79ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a0159410 0x7fc2a00b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a79ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a014e330 con 0x7fc2a00adc00 2023-08-25T04:47:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a79ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0153620 con 0x7fc2a0159410 2023-08-25T04:47:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a79ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0153900 con 0x7fc2a0070fa0 2023-08-25T04:47:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a4f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a00adc00 0x7fc2a00b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a4f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a00adc00 0x7fc2a00b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40502/0 (socket says 172.21.15.72:40502) 2023-08-25T04:47:10.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a4f9a700 1 -- 172.21.15.72:0/2751000005 learned_addr learned my addr 172.21.15.72:0/2751000005 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:10.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a5f9c700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a0159410 0x7fc2a00b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a579b700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2a0070fa0 0x7fc2a014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a4f9a700 1 -- 172.21.15.72:0/2751000005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2a0070fa0 msgr2=0x7fc2a014ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a4f9a700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2a0070fa0 0x7fc2a014ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a4f9a700 1 -- 172.21.15.72:0/2751000005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a0159410 msgr2=0x7fc2a00b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a4f9a700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a0159410 0x7fc2a00b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.128+0000 7fc2a4f9a700 1 -- 172.21.15.72:0/2751000005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29000b7f0 con 0x7fc2a00adc00 2023-08-25T04:47:10.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.129+0000 7fc2a4f9a700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a00adc00 0x7fc2a00b2880 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc290000c00 tx=0x7fc290004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:10.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.129+0000 7fc295ffb700 1 -- 172.21.15.72:0/2751000005 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290009040 con 0x7fc2a00adc00 2023-08-25T04:47:10.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.129+0000 7fc295ffb700 1 -- 172.21.15.72:0/2751000005 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290003af0 con 0x7fc2a00adc00 2023-08-25T04:47:10.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.129+0000 7fc2a79ff700 1 -- 172.21.15.72:0/2751000005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a0153be0 con 0x7fc2a00adc00 2023-08-25T04:47:10.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.129+0000 7fc295ffb700 1 -- 172.21.15.72:0/2751000005 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290003ea0 con 0x7fc2a00adc00 2023-08-25T04:47:10.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.129+0000 7fc2a79ff700 1 -- 172.21.15.72:0/2751000005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a00afee0 con 0x7fc2a00adc00 2023-08-25T04:47:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.130+0000 7fc28b7fe700 1 -- 172.21.15.72:0/2751000005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a0154100 con 0x7fc2a00adc00 2023-08-25T04:47:10.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.131+0000 7fc295ffb700 1 -- 172.21.15.72:0/2751000005 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc290015070 con 0x7fc2a00adc00 2023-08-25T04:47:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.132+0000 7fc295ffb700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc28406a0e0 0x7fc28406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.132+0000 7fc295ffb700 1 -- 172.21.15.72:0/2751000005 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc29008a540 con 0x7fc2a00adc00 2023-08-25T04:47:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.132+0000 7fc2a579b700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc28406a0e0 0x7fc28406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.132+0000 7fc2a579b700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc28406a0e0 0x7fc28406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009960 tx=0x7fc29c0090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:10.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.136+0000 7fc295ffb700 1 -- 172.21.15.72:0/2751000005 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc2a0154100 con 0x7fc2a00adc00 2023-08-25T04:47:10.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.373+0000 7fc28b7fe700 1 -- 172.21.15.72:0/2751000005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2a0154100 con 0x7fc2a00adc00 2023-08-25T04:47:10.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.374+0000 7fc295ffb700 1 -- 172.21.15.72:0/2751000005 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7fc2a0154100 con 0x7fc2a00adc00 2023-08-25T04:47:10.375 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:10.375 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:45:32.715423+0000","modified":"2023-08-25T04:45:57.525662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:47:10.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.376+0000 7fc28b7fe700 1 -- 172.21.15.72:0/2751000005 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc28406a0e0 msgr2=0x7fc28406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.376+0000 7fc28b7fe700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc28406a0e0 0x7fc28406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009960 tx=0x7fc29c0090e0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.376+0000 7fc28b7fe700 1 -- 172.21.15.72:0/2751000005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a00adc00 msgr2=0x7fc2a00b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.376+0000 7fc28b7fe700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a00adc00 0x7fc2a00b2880 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc290000c00 tx=0x7fc290004750 comp rx=0 tx=0).stop 2023-08-25T04:47:10.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.376+0000 7fc28b7fe700 1 -- 172.21.15.72:0/2751000005 shutdown_connections 2023-08-25T04:47:10.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.376+0000 7fc28b7fe700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc28406a0e0 0x7fc28406c5a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.376+0000 7fc28b7fe700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2a0159410 0x7fc2a00b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.376+0000 7fc28b7fe700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc2a0070fa0 0x7fc2a014ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.376+0000 7fc28b7fe700 1 --2- 172.21.15.72:0/2751000005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2a00adc00 0x7fc2a00b2880 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.376+0000 7fc28b7fe700 1 -- 172.21.15.72:0/2751000005 >> 172.21.15.72:0/2751000005 conn(0x7fc2a00ce990 msgr2=0x7fc2a00b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.377+0000 7fc28b7fe700 1 -- 172.21.15.72:0/2751000005 shutdown_connections 2023-08-25T04:47:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.377+0000 7fc28b7fe700 1 -- 172.21.15.72:0/2751000005 wait complete. 2023-08-25T04:47:10.379 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-08-25T04:47:10.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:47:10.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.589+0000 7f619cdff700 1 Processor -- start 2023-08-25T04:47:10.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.590+0000 7f619cdff700 1 -- start start 2023-08-25T04:47:10.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.591+0000 7f619cdff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f619815ac50 0x7f619806cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.591+0000 7f619cdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619806d4f0 con 0x7f619806e590 2023-08-25T04:47:10.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.591+0000 7f619cdff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619806d7d0 con 0x7f61980c3f40 2023-08-25T04:47:10.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.591+0000 7f619cdff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619806dab0 con 0x7f619815ac50 2023-08-25T04:47:10.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f618ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f619806e590 0x7f61980addd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46500/0 (socket says 172.21.15.72:46500) 2023-08-25T04:47:10.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f618ffff700 1 -- 172.21.15.72:0/3212152853 learned_addr learned my addr 172.21.15.72:0/3212152853 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:10.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f619659c700 1 --2- 172.21.15.72:0/3212152853 >> v2:172.21.15.137:3300/0 conn(0x7f619815ac50 0x7f619806cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986019502 0 0) 0x7f619806d4f0 con 0x7f619806e590 2023-08-25T04:47:10.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61840035b0 con 0x7f619806e590 2023-08-25T04:47:10.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085220649 0 0) 0x7f61840035b0 con 0x7f619806e590 2023-08-25T04:47:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 >> v2:172.21.15.137:3300/0 conn(0x7f619815ac50 msgr2=0x7f619806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 --2- 172.21.15.72:0/3212152853 >> v2:172.21.15.137:3300/0 conn(0x7f619815ac50 0x7f619806cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 >> v1:172.21.15.137:6789/0 conn(0x7f61980c3f40 legacy=0x7f61980c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619806dd90 con 0x7f619806e590 2023-08-25T04:47:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f6180001670 con 0x7f619806e590 2023-08-25T04:47:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 >> v1:172.21.15.72:6789/0 conn(0x7f619806e590 legacy=0x7f61980addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6184003a00 0x7f6184003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184004850 0x7f6184004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.592+0000 7f6195d9b700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6184005210 0x7f618400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619806dab0 con 0x7f6184004850 2023-08-25T04:47:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618400c1b0 con 0x7f6184005210 2023-08-25T04:47:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618400c370 con 0x7f6184003a00 2023-08-25T04:47:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f618ffff700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184004850 0x7f6184004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f619659c700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6184003a00 0x7f6184003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f6196d9d700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6184005210 0x7f618400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f618ffff700 1 -- 172.21.15.72:0/3212152853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6184003a00 msgr2=0x7f6184003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f618ffff700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6184003a00 0x7f6184003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f618ffff700 1 -- 172.21.15.72:0/3212152853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6184005210 msgr2=0x7f618400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f618ffff700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6184005210 0x7f618400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f618ffff700 1 -- 172.21.15.72:0/3212152853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61840035b0 con 0x7f6184004850 2023-08-25T04:47:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f6196d9d700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6184005210 0x7f618400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f6196d9d700 1 -- 172.21.15.72:0/3212152853 reap_dead start 2023-08-25T04:47:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f618ffff700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184004850 0x7f6184004cd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f618000c240 tx=0x7f6184005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd70b5a16f89fb49 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.593+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180007c10 con 0x7f6184004850 2023-08-25T04:47:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.594+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618000ce00 con 0x7f6184004850 2023-08-25T04:47:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.594+0000 7f6195d9b700 1 -- 172.21.15.72:0/3212152853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180005ba0 con 0x7f6184004850 2023-08-25T04:47:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.594+0000 7f619cdff700 1 -- 172.21.15.72:0/3212152853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184004850 msgr2=0x7f6184004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.594+0000 7f619cdff700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184004850 0x7f6184004cd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f618000c240 tx=0x7f6184005880 comp rx=0 tx=0).stop 2023-08-25T04:47:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.594+0000 7f619cdff700 1 -- 172.21.15.72:0/3212152853 shutdown_connections 2023-08-25T04:47:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.594+0000 7f619cdff700 1 --2- 172.21.15.72:0/3212152853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6184004850 0x7f6184004cd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.594+0000 7f619cdff700 1 -- 172.21.15.72:0/3212152853 >> 172.21.15.72:0/3212152853 conn(0x7f61980ce990 msgr2=0x7f61980ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.594+0000 7f619cdff700 1 -- 172.21.15.72:0/3212152853 shutdown_connections 2023-08-25T04:47:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.594+0000 7f619cdff700 1 -- 172.21.15.72:0/3212152853 wait complete. 2023-08-25T04:47:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.596+0000 7f619cdff700 1 Processor -- start 2023-08-25T04:47:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.596+0000 7f619cdff700 1 -- start start 2023-08-25T04:47:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f619cdff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6184004850 0x7f619814d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f619cdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61981562b0 0x7f6198156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f619cdff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6198159560 0x7f6198159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f619cdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980b2110 con 0x7f61981562b0 2023-08-25T04:47:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f619cdff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6198156c70 con 0x7f6184004850 2023-08-25T04:47:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f619cdff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619815a290 con 0x7f6198159560 2023-08-25T04:47:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f618ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61981562b0 0x7f6198156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f618ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61981562b0 0x7f6198156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40530/0 (socket says 172.21.15.72:40530) 2023-08-25T04:47:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f618ffff700 1 -- 172.21.15.72:0/3377762491 learned_addr learned my addr 172.21.15.72:0/3377762491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:10.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f619659c700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6184004850 0x7f619814d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.597+0000 7f6196d9d700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6198159560 0x7f6198159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f618ffff700 1 -- 172.21.15.72:0/3377762491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6198159560 msgr2=0x7f6198159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f618ffff700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6198159560 0x7f6198159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f618ffff700 1 -- 172.21.15.72:0/3377762491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6184004850 msgr2=0x7f619814d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f618ffff700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6184004850 0x7f619814d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f618ffff700 1 -- 172.21.15.72:0/3377762491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980b1770 con 0x7f61981562b0 2023-08-25T04:47:10.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f618ffff700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61981562b0 0x7f6198156730 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f618400c180 tx=0x7f6180001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:10.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f618effd700 1 -- 172.21.15.72:0/3377762491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180001670 con 0x7f61981562b0 2023-08-25T04:47:10.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f618effd700 1 -- 172.21.15.72:0/3377762491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61800070d0 con 0x7f61981562b0 2023-08-25T04:47:10.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f619cdff700 1 -- 172.21.15.72:0/3377762491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61980b1a50 con 0x7f61981562b0 2023-08-25T04:47:10.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f618effd700 1 -- 172.21.15.72:0/3377762491 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180007480 con 0x7f61981562b0 2023-08-25T04:47:10.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.598+0000 7f619cdff700 1 -- 172.21.15.72:0/3377762491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6198159f50 con 0x7f61981562b0 2023-08-25T04:47:10.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.599+0000 7f619cdff700 1 -- 172.21.15.72:0/3377762491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619806ce90 con 0x7f61981562b0 2023-08-25T04:47:10.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.600+0000 7f618effd700 1 -- 172.21.15.72:0/3377762491 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f61800075e0 con 0x7f61981562b0 2023-08-25T04:47:10.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.601+0000 7f618effd700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f617806a0e0 0x7f617806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:10.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.601+0000 7f618effd700 1 -- 172.21.15.72:0/3377762491 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6180089af0 con 0x7f61981562b0 2023-08-25T04:47:10.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.601+0000 7f619659c700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f617806a0e0 0x7f617806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:10.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.602+0000 7f619659c700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f617806a0e0 0x7f617806c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6188009c20 tx=0x7f6188008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:10.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.605+0000 7f618effd700 1 -- 172.21.15.72:0/3377762491 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6180054ec0 con 0x7f61981562b0 2023-08-25T04:47:10.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.804+0000 7f619cdff700 1 -- 172.21.15.72:0/3377762491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f619804e620 con 0x7f61981562b0 2023-08-25T04:47:10.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.806+0000 7f618effd700 1 -- 172.21.15.72:0/3377762491 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f61800584e0 con 0x7f61981562b0 2023-08-25T04:47:10.807 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:10.807 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:47:10.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 -- 172.21.15.72:0/3377762491 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f617806a0e0 msgr2=0x7f617806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f617806a0e0 0x7f617806c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6188009c20 tx=0x7f6188008040 comp rx=0 tx=0).stop 2023-08-25T04:47:10.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 -- 172.21.15.72:0/3377762491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61981562b0 msgr2=0x7f6198156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:10.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61981562b0 0x7f6198156730 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f618400c180 tx=0x7f6180001a00 comp rx=0 tx=0).stop 2023-08-25T04:47:10.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 -- 172.21.15.72:0/3377762491 shutdown_connections 2023-08-25T04:47:10.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f617806a0e0 0x7f617806c5a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6198159560 0x7f6198159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6184004850 0x7f619814d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 --2- 172.21.15.72:0/3377762491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61981562b0 0x7f6198156730 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:10.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 -- 172.21.15.72:0/3377762491 >> 172.21.15.72:0/3377762491 conn(0x7f61980ce990 msgr2=0x7f61980cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:10.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 -- 172.21.15.72:0/3377762491 shutdown_connections 2023-08-25T04:47:10.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:10.808+0000 7f619cdff700 1 -- 172.21.15.72:0/3377762491 wait complete. 2023-08-25T04:47:10.827 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T04:47:10.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:47:11.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.023+0000 7fda4cdff700 1 Processor -- start 2023-08-25T04:47:11.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.023+0000 7fda4cdff700 1 -- start start 2023-08-25T04:47:11.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.024+0000 7fda4cdff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fda4815d130 0x7fda480d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.024+0000 7fda4cdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480d1780 con 0x7fda480b47c0 2023-08-25T04:47:11.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.024+0000 7fda4cdff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480d1a60 con 0x7fda480b86b0 2023-08-25T04:47:11.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.024+0000 7fda4cdff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480d1d40 con 0x7fda4815d130 2023-08-25T04:47:11.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.024+0000 7fda4659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda480b47c0 0x7fda480b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46504/0 (socket says 172.21.15.72:46504) 2023-08-25T04:47:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.024+0000 7fda4659c700 1 -- 172.21.15.72:0/4002944108 learned_addr learned my addr 172.21.15.72:0/4002944108 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.025+0000 7fda3ffff700 1 --2- 172.21.15.72:0/4002944108 >> v2:172.21.15.137:3300/0 conn(0x7fda4815d130 0x7fda480d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.025+0000 7fda45d9b700 1 -- 172.21.15.72:0/4002944108 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714588945 0 0) 0x7fda480d1780 con 0x7fda480b47c0 2023-08-25T04:47:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.025+0000 7fda45d9b700 1 -- 172.21.15.72:0/4002944108 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda340035b0 con 0x7fda480b47c0 2023-08-25T04:47:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.025+0000 7fda3ffff700 1 -- 172.21.15.72:0/4002944108 >> v1:172.21.15.137:6789/0 conn(0x7fda480b86b0 legacy=0x7fda480b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.025+0000 7fda3ffff700 1 -- 172.21.15.72:0/4002944108 >> v1:172.21.15.72:6789/0 conn(0x7fda480b47c0 legacy=0x7fda480b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.025+0000 7fda3ffff700 1 -- 172.21.15.72:0/4002944108 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480d2020 con 0x7fda4815d130 2023-08-25T04:47:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.025+0000 7fda3ffff700 1 --2- 172.21.15.72:0/4002944108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda4815d130 0x7fda480d0e80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda30009840 tx=0x7fda30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77986cfe11d73e57 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.026+0000 7fda45d9b700 1 -- 172.21.15.72:0/4002944108 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30011830 con 0x7fda4815d130 2023-08-25T04:47:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.026+0000 7fda45d9b700 1 -- 172.21.15.72:0/4002944108 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda30011990 con 0x7fda4815d130 2023-08-25T04:47:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.026+0000 7fda45d9b700 1 -- 172.21.15.72:0/4002944108 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30011d20 con 0x7fda4815d130 2023-08-25T04:47:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.026+0000 7fda4cdff700 1 -- 172.21.15.72:0/4002944108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda4815d130 msgr2=0x7fda480d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.026+0000 7fda4cdff700 1 --2- 172.21.15.72:0/4002944108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda4815d130 0x7fda480d0e80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda30009840 tx=0x7fda30009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.026+0000 7fda4cdff700 1 -- 172.21.15.72:0/4002944108 shutdown_connections 2023-08-25T04:47:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.026+0000 7fda4cdff700 1 --2- 172.21.15.72:0/4002944108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda4815d130 0x7fda480d0e80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.026+0000 7fda4cdff700 1 -- 172.21.15.72:0/4002944108 >> 172.21.15.72:0/4002944108 conn(0x7fda48072050 msgr2=0x7fda480d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:11.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.026+0000 7fda4cdff700 1 -- 172.21.15.72:0/4002944108 shutdown_connections 2023-08-25T04:47:11.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.026+0000 7fda4cdff700 1 -- 172.21.15.72:0/4002944108 wait complete. 2023-08-25T04:47:11.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.028+0000 7fda4cdff700 1 Processor -- start 2023-08-25T04:47:11.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.028+0000 7fda4cdff700 1 -- start start 2023-08-25T04:47:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.029+0000 7fda4cdff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda480b47c0 0x7fda4814a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.029+0000 7fda4cdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda480b86b0 0x7fda4815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.029+0000 7fda4cdff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda4815d130 0x7fda4814f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.029+0000 7fda4cdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4814e690 con 0x7fda480b86b0 2023-08-25T04:47:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.029+0000 7fda4cdff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4814e970 con 0x7fda4815d130 2023-08-25T04:47:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.029+0000 7fda4cdff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4814ec50 con 0x7fda480b47c0 2023-08-25T04:47:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda480b86b0 0x7fda4815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda3ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda480b86b0 0x7fda4815f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40544/0 (socket says 172.21.15.72:40544) 2023-08-25T04:47:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda3ffff700 1 -- 172.21.15.72:0/1252475306 learned_addr learned my addr 172.21.15.72:0/1252475306 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda4659c700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda480b47c0 0x7fda4814a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda3ffff700 1 -- 172.21.15.72:0/1252475306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda480b47c0 msgr2=0x7fda4814a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda3ffff700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda480b47c0 0x7fda4814a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda46d9d700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda4815d130 0x7fda4814f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda3ffff700 1 -- 172.21.15.72:0/1252475306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda4815d130 msgr2=0x7fda4814f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda3ffff700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda4815d130 0x7fda4814f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda3ffff700 1 -- 172.21.15.72:0/1252475306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300094a0 con 0x7fda480b86b0 2023-08-25T04:47:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda4659c700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda480b47c0 0x7fda4814a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda46d9d700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda4815d130 0x7fda4814f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.030+0000 7fda3ffff700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda480b86b0 0x7fda4815f2b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fda30009b90 tx=0x7fda30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.031+0000 7fda3effd700 1 -- 172.21.15.72:0/1252475306 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300038a0 con 0x7fda480b86b0 2023-08-25T04:47:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.031+0000 7fda3effd700 1 -- 172.21.15.72:0/1252475306 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3001e070 con 0x7fda480b86b0 2023-08-25T04:47:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.031+0000 7fda3effd700 1 -- 172.21.15.72:0/1252475306 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30003c40 con 0x7fda480b86b0 2023-08-25T04:47:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.031+0000 7fda4cdff700 1 -- 172.21.15.72:0/1252475306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4814ef30 con 0x7fda480b86b0 2023-08-25T04:47:11.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.031+0000 7fda4cdff700 1 -- 172.21.15.72:0/1252475306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4814e2d0 con 0x7fda480b86b0 2023-08-25T04:47:11.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.032+0000 7fda4cdff700 1 -- 172.21.15.72:0/1252475306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda48151450 con 0x7fda480b86b0 2023-08-25T04:47:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.033+0000 7fda3effd700 1 -- 172.21.15.72:0/1252475306 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fda3002d450 con 0x7fda480b86b0 2023-08-25T04:47:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.033+0000 7fda3effd700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda2806a0e0 0x7fda2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.034+0000 7fda3effd700 1 -- 172.21.15.72:0/1252475306 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fda30089800 con 0x7fda480b86b0 2023-08-25T04:47:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.034+0000 7fda4659c700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda2806a0e0 0x7fda2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.034+0000 7fda4659c700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda2806a0e0 0x7fda2806c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fda380011e0 tx=0x7fda38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.038+0000 7fda3effd700 1 -- 172.21.15.72:0/1252475306 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fda30054c50 con 0x7fda480b86b0 2023-08-25T04:47:11.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.277+0000 7fda4cdff700 1 -- 172.21.15.72:0/1252475306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda4804e620 con 0x7fda480b86b0 2023-08-25T04:47:11.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.277+0000 7fda3effd700 1 -- 172.21.15.72:0/1252475306 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7fda30058270 con 0x7fda480b86b0 2023-08-25T04:47:11.278 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:11.279 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:45:32.715423+0000","modified":"2023-08-25T04:45:57.525662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:47:11.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.279+0000 7fda4cdff700 1 -- 172.21.15.72:0/1252475306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda2806a0e0 msgr2=0x7fda2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.279+0000 7fda4cdff700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda2806a0e0 0x7fda2806c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fda380011e0 tx=0x7fda38009040 comp rx=0 tx=0).stop 2023-08-25T04:47:11.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.279+0000 7fda4cdff700 1 -- 172.21.15.72:0/1252475306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda480b86b0 msgr2=0x7fda4815f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.279+0000 7fda4cdff700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda480b86b0 0x7fda4815f2b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fda30009b90 tx=0x7fda30004750 comp rx=0 tx=0).stop 2023-08-25T04:47:11.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.280+0000 7fda4cdff700 1 -- 172.21.15.72:0/1252475306 shutdown_connections 2023-08-25T04:47:11.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.280+0000 7fda4cdff700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fda2806a0e0 0x7fda2806c5a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.280+0000 7fda4cdff700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda4815d130 0x7fda4814f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.280+0000 7fda4cdff700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fda480b47c0 0x7fda4814a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.280+0000 7fda4cdff700 1 --2- 172.21.15.72:0/1252475306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda480b86b0 0x7fda4815f2b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.280+0000 7fda4cdff700 1 -- 172.21.15.72:0/1252475306 >> 172.21.15.72:0/1252475306 conn(0x7fda48072050 msgr2=0x7fda48072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:11.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.280+0000 7fda4cdff700 1 -- 172.21.15.72:0/1252475306 shutdown_connections 2023-08-25T04:47:11.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.280+0000 7fda4cdff700 1 -- 172.21.15.72:0/1252475306 wait complete. 2023-08-25T04:47:11.282 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-08-25T04:47:11.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:47:11.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.495+0000 7f8ede3ff700 1 Processor -- start 2023-08-25T04:47:11.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.496+0000 7f8ede3ff700 1 -- start start 2023-08-25T04:47:11.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.497+0000 7f8ede3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ed8159b90 0x7f8ed80b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.497+0000 7f8ede3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80c48f0 con 0x7f8ed80b0ab0 2023-08-25T04:47:11.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.497+0000 7f8ede3ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80c5470 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.497+0000 7f8ede3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed8159f70 con 0x7f8ed8159b90 2023-08-25T04:47:11.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.497+0000 7f8ed7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ed8159b90 0x7f8ed80b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.497+0000 7f8ecffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8ed80b0ab0 0x7f8ed80cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46506/0 (socket says 172.21.15.72:46506) 2023-08-25T04:47:11.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.497+0000 7f8ecffff700 1 -- 172.21.15.72:0/1743253375 learned_addr learned my addr 172.21.15.72:0/1743253375 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:11.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.498+0000 7f8ed77fe700 1 -- 172.21.15.72:0/1743253375 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854439255 0 0) 0x7f8ed80c48f0 con 0x7f8ed80b0ab0 2023-08-25T04:47:11.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.498+0000 7f8ed7fff700 1 -- 172.21.15.72:0/1743253375 >> v1:172.21.15.137:6789/0 conn(0x7f8ed80ce3c0 legacy=0x7f8ed80c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:11.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.498+0000 7f8ed7fff700 1 -- 172.21.15.72:0/1743253375 >> v1:172.21.15.72:6789/0 conn(0x7f8ed80b0ab0 legacy=0x7f8ed80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.498+0000 7f8ed7fff700 1 -- 172.21.15.72:0/1743253375 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80c4b40 con 0x7f8ed8159b90 2023-08-25T04:47:11.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.498+0000 7f8ed7fff700 1 --2- 172.21.15.72:0/1743253375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed8159b90 0x7f8ed80b0570 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009840 tx=0x7f8ec8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19022ad4568b7a3b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:11.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.498+0000 7f8ed77fe700 1 -- 172.21.15.72:0/1743253375 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8004230 con 0x7f8ed8159b90 2023-08-25T04:47:11.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.498+0000 7f8ed77fe700 1 -- 172.21.15.72:0/1743253375 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec8004390 con 0x7f8ed8159b90 2023-08-25T04:47:11.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.498+0000 7f8ed77fe700 1 -- 172.21.15.72:0/1743253375 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80036a0 con 0x7f8ed8159b90 2023-08-25T04:47:11.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.499+0000 7f8ede3ff700 1 -- 172.21.15.72:0/1743253375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed8159b90 msgr2=0x7f8ed80b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.499+0000 7f8ede3ff700 1 --2- 172.21.15.72:0/1743253375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed8159b90 0x7f8ed80b0570 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009840 tx=0x7f8ec8009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:11.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.499+0000 7f8ede3ff700 1 -- 172.21.15.72:0/1743253375 shutdown_connections 2023-08-25T04:47:11.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.499+0000 7f8ede3ff700 1 --2- 172.21.15.72:0/1743253375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed8159b90 0x7f8ed80b0570 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.499+0000 7f8ede3ff700 1 -- 172.21.15.72:0/1743253375 >> 172.21.15.72:0/1743253375 conn(0x7f8ed80ce990 msgr2=0x7f8ed80ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:11.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.499+0000 7f8ede3ff700 1 -- 172.21.15.72:0/1743253375 shutdown_connections 2023-08-25T04:47:11.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.499+0000 7f8ede3ff700 1 -- 172.21.15.72:0/1743253375 wait complete. 2023-08-25T04:47:11.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.500+0000 7f8ede3ff700 1 Processor -- start 2023-08-25T04:47:11.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.501+0000 7f8ede3ff700 1 -- start start 2023-08-25T04:47:11.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.501+0000 7f8ede3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ed80b0ab0 0x7f8ed8144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.501+0000 7f8ede3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed80ce3c0 0x7f8ed80b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.501+0000 7f8ede3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ed8159b90 0x7f8ed81582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ede3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed8144b70 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ede3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b36e0 con 0x7f8ed8159b90 2023-08-25T04:47:11.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ede3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b2100 con 0x7f8ed80b0ab0 2023-08-25T04:47:11.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed80ce3c0 0x7f8ed80b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed80ce3c0 0x7f8ed80b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40562/0 (socket says 172.21.15.72:40562) 2023-08-25T04:47:11.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ecffff700 1 -- 172.21.15.72:0/3282215859 learned_addr learned my addr 172.21.15.72:0/3282215859 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:11.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ed7fff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ed80b0ab0 0x7f8ed8144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8edc99c700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ed8159b90 0x7f8ed81582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ecffff700 1 -- 172.21.15.72:0/3282215859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ed80b0ab0 msgr2=0x7f8ed8144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ecffff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ed80b0ab0 0x7f8ed8144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ecffff700 1 -- 172.21.15.72:0/3282215859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ed8159b90 msgr2=0x7f8ed81582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ecffff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ed8159b90 0x7f8ed81582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ecffff700 1 -- 172.21.15.72:0/3282215859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80094a0 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ed7fff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ed80b0ab0 0x7f8ed8144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:11.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.502+0000 7f8ecffff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed80ce3c0 0x7f8ed80b31a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c520 tx=0x7f8ec000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:11.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.503+0000 7f8ed57fa700 1 -- 172.21.15.72:0/3282215859 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0004c80 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.503+0000 7f8ed57fa700 1 -- 172.21.15.72:0/3282215859 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec0004e00 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.503+0000 7f8ede3ff700 1 -- 172.21.15.72:0/3282215859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed80b23e0 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.503+0000 7f8ed57fa700 1 -- 172.21.15.72:0/3282215859 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0007310 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.503+0000 7f8ede3ff700 1 -- 172.21.15.72:0/3282215859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed80b29a0 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.504+0000 7f8ede3ff700 1 -- 172.21.15.72:0/3282215859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed804e620 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.505+0000 7f8ed57fa700 1 -- 172.21.15.72:0/3282215859 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ec0007470 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.506+0000 7f8ed57fa700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8eb806a0e0 0x7f8eb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.506+0000 7f8ed57fa700 1 -- 172.21.15.72:0/3282215859 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8ec00885d0 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.506+0000 7f8ed7fff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8eb806a0e0 0x7f8eb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.507+0000 7f8ed7fff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8eb806a0e0 0x7f8eb806c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80090b0 tx=0x7f8ec8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:11.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.510+0000 7f8ed57fa700 1 -- 172.21.15.72:0/3282215859 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8ec0053990 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.747+0000 7f8ede3ff700 1 -- 172.21.15.72:0/3282215859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ed80c4580 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.748+0000 7f8ed57fa700 1 -- 172.21.15.72:0/3282215859 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f8ec0056fb0 con 0x7f8ed80ce3c0 2023-08-25T04:47:11.749 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:11.749 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3607974500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3607974500},{"type":"v1","addr":"172.21.15.72:6836","nonce":3607974500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2435730436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2435730436},{"type":"v1","addr":"172.21.15.137:6835","nonce":2435730436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3359614699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3359614699},{"type":"v1","addr":"172.21.15.72:6837","nonce":3359614699}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:45:32.715423+0000","modified":"2023-08-25T04:45:57.525662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6834/1278273500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1278273500},{"type":"v1","addr":"172.21.15.137:6834","nonce":1278273500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:47:11.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 -- 172.21.15.72:0/3282215859 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8eb806a0e0 msgr2=0x7f8eb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8eb806a0e0 0x7f8eb806c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80090b0 tx=0x7f8ec8008030 comp rx=0 tx=0).stop 2023-08-25T04:47:11.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 -- 172.21.15.72:0/3282215859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed80ce3c0 msgr2=0x7f8ed80b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed80ce3c0 0x7f8ed80b31a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c520 tx=0x7f8ec000c8e0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 -- 172.21.15.72:0/3282215859 shutdown_connections 2023-08-25T04:47:11.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f8eb806a0e0 0x7f8eb806c5a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ed8159b90 0x7f8ed81582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8ed80b0ab0 0x7f8ed8144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 --2- 172.21.15.72:0/3282215859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ed80ce3c0 0x7f8ed80b31a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 -- 172.21.15.72:0/3282215859 >> 172.21.15.72:0/3282215859 conn(0x7f8ed80ce990 msgr2=0x7f8ed8157950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:11.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.750+0000 7f8ede3ff700 1 -- 172.21.15.72:0/3282215859 shutdown_connections 2023-08-25T04:47:11.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.751+0000 7f8ede3ff700 1 -- 172.21.15.72:0/3282215859 wait complete. 2023-08-25T04:47:11.753 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-08-25T04:47:11.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:47:11.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.966+0000 7f2e805ff700 1 Processor -- start 2023-08-25T04:47:11.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.967+0000 7f2e805ff700 1 -- start start 2023-08-25T04:47:11.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.968+0000 7f2e805ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e780cd820 0x7f2e780ca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.968+0000 7f2e805ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e7806a2f0 0x7f2e7806a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.968+0000 7f2e805ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e780ce9f0 con 0x7f2e7815d040 2023-08-25T04:47:11.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.968+0000 7f2e805ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7806acc0 con 0x7f2e780cd820 2023-08-25T04:47:11.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.968+0000 7f2e805ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780cdde0 con 0x7f2e7806a2f0 2023-08-25T04:47:11.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.968+0000 7f2e7db9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e780cd820 0x7f2e780ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.968+0000 7f2e7e39b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2e7815d040 0x7f2e781616c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46510/0 (socket says 172.21.15.72:46510) 2023-08-25T04:47:11.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.968+0000 7f2e7e39b700 1 -- 172.21.15.72:0/1845525781 learned_addr learned my addr 172.21.15.72:0/1845525781 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:11.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.968+0000 7f2e7eb9c700 1 --2- 172.21.15.72:0/1845525781 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e7806a2f0 0x7f2e7806a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.969+0000 7f2e7d399700 1 -- 172.21.15.72:0/1845525781 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272288201 0 0) 0x7f2e780ce9f0 con 0x7f2e7815d040 2023-08-25T04:47:11.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.969+0000 7f2e7d399700 1 -- 172.21.15.72:0/1845525781 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e640035b0 con 0x7f2e7815d040 2023-08-25T04:47:11.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.969+0000 7f2e7db9a700 1 -- 172.21.15.72:0/1845525781 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e7806a2f0 msgr2=0x7f2e7806a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.969+0000 7f2e7db9a700 1 --2- 172.21.15.72:0/1845525781 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e7806a2f0 0x7f2e7806a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.969+0000 7f2e7db9a700 1 -- 172.21.15.72:0/1845525781 >> v1:172.21.15.72:6789/0 conn(0x7f2e7815d040 legacy=0x7f2e781616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.969+0000 7f2e7db9a700 1 -- 172.21.15.72:0/1845525781 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e780ce0c0 con 0x7f2e780cd820 2023-08-25T04:47:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.969+0000 7f2e7db9a700 1 --2- 172.21.15.72:0/1845525781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e780cd820 0x7f2e780ca790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009840 tx=0x7f2e68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c873056ace7d0a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.969+0000 7f2e7d399700 1 -- 172.21.15.72:0/1845525781 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011830 con 0x7f2e780cd820 2023-08-25T04:47:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.969+0000 7f2e7d399700 1 -- 172.21.15.72:0/1845525781 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68011990 con 0x7f2e780cd820 2023-08-25T04:47:11.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.969+0000 7f2e7d399700 1 -- 172.21.15.72:0/1845525781 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011d20 con 0x7f2e780cd820 2023-08-25T04:47:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.970+0000 7f2e805ff700 1 -- 172.21.15.72:0/1845525781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e780cd820 msgr2=0x7f2e780ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.970+0000 7f2e805ff700 1 --2- 172.21.15.72:0/1845525781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e780cd820 0x7f2e780ca790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009840 tx=0x7f2e68009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.970+0000 7f2e805ff700 1 -- 172.21.15.72:0/1845525781 shutdown_connections 2023-08-25T04:47:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.970+0000 7f2e805ff700 1 --2- 172.21.15.72:0/1845525781 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e7806a2f0 0x7f2e7806a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.970+0000 7f2e805ff700 1 --2- 172.21.15.72:0/1845525781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e780cd820 0x7f2e780ca790 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.970+0000 7f2e805ff700 1 -- 172.21.15.72:0/1845525781 >> 172.21.15.72:0/1845525781 conn(0x7f2e7806db30 msgr2=0x7f2e7806df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.970+0000 7f2e805ff700 1 -- 172.21.15.72:0/1845525781 shutdown_connections 2023-08-25T04:47:11.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.970+0000 7f2e805ff700 1 -- 172.21.15.72:0/1845525781 wait complete. 2023-08-25T04:47:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.972+0000 7f2e805ff700 1 Processor -- start 2023-08-25T04:47:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.972+0000 7f2e805ff700 1 -- start start 2023-08-25T04:47:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e805ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7806a2f0 0x7f2e780ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e805ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e780cd820 0x7f2e780c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e805ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e7815d040 0x7f2e7814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e805ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780c90c0 con 0x7f2e7806a2f0 2023-08-25T04:47:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e805ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780c8440 con 0x7f2e7815d040 2023-08-25T04:47:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e805ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780c8720 con 0x7f2e780cd820 2023-08-25T04:47:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e7e39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7806a2f0 0x7f2e780ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e7e39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7806a2f0 0x7f2e780ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40582/0 (socket says 172.21.15.72:40582) 2023-08-25T04:47:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e7e39b700 1 -- 172.21.15.72:0/1985987421 learned_addr learned my addr 172.21.15.72:0/1985987421 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:11.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e7e39b700 1 -- 172.21.15.72:0/1985987421 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e780cd820 msgr2=0x7f2e780c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e7e39b700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e780cd820 0x7f2e780c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e7e39b700 1 -- 172.21.15.72:0/1985987421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e7815d040 msgr2=0x7f2e7814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:11.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e7e39b700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e7815d040 0x7f2e7814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:11.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e7e39b700 1 -- 172.21.15.72:0/1985987421 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e680094a0 con 0x7f2e7806a2f0 2023-08-25T04:47:11.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.973+0000 7f2e7e39b700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7806a2f0 0x7f2e780ab8f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400c700 tx=0x7f2e7400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:11.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.974+0000 7f2e6effd700 1 -- 172.21.15.72:0/1985987421 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74005d70 con 0x7f2e7806a2f0 2023-08-25T04:47:11.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.974+0000 7f2e6effd700 1 -- 172.21.15.72:0/1985987421 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e740070d0 con 0x7f2e7806a2f0 2023-08-25T04:47:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.974+0000 7f2e805ff700 1 -- 172.21.15.72:0/1985987421 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e780c8a00 con 0x7f2e7806a2f0 2023-08-25T04:47:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.974+0000 7f2e6effd700 1 -- 172.21.15.72:0/1985987421 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74007460 con 0x7f2e7806a2f0 2023-08-25T04:47:11.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.974+0000 7f2e805ff700 1 -- 172.21.15.72:0/1985987421 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7814f2e0 con 0x7f2e7806a2f0 2023-08-25T04:47:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.975+0000 7f2e805ff700 1 -- 172.21.15.72:0/1985987421 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e78160300 con 0x7f2e7806a2f0 2023-08-25T04:47:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.976+0000 7f2e6effd700 1 -- 172.21.15.72:0/1985987421 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2e740075c0 con 0x7f2e7806a2f0 2023-08-25T04:47:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.976+0000 7f2e6effd700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e5c06a0e0 0x7f2e5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.977+0000 7f2e6effd700 1 -- 172.21.15.72:0/1985987421 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2e74087f10 con 0x7f2e7806a2f0 2023-08-25T04:47:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.977+0000 7f2e7db9a700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e5c06a0e0 0x7f2e5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:11.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.977+0000 7f2e7db9a700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e5c06a0e0 0x7f2e5c06c5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e781f62a0 tx=0x7f2e68010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:11.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:11.981+0000 7f2e6effd700 1 -- 172.21.15.72:0/1985987421 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2e74053240 con 0x7f2e7806a2f0 2023-08-25T04:47:12.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.179+0000 7f2e805ff700 1 -- 172.21.15.72:0/1985987421 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e7804e620 con 0x7f2e7806a2f0 2023-08-25T04:47:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.180+0000 7f2e6effd700 1 -- 172.21.15.72:0/1985987421 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20158 (secure 0 0 0) 0x7f2e74056860 con 0x7f2e7806a2f0 2023-08-25T04:47:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:12.181 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:46:21.650685+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:45:31.153894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:45:31.731180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-25T04:45:35.484731+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:47:12.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.182+0000 7f2e805ff700 1 -- 172.21.15.72:0/1985987421 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e5c06a0e0 msgr2=0x7f2e5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.182+0000 7f2e805ff700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e5c06a0e0 0x7f2e5c06c5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e781f62a0 tx=0x7f2e68010000 comp rx=0 tx=0).stop 2023-08-25T04:47:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.182+0000 7f2e805ff700 1 -- 172.21.15.72:0/1985987421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7806a2f0 msgr2=0x7f2e780ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.182+0000 7f2e805ff700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7806a2f0 0x7f2e780ab8f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400c700 tx=0x7f2e7400cac0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.182+0000 7f2e805ff700 1 -- 172.21.15.72:0/1985987421 shutdown_connections 2023-08-25T04:47:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.182+0000 7f2e805ff700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e5c06a0e0 0x7f2e5c06c5a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.182+0000 7f2e805ff700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e7815d040 0x7f2e7814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.182+0000 7f2e805ff700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7806a2f0 0x7f2e780ab8f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.182+0000 7f2e805ff700 1 --2- 172.21.15.72:0/1985987421 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e780cd820 0x7f2e780c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.182+0000 7f2e805ff700 1 -- 172.21.15.72:0/1985987421 >> 172.21.15.72:0/1985987421 conn(0x7f2e7806db30 msgr2=0x7f2e780b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.183+0000 7f2e805ff700 1 -- 172.21.15.72:0/1985987421 shutdown_connections 2023-08-25T04:47:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.183+0000 7f2e805ff700 1 -- 172.21.15.72:0/1985987421 wait complete. 2023-08-25T04:47:12.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T04:47:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.397+0000 7f6ca4bff700 1 Processor -- start 2023-08-25T04:47:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.397+0000 7f6ca4bff700 1 -- start start 2023-08-25T04:47:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.398+0000 7f6ca4bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ca0160710 0x7f6ca00b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.398+0000 7f6ca4bff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6ca00b4c80 0x7f6ca00b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.398+0000 7f6ca4bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca00b7400 con 0x7f6ca00b4800 2023-08-25T04:47:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.398+0000 7f6ca4bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca00b8d30 con 0x7f6ca0160710 2023-08-25T04:47:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.398+0000 7f6ca4bff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca00b5110 con 0x7f6ca00b4c80 2023-08-25T04:47:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.398+0000 7f6c9dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6ca00b4800 0x7f6ca00d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46518/0 (socket says 172.21.15.72:46518) 2023-08-25T04:47:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.398+0000 7f6c9e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ca0160710 0x7f6ca00b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.398+0000 7f6c9dd9b700 1 -- 172.21.15.72:0/3835226870 learned_addr learned my addr 172.21.15.72:0/3835226870 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.399+0000 7f6c9ed9d700 1 --2- 172.21.15.72:0/3835226870 >> v2:172.21.15.137:3300/0 conn(0x7f6ca00b4c80 0x7f6ca00b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.399+0000 7f6c9e59c700 1 -- 172.21.15.72:0/3835226870 >> v2:172.21.15.137:3300/0 conn(0x7f6ca00b4c80 msgr2=0x7f6ca00b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.399+0000 7f6c9e59c700 1 --2- 172.21.15.72:0/3835226870 >> v2:172.21.15.137:3300/0 conn(0x7f6ca00b4c80 0x7f6ca00b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.399+0000 7f6c9e59c700 1 -- 172.21.15.72:0/3835226870 >> v1:172.21.15.72:6789/0 conn(0x7f6ca00b4800 legacy=0x7f6ca00d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.399+0000 7f6c9e59c700 1 -- 172.21.15.72:0/3835226870 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00b7650 con 0x7f6ca0160710 2023-08-25T04:47:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.399+0000 7f6c9e59c700 1 --2- 172.21.15.72:0/3835226870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca0160710 0x7f6ca00b87f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00cd460 tx=0x7f6c90009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b82007779d1a6e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.399+0000 7f6c9d59a700 1 -- 172.21.15.72:0/3835226870 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90011830 con 0x7f6ca0160710 2023-08-25T04:47:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.399+0000 7f6c9d59a700 1 -- 172.21.15.72:0/3835226870 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90011990 con 0x7f6ca0160710 2023-08-25T04:47:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.399+0000 7f6c9d59a700 1 -- 172.21.15.72:0/3835226870 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90011d20 con 0x7f6ca0160710 2023-08-25T04:47:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.400+0000 7f6ca4bff700 1 -- 172.21.15.72:0/3835226870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca0160710 msgr2=0x7f6ca00b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.400+0000 7f6ca4bff700 1 --2- 172.21.15.72:0/3835226870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca0160710 0x7f6ca00b87f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00cd460 tx=0x7f6c90009b20 comp rx=0 tx=0).stop 2023-08-25T04:47:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.400+0000 7f6ca4bff700 1 -- 172.21.15.72:0/3835226870 shutdown_connections 2023-08-25T04:47:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.400+0000 7f6ca4bff700 1 --2- 172.21.15.72:0/3835226870 >> v2:172.21.15.137:3300/0 conn(0x7f6ca00b4c80 0x7f6ca00b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.400+0000 7f6ca4bff700 1 --2- 172.21.15.72:0/3835226870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca0160710 0x7f6ca00b87f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.400+0000 7f6ca4bff700 1 -- 172.21.15.72:0/3835226870 >> 172.21.15.72:0/3835226870 conn(0x7f6ca0071e40 msgr2=0x7f6ca0072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.400+0000 7f6ca4bff700 1 -- 172.21.15.72:0/3835226870 shutdown_connections 2023-08-25T04:47:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.400+0000 7f6ca4bff700 1 -- 172.21.15.72:0/3835226870 wait complete. 2023-08-25T04:47:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.402+0000 7f6ca4bff700 1 Processor -- start 2023-08-25T04:47:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.403+0000 7f6ca4bff700 1 -- start start 2023-08-25T04:47:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6ca4bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca00b4800 0x7f6ca01f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6ca4bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca00b4c80 0x7f6ca0153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6ca4bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca0160710 0x7f6ca01577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6ca4bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0155c40 con 0x7f6ca00b4c80 2023-08-25T04:47:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6ca4bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01f6350 con 0x7f6ca00b4800 2023-08-25T04:47:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6ca4bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01f6580 con 0x7f6ca0160710 2023-08-25T04:47:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6c9dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca00b4c80 0x7f6ca0153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6c9dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca00b4c80 0x7f6ca0153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40610/0 (socket says 172.21.15.72:40610) 2023-08-25T04:47:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6c9dd9b700 1 -- 172.21.15.72:0/1091268639 learned_addr learned my addr 172.21.15.72:0/1091268639 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6c9e59c700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca00b4800 0x7f6ca01f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.404+0000 7f6c9ed9d700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca0160710 0x7f6ca01577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6c9dd9b700 1 -- 172.21.15.72:0/1091268639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca0160710 msgr2=0x7f6ca01577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6c9dd9b700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca0160710 0x7f6ca01577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6c9dd9b700 1 -- 172.21.15.72:0/1091268639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca00b4800 msgr2=0x7f6ca01f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6c9dd9b700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca00b4800 0x7f6ca01f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6c9dd9b700 1 -- 172.21.15.72:0/1091268639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c900094a0 con 0x7f6ca00b4c80 2023-08-25T04:47:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6c9ed9d700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca0160710 0x7f6ca01577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6c9dd9b700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca00b4c80 0x7f6ca0153440 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400c4b0 tx=0x7f6c9400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6c8effd700 1 -- 172.21.15.72:0/1091268639 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94005d70 con 0x7f6ca00b4c80 2023-08-25T04:47:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6c8effd700 1 -- 172.21.15.72:0/1091268639 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c940070d0 con 0x7f6ca00b4c80 2023-08-25T04:47:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6c8effd700 1 -- 172.21.15.72:0/1091268639 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94007440 con 0x7f6ca00b4c80 2023-08-25T04:47:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6ca4bff700 1 -- 172.21.15.72:0/1091268639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca01f6860 con 0x7f6ca00b4c80 2023-08-25T04:47:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.405+0000 7f6ca4bff700 1 -- 172.21.15.72:0/1091268639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca00c9fd0 con 0x7f6ca00b4c80 2023-08-25T04:47:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.406+0000 7f6ca4bff700 1 -- 172.21.15.72:0/1091268639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca01f6d80 con 0x7f6ca00b4c80 2023-08-25T04:47:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.407+0000 7f6c8effd700 1 -- 172.21.15.72:0/1091268639 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6c940075a0 con 0x7f6ca00b4c80 2023-08-25T04:47:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.408+0000 7f6c8effd700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f6c8006a0e0 0x7f6c8006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.408+0000 7f6c8effd700 1 -- 172.21.15.72:0/1091268639 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c94087b50 con 0x7f6ca00b4c80 2023-08-25T04:47:12.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.408+0000 7f6c9e59c700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f6c8006a0e0 0x7f6c8006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.409+0000 7f6c9e59c700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f6c8006a0e0 0x7f6c8006c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6c900090b0 tx=0x7f6c9001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:12.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.412+0000 7f6c8effd700 1 -- 172.21.15.72:0/1091268639 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6ca01f6d80 con 0x7f6ca00b4c80 2023-08-25T04:47:12.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.654+0000 7f6ca4bff700 1 -- 172.21.15.72:0/1091268639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6ca00c9e30 con 0x7f6ca00b4c80 2023-08-25T04:47:12.656 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-25T04:47:12.655+0000 7f8658df4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T04:47:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.661+0000 7f6c8effd700 1 -- 172.21.15.72:0/1091268639 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6ca00c9e30 con 0x7f6ca00b4c80 2023-08-25T04:47:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 -- 172.21.15.72:0/1091268639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f6c8006a0e0 msgr2=0x7f6c8006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f6c8006a0e0 0x7f6c8006c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6c900090b0 tx=0x7f6c9001c040 comp rx=0 tx=0).stop 2023-08-25T04:47:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 -- 172.21.15.72:0/1091268639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca00b4c80 msgr2=0x7f6ca0153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca00b4c80 0x7f6ca0153440 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400c4b0 tx=0x7f6c9400c7c0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 -- 172.21.15.72:0/1091268639 shutdown_connections 2023-08-25T04:47:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f6c8006a0e0 0x7f6c8006c5a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ca0160710 0x7f6ca01577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ca00b4800 0x7f6ca01f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 --2- 172.21.15.72:0/1091268639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ca00b4c80 0x7f6ca0153440 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 -- 172.21.15.72:0/1091268639 >> 172.21.15.72:0/1091268639 conn(0x7f6ca0071e40 msgr2=0x7f6ca00b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 -- 172.21.15.72:0/1091268639 shutdown_connections 2023-08-25T04:47:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.664+0000 7f6ca4bff700 1 -- 172.21.15.72:0/1091268639 wait complete. 2023-08-25T04:47:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T04:47:12.674 INFO:tasks.ceph.mds.b.smithi137.stderr: -6416> 2023-08-25T04:45:38.146+0000 7f5a9a7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:47:12.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T04:47:12.726 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2023-08-25T04:47:12.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.880+0000 7fa1ce9ff700 1 Processor -- start 2023-08-25T04:47:12.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.880+0000 7fa1ce9ff700 1 -- start start 2023-08-25T04:47:12.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.881+0000 7fa1ce9ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa1c8150ac0 0x7fa1c815def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.881+0000 7fa1ce9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 0x7fa1c815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.881+0000 7fa1ce9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c80aebf0 con 0x7fa1c8150ea0 2023-08-25T04:47:12.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.881+0000 7fa1ce9ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c80af490 con 0x7fa1c8150ac0 2023-08-25T04:47:12.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.881+0000 7fa1ce9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c815d7c0 con 0x7fa1c80cbd60 2023-08-25T04:47:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.881+0000 7fa1c77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa1c8150ea0 0x7fa1c80cb650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57054/0 (socket says 172.21.15.72:57054) 2023-08-25T04:47:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.882+0000 7fa1c77fe700 1 -- 172.21.15.72:0/2166493262 learned_addr learned my addr 172.21.15.72:0/2166493262 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.882+0000 7fa1c7fff700 1 --2- 172.21.15.72:0/2166493262 >> v2:172.21.15.137:3300/0 conn(0x7fa1c8150ac0 0x7fa1c815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.882+0000 7fa1ccf9c700 1 --2- 172.21.15.72:0/2166493262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 0x7fa1c815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.882+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/2166493262 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065553939 0 0) 0x7fa1c80aebf0 con 0x7fa1c8150ea0 2023-08-25T04:47:12.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.882+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/2166493262 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1b00035b0 con 0x7fa1c8150ea0 2023-08-25T04:47:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.882+0000 7fa1c7fff700 1 -- 172.21.15.72:0/2166493262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 msgr2=0x7fa1c815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.882+0000 7fa1c7fff700 1 --2- 172.21.15.72:0/2166493262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 0x7fa1c815a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.882+0000 7fa1c7fff700 1 -- 172.21.15.72:0/2166493262 >> v1:172.21.15.72:6789/0 conn(0x7fa1c8150ea0 legacy=0x7fa1c80cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.882+0000 7fa1c7fff700 1 -- 172.21.15.72:0/2166493262 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c80aeed0 con 0x7fa1c8150ac0 2023-08-25T04:47:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1c7fff700 1 --2- 172.21.15.72:0/2166493262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1c8150ac0 0x7fa1c815def0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009840 tx=0x7fa1b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=153405b13ff3d136 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/2166493262 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8011830 con 0x7fa1c8150ac0 2023-08-25T04:47:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/2166493262 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b8011990 con 0x7fa1c8150ac0 2023-08-25T04:47:12.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/2166493262 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8011d00 con 0x7fa1c8150ac0 2023-08-25T04:47:12.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2166493262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1c8150ac0 msgr2=0x7fa1c815def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1ce9ff700 1 --2- 172.21.15.72:0/2166493262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1c8150ac0 0x7fa1c815def0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009840 tx=0x7fa1b8009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:12.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2166493262 shutdown_connections 2023-08-25T04:47:12.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1ce9ff700 1 --2- 172.21.15.72:0/2166493262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1c8150ac0 0x7fa1c815def0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1ce9ff700 1 --2- 172.21.15.72:0/2166493262 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 0x7fa1c815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2166493262 >> 172.21.15.72:0/2166493262 conn(0x7fa1c806a710 msgr2=0x7fa1c806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:12.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2166493262 shutdown_connections 2023-08-25T04:47:12.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.883+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2166493262 wait complete. 2023-08-25T04:47:12.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.885+0000 7fa1ce9ff700 1 Processor -- start 2023-08-25T04:47:12.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.885+0000 7fa1ce9ff700 1 -- start start 2023-08-25T04:47:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.886+0000 7fa1ce9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 0x7fa1c814e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1ce9ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1c8150ac0 0x7fa1c80b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1ce9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c8150ea0 0x7fa1c80b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1ce9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80c2ec0 con 0x7fa1c8150ea0 2023-08-25T04:47:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1ce9ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80ce2d0 con 0x7fa1c8150ac0 2023-08-25T04:47:12.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1ce9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80c2590 con 0x7fa1c80cbd60 2023-08-25T04:47:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1c7fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 0x7fa1c814e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1c7fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 0x7fa1c814e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:58998/0 (socket says 172.21.15.72:58998) 2023-08-25T04:47:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1c7fff700 1 -- 172.21.15.72:0/2147618030 learned_addr learned my addr 172.21.15.72:0/2147618030 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1ccf9c700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c8150ea0 0x7fa1c80b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1c77fe700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1c8150ac0 0x7fa1c80b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1ccf9c700 1 -- 172.21.15.72:0/2147618030 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 msgr2=0x7fa1c814e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1ccf9c700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 0x7fa1c814e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1ccf9c700 1 -- 172.21.15.72:0/2147618030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1c8150ac0 msgr2=0x7fa1c80b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:12.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.887+0000 7fa1ccf9c700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1c8150ac0 0x7fa1c80b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:12.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.888+0000 7fa1ccf9c700 1 -- 172.21.15.72:0/2147618030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b80094a0 con 0x7fa1c8150ea0 2023-08-25T04:47:12.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.888+0000 7fa1c7fff700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 0x7fa1c814e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:12.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.888+0000 7fa1c77fe700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1c8150ac0 0x7fa1c80b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.888+0000 7fa1ccf9c700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c8150ea0 0x7fa1c80b3bb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000efc0 tx=0x7fa1c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.890+0000 7fa1c4ff9700 1 -- 172.21.15.72:0/2147618030 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000cc90 con 0x7fa1c8150ea0 2023-08-25T04:47:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.890+0000 7fa1c4ff9700 1 -- 172.21.15.72:0/2147618030 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c000f040 con 0x7fa1c8150ea0 2023-08-25T04:47:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.890+0000 7fa1c4ff9700 1 -- 172.21.15.72:0/2147618030 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c00146c0 con 0x7fa1c8150ea0 2023-08-25T04:47:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.890+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2147618030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c80c2870 con 0x7fa1c8150ea0 2023-08-25T04:47:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.890+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2147618030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c8151e50 con 0x7fa1c8150ea0 2023-08-25T04:47:12.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.891+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2147618030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a80052f0 con 0x7fa1c8150ea0 2023-08-25T04:47:12.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.893+0000 7fa1c4ff9700 1 -- 172.21.15.72:0/2147618030 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa1c0014820 con 0x7fa1c8150ea0 2023-08-25T04:47:12.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.894+0000 7fa1c4ff9700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa1b406a130 0x7fa1b406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:12.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.894+0000 7fa1c4ff9700 1 -- 172.21.15.72:0/2147618030 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fa1c00892e0 con 0x7fa1c8150ea0 2023-08-25T04:47:12.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.894+0000 7fa1c7fff700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa1b406a130 0x7fa1b406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:12.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.895+0000 7fa1c7fff700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa1b406a130 0x7fa1b406c5f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009b90 tx=0x7fa1b8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:12.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:12.899+0000 7fa1c4ff9700 1 -- 172.21.15.72:0/2147618030 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa1c0054750 con 0x7fa1c8150ea0 2023-08-25T04:47:13.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.137+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2147618030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa1a8005b20 con 0x7fa1c8150ea0 2023-08-25T04:47:13.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.662+0000 7fa1c4ff9700 1 -- 172.21.15.72:0/2147618030 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa1c0009e60 con 0x7fa1c8150ea0 2023-08-25T04:47:13.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.665+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa1b406a130 msgr2=0x7fa1b406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.665+0000 7fa1ce9ff700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa1b406a130 0x7fa1b406c5f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009b90 tx=0x7fa1b8008030 comp rx=0 tx=0).stop 2023-08-25T04:47:13.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.665+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c8150ea0 msgr2=0x7fa1c80b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.665+0000 7fa1ce9ff700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c8150ea0 0x7fa1c80b3bb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000efc0 tx=0x7fa1c000c3a0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.665+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2147618030 shutdown_connections 2023-08-25T04:47:13.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.665+0000 7fa1ce9ff700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa1b406a130 0x7fa1b406c5f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.665+0000 7fa1ce9ff700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c8150ea0 0x7fa1c80b3bb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.665+0000 7fa1ce9ff700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa1c80cbd60 0x7fa1c814e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.665+0000 7fa1ce9ff700 1 --2- 172.21.15.72:0/2147618030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa1c8150ac0 0x7fa1c80b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.665+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2147618030 >> 172.21.15.72:0/2147618030 conn(0x7fa1c806a710 msgr2=0x7fa1c80ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:13.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.666+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2147618030 shutdown_connections 2023-08-25T04:47:13.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.666+0000 7fa1ce9ff700 1 -- 172.21.15.72:0/2147618030 wait complete. 2023-08-25T04:47:13.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T04:47:13.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.886+0000 7fbe54bff700 1 Processor -- start 2023-08-25T04:47:13.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.886+0000 7fbe54bff700 1 -- start start 2023-08-25T04:47:13.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.887+0000 7fbe54bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbe500ade30 0x7fbe50070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.887+0000 7fbe54bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe50070ff0 0x7fbe50159d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.887+0000 7fbe54bff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbe5015a270 0x7fbe501566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.887+0000 7fbe54bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe500ae210 con 0x7fbe500ade30 2023-08-25T04:47:13.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.887+0000 7fbe54bff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe50071470 con 0x7fbe5015a270 2023-08-25T04:47:13.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.887+0000 7fbe54bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5015dac0 con 0x7fbe50070ff0 2023-08-25T04:47:13.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.887+0000 7fbe4e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbe500ade30 0x7fbe50070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.887+0000 7fbe4e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbe500ade30 0x7fbe50070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44582/0 (socket says 172.21.15.72:44582) 2023-08-25T04:47:13.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.887+0000 7fbe4e59c700 1 -- 172.21.15.72:0/76430856 learned_addr learned my addr 172.21.15.72:0/76430856 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:13.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.888+0000 7fbe4e59c700 1 -- 172.21.15.72:0/76430856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe50070ff0 msgr2=0x7fbe50159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:13.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.888+0000 7fbe4e59c700 1 --2- 172.21.15.72:0/76430856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe50070ff0 0x7fbe50159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.888+0000 7fbe4e59c700 1 -- 172.21.15.72:0/76430856 >> v2:172.21.15.137:3300/0 conn(0x7fbe5015a270 msgr2=0x7fbe501566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:13.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.888+0000 7fbe4e59c700 1 --2- 172.21.15.72:0/76430856 >> v2:172.21.15.137:3300/0 conn(0x7fbe5015a270 0x7fbe501566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.888+0000 7fbe4e59c700 1 -- 172.21.15.72:0/76430856 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5006d690 con 0x7fbe500ade30 2023-08-25T04:47:13.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.888+0000 7fbe4e59c700 1 --2- 172.21.15.72:0/76430856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe500ade30 0x7fbe50070ab0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbe500cfad0 tx=0x7fbe40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ecc00e9eba5889 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:13.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.888+0000 7fbe4d59a700 1 -- 172.21.15.72:0/76430856 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000b870 con 0x7fbe500ade30 2023-08-25T04:47:13.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.888+0000 7fbe4d59a700 1 -- 172.21.15.72:0/76430856 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4000b9d0 con 0x7fbe500ade30 2023-08-25T04:47:13.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.888+0000 7fbe4d59a700 1 -- 172.21.15.72:0/76430856 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000bd60 con 0x7fbe500ade30 2023-08-25T04:47:13.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.889+0000 7fbe54bff700 1 -- 172.21.15.72:0/76430856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe500ade30 msgr2=0x7fbe50070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.889+0000 7fbe54bff700 1 --2- 172.21.15.72:0/76430856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe500ade30 0x7fbe50070ab0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbe500cfad0 tx=0x7fbe40009bd0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.889+0000 7fbe54bff700 1 -- 172.21.15.72:0/76430856 shutdown_connections 2023-08-25T04:47:13.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.889+0000 7fbe54bff700 1 --2- 172.21.15.72:0/76430856 >> v2:172.21.15.137:3300/0 conn(0x7fbe5015a270 0x7fbe501566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.889+0000 7fbe54bff700 1 --2- 172.21.15.72:0/76430856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe500ade30 0x7fbe50070ab0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.889+0000 7fbe54bff700 1 --2- 172.21.15.72:0/76430856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe50070ff0 0x7fbe50159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.889+0000 7fbe54bff700 1 -- 172.21.15.72:0/76430856 >> 172.21.15.72:0/76430856 conn(0x7fbe500ceaa0 msgr2=0x7fbe500ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:13.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.889+0000 7fbe54bff700 1 -- 172.21.15.72:0/76430856 shutdown_connections 2023-08-25T04:47:13.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.889+0000 7fbe54bff700 1 -- 172.21.15.72:0/76430856 wait complete. 2023-08-25T04:47:13.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.891+0000 7fbe54bff700 1 Processor -- start 2023-08-25T04:47:13.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.891+0000 7fbe54bff700 1 -- start start 2023-08-25T04:47:13.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe54bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe50070ff0 0x7fbe501e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe54bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe500ade30 0x7fbe500c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe54bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5015a270 0x7fbe50157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe54bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500ac620 con 0x7fbe50070ff0 2023-08-25T04:47:13.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe54bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500ac900 con 0x7fbe5015a270 2023-08-25T04:47:13.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe54bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500b2b00 con 0x7fbe500ade30 2023-08-25T04:47:13.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe4e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe50070ff0 0x7fbe501e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe4e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe50070ff0 0x7fbe501e35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44586/0 (socket says 172.21.15.72:44586) 2023-08-25T04:47:13.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe4e59c700 1 -- 172.21.15.72:0/3759498699 learned_addr learned my addr 172.21.15.72:0/3759498699 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:13.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe4ed9d700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5015a270 0x7fbe50157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.892+0000 7fbe4dd9b700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe500ade30 0x7fbe500c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.893+0000 7fbe4e59c700 1 -- 172.21.15.72:0/3759498699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe500ade30 msgr2=0x7fbe500c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.893+0000 7fbe4e59c700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe500ade30 0x7fbe500c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.893+0000 7fbe4e59c700 1 -- 172.21.15.72:0/3759498699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5015a270 msgr2=0x7fbe50157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:13.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.893+0000 7fbe4e59c700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5015a270 0x7fbe50157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.893+0000 7fbe4e59c700 1 -- 172.21.15.72:0/3759498699 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe40009550 con 0x7fbe50070ff0 2023-08-25T04:47:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.893+0000 7fbe4e59c700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe50070ff0 0x7fbe501e35e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbe5006ecf0 tx=0x7fbe40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.895+0000 7fbe3effd700 1 -- 172.21.15.72:0/3759498699 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40004310 con 0x7fbe50070ff0 2023-08-25T04:47:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.895+0000 7fbe54bff700 1 -- 172.21.15.72:0/3759498699 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe500b2de0 con 0x7fbe50070ff0 2023-08-25T04:47:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.895+0000 7fbe54bff700 1 -- 172.21.15.72:0/3759498699 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe501e3b20 con 0x7fbe50070ff0 2023-08-25T04:47:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.895+0000 7fbe3effd700 1 -- 172.21.15.72:0/3759498699 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4001f070 con 0x7fbe50070ff0 2023-08-25T04:47:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.895+0000 7fbe3effd700 1 -- 172.21.15.72:0/3759498699 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400036a0 con 0x7fbe50070ff0 2023-08-25T04:47:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.896+0000 7fbe54bff700 1 -- 172.21.15.72:0/3759498699 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5004e690 con 0x7fbe50070ff0 2023-08-25T04:47:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.897+0000 7fbe3effd700 1 -- 172.21.15.72:0/3759498699 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbe40021030 con 0x7fbe50070ff0 2023-08-25T04:47:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.898+0000 7fbe3effd700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbe3006a0e0 0x7fbe3006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.898+0000 7fbe3effd700 1 -- 172.21.15.72:0/3759498699 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fbe40089e70 con 0x7fbe50070ff0 2023-08-25T04:47:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.898+0000 7fbe4dd9b700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbe3006a0e0 0x7fbe3006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.899+0000 7fbe4dd9b700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbe3006a0e0 0x7fbe3006c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbe50158b80 tx=0x7fbe44009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:13.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:13.902+0000 7fbe3effd700 1 -- 172.21.15.72:0/3759498699 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbe40055150 con 0x7fbe50070ff0 2023-08-25T04:47:14.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.097+0000 7fbe54bff700 1 -- 172.21.15.72:0/3759498699 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe5006e330 con 0x7fbe50070ff0 2023-08-25T04:47:14.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.901+0000 7fbe3effd700 1 -- 172.21.15.72:0/3759498699 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbe40058770 con 0x7fbe50070ff0 2023-08-25T04:47:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.907+0000 7fbe54bff700 1 -- 172.21.15.72:0/3759498699 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbe3006a0e0 msgr2=0x7fbe3006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.907+0000 7fbe54bff700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbe3006a0e0 0x7fbe3006c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbe50158b80 tx=0x7fbe44009190 comp rx=0 tx=0).stop 2023-08-25T04:47:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.907+0000 7fbe54bff700 1 -- 172.21.15.72:0/3759498699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe50070ff0 msgr2=0x7fbe501e35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.907+0000 7fbe54bff700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe50070ff0 0x7fbe501e35e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbe5006ecf0 tx=0x7fbe40004750 comp rx=0 tx=0).stop 2023-08-25T04:47:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.907+0000 7fbe54bff700 1 -- 172.21.15.72:0/3759498699 shutdown_connections 2023-08-25T04:47:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.907+0000 7fbe54bff700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fbe3006a0e0 0x7fbe3006c5a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.907+0000 7fbe54bff700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbe5015a270 0x7fbe50157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.907+0000 7fbe54bff700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe50070ff0 0x7fbe501e35e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.907+0000 7fbe54bff700 1 --2- 172.21.15.72:0/3759498699 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbe500ade30 0x7fbe500c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.907+0000 7fbe54bff700 1 -- 172.21.15.72:0/3759498699 >> 172.21.15.72:0/3759498699 conn(0x7fbe500ceaa0 msgr2=0x7fbe500ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.908+0000 7fbe54bff700 1 -- 172.21.15.72:0/3759498699 shutdown_connections 2023-08-25T04:47:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:14.908+0000 7fbe54bff700 1 -- 172.21.15.72:0/3759498699 wait complete. 2023-08-25T04:47:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-25T04:47:14.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T04:47:15.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.131+0000 7fe1103ff700 1 Processor -- start 2023-08-25T04:47:15.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.131+0000 7fe1103ff700 1 -- start start 2023-08-25T04:47:15.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.132+0000 7fe1103ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe10815a440 0x7fe1081566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.132+0000 7fe1103ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10815dac0 con 0x7fe1080711c0 2023-08-25T04:47:15.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.132+0000 7fe1103ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10815aa60 con 0x7fe1080ade30 2023-08-25T04:47:15.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.132+0000 7fe1103ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080ae210 con 0x7fe10815a440 2023-08-25T04:47:15.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d99a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe1080711c0 0x7fe108159d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57068/0 (socket says 172.21.15.72:57068) 2023-08-25T04:47:15.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d99a700 1 -- 172.21.15.72:0/2927507757 learned_addr learned my addr 172.21.15.72:0/2927507757 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:15.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10e99c700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe10815a440 0x7fe1081566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840594169 0 0) 0x7fe10815dac0 con 0x7fe1080711c0 2023-08-25T04:47:15.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f40034d0 con 0x7fe1080711c0 2023-08-25T04:47:15.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082923551 0 0) 0x7fe10815aa60 con 0x7fe1080ade30 2023-08-25T04:47:15.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe10815dac0 con 0x7fe1080ade30 2023-08-25T04:47:15.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2704996938 0 0) 0x7fe0f40034d0 con 0x7fe1080711c0 2023-08-25T04:47:15.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe10815a440 msgr2=0x7fe1081566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:15.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d199700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe10815a440 0x7fe1081566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 >> v1:172.21.15.137:6789/0 conn(0x7fe1080ade30 legacy=0x7fe108070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10815d190 con 0x7fe1080711c0 2023-08-25T04:47:15.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.133+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fe0f8001670 con 0x7fe1080711c0 2023-08-25T04:47:15.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.134+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 >> v1:172.21.15.72:6789/0 conn(0x7fe1080711c0 legacy=0x7fe108159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.134+0000 7fe10d199700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 0x7fe0f400ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.134+0000 7fe10d199700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe10815a440 0x7fe0f400d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.134+0000 7fe10d199700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f40040b0 0x7fe0f400f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.134+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080ae210 con 0x7fe0f4003cb0 2023-08-25T04:47:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.134+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f400fed0 con 0x7fe0f40040b0 2023-08-25T04:47:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.134+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4010090 con 0x7fe10815a440 2023-08-25T04:47:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.134+0000 7fe10e19b700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 0x7fe0f400ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.134+0000 7fe10d99a700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe10815a440 0x7fe0f400d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.134+0000 7fe10e99c700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f40040b0 0x7fe0f400f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.135+0000 7fe10e19b700 1 -- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe10815a440 msgr2=0x7fe0f400d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:15.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.135+0000 7fe10e19b700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe10815a440 0x7fe0f400d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.135+0000 7fe10e19b700 1 -- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f40040b0 msgr2=0x7fe0f400f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:15.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.135+0000 7fe10e19b700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0f40040b0 0x7fe0f400f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.135+0000 7fe10e19b700 1 -- 172.21.15.72:0/2927507757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40034d0 con 0x7fe0f4003cb0 2023-08-25T04:47:15.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.135+0000 7fe10e19b700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 0x7fe0f400ace0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe104001940 tx=0x7fe0f4003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70f1857c3d52c77 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.135+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104001430 con 0x7fe0f4003cb0 2023-08-25T04:47:15.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.135+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104001d70 con 0x7fe0f4003cb0 2023-08-25T04:47:15.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.135+0000 7fe10d199700 1 -- 172.21.15.72:0/2927507757 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104005510 con 0x7fe0f4003cb0 2023-08-25T04:47:15.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.136+0000 7fe1103ff700 1 -- 172.21.15.72:0/2927507757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 msgr2=0x7fe0f400ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.136+0000 7fe1103ff700 1 --2- 172.21.15.72:0/2927507757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 0x7fe0f400ace0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe104001940 tx=0x7fe0f4003780 comp rx=0 tx=0).stop 2023-08-25T04:47:15.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.136+0000 7fe10e99c700 1 -- 172.21.15.72:0/2927507757 reap_dead start 2023-08-25T04:47:15.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.136+0000 7fe1103ff700 1 -- 172.21.15.72:0/2927507757 shutdown_connections 2023-08-25T04:47:15.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.136+0000 7fe1103ff700 1 -- 172.21.15.72:0/2927507757 >> 172.21.15.72:0/2927507757 conn(0x7fe1080ceaa0 msgr2=0x7fe1080ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:15.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.136+0000 7fe1103ff700 1 -- 172.21.15.72:0/2927507757 shutdown_connections 2023-08-25T04:47:15.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.136+0000 7fe1103ff700 1 -- 172.21.15.72:0/2927507757 wait complete. 2023-08-25T04:47:15.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.141+0000 7fe1103ff700 1 Processor -- start 2023-08-25T04:47:15.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.141+0000 7fe1103ff700 1 -- start start 2023-08-25T04:47:15.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.143+0000 7fe1103ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 0x7fe1080c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.143+0000 7fe1103ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1081561c0 0x7fe1080b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.143+0000 7fe1103ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1080c7770 0x7fe1080c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.143+0000 7fe1103ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080c8160 con 0x7fe0f4003cb0 2023-08-25T04:47:15.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.143+0000 7fe1103ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080b1bd0 con 0x7fe1081561c0 2023-08-25T04:47:15.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.143+0000 7fe1103ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080b1e70 con 0x7fe1080c7770 2023-08-25T04:47:15.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.143+0000 7fe10e19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 0x7fe1080c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.143+0000 7fe10e19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 0x7fe1080c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44594/0 (socket says 172.21.15.72:44594) 2023-08-25T04:47:15.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.143+0000 7fe10e19b700 1 -- 172.21.15.72:0/3484000613 learned_addr learned my addr 172.21.15.72:0/3484000613 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:15.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.144+0000 7fe10e99c700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1080c7770 0x7fe1080c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.144+0000 7fe10d99a700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1081561c0 0x7fe1080b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.144+0000 7fe10e19b700 1 -- 172.21.15.72:0/3484000613 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1080c7770 msgr2=0x7fe1080c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.144+0000 7fe10e19b700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1080c7770 0x7fe1080c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.144+0000 7fe10e19b700 1 -- 172.21.15.72:0/3484000613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1081561c0 msgr2=0x7fe1080b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.144+0000 7fe10e19b700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1081561c0 0x7fe1080b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.144+0000 7fe10e19b700 1 -- 172.21.15.72:0/3484000613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1080b2150 con 0x7fe0f4003cb0 2023-08-25T04:47:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.144+0000 7fe10e19b700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 0x7fe1080c6c10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe104004000 tx=0x7fe1040012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.145+0000 7fe0feffd700 1 -- 172.21.15.72:0/3484000613 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104006c70 con 0x7fe0f4003cb0 2023-08-25T04:47:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.145+0000 7fe0feffd700 1 -- 172.21.15.72:0/3484000613 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104006dd0 con 0x7fe0f4003cb0 2023-08-25T04:47:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.145+0000 7fe0feffd700 1 -- 172.21.15.72:0/3484000613 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104007240 con 0x7fe0f4003cb0 2023-08-25T04:47:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.145+0000 7fe1103ff700 1 -- 172.21.15.72:0/3484000613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1080b2430 con 0x7fe0f4003cb0 2023-08-25T04:47:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.145+0000 7fe1103ff700 1 -- 172.21.15.72:0/3484000613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1080b29f0 con 0x7fe0f4003cb0 2023-08-25T04:47:15.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.147+0000 7fe1103ff700 1 -- 172.21.15.72:0/3484000613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10804e690 con 0x7fe0f4003cb0 2023-08-25T04:47:15.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.148+0000 7fe0feffd700 1 -- 172.21.15.72:0/3484000613 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe1040073a0 con 0x7fe0f4003cb0 2023-08-25T04:47:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.149+0000 7fe0feffd700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe0ec06a0e0 0x7fe0ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.149+0000 7fe0feffd700 1 -- 172.21.15.72:0/3484000613 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fe104089820 con 0x7fe0f4003cb0 2023-08-25T04:47:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.149+0000 7fe10d99a700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe0ec06a0e0 0x7fe0ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.150+0000 7fe10d99a700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe0ec06a0e0 0x7fe0ec06c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8000fd0 tx=0x7fe0f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:15.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.154+0000 7fe0feffd700 1 -- 172.21.15.72:0/3484000613 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe104054d30 con 0x7fe0f4003cb0 2023-08-25T04:47:15.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.350+0000 7fe1103ff700 1 -- 172.21.15.72:0/3484000613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe1080b4a20 con 0x7fe0f4003cb0 2023-08-25T04:47:15.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.907+0000 7fe0feffd700 1 -- 172.21.15.72:0/3484000613 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe104007650 con 0x7fe0f4003cb0 2023-08-25T04:47:15.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.912+0000 7fe1103ff700 1 -- 172.21.15.72:0/3484000613 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe0ec06a0e0 msgr2=0x7fe0ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.912+0000 7fe1103ff700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe0ec06a0e0 0x7fe0ec06c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8000fd0 tx=0x7fe0f8009040 comp rx=0 tx=0).stop 2023-08-25T04:47:15.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.912+0000 7fe1103ff700 1 -- 172.21.15.72:0/3484000613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 msgr2=0x7fe1080c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:15.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.912+0000 7fe1103ff700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 0x7fe1080c6c10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe104004000 tx=0x7fe1040012d0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.912+0000 7fe1103ff700 1 -- 172.21.15.72:0/3484000613 shutdown_connections 2023-08-25T04:47:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.912+0000 7fe1103ff700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe0ec06a0e0 0x7fe0ec06c5a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.912+0000 7fe1103ff700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1080c7770 0x7fe1080c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.912+0000 7fe1103ff700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f4003cb0 0x7fe1080c6c10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.912+0000 7fe1103ff700 1 --2- 172.21.15.72:0/3484000613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1081561c0 0x7fe1080b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.912+0000 7fe1103ff700 1 -- 172.21.15.72:0/3484000613 >> 172.21.15.72:0/3484000613 conn(0x7fe1080ceaa0 msgr2=0x7fe10806da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.913+0000 7fe1103ff700 1 -- 172.21.15.72:0/3484000613 shutdown_connections 2023-08-25T04:47:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:15.913+0000 7fe1103ff700 1 -- 172.21.15.72:0/3484000613 wait complete. 2023-08-25T04:47:15.915 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-25T04:47:15.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-08-25T04:47:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.133+0000 7fb9271ff700 1 Processor -- start 2023-08-25T04:47:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.134+0000 7fb9271ff700 1 -- start start 2023-08-25T04:47:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.135+0000 7fb9271ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb9200d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.135+0000 7fb9271ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb9200b5e80 0x7fb9200cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.135+0000 7fb9271ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9200d1fb0 con 0x7fb9200d2890 2023-08-25T04:47:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.135+0000 7fb9271ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92015d3e0 con 0x7fb9200b5e80 2023-08-25T04:47:16.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.135+0000 7fb9271ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb920160b80 con 0x7fb92015d000 2023-08-25T04:47:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.135+0000 7fb924f9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb9200d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.135+0000 7fb91ffff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb9200b5e80 0x7fb9200cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.135+0000 7fb92579c700 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb9200d2890 0x7fb9200b4900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:38850/0 (socket says 172.21.15.72:38850) 2023-08-25T04:47:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.135+0000 7fb924f9b700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb9200d2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:59050/0 (socket says 172.21.15.72:59050) 2023-08-25T04:47:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.135+0000 7fb92579c700 1 -- 172.21.15.72:0/3778747883 learned_addr learned my addr 172.21.15.72:0/3778747883 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.136+0000 7fb924f9b700 1 -- 172.21.15.72:0/3778747883 >> v2:172.21.15.137:3300/0 conn(0x7fb9200b5e80 msgr2=0x7fb9200cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.136+0000 7fb924f9b700 1 --2- 172.21.15.72:0/3778747883 >> v2:172.21.15.137:3300/0 conn(0x7fb9200b5e80 0x7fb9200cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.136+0000 7fb924f9b700 1 -- 172.21.15.72:0/3778747883 >> v1:172.21.15.137:6789/0 conn(0x7fb9200d2890 legacy=0x7fb9200b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.136+0000 7fb924f9b700 1 -- 172.21.15.72:0/3778747883 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb920160e60 con 0x7fb92015d000 2023-08-25T04:47:16.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.136+0000 7fb91f7fe700 1 -- 172.21.15.72:0/3778747883 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137645274 0 0) 0x7fb9200d1fb0 con 0x7fb9200d2890 2023-08-25T04:47:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.136+0000 7fb924f9b700 1 --2- 172.21.15.72:0/3778747883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb9200d2350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb914009840 tx=0x7fb914009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4808608a9bd41805 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.136+0000 7fb91f7fe700 1 -- 172.21.15.72:0/3778747883 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914011830 con 0x7fb92015d000 2023-08-25T04:47:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.137+0000 7fb91f7fe700 1 -- 172.21.15.72:0/3778747883 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb914011990 con 0x7fb92015d000 2023-08-25T04:47:16.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.137+0000 7fb91f7fe700 1 -- 172.21.15.72:0/3778747883 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914011d20 con 0x7fb92015d000 2023-08-25T04:47:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.137+0000 7fb9271ff700 1 -- 172.21.15.72:0/3778747883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 msgr2=0x7fb9200d2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.137+0000 7fb9271ff700 1 --2- 172.21.15.72:0/3778747883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb9200d2350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb914009840 tx=0x7fb914009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.137+0000 7fb9271ff700 1 -- 172.21.15.72:0/3778747883 shutdown_connections 2023-08-25T04:47:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.137+0000 7fb9271ff700 1 --2- 172.21.15.72:0/3778747883 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb9200d2350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.137+0000 7fb9271ff700 1 --2- 172.21.15.72:0/3778747883 >> v2:172.21.15.137:3300/0 conn(0x7fb9200b5e80 0x7fb9200cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.137+0000 7fb9271ff700 1 -- 172.21.15.72:0/3778747883 >> 172.21.15.72:0/3778747883 conn(0x7fb92006ba80 msgr2=0x7fb92006be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.137+0000 7fb9271ff700 1 -- 172.21.15.72:0/3778747883 shutdown_connections 2023-08-25T04:47:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.137+0000 7fb9271ff700 1 -- 172.21.15.72:0/3778747883 wait complete. 2023-08-25T04:47:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.139+0000 7fb9271ff700 1 Processor -- start 2023-08-25T04:47:16.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.139+0000 7fb9271ff700 1 -- start start 2023-08-25T04:47:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.140+0000 7fb9271ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9200b5e80 0x7fb92014d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.140+0000 7fb9271ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200d2890 0x7fb9200cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.140+0000 7fb9271ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb920159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.140+0000 7fb9271ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92014d730 con 0x7fb9200b5e80 2023-08-25T04:47:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.140+0000 7fb9271ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200cada0 con 0x7fb9200d2890 2023-08-25T04:47:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.140+0000 7fb9271ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200cb7d0 con 0x7fb92015d000 2023-08-25T04:47:16.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.140+0000 7fb924f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9200b5e80 0x7fb92014d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.140+0000 7fb924f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9200b5e80 0x7fb92014d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44606/0 (socket says 172.21.15.72:44606) 2023-08-25T04:47:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.140+0000 7fb924f9b700 1 -- 172.21.15.72:0/2923152076 learned_addr learned my addr 172.21.15.72:0/2923152076 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb92579c700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb920159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb91ffff700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200d2890 0x7fb9200cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb924f9b700 1 -- 172.21.15.72:0/2923152076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 msgr2=0x7fb920159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb924f9b700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb920159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb924f9b700 1 -- 172.21.15.72:0/2923152076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200d2890 msgr2=0x7fb9200cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb924f9b700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200d2890 0x7fb9200cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb924f9b700 1 -- 172.21.15.72:0/2923152076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9140094a0 con 0x7fb9200b5e80 2023-08-25T04:47:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb92579c700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb920159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb91ffff700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200d2890 0x7fb9200cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb924f9b700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9200b5e80 0x7fb92014d1f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb914014040 tx=0x7fb914004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.141+0000 7fb91d7fa700 1 -- 172.21.15.72:0/2923152076 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9140038a0 con 0x7fb9200b5e80 2023-08-25T04:47:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.142+0000 7fb91d7fa700 1 -- 172.21.15.72:0/2923152076 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91401f070 con 0x7fb9200b5e80 2023-08-25T04:47:16.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.142+0000 7fb91d7fa700 1 -- 172.21.15.72:0/2923152076 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914003c40 con 0x7fb9200b5e80 2023-08-25T04:47:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.142+0000 7fb9271ff700 1 -- 172.21.15.72:0/2923152076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9200cbab0 con 0x7fb9200b5e80 2023-08-25T04:47:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.142+0000 7fb9271ff700 1 -- 172.21.15.72:0/2923152076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9200cc070 con 0x7fb9200b5e80 2023-08-25T04:47:16.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.143+0000 7fb9271ff700 1 -- 172.21.15.72:0/2923152076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92004e690 con 0x7fb9200b5e80 2023-08-25T04:47:16.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.143+0000 7fb91d7fa700 1 -- 172.21.15.72:0/2923152076 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb914026480 con 0x7fb9200b5e80 2023-08-25T04:47:16.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.145+0000 7fb91d7fa700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb90406a0e0 0x7fb90406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:16.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.145+0000 7fb91d7fa700 1 -- 172.21.15.72:0/2923152076 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fb914021070 con 0x7fb9200b5e80 2023-08-25T04:47:16.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.145+0000 7fb91ffff700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb90406a0e0 0x7fb90406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:16.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.146+0000 7fb91ffff700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb90406a0e0 0x7fb90406c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb9200b55d0 tx=0x7fb90c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:16.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.149+0000 7fb91d7fa700 1 -- 172.21.15.72:0/2923152076 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb9140551f0 con 0x7fb9200b5e80 2023-08-25T04:47:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.345+0000 7fb9271ff700 1 -- 172.21.15.72:0/2923152076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9200cfcf0 con 0x7fb9200b5e80 2023-08-25T04:47:16.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.918+0000 7fb91d7fa700 1 -- 172.21.15.72:0/2923152076 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fb914015070 con 0x7fb9200b5e80 2023-08-25T04:47:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.923+0000 7fb9271ff700 1 -- 172.21.15.72:0/2923152076 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb90406a0e0 msgr2=0x7fb90406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.923+0000 7fb9271ff700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb90406a0e0 0x7fb90406c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb9200b55d0 tx=0x7fb90c008040 comp rx=0 tx=0).stop 2023-08-25T04:47:16.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.923+0000 7fb9271ff700 1 -- 172.21.15.72:0/2923152076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9200b5e80 msgr2=0x7fb92014d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.923+0000 7fb9271ff700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9200b5e80 0x7fb92014d1f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb914014040 tx=0x7fb914004750 comp rx=0 tx=0).stop 2023-08-25T04:47:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.924+0000 7fb9271ff700 1 -- 172.21.15.72:0/2923152076 shutdown_connections 2023-08-25T04:47:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.924+0000 7fb9271ff700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fb90406a0e0 0x7fb90406c5a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.924+0000 7fb9271ff700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92015d000 0x7fb920159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.924+0000 7fb9271ff700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9200b5e80 0x7fb92014d1f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.924+0000 7fb9271ff700 1 --2- 172.21.15.72:0/2923152076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200d2890 0x7fb9200cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:16.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.924+0000 7fb9271ff700 1 -- 172.21.15.72:0/2923152076 >> 172.21.15.72:0/2923152076 conn(0x7fb92006ba80 msgr2=0x7fb92015bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:16.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.925+0000 7fb9271ff700 1 -- 172.21.15.72:0/2923152076 shutdown_connections 2023-08-25T04:47:16.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:16.925+0000 7fb9271ff700 1 -- 172.21.15.72:0/2923152076 wait complete. 2023-08-25T04:47:16.928 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' removed 2023-08-25T04:47:16.948 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:47:16.948 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T04:47:16.948 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T04:47:16.949 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:16.949 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:47:16.949 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T04:47:16.949 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T04:47:16.949 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:16.950 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:47:16.950 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T04:47:16.950 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T04:47:16.950 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:16.951 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:47:16.951 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T04:47:16.951 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T04:47:16.951 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:47:16.962 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T04:47:16.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:47:16.964 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T04:47:16.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:47:16.971 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T04:47:16.971 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:47:16.972 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T04:47:16.972 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:47:17.007 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:47:17.008 DEBUG:teuthology.parallel:result is None 2023-08-25T04:47:17.011 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:47:17.011 DEBUG:teuthology.parallel:result is None 2023-08-25T04:47:17.016 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:47:17.016 DEBUG:teuthology.parallel:result is None 2023-08-25T04:47:17.019 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:47:17.019 DEBUG:teuthology.parallel:result is None 2023-08-25T04:47:17.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T04:47:17.166 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-25T04:47:17.167 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-25T04:47:17.183 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2023-08-25T04:47:17.184 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2023-08-25T04:47:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.231+0000 7f7b3b3ff700 1 Processor -- start 2023-08-25T04:47:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.232+0000 7f7b3b3ff700 1 -- start start 2023-08-25T04:47:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.233+0000 7f7b3b3ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7b34160710 0x7f7b340b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.233+0000 7f7b3b3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b340b4c80 0x7f7b340b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.233+0000 7f7b3b3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b340b7400 con 0x7f7b340b4800 2023-08-25T04:47:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.233+0000 7f7b3b3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b340b8d30 con 0x7f7b340b4c80 2023-08-25T04:47:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.233+0000 7f7b3b3ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b340b5110 con 0x7f7b34160710 2023-08-25T04:47:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.233+0000 7f7b3999c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b340b4c80 0x7f7b340b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.233+0000 7f7b3899a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7b340b4800 0x7f7b340d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57088/0 (socket says 172.21.15.72:57088) 2023-08-25T04:47:17.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.233+0000 7f7b3899a700 1 -- 172.21.15.72:0/2094237271 learned_addr learned my addr 172.21.15.72:0/2094237271 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:17.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.233+0000 7f7b3919b700 1 --2- 172.21.15.72:0/2094237271 >> v2:172.21.15.137:3300/0 conn(0x7f7b34160710 0x7f7b340b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.234+0000 7f7b3999c700 1 -- 172.21.15.72:0/2094237271 >> v2:172.21.15.137:3300/0 conn(0x7f7b34160710 msgr2=0x7f7b340b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:17.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.234+0000 7f7b3999c700 1 --2- 172.21.15.72:0/2094237271 >> v2:172.21.15.137:3300/0 conn(0x7f7b34160710 0x7f7b340b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.234+0000 7f7b3999c700 1 -- 172.21.15.72:0/2094237271 >> v1:172.21.15.72:6789/0 conn(0x7f7b340b4800 legacy=0x7f7b340d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.234+0000 7f7b3999c700 1 -- 172.21.15.72:0/2094237271 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b340b7650 con 0x7f7b340b4c80 2023-08-25T04:47:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.234+0000 7f7b3999c700 1 --2- 172.21.15.72:0/2094237271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 0x7f7b340b6ec0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7b340cd5d0 tx=0x7f7b2c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14768d3894891279 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.234+0000 7f7b2bfff700 1 -- 172.21.15.72:0/2094237271 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c011830 con 0x7f7b340b4c80 2023-08-25T04:47:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.234+0000 7f7b2bfff700 1 -- 172.21.15.72:0/2094237271 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c011990 con 0x7f7b340b4c80 2023-08-25T04:47:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.234+0000 7f7b2bfff700 1 -- 172.21.15.72:0/2094237271 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c011d20 con 0x7f7b340b4c80 2023-08-25T04:47:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.235+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/2094237271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 msgr2=0x7f7b340b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.235+0000 7f7b3b3ff700 1 --2- 172.21.15.72:0/2094237271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 0x7f7b340b6ec0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7b340cd5d0 tx=0x7f7b2c009b20 comp rx=0 tx=0).stop 2023-08-25T04:47:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.235+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/2094237271 shutdown_connections 2023-08-25T04:47:17.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.235+0000 7f7b3b3ff700 1 --2- 172.21.15.72:0/2094237271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 0x7f7b340b6ec0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.235+0000 7f7b3b3ff700 1 --2- 172.21.15.72:0/2094237271 >> v2:172.21.15.137:3300/0 conn(0x7f7b34160710 0x7f7b340b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.235+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/2094237271 >> 172.21.15.72:0/2094237271 conn(0x7f7b34071e40 msgr2=0x7f7b34072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:17.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.235+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/2094237271 shutdown_connections 2023-08-25T04:47:17.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.235+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/2094237271 wait complete. 2023-08-25T04:47:17.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.237+0000 7f7b3b3ff700 1 Processor -- start 2023-08-25T04:47:17.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.237+0000 7f7b3b3ff700 1 -- start start 2023-08-25T04:47:17.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3b3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b340b4800 0x7f7b340cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3b3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 0x7f7b3415a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3b3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b34160710 0x7f7b341e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3b3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341e5e50 con 0x7f7b340b4c80 2023-08-25T04:47:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3b3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341ea2f0 con 0x7f7b34160710 2023-08-25T04:47:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3b3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341ea5d0 con 0x7f7b340b4800 2023-08-25T04:47:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3899a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 0x7f7b3415a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3899a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 0x7f7b3415a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44666/0 (socket says 172.21.15.72:44666) 2023-08-25T04:47:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3899a700 1 -- 172.21.15.72:0/705078175 learned_addr learned my addr 172.21.15.72:0/705078175 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3999c700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b34160710 0x7f7b341e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3919b700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b340b4800 0x7f7b340cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3899a700 1 -- 172.21.15.72:0/705078175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b340b4800 msgr2=0x7f7b340cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3899a700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b340b4800 0x7f7b340cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3899a700 1 -- 172.21.15.72:0/705078175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b34160710 msgr2=0x7f7b341e92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3899a700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b34160710 0x7f7b341e92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3899a700 1 -- 172.21.15.72:0/705078175 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c0094a0 con 0x7f7b340b4c80 2023-08-25T04:47:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.238+0000 7f7b3919b700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b340b4800 0x7f7b340cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.239+0000 7f7b3899a700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 0x7f7b3415a200 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400c480 tx=0x7f7b2400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:17.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.239+0000 7f7b29ffb700 1 -- 172.21.15.72:0/705078175 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24005d70 con 0x7f7b340b4c80 2023-08-25T04:47:17.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.239+0000 7f7b29ffb700 1 -- 172.21.15.72:0/705078175 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240070d0 con 0x7f7b340b4c80 2023-08-25T04:47:17.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.239+0000 7f7b29ffb700 1 -- 172.21.15.72:0/705078175 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24007440 con 0x7f7b340b4c80 2023-08-25T04:47:17.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.239+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/705078175 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b341e5800 con 0x7f7b340b4c80 2023-08-25T04:47:17.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.239+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/705078175 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3415a740 con 0x7f7b340b4c80 2023-08-25T04:47:17.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.240+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/705078175 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3408a000 con 0x7f7b340b4c80 2023-08-25T04:47:17.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.241+0000 7f7b29ffb700 1 -- 172.21.15.72:0/705078175 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b240075a0 con 0x7f7b340b4c80 2023-08-25T04:47:17.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.242+0000 7f7b29ffb700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b1806a0e0 0x7f7b1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:17.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.242+0000 7f7b29ffb700 1 -- 172.21.15.72:0/705078175 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7b24087640 con 0x7f7b340b4c80 2023-08-25T04:47:17.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.242+0000 7f7b3919b700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b1806a0e0 0x7f7b1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:17.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.243+0000 7f7b3919b700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b1806a0e0 0x7f7b1806c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009f50 tx=0x7f7b3000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:17.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.246+0000 7f7b29ffb700 1 -- 172.21.15.72:0/705078175 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7b24053060 con 0x7f7b340b4c80 2023-08-25T04:47:17.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:17.458+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/705078175 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7b341e5f90 con 0x7f7b340b4c80 2023-08-25T04:47:18.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.478+0000 7f7b29ffb700 1 -- 172.21.15.72:0/705078175 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7b24056680 con 0x7f7b340b4c80 2023-08-25T04:47:18.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.481+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/705078175 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b1806a0e0 msgr2=0x7f7b1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:18.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.481+0000 7f7b3b3ff700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b1806a0e0 0x7f7b1806c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009f50 tx=0x7f7b3000b040 comp rx=0 tx=0).stop 2023-08-25T04:47:18.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.481+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/705078175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 msgr2=0x7f7b3415a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:18.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.481+0000 7f7b3b3ff700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 0x7f7b3415a200 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400c480 tx=0x7f7b2400c790 comp rx=0 tx=0).stop 2023-08-25T04:47:18.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.482+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/705078175 shutdown_connections 2023-08-25T04:47:18.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.482+0000 7f7b3b3ff700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7b1806a0e0 0x7f7b1806c5a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.482+0000 7f7b3b3ff700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b34160710 0x7f7b341e92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.482+0000 7f7b3b3ff700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b340b4800 0x7f7b340cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.482+0000 7f7b3b3ff700 1 --2- 172.21.15.72:0/705078175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b340b4c80 0x7f7b3415a200 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.482+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/705078175 >> 172.21.15.72:0/705078175 conn(0x7f7b34071e40 msgr2=0x7f7b340b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:18.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.482+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/705078175 shutdown_connections 2023-08-25T04:47:18.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.482+0000 7f7b3b3ff700 1 -- 172.21.15.72:0/705078175 wait complete. 2023-08-25T04:47:18.484 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-25T04:47:18.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T04:47:18.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.701+0000 7f91149ff700 1 Processor -- start 2023-08-25T04:47:18.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.701+0000 7f91149ff700 1 -- start start 2023-08-25T04:47:18.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.702+0000 7f91149ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91100d0520 0x7f91100d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:18.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.702+0000 7f91149ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91100d2ba0 0x7f91100b6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:18.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f91149ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91100b5f70 con 0x7f911015d110 2023-08-25T04:47:18.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f91149ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91100d3430 con 0x7f91100d0520 2023-08-25T04:47:18.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f91149ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91100d3710 con 0x7f91100d2ba0 2023-08-25T04:47:18.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f910e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f911015d110 0x7f91100cfe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57090/0 (socket says 172.21.15.72:57090) 2023-08-25T04:47:18.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f910e59c700 1 -- 172.21.15.72:0/4061078323 learned_addr learned my addr 172.21.15.72:0/4061078323 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:18.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f910dd9b700 1 --2- 172.21.15.72:0/4061078323 >> v2:172.21.15.72:3300/0 conn(0x7f91100d0520 0x7f91100d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f910ed9d700 1 --2- 172.21.15.72:0/4061078323 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91100d2ba0 0x7f91100b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f910d59a700 1 -- 172.21.15.72:0/4061078323 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367627774 0 0) 0x7f91100b5f70 con 0x7f911015d110 2023-08-25T04:47:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f910d59a700 1 -- 172.21.15.72:0/4061078323 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f80035b0 con 0x7f911015d110 2023-08-25T04:47:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f910dd9b700 1 -- 172.21.15.72:0/4061078323 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91100d2ba0 msgr2=0x7f91100b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f910dd9b700 1 --2- 172.21.15.72:0/4061078323 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91100d2ba0 0x7f91100b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f910dd9b700 1 -- 172.21.15.72:0/4061078323 >> v1:172.21.15.72:6789/0 conn(0x7f911015d110 legacy=0x7f91100cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.703+0000 7f910dd9b700 1 -- 172.21.15.72:0/4061078323 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91100d39f0 con 0x7f91100d0520 2023-08-25T04:47:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f910dd9b700 1 --2- 172.21.15.72:0/4061078323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91100d0520 0x7f91100d2660 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9104009840 tx=0x7f9104009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26564e9f3f6b46a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f910d59a700 1 -- 172.21.15.72:0/4061078323 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104011830 con 0x7f91100d0520 2023-08-25T04:47:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f910d59a700 1 -- 172.21.15.72:0/4061078323 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9104011990 con 0x7f91100d0520 2023-08-25T04:47:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f910d59a700 1 -- 172.21.15.72:0/4061078323 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104011d20 con 0x7f91100d0520 2023-08-25T04:47:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f91149ff700 1 -- 172.21.15.72:0/4061078323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91100d0520 msgr2=0x7f91100d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f91149ff700 1 --2- 172.21.15.72:0/4061078323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91100d0520 0x7f91100d2660 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9104009840 tx=0x7f9104009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:18.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f91149ff700 1 -- 172.21.15.72:0/4061078323 shutdown_connections 2023-08-25T04:47:18.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f91149ff700 1 --2- 172.21.15.72:0/4061078323 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91100d2ba0 0x7f91100b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f91149ff700 1 --2- 172.21.15.72:0/4061078323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91100d0520 0x7f91100d2660 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f91149ff700 1 -- 172.21.15.72:0/4061078323 >> 172.21.15.72:0/4061078323 conn(0x7f9110071c00 msgr2=0x7f9110071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:18.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.704+0000 7f91149ff700 1 -- 172.21.15.72:0/4061078323 shutdown_connections 2023-08-25T04:47:18.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.705+0000 7f91149ff700 1 -- 172.21.15.72:0/4061078323 wait complete. 2023-08-25T04:47:18.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.707+0000 7f91149ff700 1 Processor -- start 2023-08-25T04:47:18.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.707+0000 7f91149ff700 1 -- start start 2023-08-25T04:47:18.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.708+0000 7f91149ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91100d0520 0x7f91101f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.708+0000 7f91149ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91100d2ba0 0x7f91100c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.708+0000 7f91149ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f911015d110 0x7f91101583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.708+0000 7f91149ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100c7990 con 0x7f911015d110 2023-08-25T04:47:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.708+0000 7f91149ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91101f3260 con 0x7f91100d0520 2023-08-25T04:47:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.708+0000 7f91149ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91100c84d0 con 0x7f91100d2ba0 2023-08-25T04:47:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f911015d110 0x7f91101583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:18.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f911015d110 0x7f91101583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44688/0 (socket says 172.21.15.72:44688) 2023-08-25T04:47:18.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910ed9d700 1 -- 172.21.15.72:0/3042629311 learned_addr learned my addr 172.21.15.72:0/3042629311 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:18.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910dd9b700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91100d2ba0 0x7f91100c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910e59c700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91100d0520 0x7f91101f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910ed9d700 1 -- 172.21.15.72:0/3042629311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91100d2ba0 msgr2=0x7f91100c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910ed9d700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91100d2ba0 0x7f91100c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910ed9d700 1 -- 172.21.15.72:0/3042629311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91100d0520 msgr2=0x7f91101f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910ed9d700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91100d0520 0x7f91101f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:18.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910ed9d700 1 -- 172.21.15.72:0/3042629311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91040094a0 con 0x7f911015d110 2023-08-25T04:47:18.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910e59c700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91100d0520 0x7f91101f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:18.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f910ed9d700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f911015d110 0x7f91101583a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f910800efc0 tx=0x7f910800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:18.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f90feffd700 1 -- 172.21.15.72:0/3042629311 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108009ea0 con 0x7f911015d110 2023-08-25T04:47:18.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f90feffd700 1 -- 172.21.15.72:0/3042629311 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910800f040 con 0x7f911015d110 2023-08-25T04:47:18.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f91149ff700 1 -- 172.21.15.72:0/3042629311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91100c87b0 con 0x7f911015d110 2023-08-25T04:47:18.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.709+0000 7f90feffd700 1 -- 172.21.15.72:0/3042629311 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108014480 con 0x7f911015d110 2023-08-25T04:47:18.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.710+0000 7f91149ff700 1 -- 172.21.15.72:0/3042629311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91100c8d70 con 0x7f911015d110 2023-08-25T04:47:18.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.711+0000 7f91149ff700 1 -- 172.21.15.72:0/3042629311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91100676b0 con 0x7f911015d110 2023-08-25T04:47:18.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.711+0000 7f90feffd700 1 -- 172.21.15.72:0/3042629311 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f91080145e0 con 0x7f911015d110 2023-08-25T04:47:18.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.712+0000 7f90feffd700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f90f006a0e0 0x7f90f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:18.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.712+0000 7f90feffd700 1 -- 172.21.15.72:0/3042629311 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9108088e50 con 0x7f911015d110 2023-08-25T04:47:18.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.713+0000 7f910e59c700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f90f006a0e0 0x7f90f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:18.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.713+0000 7f910e59c700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f90f006a0e0 0x7f90f006c5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f91000011e0 tx=0x7f9100009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:18.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.717+0000 7f90feffd700 1 -- 172.21.15.72:0/3042629311 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f91080547c0 con 0x7f911015d110 2023-08-25T04:47:18.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.990+0000 7f91149ff700 1 -- 172.21.15.72:0/3042629311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f911006d1d0 con 0x7f911015d110 2023-08-25T04:47:18.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.990+0000 7f90feffd700 1 -- 172.21.15.72:0/3042629311 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f9108018090 con 0x7f911015d110 2023-08-25T04:47:18.992 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:18.992 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-25T04:47:18.992 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-25T04:47:18.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:18.992 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-25T04:47:18.992 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCyMehkfbVIFxAAWWNregS9iZvkpvOEDJ4TEw==", 2023-08-25T04:47:18.993 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:18.993 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-25T04:47:18.993 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-25T04:47:18.993 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-25T04:47:18.993 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:18.993 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:18.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:18.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:18.994 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-25T04:47:18.994 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCyMehkKnVmLxAA9HDj0N7GKb4iXGDuuO5v4Q==", 2023-08-25T04:47:18.994 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:18.994 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-25T04:47:18.994 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-25T04:47:18.994 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-25T04:47:18.994 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:18.995 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:18.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:18.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:18.995 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-25T04:47:18.995 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCyMehkXRBdIxAA7v1mR2qJDWv2dOr0809k5w==", 2023-08-25T04:47:18.995 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:18.995 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-25T04:47:18.995 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-25T04:47:18.996 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-25T04:47:18.996 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:18.996 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:18.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:18.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:18.996 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-25T04:47:18.996 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCyMehk9D5MOxAAd7zkt5YLn4XGWrCNpPTytA==", 2023-08-25T04:47:18.997 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:18.997 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-25T04:47:18.997 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-25T04:47:18.997 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-25T04:47:18.997 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:18.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:18.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:18.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:18.998 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-25T04:47:18.998 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQC3MehkeowxGBAAdfLfv49cradHQgBwjB3p2A==", 2023-08-25T04:47:18.998 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:18.998 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-25T04:47:18.998 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-25T04:47:18.998 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:18.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:18.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:18.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:18.999 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-25T04:47:18.999 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQC6MehkIfE+HBAALDhHjxDLI+phk4hmktQsIQ==", 2023-08-25T04:47:18.999 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:18.999 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-25T04:47:18.999 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-25T04:47:18.999 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:18.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.000 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-25T04:47:19.000 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQC9MehkYbYHLxAA9TV5t8cF/uJ2YpXnfLHivA==", 2023-08-25T04:47:19.000 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.000 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-25T04:47:19.000 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-25T04:47:19.001 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:19.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.001 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-25T04:47:19.001 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDAMehkPu2BMhAAIq21LrF4iC884d1S+lVOwA==", 2023-08-25T04:47:19.001 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.001 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-25T04:47:19.002 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-25T04:47:19.002 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:19.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.002 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-25T04:47:19.002 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDHMehkE35KDBAAUrpHvzydL16wxT9piuE+Ig==", 2023-08-25T04:47:19.002 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.003 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-25T04:47:19.003 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-25T04:47:19.003 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:19.003 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.003 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-25T04:47:19.003 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDKMehkRXWLDxAAGATWxMXtkSttsOo4RSXPeg==", 2023-08-25T04:47:19.004 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.004 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-25T04:47:19.004 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-25T04:47:19.004 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:19.004 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.004 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-25T04:47:19.005 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDNMehkRKZYEhAAZroscH7VwD5hZ5OW/ZNGxg==", 2023-08-25T04:47:19.005 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.005 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-25T04:47:19.005 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-25T04:47:19.005 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:19.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.006 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-25T04:47:19.006 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDQMehkYSOOFRAAVQFCeof4ei6MKtxDrLQvJg==", 2023-08-25T04:47:19.006 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.006 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-25T04:47:19.006 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-25T04:47:19.006 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:19.006 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.007 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-25T04:47:19.007 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCzMehkm9HlCRAAFQVBmTswDkoqPJVY2o1K/Q==", 2023-08-25T04:47:19.007 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.007 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-25T04:47:19.007 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-25T04:47:19.007 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-25T04:47:19.008 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-25T04:47:19.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.008 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-25T04:47:19.008 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCzMehkmZg+GRAASPWJw08ad+UzjwJxHQU30Q==", 2023-08-25T04:47:19.008 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.008 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-25T04:47:19.009 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-25T04:47:19.009 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-25T04:47:19.009 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-25T04:47:19.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.009 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-25T04:47:19.009 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCzMehkzhasERAA8er45ZkwFgFagQLriDI2Xg==", 2023-08-25T04:47:19.010 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.010 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-25T04:47:19.010 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-25T04:47:19.010 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-25T04:47:19.010 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-25T04:47:19.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.011 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-25T04:47:19.011 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCzMehk8IHCIBAAPsuQzLkEO9aZwYq4KDZxyg==", 2023-08-25T04:47:19.011 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.011 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-25T04:47:19.011 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-25T04:47:19.011 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-25T04:47:19.011 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-25T04:47:19.011 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.012 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-25T04:47:19.012 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCxMehkki/bGhAA7AACokUqOL3tz75ZHgWgtA==", 2023-08-25T04:47:19.012 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.012 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-25T04:47:19.012 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-25T04:47:19.013 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-25T04:47:19.013 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:19.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.013 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mds", 2023-08-25T04:47:19.013 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDYMehkIA0UJhAAAHMLjLRPJEgL22sJRRNVdw==", 2023-08-25T04:47:19.013 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.014 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mds" 2023-08-25T04:47:19.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.014 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mgr", 2023-08-25T04:47:19.014 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDYMehkdBgUJhAAo62RqUCsurjQU14+5F0ZwQ==", 2023-08-25T04:47:19.014 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.014 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-25T04:47:19.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.015 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-osd", 2023-08-25T04:47:19.015 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDYMehkHyEUJhAAOdlWSVIZH3yRWmNi96ufCA==", 2023-08-25T04:47:19.015 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.015 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-osd" 2023-08-25T04:47:19.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.016 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd", 2023-08-25T04:47:19.016 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDYMehkZikUJhAA5utKC6L11IXHAQ8AN2gaXQ==", 2023-08-25T04:47:19.016 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-25T04:47:19.016 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.017 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-25T04:47:19.017 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDYMehkrDEUJhAANUH3rgFjnRxJNe8ttezzdA==", 2023-08-25T04:47:19.017 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.017 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-25T04:47:19.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.018 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rgw", 2023-08-25T04:47:19.018 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDYMehkNDoUJhAALN1dT12UB0D2y8TSQIWrCg==", 2023-08-25T04:47:19.018 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.018 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-25T04:47:19.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.019 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-25T04:47:19.019 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCyMehk33RZDxAABIj8EsUDjqm4wtepBsiUmw==", 2023-08-25T04:47:19.019 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.019 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-25T04:47:19.019 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-25T04:47:19.019 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:19.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:19.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:19.020 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-25T04:47:19.020 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCyMehkClVvBxAA44K6j5FqscADcuhreEKghw==", 2023-08-25T04:47:19.020 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-25T04:47:19.020 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-25T04:47:19.020 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-25T04:47:19.020 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-25T04:47:19.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:19.021 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-25T04:47:19.021 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-25T04:47:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 -- 172.21.15.72:0/3042629311 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f90f006a0e0 msgr2=0x7f90f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f90f006a0e0 0x7f90f006c5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f91000011e0 tx=0x7f9100009040 comp rx=0 tx=0).stop 2023-08-25T04:47:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 -- 172.21.15.72:0/3042629311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f911015d110 msgr2=0x7f91101583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f911015d110 0x7f91101583a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f910800efc0 tx=0x7f910800c3a0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 -- 172.21.15.72:0/3042629311 shutdown_connections 2023-08-25T04:47:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f90f006a0e0 0x7f90f006c5a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f911015d110 0x7f91101583a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91100d0520 0x7f91101f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 --2- 172.21.15.72:0/3042629311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91100d2ba0 0x7f91100c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 -- 172.21.15.72:0/3042629311 >> 172.21.15.72:0/3042629311 conn(0x7f9110071c00 msgr2=0x7f91100b6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 -- 172.21.15.72:0/3042629311 shutdown_connections 2023-08-25T04:47:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:18.993+0000 7f91149ff700 1 -- 172.21.15.72:0/3042629311 wait complete. 2023-08-25T04:47:19.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-25T04:47:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.220+0000 7fdf6d9ff700 1 Processor -- start 2023-08-25T04:47:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.221+0000 7fdf6d9ff700 1 -- start start 2023-08-25T04:47:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.222+0000 7fdf6d9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf68160710 0x7fdf680b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.222+0000 7fdf6d9ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdf680b4c80 0x7fdf680b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.222+0000 7fdf6d9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf680b7400 con 0x7fdf680b4800 2023-08-25T04:47:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.222+0000 7fdf6d9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf680b8d30 con 0x7fdf68160710 2023-08-25T04:47:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.222+0000 7fdf6d9ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf680b5110 con 0x7fdf680b4c80 2023-08-25T04:47:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.222+0000 7fdf66ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf68160710 0x7fdf680b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.222+0000 7fdf5ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdf680b4800 0x7fdf680d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57104/0 (socket says 172.21.15.72:57104) 2023-08-25T04:47:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.222+0000 7fdf66ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf68160710 0x7fdf680b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44692/0 (socket says 172.21.15.72:44692) 2023-08-25T04:47:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.222+0000 7fdf5ffff700 1 -- 172.21.15.72:0/2607948237 learned_addr learned my addr 172.21.15.72:0/2607948237 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf66ffd700 1 -- 172.21.15.72:0/2607948237 >> v2:172.21.15.137:3300/0 conn(0x7fdf680b4c80 msgr2=0x7fdf680b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf677fe700 1 --2- 172.21.15.72:0/2607948237 >> v2:172.21.15.137:3300/0 conn(0x7fdf680b4c80 0x7fdf680b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf66ffd700 1 --2- 172.21.15.72:0/2607948237 >> v2:172.21.15.137:3300/0 conn(0x7fdf680b4c80 0x7fdf680b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf66ffd700 1 -- 172.21.15.72:0/2607948237 >> v1:172.21.15.72:6789/0 conn(0x7fdf680b4800 legacy=0x7fdf680d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf66ffd700 1 -- 172.21.15.72:0/2607948237 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf680b7650 con 0x7fdf68160710 2023-08-25T04:47:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf667fc700 1 -- 172.21.15.72:0/2607948237 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513670066 0 0) 0x7fdf680b7400 con 0x7fdf680b4800 2023-08-25T04:47:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf677fe700 1 --2- 172.21.15.72:0/2607948237 >> v2:172.21.15.137:3300/0 conn(0x7fdf680b4c80 0x7fdf680b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf66ffd700 1 --2- 172.21.15.72:0/2607948237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf68160710 0x7fdf680b87f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdf680cd460 tx=0x7fdf58009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b941778e8d1d45e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf667fc700 1 -- 172.21.15.72:0/2607948237 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58011830 con 0x7fdf68160710 2023-08-25T04:47:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf667fc700 1 -- 172.21.15.72:0/2607948237 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf58011990 con 0x7fdf68160710 2023-08-25T04:47:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.223+0000 7fdf667fc700 1 -- 172.21.15.72:0/2607948237 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58011d20 con 0x7fdf68160710 2023-08-25T04:47:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.224+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/2607948237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf68160710 msgr2=0x7fdf680b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.224+0000 7fdf6d9ff700 1 --2- 172.21.15.72:0/2607948237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf68160710 0x7fdf680b87f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdf680cd460 tx=0x7fdf58009b20 comp rx=0 tx=0).stop 2023-08-25T04:47:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.224+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/2607948237 shutdown_connections 2023-08-25T04:47:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.224+0000 7fdf6d9ff700 1 --2- 172.21.15.72:0/2607948237 >> v2:172.21.15.137:3300/0 conn(0x7fdf680b4c80 0x7fdf680b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.224+0000 7fdf6d9ff700 1 --2- 172.21.15.72:0/2607948237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf68160710 0x7fdf680b87f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.224+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/2607948237 >> 172.21.15.72:0/2607948237 conn(0x7fdf68071e40 msgr2=0x7fdf68072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.224+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/2607948237 shutdown_connections 2023-08-25T04:47:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.224+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/2607948237 wait complete. 2023-08-25T04:47:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.226+0000 7fdf6d9ff700 1 Processor -- start 2023-08-25T04:47:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.226+0000 7fdf6d9ff700 1 -- start start 2023-08-25T04:47:19.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf6d9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf680b4800 0x7fdf681567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf6d9ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf680b4c80 0x7fdf68152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf6d9ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf68160710 0x7fdf680cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf6d9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf68152b50 con 0x7fdf680b4800 2023-08-25T04:47:19.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf6d9ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680cacc0 con 0x7fdf680b4c80 2023-08-25T04:47:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf6d9ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680caf30 con 0x7fdf68160710 2023-08-25T04:47:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf66ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf680b4800 0x7fdf681567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf66ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf680b4800 0x7fdf681567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44708/0 (socket says 172.21.15.72:44708) 2023-08-25T04:47:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf66ffd700 1 -- 172.21.15.72:0/1758982401 learned_addr learned my addr 172.21.15.72:0/1758982401 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf66ffd700 1 -- 172.21.15.72:0/1758982401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf68160710 msgr2=0x7fdf680cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf5ffff700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf680b4c80 0x7fdf68152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf66ffd700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf68160710 0x7fdf680cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf66ffd700 1 -- 172.21.15.72:0/1758982401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf680b4c80 msgr2=0x7fdf68152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf66ffd700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf680b4c80 0x7fdf68152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf66ffd700 1 -- 172.21.15.72:0/1758982401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf580094a0 con 0x7fdf680b4800 2023-08-25T04:47:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.227+0000 7fdf5ffff700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf680b4c80 0x7fdf68152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.228+0000 7fdf66ffd700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf680b4800 0x7fdf681567c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdf58014040 tx=0x7fdf58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.228+0000 7fdf64ff9700 1 -- 172.21.15.72:0/1758982401 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580038a0 con 0x7fdf680b4800 2023-08-25T04:47:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.228+0000 7fdf64ff9700 1 -- 172.21.15.72:0/1758982401 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5801e070 con 0x7fdf680b4800 2023-08-25T04:47:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.228+0000 7fdf64ff9700 1 -- 172.21.15.72:0/1758982401 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58003c20 con 0x7fdf680b4800 2023-08-25T04:47:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.228+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/1758982401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf680cb210 con 0x7fdf680b4800 2023-08-25T04:47:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.228+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/1758982401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf68156da0 con 0x7fdf680b4800 2023-08-25T04:47:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.229+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/1758982401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6808a000 con 0x7fdf680b4800 2023-08-25T04:47:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.230+0000 7fdf64ff9700 1 -- 172.21.15.72:0/1758982401 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdf5802d450 con 0x7fdf680b4800 2023-08-25T04:47:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.231+0000 7fdf64ff9700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdf4806a0e0 0x7fdf4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.231+0000 7fdf64ff9700 1 -- 172.21.15.72:0/1758982401 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fdf580894b0 con 0x7fdf680b4800 2023-08-25T04:47:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.231+0000 7fdf5ffff700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdf4806a0e0 0x7fdf4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.232+0000 7fdf5ffff700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdf4806a0e0 0x7fdf4806c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf68154470 tx=0x7fdf50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:19.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.235+0000 7fdf64ff9700 1 -- 172.21.15.72:0/1758982401 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdf58054da0 con 0x7fdf680b4800 2023-08-25T04:47:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.508+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/1758982401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fdf680ce9c0 con 0x7fdf680b4800 2023-08-25T04:47:19.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.512+0000 7fdf64ff9700 1 -- 172.21.15.72:0/1758982401 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdf580583c0 con 0x7fdf680b4800 2023-08-25T04:47:19.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/1758982401 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdf4806a0e0 msgr2=0x7fdf4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdf4806a0e0 0x7fdf4806c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf68154470 tx=0x7fdf50009040 comp rx=0 tx=0).stop 2023-08-25T04:47:19.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/1758982401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf680b4800 msgr2=0x7fdf681567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf680b4800 0x7fdf681567c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdf58014040 tx=0x7fdf58004750 comp rx=0 tx=0).stop 2023-08-25T04:47:19.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/1758982401 shutdown_connections 2023-08-25T04:47:19.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdf4806a0e0 0x7fdf4806c5a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdf68160710 0x7fdf680cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf680b4800 0x7fdf681567c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 --2- 172.21.15.72:0/1758982401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf680b4c80 0x7fdf68152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/1758982401 >> 172.21.15.72:0/1758982401 conn(0x7fdf68071e40 msgr2=0x7fdf6815dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:19.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/1758982401 shutdown_connections 2023-08-25T04:47:19.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.515+0000 7fdf6d9ff700 1 -- 172.21.15.72:0/1758982401 wait complete. 2023-08-25T04:47:19.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-25T04:47:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.729+0000 7fe9de5ff700 1 Processor -- start 2023-08-25T04:47:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.729+0000 7fe9de5ff700 1 -- start start 2023-08-25T04:47:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.730+0000 7fe9de5ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe9d80d20f0 0x7fe9d80b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.730+0000 7fe9de5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d80b4d40 0x7fe9d80b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.730+0000 7fe9de5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d80b7650 con 0x7fe9d8160710 2023-08-25T04:47:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.730+0000 7fe9de5ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d80b51d0 con 0x7fe9d80d20f0 2023-08-25T04:47:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.730+0000 7fe9de5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80b7400 con 0x7fe9d80b4d40 2023-08-25T04:47:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe9d8160710 0x7fe9d80b87f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57106/0 (socket says 172.21.15.72:57106) 2023-08-25T04:47:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d7fff700 1 -- 172.21.15.72:0/98955869 learned_addr learned my addr 172.21.15.72:0/98955869 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019400672 0 0) 0x7fe9d80b7650 con 0x7fe9d8160710 2023-08-25T04:47:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9dcb9c700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d80b4d40 0x7fe9d80b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c00035b0 con 0x7fe9d8160710 2023-08-25T04:47:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d77fe700 1 --2- 172.21.15.72:0/98955869 >> v2:172.21.15.137:3300/0 conn(0x7fe9d80d20f0 0x7fe9d80b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3845404390 0 0) 0x7fe9c00035b0 con 0x7fe9d8160710 2023-08-25T04:47:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d80b4d40 msgr2=0x7fe9d80b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d6ffd700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d80b4d40 0x7fe9d80b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 >> v2:172.21.15.137:3300/0 conn(0x7fe9d80d20f0 msgr2=0x7fe9d80b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d6ffd700 1 --2- 172.21.15.72:0/98955869 >> v2:172.21.15.137:3300/0 conn(0x7fe9d80d20f0 0x7fe9d80b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d80b7930 con 0x7fe9d8160710 2023-08-25T04:47:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.731+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fe9c80019f0 con 0x7fe9d8160710 2023-08-25T04:47:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 >> v1:172.21.15.72:6789/0 conn(0x7fe9d8160710 legacy=0x7fe9d80b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9d6ffd700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9c0003a00 0x7fe9c0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9d6ffd700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d80b4d40 0x7fe9c0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9d6ffd700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 0x7fe9c0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80b51d0 con 0x7fe9c0004d90 2023-08-25T04:47:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80b7400 con 0x7fe9c0003a00 2023-08-25T04:47:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c000ba10 con 0x7fe9d80b4d40 2023-08-25T04:47:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9dcb9c700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 0x7fe9c0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9d7fff700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9c0003a00 0x7fe9c0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9d77fe700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d80b4d40 0x7fe9c0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9dcb9c700 1 -- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d80b4d40 msgr2=0x7fe9c0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9dcb9c700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d80b4d40 0x7fe9c0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9dcb9c700 1 -- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9c0003a00 msgr2=0x7fe9c0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9dcb9c700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9c0003a00 0x7fe9c0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.732+0000 7fe9dcb9c700 1 -- 172.21.15.72:0/98955869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00035b0 con 0x7fe9c0004d90 2023-08-25T04:47:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.733+0000 7fe9dcb9c700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 0x7fe9c0005210 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009b90 tx=0x7fe9c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffdd94b8594d191 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.733+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000e6c0 con 0x7fe9c0004d90 2023-08-25T04:47:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.733+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d000e820 con 0x7fe9c0004d90 2023-08-25T04:47:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.733+0000 7fe9d6ffd700 1 -- 172.21.15.72:0/98955869 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000eb90 con 0x7fe9c0004d90 2023-08-25T04:47:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.733+0000 7fe9de5ff700 1 -- 172.21.15.72:0/98955869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 msgr2=0x7fe9c0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.733+0000 7fe9de5ff700 1 --2- 172.21.15.72:0/98955869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 0x7fe9c0005210 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009b90 tx=0x7fe9c0005880 comp rx=0 tx=0).stop 2023-08-25T04:47:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.733+0000 7fe9dcb9c700 1 -- 172.21.15.72:0/98955869 reap_dead start 2023-08-25T04:47:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.733+0000 7fe9de5ff700 1 -- 172.21.15.72:0/98955869 shutdown_connections 2023-08-25T04:47:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.733+0000 7fe9de5ff700 1 -- 172.21.15.72:0/98955869 >> 172.21.15.72:0/98955869 conn(0x7fe9d8071e40 msgr2=0x7fe9d8072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.733+0000 7fe9de5ff700 1 -- 172.21.15.72:0/98955869 shutdown_connections 2023-08-25T04:47:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.734+0000 7fe9de5ff700 1 -- 172.21.15.72:0/98955869 wait complete. 2023-08-25T04:47:19.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.735+0000 7fe9de5ff700 1 Processor -- start 2023-08-25T04:47:19.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.735+0000 7fe9de5ff700 1 -- start start 2023-08-25T04:47:19.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.736+0000 7fe9de5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 0x7fe9d80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.736+0000 7fe9de5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d81f2a30 0x7fe9d806b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.736+0000 7fe9de5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d806bea0 0x7fe9d80c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.736+0000 7fe9de5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d8153e00 con 0x7fe9c0004d90 2023-08-25T04:47:19.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.736+0000 7fe9de5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d806c320 con 0x7fe9d806bea0 2023-08-25T04:47:19.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.736+0000 7fe9de5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81540a0 con 0x7fe9d81f2a30 2023-08-25T04:47:19.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 0x7fe9d80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 0x7fe9d80cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44722/0 (socket says 172.21.15.72:44722) 2023-08-25T04:47:19.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d7fff700 1 -- 172.21.15.72:0/1600310329 learned_addr learned my addr 172.21.15.72:0/1600310329 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:19.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d77fe700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d81f2a30 0x7fe9d806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9dcb9c700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d806bea0 0x7fe9d80c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d7fff700 1 -- 172.21.15.72:0/1600310329 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d81f2a30 msgr2=0x7fe9d806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d7fff700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d81f2a30 0x7fe9d806b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d7fff700 1 -- 172.21.15.72:0/1600310329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d806bea0 msgr2=0x7fe9d80c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d7fff700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d806bea0 0x7fe9d80c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d7fff700 1 -- 172.21.15.72:0/1600310329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d81f3280 con 0x7fe9c0004d90 2023-08-25T04:47:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9dcb9c700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d806bea0 0x7fe9d80c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d7fff700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 0x7fe9d80cc8d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8001330 tx=0x7fe9c800a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:19.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d4ff9700 1 -- 172.21.15.72:0/1600310329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80133f0 con 0x7fe9c0004d90 2023-08-25T04:47:19.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d4ff9700 1 -- 172.21.15.72:0/1600310329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c8013570 con 0x7fe9c0004d90 2023-08-25T04:47:19.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9de5ff700 1 -- 172.21.15.72:0/1600310329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d81f3560 con 0x7fe9c0004d90 2023-08-25T04:47:19.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.737+0000 7fe9d4ff9700 1 -- 172.21.15.72:0/1600310329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8013920 con 0x7fe9c0004d90 2023-08-25T04:47:19.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.738+0000 7fe9de5ff700 1 -- 172.21.15.72:0/1600310329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d81f2eb0 con 0x7fe9c0004d90 2023-08-25T04:47:19.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.739+0000 7fe9de5ff700 1 -- 172.21.15.72:0/1600310329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d81f3040 con 0x7fe9c0004d90 2023-08-25T04:47:19.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.740+0000 7fe9d4ff9700 1 -- 172.21.15.72:0/1600310329 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe9c8013c90 con 0x7fe9c0004d90 2023-08-25T04:47:19.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.740+0000 7fe9d4ff9700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9c406a0e0 0x7fe9c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:19.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.741+0000 7fe9d4ff9700 1 -- 172.21.15.72:0/1600310329 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe9c8089530 con 0x7fe9c0004d90 2023-08-25T04:47:19.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.741+0000 7fe9d77fe700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9c406a0e0 0x7fe9c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:19.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.741+0000 7fe9d77fe700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9c406a0e0 0x7fe9c406c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8159f10 tx=0x7fe9cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:19.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:19.745+0000 7fe9d4ff9700 1 -- 172.21.15.72:0/1600310329 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe9d81f3040 con 0x7fe9c0004d90 2023-08-25T04:47:20.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.025+0000 7fe9de5ff700 1 -- 172.21.15.72:0/1600310329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe9d81f3040 con 0x7fe9c0004d90 2023-08-25T04:47:20.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.029+0000 7fe9d4ff9700 1 -- 172.21.15.72:0/1600310329 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe9d81f3040 con 0x7fe9c0004d90 2023-08-25T04:47:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 -- 172.21.15.72:0/1600310329 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9c406a0e0 msgr2=0x7fe9c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9c406a0e0 0x7fe9c406c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8159f10 tx=0x7fe9cc008040 comp rx=0 tx=0).stop 2023-08-25T04:47:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 -- 172.21.15.72:0/1600310329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 msgr2=0x7fe9d80cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 0x7fe9d80cc8d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8001330 tx=0x7fe9c800a9a0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 -- 172.21.15.72:0/1600310329 shutdown_connections 2023-08-25T04:47:20.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe9c406a0e0 0x7fe9c406c5a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9d806bea0 0x7fe9d80c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0004d90 0x7fe9d80cc8d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 --2- 172.21.15.72:0/1600310329 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9d81f2a30 0x7fe9d806b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 -- 172.21.15.72:0/1600310329 >> 172.21.15.72:0/1600310329 conn(0x7fe9d8071e40 msgr2=0x7fe9d80b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:20.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 -- 172.21.15.72:0/1600310329 shutdown_connections 2023-08-25T04:47:20.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.032+0000 7fe9de5ff700 1 -- 172.21.15.72:0/1600310329 wait complete. 2023-08-25T04:47:20.050 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-25T04:47:20.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.245+0000 7fd2c1bff700 1 Processor -- start 2023-08-25T04:47:20.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.245+0000 7fd2c1bff700 1 -- start start 2023-08-25T04:47:20.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.246+0000 7fd2c1bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2bc06a2f0 0x7fd2bc0b1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.246+0000 7fd2c1bff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2bc0ca830 0x7fd2bc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.246+0000 7fd2c1bff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0cd7e0 con 0x7fd2bc15d470 2023-08-25T04:47:20.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.246+0000 7fd2c1bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0b24e0 con 0x7fd2bc06a2f0 2023-08-25T04:47:20.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.246+0000 7fd2c1bff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0b1c40 con 0x7fd2bc0ca830 2023-08-25T04:47:20.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2bb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2bc06a2f0 0x7fd2bc0b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2bb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2bc06a2f0 0x7fd2bc0b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44724/0 (socket says 172.21.15.72:44724) 2023-08-25T04:47:20.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2bb7fe700 1 -- 172.21.15.72:0/3264753134 learned_addr learned my addr 172.21.15.72:0/3264753134 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:20.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2bbfff700 1 --2- 172.21.15.72:0/3264753134 >> v2:172.21.15.137:3300/0 conn(0x7fd2bc0ca830 0x7fd2bc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2bb7fe700 1 -- 172.21.15.72:0/3264753134 >> v2:172.21.15.137:3300/0 conn(0x7fd2bc0ca830 msgr2=0x7fd2bc0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:20.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2bb7fe700 1 --2- 172.21.15.72:0/3264753134 >> v2:172.21.15.137:3300/0 conn(0x7fd2bc0ca830 0x7fd2bc0ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2bb7fe700 1 -- 172.21.15.72:0/3264753134 >> v1:172.21.15.137:6789/0 conn(0x7fd2bc15d470 legacy=0x7fd2bc06a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:20.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2bb7fe700 1 -- 172.21.15.72:0/3264753134 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0b1f20 con 0x7fd2bc06a2f0 2023-08-25T04:47:20.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2bbfff700 1 --2- 172.21.15.72:0/3264753134 >> v2:172.21.15.137:3300/0 conn(0x7fd2bc0ca830 0x7fd2bc0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:20.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2bb7fe700 1 --2- 172.21.15.72:0/3264753134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc06a2f0 0x7fd2bc0b1560 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0af2f0 tx=0x7fd2ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d32a00f58c717a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:20.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.247+0000 7fd2ba7fc700 1 -- 172.21.15.72:0/3264753134 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac004230 con 0x7fd2bc06a2f0 2023-08-25T04:47:20.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.248+0000 7fd2ba7fc700 1 -- 172.21.15.72:0/3264753134 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac004390 con 0x7fd2bc06a2f0 2023-08-25T04:47:20.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.248+0000 7fd2ba7fc700 1 -- 172.21.15.72:0/3264753134 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0036a0 con 0x7fd2bc06a2f0 2023-08-25T04:47:20.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.248+0000 7fd2c1bff700 1 -- 172.21.15.72:0/3264753134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc06a2f0 msgr2=0x7fd2bc0b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.248+0000 7fd2c1bff700 1 --2- 172.21.15.72:0/3264753134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc06a2f0 0x7fd2bc0b1560 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0af2f0 tx=0x7fd2ac009bd0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.248+0000 7fd2c1bff700 1 -- 172.21.15.72:0/3264753134 shutdown_connections 2023-08-25T04:47:20.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.248+0000 7fd2c1bff700 1 --2- 172.21.15.72:0/3264753134 >> v2:172.21.15.137:3300/0 conn(0x7fd2bc0ca830 0x7fd2bc0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.248+0000 7fd2c1bff700 1 --2- 172.21.15.72:0/3264753134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc06a2f0 0x7fd2bc0b1560 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.248+0000 7fd2c1bff700 1 -- 172.21.15.72:0/3264753134 >> 172.21.15.72:0/3264753134 conn(0x7fd2bc06db30 msgr2=0x7fd2bc06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:20.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.248+0000 7fd2c1bff700 1 -- 172.21.15.72:0/3264753134 shutdown_connections 2023-08-25T04:47:20.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.248+0000 7fd2c1bff700 1 -- 172.21.15.72:0/3264753134 wait complete. 2023-08-25T04:47:20.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.250+0000 7fd2c1bff700 1 Processor -- start 2023-08-25T04:47:20.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.250+0000 7fd2c1bff700 1 -- start start 2023-08-25T04:47:20.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2c1bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2bc06a2f0 0x7fd2bc15f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2c1bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc15d470 0x7fd2bc0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2c1bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc0ab8f0 0x7fd2bc0c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2c1bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc152690 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2c1bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0c4be0 con 0x7fd2bc06a2f0 2023-08-25T04:47:20.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2c1bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0b3cf0 con 0x7fd2bc15d470 2023-08-25T04:47:20.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc0ab8f0 0x7fd2bc0c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc0ab8f0 0x7fd2bc0c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44736/0 (socket says 172.21.15.72:44736) 2023-08-25T04:47:20.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2bbfff700 1 -- 172.21.15.72:0/937373437 learned_addr learned my addr 172.21.15.72:0/937373437 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:20.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2bb7fe700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2bc06a2f0 0x7fd2bc15f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.251+0000 7fd2baffd700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc15d470 0x7fd2bc0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2bbfff700 1 -- 172.21.15.72:0/937373437 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc15d470 msgr2=0x7fd2bc0c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2bbfff700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc15d470 0x7fd2bc0c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2bbfff700 1 -- 172.21.15.72:0/937373437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2bc06a2f0 msgr2=0x7fd2bc15f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2bbfff700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2bc06a2f0 0x7fd2bc15f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2bbfff700 1 -- 172.21.15.72:0/937373437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac009550 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2bbfff700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc0ab8f0 0x7fd2bc0c4540 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400ce80 tx=0x7fd2b400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2a3fff700 1 -- 172.21.15.72:0/937373437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400ad40 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2a3fff700 1 -- 172.21.15.72:0/937373437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b4015440 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2c1bff700 1 -- 172.21.15.72:0/937373437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc0b3fd0 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2a3fff700 1 -- 172.21.15.72:0/937373437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400aea0 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.252+0000 7fd2c1bff700 1 -- 172.21.15.72:0/937373437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc0c4ec0 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.254+0000 7fd2c1bff700 1 -- 172.21.15.72:0/937373437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc0b44f0 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.254+0000 7fd2a3fff700 1 -- 172.21.15.72:0/937373437 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd2b400d430 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.255+0000 7fd2a3fff700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2a806a0e0 0x7fd2a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.255+0000 7fd2a3fff700 1 -- 172.21.15.72:0/937373437 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd2b40887d0 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.255+0000 7fd2bb7fe700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2a806a0e0 0x7fd2a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.256+0000 7fd2bb7fe700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2a806a0e0 0x7fd2a806c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009130 tx=0x7fd2ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:20.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.260+0000 7fd2a3fff700 1 -- 172.21.15.72:0/937373437 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd2bc0b44f0 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.534+0000 7fd2c1bff700 1 -- 172.21.15.72:0/937373437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd2bc166d60 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.537+0000 7fd2a3fff700 1 -- 172.21.15.72:0/937373437 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd2b40540c0 con 0x7fd2bc0ab8f0 2023-08-25T04:47:20.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.539+0000 7fd2c1bff700 1 -- 172.21.15.72:0/937373437 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2a806a0e0 msgr2=0x7fd2a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.539+0000 7fd2c1bff700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2a806a0e0 0x7fd2a806c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009130 tx=0x7fd2ac008030 comp rx=0 tx=0).stop 2023-08-25T04:47:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.539+0000 7fd2c1bff700 1 -- 172.21.15.72:0/937373437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc0ab8f0 msgr2=0x7fd2bc0c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.539+0000 7fd2c1bff700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc0ab8f0 0x7fd2bc0c4540 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400ce80 tx=0x7fd2b400ceb0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.540+0000 7fd2c1bff700 1 -- 172.21.15.72:0/937373437 shutdown_connections 2023-08-25T04:47:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.540+0000 7fd2c1bff700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd2a806a0e0 0x7fd2a806c5a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.540+0000 7fd2c1bff700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc0ab8f0 0x7fd2bc0c4540 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.540+0000 7fd2c1bff700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2bc06a2f0 0x7fd2bc15f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.540+0000 7fd2c1bff700 1 --2- 172.21.15.72:0/937373437 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc15d470 0x7fd2bc0c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.540+0000 7fd2c1bff700 1 -- 172.21.15.72:0/937373437 >> 172.21.15.72:0/937373437 conn(0x7fd2bc06db30 msgr2=0x7fd2bc153490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:20.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.540+0000 7fd2c1bff700 1 -- 172.21.15.72:0/937373437 shutdown_connections 2023-08-25T04:47:20.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.540+0000 7fd2c1bff700 1 -- 172.21.15.72:0/937373437 wait complete. 2023-08-25T04:47:20.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-25T04:47:20.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.755+0000 7fd225dff700 1 Processor -- start 2023-08-25T04:47:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.756+0000 7fd225dff700 1 -- start start 2023-08-25T04:47:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.757+0000 7fd225dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2200b4f10 0x7fd2200b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.757+0000 7fd225dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2200b7400 con 0x7fd2200d20f0 2023-08-25T04:47:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.757+0000 7fd225dff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2200b7650 con 0x7fd220160710 2023-08-25T04:47:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.757+0000 7fd225dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2200b7930 con 0x7fd2200b4f10 2023-08-25T04:47:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.757+0000 7fd21effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd2200d20f0 0x7fd2200b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57116/0 (socket says 172.21.15.72:57116) 2023-08-25T04:47:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.757+0000 7fd21effd700 1 -- 172.21.15.72:0/1576666467 learned_addr learned my addr 172.21.15.72:0/1576666467 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:20.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.757+0000 7fd21ffff700 1 --2- 172.21.15.72:0/1576666467 >> v2:172.21.15.137:3300/0 conn(0x7fd2200b4f10 0x7fd2200b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.757+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214473737 0 0) 0x7fd2200b7400 con 0x7fd2200d20f0 2023-08-25T04:47:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2080035b0 con 0x7fd2200d20f0 2023-08-25T04:47:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3699504744 0 0) 0x7fd2080035b0 con 0x7fd2200d20f0 2023-08-25T04:47:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 >> v2:172.21.15.137:3300/0 conn(0x7fd2200b4f10 msgr2=0x7fd2200b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 --2- 172.21.15.72:0/1576666467 >> v2:172.21.15.137:3300/0 conn(0x7fd2200b4f10 0x7fd2200b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 >> v1:172.21.15.137:6789/0 conn(0x7fd220160710 legacy=0x7fd2200b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200b7c10 con 0x7fd2200d20f0 2023-08-25T04:47:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fd214001670 con 0x7fd2200d20f0 2023-08-25T04:47:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 >> v1:172.21.15.72:6789/0 conn(0x7fd2200d20f0 legacy=0x7fd2200b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd208003a00 0x7fd208003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd208004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd208005210 0x7fd20800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200b7930 con 0x7fd208004850 2023-08-25T04:47:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20800c060 con 0x7fd208003a00 2023-08-25T04:47:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20800c220 con 0x7fd208005210 2023-08-25T04:47:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21effd700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd208004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.758+0000 7fd21f7fe700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd208003a00 0x7fd208003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21ffff700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd208005210 0x7fd20800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21effd700 1 -- 172.21.15.72:0/1576666467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd208005210 msgr2=0x7fd20800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21effd700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd208005210 0x7fd20800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21effd700 1 -- 172.21.15.72:0/1576666467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd208003a00 msgr2=0x7fd208003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21effd700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd208003a00 0x7fd208003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21effd700 1 -- 172.21.15.72:0/1576666467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080035b0 con 0x7fd208004850 2023-08-25T04:47:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21ffff700 1 -- 172.21.15.72:0/1576666467 reap_dead start 2023-08-25T04:47:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21effd700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd208004cd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd21400c210 tx=0x7fd208005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f4b04226ee7636 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214007b70 con 0x7fd208004850 2023-08-25T04:47:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21400cdb0 con 0x7fd208004850 2023-08-25T04:47:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.759+0000 7fd21e7fc700 1 -- 172.21.15.72:0/1576666467 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214005ba0 con 0x7fd208004850 2023-08-25T04:47:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.760+0000 7fd225dff700 1 -- 172.21.15.72:0/1576666467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 msgr2=0x7fd208004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.760+0000 7fd225dff700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd208004cd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd21400c210 tx=0x7fd208005880 comp rx=0 tx=0).stop 2023-08-25T04:47:20.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.760+0000 7fd225dff700 1 -- 172.21.15.72:0/1576666467 shutdown_connections 2023-08-25T04:47:20.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.760+0000 7fd225dff700 1 --2- 172.21.15.72:0/1576666467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd208004cd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.760+0000 7fd225dff700 1 -- 172.21.15.72:0/1576666467 >> 172.21.15.72:0/1576666467 conn(0x7fd220071e40 msgr2=0x7fd220072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:20.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.760+0000 7fd225dff700 1 -- 172.21.15.72:0/1576666467 shutdown_connections 2023-08-25T04:47:20.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.760+0000 7fd225dff700 1 -- 172.21.15.72:0/1576666467 wait complete. 2023-08-25T04:47:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.762+0000 7fd225dff700 1 Processor -- start 2023-08-25T04:47:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.762+0000 7fd225dff700 1 -- start start 2023-08-25T04:47:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd225dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd22014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd225dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd220150d20 0x7fd2200cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd225dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2200cc9f0 0x7fd2200ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd225dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22015de10 con 0x7fd208004850 2023-08-25T04:47:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd225dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2201511b0 con 0x7fd2200cc9f0 2023-08-25T04:47:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd225dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd220151490 con 0x7fd220150d20 2023-08-25T04:47:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd22014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd22014fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44762/0 (socket says 172.21.15.72:44762) 2023-08-25T04:47:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21f7fe700 1 -- 172.21.15.72:0/4276051886 learned_addr learned my addr 172.21.15.72:0/4276051886 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21effd700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd220150d20 0x7fd2200cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21ffff700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2200cc9f0 0x7fd2200ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21f7fe700 1 -- 172.21.15.72:0/4276051886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd220150d20 msgr2=0x7fd2200cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21f7fe700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd220150d20 0x7fd2200cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21f7fe700 1 -- 172.21.15.72:0/4276051886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2200cc9f0 msgr2=0x7fd2200ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:20.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21f7fe700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2200cc9f0 0x7fd2200ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:20.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21f7fe700 1 -- 172.21.15.72:0/4276051886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22015e060 con 0x7fd208004850 2023-08-25T04:47:20.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21ffff700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2200cc9f0 0x7fd2200ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:20.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.763+0000 7fd21f7fe700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd22014fb70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd21000f780 tx=0x7fd21000fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.764+0000 7fd207fff700 1 -- 172.21.15.72:0/4276051886 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2100052e0 con 0x7fd208004850 2023-08-25T04:47:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.764+0000 7fd207fff700 1 -- 172.21.15.72:0/4276051886 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd210005460 con 0x7fd208004850 2023-08-25T04:47:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.764+0000 7fd225dff700 1 -- 172.21.15.72:0/4276051886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22015e340 con 0x7fd208004850 2023-08-25T04:47:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.764+0000 7fd207fff700 1 -- 172.21.15.72:0/4276051886 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2100038c0 con 0x7fd208004850 2023-08-25T04:47:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.764+0000 7fd225dff700 1 -- 172.21.15.72:0/4276051886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2201e5800 con 0x7fd208004850 2023-08-25T04:47:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.765+0000 7fd225dff700 1 -- 172.21.15.72:0/4276051886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd220151650 con 0x7fd208004850 2023-08-25T04:47:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.766+0000 7fd207fff700 1 -- 172.21.15.72:0/4276051886 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd210003a20 con 0x7fd208004850 2023-08-25T04:47:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.767+0000 7fd207fff700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd20c06a0e0 0x7fd20c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.767+0000 7fd207fff700 1 -- 172.21.15.72:0/4276051886 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd2100881d0 con 0x7fd208004850 2023-08-25T04:47:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.767+0000 7fd21effd700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd20c06a0e0 0x7fd20c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.767+0000 7fd21effd700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd20c06a0e0 0x7fd20c06c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd214015040 tx=0x7fd214007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:20.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:20.771+0000 7fd207fff700 1 -- 172.21.15.72:0/4276051886 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd210053ad0 con 0x7fd208004850 2023-08-25T04:47:21.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.045+0000 7fd225dff700 1 -- 172.21.15.72:0/4276051886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd22008a000 con 0x7fd208004850 2023-08-25T04:47:21.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.049+0000 7fd207fff700 1 -- 172.21.15.72:0/4276051886 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd2100570f0 con 0x7fd208004850 2023-08-25T04:47:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 -- 172.21.15.72:0/4276051886 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd20c06a0e0 msgr2=0x7fd20c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd20c06a0e0 0x7fd20c06c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd214015040 tx=0x7fd214007000 comp rx=0 tx=0).stop 2023-08-25T04:47:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 -- 172.21.15.72:0/4276051886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 msgr2=0x7fd22014fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd22014fb70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd21000f780 tx=0x7fd21000fa90 comp rx=0 tx=0).stop 2023-08-25T04:47:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 -- 172.21.15.72:0/4276051886 shutdown_connections 2023-08-25T04:47:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd20c06a0e0 0x7fd20c06c5a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2200cc9f0 0x7fd2200ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd208004850 0x7fd22014fb70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 --2- 172.21.15.72:0/4276051886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd220150d20 0x7fd2200cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 -- 172.21.15.72:0/4276051886 >> 172.21.15.72:0/4276051886 conn(0x7fd220071e40 msgr2=0x7fd2201533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 -- 172.21.15.72:0/4276051886 shutdown_connections 2023-08-25T04:47:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.052+0000 7fd225dff700 1 -- 172.21.15.72:0/4276051886 wait complete. 2023-08-25T04:47:21.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-25T04:47:21.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.265+0000 7fe00dbff700 1 Processor -- start 2023-08-25T04:47:21.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.266+0000 7fe00dbff700 1 -- start start 2023-08-25T04:47:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.267+0000 7fe00dbff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe008159ff0 0x7fe0080ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.267+0000 7fe00dbff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 0x7fe0080b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.267+0000 7fe00dbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080b1870 con 0x7fe0080b0d80 2023-08-25T04:47:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.267+0000 7fe00dbff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0080b46a0 con 0x7fe008159ff0 2023-08-25T04:47:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.267+0000 7fe00dbff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe008070de0 con 0x7fe008070890 2023-08-25T04:47:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.267+0000 7fe007fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe0080b0d80 0x7fe0080c8f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57120/0 (socket says 172.21.15.72:57120) 2023-08-25T04:47:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.267+0000 7fe007fff700 1 -- 172.21.15.72:0/1610092352 learned_addr learned my addr 172.21.15.72:0/1610092352 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:21.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.267+0000 7fe006ffd700 1 --2- 172.21.15.72:0/1610092352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 0x7fe0080b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.267+0000 7fe0077fe700 1 --2- 172.21.15.72:0/1610092352 >> v2:172.21.15.137:3300/0 conn(0x7fe008159ff0 0x7fe0080ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.267+0000 7fe0067fc700 1 -- 172.21.15.72:0/1610092352 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331110546 0 0) 0x7fe0080b1870 con 0x7fe0080b0d80 2023-08-25T04:47:21.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.268+0000 7fe0067fc700 1 -- 172.21.15.72:0/1610092352 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff00035b0 con 0x7fe0080b0d80 2023-08-25T04:47:21.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.268+0000 7fe0067fc700 1 -- 172.21.15.72:0/1610092352 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 564271913 0 0) 0x7fdff00035b0 con 0x7fe0080b0d80 2023-08-25T04:47:21.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.268+0000 7fe0077fe700 1 -- 172.21.15.72:0/1610092352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 msgr2=0x7fe0080b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:21.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.268+0000 7fe0077fe700 1 --2- 172.21.15.72:0/1610092352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 0x7fe0080b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.268+0000 7fe0077fe700 1 -- 172.21.15.72:0/1610092352 >> v1:172.21.15.72:6789/0 conn(0x7fe0080b0d80 legacy=0x7fe0080c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.268+0000 7fe0077fe700 1 -- 172.21.15.72:0/1610092352 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080710c0 con 0x7fe008159ff0 2023-08-25T04:47:21.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.268+0000 7fe006ffd700 1 --2- 172.21.15.72:0/1610092352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 0x7fe0080b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:21.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.268+0000 7fe0077fe700 1 --2- 172.21.15.72:0/1610092352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008159ff0 0x7fe0080ca980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009870 tx=0x7fdff8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e6adb7e9936e792 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:21.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.268+0000 7fe0067fc700 1 -- 172.21.15.72:0/1610092352 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800f8a0 con 0x7fe008159ff0 2023-08-25T04:47:21.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.269+0000 7fe0067fc700 1 -- 172.21.15.72:0/1610092352 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff800fa00 con 0x7fe008159ff0 2023-08-25T04:47:21.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.269+0000 7fe0067fc700 1 -- 172.21.15.72:0/1610092352 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800fd90 con 0x7fe008159ff0 2023-08-25T04:47:21.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.269+0000 7fe00dbff700 1 -- 172.21.15.72:0/1610092352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008159ff0 msgr2=0x7fe0080ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.269+0000 7fe00dbff700 1 --2- 172.21.15.72:0/1610092352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008159ff0 0x7fe0080ca980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009870 tx=0x7fdff8009b80 comp rx=0 tx=0).stop 2023-08-25T04:47:21.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.269+0000 7fe00dbff700 1 -- 172.21.15.72:0/1610092352 shutdown_connections 2023-08-25T04:47:21.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.269+0000 7fe00dbff700 1 --2- 172.21.15.72:0/1610092352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008159ff0 0x7fe0080ca980 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.269+0000 7fe00dbff700 1 --2- 172.21.15.72:0/1610092352 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 0x7fe0080b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.269+0000 7fe00dbff700 1 -- 172.21.15.72:0/1610092352 >> 172.21.15.72:0/1610092352 conn(0x7fe0080ce9a0 msgr2=0x7fe0080ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.269+0000 7fe00dbff700 1 -- 172.21.15.72:0/1610092352 shutdown_connections 2023-08-25T04:47:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.269+0000 7fe00dbff700 1 -- 172.21.15.72:0/1610092352 wait complete. 2023-08-25T04:47:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.271+0000 7fe00dbff700 1 Processor -- start 2023-08-25T04:47:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.271+0000 7fe00dbff700 1 -- start start 2023-08-25T04:47:21.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.272+0000 7fe00dbff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 0x7fe008145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.272+0000 7fe00dbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0080b0d80 0x7fe0080c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.272+0000 7fe00dbff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008159ff0 0x7fe0081435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.272+0000 7fe00dbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080c5010 con 0x7fe0080b0d80 2023-08-25T04:47:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.272+0000 7fe00dbff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe008143f80 con 0x7fe008159ff0 2023-08-25T04:47:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.272+0000 7fe00dbff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe008144260 con 0x7fe008070890 2023-08-25T04:47:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.272+0000 7fe006ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0080b0d80 0x7fe0080c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.272+0000 7fe006ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0080b0d80 0x7fe0080c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44764/0 (socket says 172.21.15.72:44764) 2023-08-25T04:47:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.272+0000 7fe006ffd700 1 -- 172.21.15.72:0/777374853 learned_addr learned my addr 172.21.15.72:0/777374853 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.272+0000 7fe007fff700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008159ff0 0x7fe0081435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fe0077fe700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 0x7fe008145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fe006ffd700 1 -- 172.21.15.72:0/777374853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 msgr2=0x7fe008145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fe006ffd700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 0x7fe008145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fe006ffd700 1 -- 172.21.15.72:0/777374853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008159ff0 msgr2=0x7fe0081435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fe006ffd700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008159ff0 0x7fe0081435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fe006ffd700 1 -- 172.21.15.72:0/777374853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0094a0 con 0x7fe0080b0d80 2023-08-25T04:47:21.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fe006ffd700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0080b0d80 0x7fe0080c4ad0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00ebb0 tx=0x7fdffc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:21.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fdfeffff700 1 -- 172.21.15.72:0/777374853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00c850 con 0x7fe0080b0d80 2023-08-25T04:47:21.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fdfeffff700 1 -- 172.21.15.72:0/777374853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc00c9b0 con 0x7fe0080b0d80 2023-08-25T04:47:21.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fe00dbff700 1 -- 172.21.15.72:0/777374853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff80094a0 con 0x7fe0080b0d80 2023-08-25T04:47:21.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fdfeffff700 1 -- 172.21.15.72:0/777374853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00cd40 con 0x7fe0080b0d80 2023-08-25T04:47:21.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.273+0000 7fe00dbff700 1 -- 172.21.15.72:0/777374853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe008144820 con 0x7fe0080b0d80 2023-08-25T04:47:21.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.274+0000 7fe00dbff700 1 -- 172.21.15.72:0/777374853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0080722d0 con 0x7fe0080b0d80 2023-08-25T04:47:21.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.275+0000 7fdfeffff700 1 -- 172.21.15.72:0/777374853 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdffc013470 con 0x7fe0080b0d80 2023-08-25T04:47:21.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.276+0000 7fdfeffff700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdff406a0e0 0x7fdff406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.276+0000 7fdfeffff700 1 -- 172.21.15.72:0/777374853 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fdffc0883c0 con 0x7fe0080b0d80 2023-08-25T04:47:21.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.276+0000 7fe0077fe700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdff406a0e0 0x7fdff406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.277+0000 7fe0077fe700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdff406a0e0 0x7fdff406c5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdff8000c00 tx=0x7fdff8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:21.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.280+0000 7fdfeffff700 1 -- 172.21.15.72:0/777374853 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdffc053c20 con 0x7fe0080b0d80 2023-08-25T04:47:21.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.562+0000 7fe00dbff700 1 -- 172.21.15.72:0/777374853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe0080c5160 con 0x7fe0080b0d80 2023-08-25T04:47:21.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.566+0000 7fdfeffff700 1 -- 172.21.15.72:0/777374853 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdffc057240 con 0x7fe0080b0d80 2023-08-25T04:47:21.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 -- 172.21.15.72:0/777374853 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdff406a0e0 msgr2=0x7fdff406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdff406a0e0 0x7fdff406c5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdff8000c00 tx=0x7fdff8008030 comp rx=0 tx=0).stop 2023-08-25T04:47:21.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 -- 172.21.15.72:0/777374853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0080b0d80 msgr2=0x7fe0080c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0080b0d80 0x7fe0080c4ad0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00ebb0 tx=0x7fdffc00eec0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 -- 172.21.15.72:0/777374853 shutdown_connections 2023-08-25T04:47:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdff406a0e0 0x7fdff406c5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008159ff0 0x7fe0081435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe008070890 0x7fe008145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 --2- 172.21.15.72:0/777374853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0080b0d80 0x7fe0080c4ad0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 -- 172.21.15.72:0/777374853 >> 172.21.15.72:0/777374853 conn(0x7fe0080ce9a0 msgr2=0x7fe0080b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 -- 172.21.15.72:0/777374853 shutdown_connections 2023-08-25T04:47:21.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.568+0000 7fe00dbff700 1 -- 172.21.15.72:0/777374853 wait complete. 2023-08-25T04:47:21.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-25T04:47:21.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.783+0000 7f5e40bff700 1 Processor -- start 2023-08-25T04:47:21.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.783+0000 7f5e40bff700 1 -- start start 2023-08-25T04:47:21.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.784+0000 7f5e40bff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5e3c160710 0x7f5e3c0b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.784+0000 7f5e40bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e3c0b4800 0x7f5e3c0b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.784+0000 7f5e40bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c0b8d30 con 0x7f5e3c0d10e0 2023-08-25T04:47:21.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.784+0000 7f5e40bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3c0b51c0 con 0x7f5e3c0b4800 2023-08-25T04:47:21.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.784+0000 7f5e40bff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3c0b7650 con 0x7f5e3c160710 2023-08-25T04:47:21.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.784+0000 7f5e33fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e3c0b4800 0x7f5e3c0b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.784+0000 7f5e3ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e3c0d10e0 0x7f5e3c0d1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57126/0 (socket says 172.21.15.72:57126) 2023-08-25T04:47:21.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.784+0000 7f5e3ad9d700 1 -- 172.21.15.72:0/780999923 learned_addr learned my addr 172.21.15.72:0/780999923 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:21.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.785+0000 7f5e3a59c700 1 --2- 172.21.15.72:0/780999923 >> v2:172.21.15.137:3300/0 conn(0x7f5e3c160710 0x7f5e3c0b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.785+0000 7f5e33fff700 1 -- 172.21.15.72:0/780999923 >> v2:172.21.15.137:3300/0 conn(0x7f5e3c160710 msgr2=0x7f5e3c0b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:21.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.785+0000 7f5e33fff700 1 --2- 172.21.15.72:0/780999923 >> v2:172.21.15.137:3300/0 conn(0x7f5e3c160710 0x7f5e3c0b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.785+0000 7f5e33fff700 1 -- 172.21.15.72:0/780999923 >> v1:172.21.15.72:6789/0 conn(0x7f5e3c0d10e0 legacy=0x7f5e3c0d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.785+0000 7f5e33fff700 1 -- 172.21.15.72:0/780999923 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c0b7930 con 0x7f5e3c0b4800 2023-08-25T04:47:21.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.785+0000 7f5e39d9b700 1 -- 172.21.15.72:0/780999923 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885566417 0 0) 0x7f5e3c0b8d30 con 0x7f5e3c0d10e0 2023-08-25T04:47:21.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.785+0000 7f5e33fff700 1 --2- 172.21.15.72:0/780999923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0b4800 0x7f5e3c0b4c80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0cd5d0 tx=0x7f5e24009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb29ab71ecc9b220 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:21.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.785+0000 7f5e39d9b700 1 -- 172.21.15.72:0/780999923 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24011830 con 0x7f5e3c0b4800 2023-08-25T04:47:21.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.785+0000 7f5e39d9b700 1 -- 172.21.15.72:0/780999923 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e24011990 con 0x7f5e3c0b4800 2023-08-25T04:47:21.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.785+0000 7f5e39d9b700 1 -- 172.21.15.72:0/780999923 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24011d20 con 0x7f5e3c0b4800 2023-08-25T04:47:21.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.786+0000 7f5e40bff700 1 -- 172.21.15.72:0/780999923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0b4800 msgr2=0x7f5e3c0b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.786+0000 7f5e40bff700 1 --2- 172.21.15.72:0/780999923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0b4800 0x7f5e3c0b4c80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0cd5d0 tx=0x7f5e24009b20 comp rx=0 tx=0).stop 2023-08-25T04:47:21.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.786+0000 7f5e40bff700 1 -- 172.21.15.72:0/780999923 shutdown_connections 2023-08-25T04:47:21.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.786+0000 7f5e40bff700 1 --2- 172.21.15.72:0/780999923 >> v2:172.21.15.137:3300/0 conn(0x7f5e3c160710 0x7f5e3c0b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.786+0000 7f5e40bff700 1 --2- 172.21.15.72:0/780999923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c0b4800 0x7f5e3c0b4c80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.786+0000 7f5e40bff700 1 -- 172.21.15.72:0/780999923 >> 172.21.15.72:0/780999923 conn(0x7f5e3c071e40 msgr2=0x7f5e3c072250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:21.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.786+0000 7f5e40bff700 1 -- 172.21.15.72:0/780999923 shutdown_connections 2023-08-25T04:47:21.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.786+0000 7f5e40bff700 1 -- 172.21.15.72:0/780999923 wait complete. 2023-08-25T04:47:21.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.788+0000 7f5e40bff700 1 Processor -- start 2023-08-25T04:47:21.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.788+0000 7f5e40bff700 1 -- start start 2023-08-25T04:47:21.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e40bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0b4800 0x7f5e3c152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e40bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c0d10e0 0x7f5e3c0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e40bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c160710 0x7f5e3c0d2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e40bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c1555a0 con 0x7f5e3c160710 2023-08-25T04:47:21.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e40bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c153430 con 0x7f5e3c0b4800 2023-08-25T04:47:21.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e40bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0cccb0 con 0x7f5e3c0d10e0 2023-08-25T04:47:21.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e3ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c160710 0x7f5e3c0d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e3ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c160710 0x7f5e3c0d2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44786/0 (socket says 172.21.15.72:44786) 2023-08-25T04:47:21.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e3ad9d700 1 -- 172.21.15.72:0/1927358034 learned_addr learned my addr 172.21.15.72:0/1927358034 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:21.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e3a59c700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0b4800 0x7f5e3c152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e33fff700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c0d10e0 0x7f5e3c0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e3ad9d700 1 -- 172.21.15.72:0/1927358034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c0d10e0 msgr2=0x7f5e3c0cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e3ad9d700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c0d10e0 0x7f5e3c0cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e3ad9d700 1 -- 172.21.15.72:0/1927358034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0b4800 msgr2=0x7f5e3c152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:21.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e3ad9d700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0b4800 0x7f5e3c152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:21.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.789+0000 7f5e3ad9d700 1 -- 172.21.15.72:0/1927358034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e240094a0 con 0x7f5e3c160710 2023-08-25T04:47:21.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.790+0000 7f5e3ad9d700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c160710 0x7f5e3c0d2600 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400cba0 tx=0x7f5e3400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:21.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.790+0000 7f5e32ffd700 1 -- 172.21.15.72:0/1927358034 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400aaa0 con 0x7f5e3c160710 2023-08-25T04:47:21.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.790+0000 7f5e32ffd700 1 -- 172.21.15.72:0/1927358034 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400ac20 con 0x7f5e3c160710 2023-08-25T04:47:21.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.790+0000 7f5e40bff700 1 -- 172.21.15.72:0/1927358034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c0b2490 con 0x7f5e3c160710 2023-08-25T04:47:21.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.790+0000 7f5e32ffd700 1 -- 172.21.15.72:0/1927358034 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340070d0 con 0x7f5e3c160710 2023-08-25T04:47:21.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.790+0000 7f5e40bff700 1 -- 172.21.15.72:0/1927358034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c154c00 con 0x7f5e3c160710 2023-08-25T04:47:21.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.791+0000 7f5e40bff700 1 -- 172.21.15.72:0/1927358034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c08a000 con 0x7f5e3c160710 2023-08-25T04:47:21.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.792+0000 7f5e32ffd700 1 -- 172.21.15.72:0/1927358034 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5e34007230 con 0x7f5e3c160710 2023-08-25T04:47:21.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.793+0000 7f5e32ffd700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e1c06a110 0x7f5e1c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:21.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.793+0000 7f5e32ffd700 1 -- 172.21.15.72:0/1927358034 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5e34087da0 con 0x7f5e3c160710 2023-08-25T04:47:21.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.793+0000 7f5e3a59c700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e1c06a110 0x7f5e1c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:21.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.793+0000 7f5e3a59c700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e1c06a110 0x7f5e1c06c5d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0b26a0 tx=0x7f5e2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:21.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:21.797+0000 7f5e32ffd700 1 -- 172.21.15.72:0/1927358034 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5e34053690 con 0x7f5e3c160710 2023-08-25T04:47:22.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.077+0000 7f5e40bff700 1 -- 172.21.15.72:0/1927358034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f5e3c0744f0 con 0x7f5e3c160710 2023-08-25T04:47:22.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.080+0000 7f5e32ffd700 1 -- 172.21.15.72:0/1927358034 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5e34018070 con 0x7f5e3c160710 2023-08-25T04:47:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 -- 172.21.15.72:0/1927358034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e1c06a110 msgr2=0x7f5e1c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e1c06a110 0x7f5e1c06c5d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0b26a0 tx=0x7f5e2c008040 comp rx=0 tx=0).stop 2023-08-25T04:47:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 -- 172.21.15.72:0/1927358034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c160710 msgr2=0x7f5e3c0d2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c160710 0x7f5e3c0d2600 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400cba0 tx=0x7f5e3400ceb0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 -- 172.21.15.72:0/1927358034 shutdown_connections 2023-08-25T04:47:22.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f5e1c06a110 0x7f5e1c06c5d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c160710 0x7f5e3c0d2600 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0b4800 0x7f5e3c152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 --2- 172.21.15.72:0/1927358034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5e3c0d10e0 0x7f5e3c0cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 -- 172.21.15.72:0/1927358034 >> 172.21.15.72:0/1927358034 conn(0x7f5e3c071e40 msgr2=0x7f5e3c0ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:22.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 -- 172.21.15.72:0/1927358034 shutdown_connections 2023-08-25T04:47:22.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.083+0000 7f5e40bff700 1 -- 172.21.15.72:0/1927358034 wait complete. 2023-08-25T04:47:22.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:47:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.295+0000 7fd7761ff700 1 Processor -- start 2023-08-25T04:47:22.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.295+0000 7fd7761ff700 1 -- start start 2023-08-25T04:47:22.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.296+0000 7fd7761ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd7700cda40 0x7fd7700cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.296+0000 7fd7761ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7700d1fe0 con 0x7fd77015ce60 2023-08-25T04:47:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.296+0000 7fd7761ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7700d13d0 con 0x7fd7700d0df0 2023-08-25T04:47:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.296+0000 7fd7761ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7700d2b80 con 0x7fd7700cda40 2023-08-25T04:47:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.296+0000 7fd76f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd77015ce60 0x7fd7700b8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57140/0 (socket says 172.21.15.72:57140) 2023-08-25T04:47:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.296+0000 7fd76f7fe700 1 -- 172.21.15.72:0/936543263 learned_addr learned my addr 172.21.15.72:0/936543263 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76ffff700 1 --2- 172.21.15.72:0/936543263 >> v2:172.21.15.137:3300/0 conn(0x7fd7700cda40 0x7fd7700cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941277402 0 0) 0x7fd7700d1fe0 con 0x7fd77015ce60 2023-08-25T04:47:22.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7580035b0 con 0x7fd77015ce60 2023-08-25T04:47:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 532370084 0 0) 0x7fd7580035b0 con 0x7fd77015ce60 2023-08-25T04:47:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 >> v2:172.21.15.137:3300/0 conn(0x7fd7700cda40 msgr2=0x7fd7700cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 --2- 172.21.15.72:0/936543263 >> v2:172.21.15.137:3300/0 conn(0x7fd7700cda40 0x7fd7700cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 >> v1:172.21.15.137:6789/0 conn(0x7fd7700d0df0 legacy=0x7fd7700d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7700d16b0 con 0x7fd77015ce60 2023-08-25T04:47:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fd760001670 con 0x7fd77015ce60 2023-08-25T04:47:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 >> v1:172.21.15.72:6789/0 conn(0x7fd77015ce60 legacy=0x7fd7700b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd758003a00 0x7fd758003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd758004850 0x7fd758004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.297+0000 7fd76e7fc700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd758005210 0x7fd75800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75800c130 con 0x7fd758004850 2023-08-25T04:47:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75800c2a0 con 0x7fd758003a00 2023-08-25T04:47:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75800c460 con 0x7fd758005210 2023-08-25T04:47:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76effd700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd758004850 0x7fd758004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76f7fe700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd758003a00 0x7fd758003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76ffff700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd758005210 0x7fd75800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76effd700 1 -- 172.21.15.72:0/936543263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd758005210 msgr2=0x7fd75800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76effd700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd758005210 0x7fd75800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76effd700 1 -- 172.21.15.72:0/936543263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd758003a00 msgr2=0x7fd758003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76effd700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd758003a00 0x7fd758003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76effd700 1 -- 172.21.15.72:0/936543263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7580035b0 con 0x7fd758004850 2023-08-25T04:47:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76ffff700 1 -- 172.21.15.72:0/936543263 reap_dead start 2023-08-25T04:47:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76effd700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd758004850 0x7fd758004cd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd7640018d0 tx=0x7fd758005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b40b785fe9efc57 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.298+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640052d0 con 0x7fd758004850 2023-08-25T04:47:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.299+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd764005430 con 0x7fd758004850 2023-08-25T04:47:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.299+0000 7fd76e7fc700 1 -- 172.21.15.72:0/936543263 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640038a0 con 0x7fd758004850 2023-08-25T04:47:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.299+0000 7fd7761ff700 1 -- 172.21.15.72:0/936543263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd758004850 msgr2=0x7fd758004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.299+0000 7fd7761ff700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd758004850 0x7fd758004cd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd7640018d0 tx=0x7fd758005880 comp rx=0 tx=0).stop 2023-08-25T04:47:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.299+0000 7fd7761ff700 1 -- 172.21.15.72:0/936543263 shutdown_connections 2023-08-25T04:47:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.299+0000 7fd7761ff700 1 --2- 172.21.15.72:0/936543263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd758004850 0x7fd758004cd0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.299+0000 7fd7761ff700 1 -- 172.21.15.72:0/936543263 >> 172.21.15.72:0/936543263 conn(0x7fd770071e10 msgr2=0x7fd770072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.299+0000 7fd7761ff700 1 -- 172.21.15.72:0/936543263 shutdown_connections 2023-08-25T04:47:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.299+0000 7fd7761ff700 1 -- 172.21.15.72:0/936543263 wait complete. 2023-08-25T04:47:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.301+0000 7fd7761ff700 1 Processor -- start 2023-08-25T04:47:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.301+0000 7fd7761ff700 1 -- start start 2023-08-25T04:47:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd7761ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd758004850 0x7fd770159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd7761ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7700b3620 0x7fd7700b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd7761ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7700c83c0 0x7fd7700c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd7761ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700b3fe0 con 0x7fd7700c83c0 2023-08-25T04:47:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd7761ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700c9190 con 0x7fd758004850 2023-08-25T04:47:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd7761ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7701f58b0 con 0x7fd7700b3620 2023-08-25T04:47:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd76ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7700c83c0 0x7fd7700c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd76ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7700c83c0 0x7fd7700c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44810/0 (socket says 172.21.15.72:44810) 2023-08-25T04:47:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd76ffff700 1 -- 172.21.15.72:0/604844034 learned_addr learned my addr 172.21.15.72:0/604844034 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd76effd700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7700b3620 0x7fd7700b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.302+0000 7fd76f7fe700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd758004850 0x7fd770159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd76ffff700 1 -- 172.21.15.72:0/604844034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7700b3620 msgr2=0x7fd7700b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd76ffff700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7700b3620 0x7fd7700b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd76ffff700 1 -- 172.21.15.72:0/604844034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd758004850 msgr2=0x7fd770159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd76ffff700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd758004850 0x7fd770159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd76ffff700 1 -- 172.21.15.72:0/604844034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7701f5b90 con 0x7fd7700c83c0 2023-08-25T04:47:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd76effd700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7700b3620 0x7fd7700b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd76f7fe700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd758004850 0x7fd770159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd76ffff700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7700c83c0 0x7fd7700c8840 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd7700b5040 tx=0x7fd7680114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd757fff700 1 -- 172.21.15.72:0/604844034 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76800e070 con 0x7fd7700c83c0 2023-08-25T04:47:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd757fff700 1 -- 172.21.15.72:0/604844034 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd768003c30 con 0x7fd7700c83c0 2023-08-25T04:47:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd7761ff700 1 -- 172.21.15.72:0/604844034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7701f5e70 con 0x7fd7700c83c0 2023-08-25T04:47:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd757fff700 1 -- 172.21.15.72:0/604844034 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768003e20 con 0x7fd7700c83c0 2023-08-25T04:47:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.303+0000 7fd7761ff700 1 -- 172.21.15.72:0/604844034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77015a490 con 0x7fd7700c83c0 2023-08-25T04:47:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.304+0000 7fd7761ff700 1 -- 172.21.15.72:0/604844034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77004e620 con 0x7fd7700c83c0 2023-08-25T04:47:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.305+0000 7fd757fff700 1 -- 172.21.15.72:0/604844034 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd7680119b0 con 0x7fd7700c83c0 2023-08-25T04:47:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.306+0000 7fd757fff700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd75c06a0e0 0x7fd75c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.306+0000 7fd757fff700 1 -- 172.21.15.72:0/604844034 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd768088a30 con 0x7fd7700c83c0 2023-08-25T04:47:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.306+0000 7fd76f7fe700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd75c06a0e0 0x7fd75c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.307+0000 7fd76f7fe700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd75c06a0e0 0x7fd75c06c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd7700b1cf0 tx=0x7fd760009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.310+0000 7fd757fff700 1 -- 172.21.15.72:0/604844034 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd768054290 con 0x7fd7700c83c0 2023-08-25T04:47:22.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.510+0000 7fd7761ff700 1 -- 172.21.15.72:0/604844034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7700721f0 con 0x7fd7700c83c0 2023-08-25T04:47:22.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.511+0000 7fd757fff700 1 -- 172.21.15.72:0/604844034 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+14786 (secure 0 0 0) 0x7fd768014350 con 0x7fd7700c83c0 2023-08-25T04:47:22.512 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:22.512 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":36,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:47:18.472760+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:47:22.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 -- 172.21.15.72:0/604844034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd75c06a0e0 msgr2=0x7fd75c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd75c06a0e0 0x7fd75c06c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd7700b1cf0 tx=0x7fd760009040 comp rx=0 tx=0).stop 2023-08-25T04:47:22.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 -- 172.21.15.72:0/604844034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7700c83c0 msgr2=0x7fd7700c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7700c83c0 0x7fd7700c8840 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd7700b5040 tx=0x7fd7680114b0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 -- 172.21.15.72:0/604844034 shutdown_connections 2023-08-25T04:47:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd75c06a0e0 0x7fd75c06c5a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7700c83c0 0x7fd7700c8840 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd758004850 0x7fd770159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 --2- 172.21.15.72:0/604844034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd7700b3620 0x7fd7700b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 -- 172.21.15.72:0/604844034 >> 172.21.15.72:0/604844034 conn(0x7fd770071e10 msgr2=0x7fd77015c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 -- 172.21.15.72:0/604844034 shutdown_connections 2023-08-25T04:47:22.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.513+0000 7fd7761ff700 1 -- 172.21.15.72:0/604844034 wait complete. 2023-08-25T04:47:22.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:45:25.331085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:45:25.911226+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:47:22.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:47:22.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.730+0000 7fc6e91ff700 1 Processor -- start 2023-08-25T04:47:22.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.730+0000 7fc6e91ff700 1 -- start start 2023-08-25T04:47:22.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.731+0000 7fc6e91ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc6e40cb650 0x7fc6e40cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.731+0000 7fc6e91ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6e40c9010 0x7fc6e41619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e91ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e40cbf70 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e91ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e40cb070 con 0x7fc6e40c9010 2023-08-25T04:47:22.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e91ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e4164f50 con 0x7fc6e40cb650 2023-08-25T04:47:22.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e359e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6e40c9010 0x7fc6e41619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e359e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6e40c9010 0x7fc6e41619a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44822/0 (socket says 172.21.15.72:44822) 2023-08-25T04:47:22.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e359e700 1 -- 172.21.15.72:0/1698673095 learned_addr learned my addr 172.21.15.72:0/1698673095 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:22.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6da59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc6e40ae2f0 0x7fc6e40ca960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57156/0 (socket says 172.21.15.72:57156) 2023-08-25T04:47:22.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e2d9d700 1 --2- 172.21.15.72:0/1698673095 >> v2:172.21.15.137:3300/0 conn(0x7fc6e40cb650 0x7fc6e40cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e359e700 1 -- 172.21.15.72:0/1698673095 >> v2:172.21.15.137:3300/0 conn(0x7fc6e40cb650 msgr2=0x7fc6e40cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:22.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e359e700 1 --2- 172.21.15.72:0/1698673095 >> v2:172.21.15.137:3300/0 conn(0x7fc6e40cb650 0x7fc6e40cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e359e700 1 -- 172.21.15.72:0/1698673095 >> v1:172.21.15.72:6789/0 conn(0x7fc6e40ae2f0 legacy=0x7fc6e40ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e359e700 1 -- 172.21.15.72:0/1698673095 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4165230 con 0x7fc6e40c9010 2023-08-25T04:47:22.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e2d9d700 1 --2- 172.21.15.72:0/1698673095 >> v2:172.21.15.137:3300/0 conn(0x7fc6e40cb650 0x7fc6e40cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:22.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.732+0000 7fc6e259c700 1 -- 172.21.15.72:0/1698673095 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607594757 0 0) 0x7fc6e40cbf70 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e359e700 1 --2- 172.21.15.72:0/1698673095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40c9010 0x7fc6e41619a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc6e406edb0 tx=0x7fc6dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e595f20419e0c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:22.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e259c700 1 -- 172.21.15.72:0/1698673095 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00b870 con 0x7fc6e40c9010 2023-08-25T04:47:22.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e259c700 1 -- 172.21.15.72:0/1698673095 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc00b9d0 con 0x7fc6e40c9010 2023-08-25T04:47:22.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e259c700 1 -- 172.21.15.72:0/1698673095 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00bd60 con 0x7fc6e40c9010 2023-08-25T04:47:22.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e91ff700 1 -- 172.21.15.72:0/1698673095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40c9010 msgr2=0x7fc6e41619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e91ff700 1 --2- 172.21.15.72:0/1698673095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40c9010 0x7fc6e41619a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc6e406edb0 tx=0x7fc6dc009bd0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e91ff700 1 -- 172.21.15.72:0/1698673095 shutdown_connections 2023-08-25T04:47:22.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e91ff700 1 --2- 172.21.15.72:0/1698673095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40c9010 0x7fc6e41619a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e91ff700 1 --2- 172.21.15.72:0/1698673095 >> v2:172.21.15.137:3300/0 conn(0x7fc6e40cb650 0x7fc6e40cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e91ff700 1 -- 172.21.15.72:0/1698673095 >> 172.21.15.72:0/1698673095 conn(0x7fc6e406a710 msgr2=0x7fc6e406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:22.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.733+0000 7fc6e91ff700 1 -- 172.21.15.72:0/1698673095 shutdown_connections 2023-08-25T04:47:22.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.734+0000 7fc6e91ff700 1 -- 172.21.15.72:0/1698673095 wait complete. 2023-08-25T04:47:22.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.735+0000 7fc6e91ff700 1 Processor -- start 2023-08-25T04:47:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.735+0000 7fc6e91ff700 1 -- start start 2023-08-25T04:47:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.736+0000 7fc6e91ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40ae2f0 0x7fc6e40c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.736+0000 7fc6e91ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e40c9010 0x7fc6e4159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.736+0000 7fc6e91ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40cb650 0x7fc6e40b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.736+0000 7fc6e91ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40c8630 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.736+0000 7fc6e91ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40c7ab0 con 0x7fc6e40cb650 2023-08-25T04:47:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.736+0000 7fc6e91ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40c7d90 con 0x7fc6e40c9010 2023-08-25T04:47:22.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.736+0000 7fc6e2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40ae2f0 0x7fc6e40c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6e2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40ae2f0 0x7fc6e40c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44830/0 (socket says 172.21.15.72:44830) 2023-08-25T04:47:22.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6e2d9d700 1 -- 172.21.15.72:0/4117648406 learned_addr learned my addr 172.21.15.72:0/4117648406 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:22.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6da59c700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e40c9010 0x7fc6e4159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6e359e700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40cb650 0x7fc6e40b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6e2d9d700 1 -- 172.21.15.72:0/4117648406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e40c9010 msgr2=0x7fc6e4159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6e2d9d700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e40c9010 0x7fc6e4159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6e2d9d700 1 -- 172.21.15.72:0/4117648406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40cb650 msgr2=0x7fc6e40b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6e2d9d700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40cb650 0x7fc6e40b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6e2d9d700 1 -- 172.21.15.72:0/4117648406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc009550 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6e2d9d700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40ae2f0 0x7fc6e40c74a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400e760 tx=0x7fc6d400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:22.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6dbfff700 1 -- 172.21.15.72:0/4117648406 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4013610 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6dbfff700 1 -- 172.21.15.72:0/4117648406 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d4013770 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6e91ff700 1 -- 172.21.15.72:0/4117648406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e40c8070 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.737+0000 7fc6dbfff700 1 -- 172.21.15.72:0/4117648406 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4013b20 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.738+0000 7fc6e91ff700 1 -- 172.21.15.72:0/4117648406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e40b3cc0 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.739+0000 7fc6e91ff700 1 -- 172.21.15.72:0/4117648406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e4072320 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.739+0000 7fc6dbfff700 1 -- 172.21.15.72:0/4117648406 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc6d4013c80 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.740+0000 7fc6dbfff700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc6c406a0e0 0x7fc6c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:22.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.740+0000 7fc6dbfff700 1 -- 172.21.15.72:0/4117648406 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc6d4087f50 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.741+0000 7fc6da59c700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc6c406a0e0 0x7fc6c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:22.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.741+0000 7fc6da59c700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc6c406a0e0 0x7fc6c406c5a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40c79e0 tx=0x7fc6cc001970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:22.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.745+0000 7fc6dbfff700 1 -- 172.21.15.72:0/4117648406 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc6d40572e0 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.944+0000 7fc6e91ff700 1 -- 172.21.15.72:0/4117648406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6e40b14d0 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.944+0000 7fc6dbfff700 1 -- 172.21.15.72:0/4117648406 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6d4056e70 con 0x7fc6e40ae2f0 2023-08-25T04:47:22.945 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-25T04:47:22.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.946+0000 7fc6e91ff700 1 -- 172.21.15.72:0/4117648406 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc6c406a0e0 msgr2=0x7fc6c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.946+0000 7fc6e91ff700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc6c406a0e0 0x7fc6c406c5a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40c79e0 tx=0x7fc6cc001970 comp rx=0 tx=0).stop 2023-08-25T04:47:22.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.946+0000 7fc6e91ff700 1 -- 172.21.15.72:0/4117648406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40ae2f0 msgr2=0x7fc6e40c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:22.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.946+0000 7fc6e91ff700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40ae2f0 0x7fc6e40c74a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400e760 tx=0x7fc6d400eb20 comp rx=0 tx=0).stop 2023-08-25T04:47:22.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.946+0000 7fc6e91ff700 1 -- 172.21.15.72:0/4117648406 shutdown_connections 2023-08-25T04:47:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.946+0000 7fc6e91ff700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc6c406a0e0 0x7fc6c406c5a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.946+0000 7fc6e91ff700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6e40cb650 0x7fc6e40b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.946+0000 7fc6e91ff700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e40ae2f0 0x7fc6e40c74a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.946+0000 7fc6e91ff700 1 --2- 172.21.15.72:0/4117648406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6e40c9010 0x7fc6e4159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.947+0000 7fc6e91ff700 1 -- 172.21.15.72:0/4117648406 >> 172.21.15.72:0/4117648406 conn(0x7fc6e406a710 msgr2=0x7fc6e40afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.947+0000 7fc6e91ff700 1 -- 172.21.15.72:0/4117648406 shutdown_connections 2023-08-25T04:47:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:22.947+0000 7fc6e91ff700 1 -- 172.21.15.72:0/4117648406 wait complete. 2023-08-25T04:47:22.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:47:23.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.163+0000 7f12d15ff700 1 Processor -- start 2023-08-25T04:47:23.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.163+0000 7f12d15ff700 1 -- start start 2023-08-25T04:47:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.164+0000 7f12d15ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12cc0b2810 0x7f12cc0b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.164+0000 7f12d15ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12cc0add40 0x7f12cc0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.164+0000 7f12d15ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12cc0b4300 con 0x7f12cc0cb650 2023-08-25T04:47:23.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.164+0000 7f12d15ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12cc0b3260 con 0x7f12cc0b2810 2023-08-25T04:47:23.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.164+0000 7f12d15ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0b3540 con 0x7f12cc0add40 2023-08-25T04:47:23.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.164+0000 7f12c3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12cc0b2810 0x7f12cc0b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.164+0000 7f12c3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12cc0b2810 0x7f12cc0b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52722/0 (socket says 172.21.15.72:52722) 2023-08-25T04:47:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.164+0000 7f12c3fff700 1 -- 172.21.15.72:0/2611338707 learned_addr learned my addr 172.21.15.72:0/2611338707 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.164+0000 7f12caffd700 1 --1- 172.21.15.72:0/2611338707 >> v1:172.21.15.72:6789/0 conn(0x7f12cc0cb650 0x7f12cc0cba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57198/0 (socket says 172.21.15.72:57198) 2023-08-25T04:47:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.165+0000 7f12c3fff700 1 -- 172.21.15.72:0/2611338707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12cc0add40 msgr2=0x7f12cc0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.165+0000 7f12c3fff700 1 --2- 172.21.15.72:0/2611338707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12cc0add40 0x7f12cc0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.165+0000 7f12c3fff700 1 -- 172.21.15.72:0/2611338707 >> v1:172.21.15.72:6789/0 conn(0x7f12cc0cb650 legacy=0x7f12cc0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.165+0000 7f12c3fff700 1 -- 172.21.15.72:0/2611338707 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc0b3820 con 0x7f12cc0b2810 2023-08-25T04:47:23.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.165+0000 7f12c3fff700 1 --2- 172.21.15.72:0/2611338707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0b2810 0x7f12cc0b2c70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f12b40098f0 tx=0x7f12b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a90787a1b6cb20 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:23.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.165+0000 7f12ca7fc700 1 -- 172.21.15.72:0/2611338707 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4004230 con 0x7f12cc0b2810 2023-08-25T04:47:23.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.165+0000 7f12ca7fc700 1 -- 172.21.15.72:0/2611338707 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4004390 con 0x7f12cc0b2810 2023-08-25T04:47:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.165+0000 7f12ca7fc700 1 -- 172.21.15.72:0/2611338707 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b40036a0 con 0x7f12cc0b2810 2023-08-25T04:47:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.166+0000 7f12d15ff700 1 -- 172.21.15.72:0/2611338707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0b2810 msgr2=0x7f12cc0b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.166+0000 7f12d15ff700 1 --2- 172.21.15.72:0/2611338707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0b2810 0x7f12cc0b2c70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f12b40098f0 tx=0x7f12b4009c00 comp rx=0 tx=0).stop 2023-08-25T04:47:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.166+0000 7f12d15ff700 1 -- 172.21.15.72:0/2611338707 shutdown_connections 2023-08-25T04:47:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.166+0000 7f12d15ff700 1 --2- 172.21.15.72:0/2611338707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12cc0add40 0x7f12cc0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.166+0000 7f12d15ff700 1 --2- 172.21.15.72:0/2611338707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0b2810 0x7f12cc0b2c70 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.166+0000 7f12d15ff700 1 -- 172.21.15.72:0/2611338707 >> 172.21.15.72:0/2611338707 conn(0x7f12cc06a710 msgr2=0x7f12cc06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.166+0000 7f12d15ff700 1 -- 172.21.15.72:0/2611338707 shutdown_connections 2023-08-25T04:47:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.166+0000 7f12d15ff700 1 -- 172.21.15.72:0/2611338707 wait complete. 2023-08-25T04:47:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.168+0000 7f12d15ff700 1 Processor -- start 2023-08-25T04:47:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.168+0000 7f12d15ff700 1 -- start start 2023-08-25T04:47:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.169+0000 7f12d15ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0add40 0x7f12cc1f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12d15ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12cc0b2810 0x7f12cc0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12d15ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc0cb650 0x7f12cc0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12d15ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0c96e0 con 0x7f12cc0add40 2023-08-25T04:47:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12d15ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0c3750 con 0x7f12cc0cb650 2023-08-25T04:47:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12d15ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc1f5ce0 con 0x7f12cc0b2810 2023-08-25T04:47:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12caffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0add40 0x7f12cc1f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12caffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0add40 0x7f12cc1f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52734/0 (socket says 172.21.15.72:52734) 2023-08-25T04:47:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12caffd700 1 -- 172.21.15.72:0/1709999365 learned_addr learned my addr 172.21.15.72:0/1709999365 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12c3fff700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12cc0b2810 0x7f12cc0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12cb7fe700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc0cb650 0x7f12cc0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12caffd700 1 -- 172.21.15.72:0/1709999365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12cc0b2810 msgr2=0x7f12cc0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12caffd700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12cc0b2810 0x7f12cc0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12caffd700 1 -- 172.21.15.72:0/1709999365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc0cb650 msgr2=0x7f12cc0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12caffd700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc0cb650 0x7f12cc0cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12caffd700 1 -- 172.21.15.72:0/1709999365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b4009550 con 0x7f12cc0add40 2023-08-25T04:47:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12cb7fe700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc0cb650 0x7f12cc0cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.170+0000 7f12c3fff700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12cc0b2810 0x7f12cc0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.171+0000 7f12caffd700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0add40 0x7f12cc1f5700 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c780 tx=0x7f12bc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.171+0000 7f12c37fe700 1 -- 172.21.15.72:0/1709999365 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc004c80 con 0x7f12cc0add40 2023-08-25T04:47:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.171+0000 7f12c37fe700 1 -- 172.21.15.72:0/1709999365 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc004de0 con 0x7f12cc0add40 2023-08-25T04:47:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.171+0000 7f12c37fe700 1 -- 172.21.15.72:0/1709999365 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0072f0 con 0x7f12cc0add40 2023-08-25T04:47:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.171+0000 7f12d15ff700 1 -- 172.21.15.72:0/1709999365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12cc1f5fc0 con 0x7f12cc0add40 2023-08-25T04:47:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.171+0000 7f12d15ff700 1 -- 172.21.15.72:0/1709999365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12cc1f6580 con 0x7f12cc0add40 2023-08-25T04:47:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.172+0000 7f12d15ff700 1 -- 172.21.15.72:0/1709999365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12cc0c3920 con 0x7f12cc0add40 2023-08-25T04:47:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.173+0000 7f12c37fe700 1 -- 172.21.15.72:0/1709999365 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f12bc007450 con 0x7f12cc0add40 2023-08-25T04:47:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.174+0000 7f12c37fe700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f12ac06a0e0 0x7f12ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.174+0000 7f12c37fe700 1 -- 172.21.15.72:0/1709999365 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f12bc087620 con 0x7f12cc0add40 2023-08-25T04:47:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.174+0000 7f12c3fff700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f12ac06a0e0 0x7f12ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.174+0000 7f12c3fff700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f12ac06a0e0 0x7f12ac06c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009130 tx=0x7f12b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.178+0000 7f12c37fe700 1 -- 172.21.15.72:0/1709999365 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f12bc052f10 con 0x7f12cc0add40 2023-08-25T04:47:23.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.372+0000 7f12d15ff700 1 -- 172.21.15.72:0/1709999365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12cc072320 con 0x7f12cc0add40 2023-08-25T04:47:23.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.373+0000 7f12c37fe700 1 -- 172.21.15.72:0/1709999365 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12bc018020 con 0x7f12cc0add40 2023-08-25T04:47:23.374 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-25T04:47:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 -- 172.21.15.72:0/1709999365 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f12ac06a0e0 msgr2=0x7f12ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f12ac06a0e0 0x7f12ac06c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009130 tx=0x7f12b4008030 comp rx=0 tx=0).stop 2023-08-25T04:47:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 -- 172.21.15.72:0/1709999365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0add40 msgr2=0x7f12cc1f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0add40 0x7f12cc1f5700 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c780 tx=0x7f12bc00cb40 comp rx=0 tx=0).stop 2023-08-25T04:47:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 -- 172.21.15.72:0/1709999365 shutdown_connections 2023-08-25T04:47:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f12ac06a0e0 0x7f12ac06c5a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12cc0cb650 0x7f12cc0cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12cc0add40 0x7f12cc1f5700 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 --2- 172.21.15.72:0/1709999365 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12cc0b2810 0x7f12cc0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 -- 172.21.15.72:0/1709999365 >> 172.21.15.72:0/1709999365 conn(0x7f12cc06a710 msgr2=0x7f12cc06aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 -- 172.21.15.72:0/1709999365 shutdown_connections 2023-08-25T04:47:23.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.375+0000 7f12d15ff700 1 -- 172.21.15.72:0/1709999365 wait complete. 2023-08-25T04:47:23.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:47:23.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.588+0000 7f34cffff700 1 Processor -- start 2023-08-25T04:47:23.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.588+0000 7f34cffff700 1 -- start start 2023-08-25T04:47:23.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.589+0000 7f34cffff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f34c815ce60 0x7f34c80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.589+0000 7f34cffff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34c80cda40 0x7f34c80cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.589+0000 7f34cffff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c80d1fe0 con 0x7f34c80b8770 2023-08-25T04:47:23.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.589+0000 7f34cffff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c80d2b80 con 0x7f34c815ce60 2023-08-25T04:47:23.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.589+0000 7f34cffff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c80ce410 con 0x7f34c80cda40 2023-08-25T04:47:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.589+0000 7f34cd59a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f34c80b8770 0x7f34c80d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57206/0 (socket says 172.21.15.72:57206) 2023-08-25T04:47:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.589+0000 7f34cdd9b700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f34c815ce60 0x7f34c80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.589+0000 7f34cd59a700 1 -- 172.21.15.72:0/3370571611 learned_addr learned my addr 172.21.15.72:0/3370571611 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ce59c700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34c80cda40 0x7f34c80cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264576444 0 0) 0x7f34c80d1fe0 con 0x7f34c80b8770 2023-08-25T04:47:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34b40035b0 con 0x7f34c80b8770 2023-08-25T04:47:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1708240118 0 0) 0x7f34b40035b0 con 0x7f34c80b8770 2023-08-25T04:47:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34c80cda40 msgr2=0x7f34c80cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34c80cda40 0x7f34c80cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 >> v2:172.21.15.137:3300/0 conn(0x7f34c815ce60 msgr2=0x7f34c80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 --2- 172.21.15.72:0/3370571611 >> v2:172.21.15.137:3300/0 conn(0x7f34c815ce60 0x7f34c80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c80d13d0 con 0x7f34c80b8770 2023-08-25T04:47:23.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f34b8001670 con 0x7f34c80b8770 2023-08-25T04:47:23.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 >> v1:172.21.15.72:6789/0 conn(0x7f34c80b8770 legacy=0x7f34c80d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34b4003a00 0x7f34b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34c80cda40 0x7f34b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34b4004d90 0x7f34b4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c80ce410 con 0x7f34b4003a00 2023-08-25T04:47:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b400ba10 con 0x7f34b4004d90 2023-08-25T04:47:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.590+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b400bb50 con 0x7f34c80cda40 2023-08-25T04:47:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34cdd9b700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34b4003a00 0x7f34b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34cd59a700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34c80cda40 0x7f34b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34ce59c700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34b4004d90 0x7f34b4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34cdd9b700 1 -- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34c80cda40 msgr2=0x7f34b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34cdd9b700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34c80cda40 0x7f34b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34cdd9b700 1 -- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34b4004d90 msgr2=0x7f34b4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34cdd9b700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34b4004d90 0x7f34b4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34cdd9b700 1 -- 172.21.15.72:0/3370571611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b40035b0 con 0x7f34b4003a00 2023-08-25T04:47:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34cdd9b700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34b4003a00 0x7f34b4003e20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009b60 tx=0x7f34b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f99fe558fe2226 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c400e6c0 con 0x7f34b4003a00 2023-08-25T04:47:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c400e820 con 0x7f34b4003a00 2023-08-25T04:47:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.591+0000 7f34ccd99700 1 -- 172.21.15.72:0/3370571611 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c400eb90 con 0x7f34b4003a00 2023-08-25T04:47:23.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.592+0000 7f34cffff700 1 -- 172.21.15.72:0/3370571611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34b4003a00 msgr2=0x7f34b4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.592+0000 7f34cffff700 1 --2- 172.21.15.72:0/3370571611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34b4003a00 0x7f34b4003e20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009b60 tx=0x7f34b4005880 comp rx=0 tx=0).stop 2023-08-25T04:47:23.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.592+0000 7f34ce59c700 1 -- 172.21.15.72:0/3370571611 reap_dead start 2023-08-25T04:47:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.592+0000 7f34cffff700 1 -- 172.21.15.72:0/3370571611 shutdown_connections 2023-08-25T04:47:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.592+0000 7f34cffff700 1 -- 172.21.15.72:0/3370571611 >> 172.21.15.72:0/3370571611 conn(0x7f34c8071e10 msgr2=0x7f34c8072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.592+0000 7f34cffff700 1 -- 172.21.15.72:0/3370571611 shutdown_connections 2023-08-25T04:47:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.592+0000 7f34cffff700 1 -- 172.21.15.72:0/3370571611 wait complete. 2023-08-25T04:47:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.594+0000 7f34cffff700 1 Processor -- start 2023-08-25T04:47:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.594+0000 7f34cffff700 1 -- start start 2023-08-25T04:47:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34cffff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34b4003a00 0x7f34c81f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34cffff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34c80cbc40 0x7f34c80cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c81f1990 0x7f34c81f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34cffff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c80c7950 con 0x7f34c81f1990 2023-08-25T04:47:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34cffff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c80cc600 con 0x7f34c80cbc40 2023-08-25T04:47:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34cffff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c81f2350 con 0x7f34b4003a00 2023-08-25T04:47:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34ce59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c81f1990 0x7f34c81f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34ce59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c81f1990 0x7f34c81f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52748/0 (socket says 172.21.15.72:52748) 2023-08-25T04:47:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34ce59c700 1 -- 172.21.15.72:0/1764909328 learned_addr learned my addr 172.21.15.72:0/1764909328 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34cdd9b700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34b4003a00 0x7f34c81f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.595+0000 7f34cd59a700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34c80cbc40 0x7f34c80cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34ce59c700 1 -- 172.21.15.72:0/1764909328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34b4003a00 msgr2=0x7f34c81f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34ce59c700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34b4003a00 0x7f34c81f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34ce59c700 1 -- 172.21.15.72:0/1764909328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34c80cbc40 msgr2=0x7f34c80cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34ce59c700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34c80cbc40 0x7f34c80cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34ce59c700 1 -- 172.21.15.72:0/1764909328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c815df00 con 0x7f34c81f1990 2023-08-25T04:47:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34ce59c700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c81f1990 0x7f34c81f1e10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f34c0007d10 tx=0x7f34c00114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34be7fc700 1 -- 172.21.15.72:0/1764909328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c000e070 con 0x7f34c81f1990 2023-08-25T04:47:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34be7fc700 1 -- 172.21.15.72:0/1764909328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c0003c30 con 0x7f34c81f1990 2023-08-25T04:47:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34be7fc700 1 -- 172.21.15.72:0/1764909328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0003e20 con 0x7f34c81f1990 2023-08-25T04:47:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34cffff700 1 -- 172.21.15.72:0/1764909328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c80cc870 con 0x7f34c81f1990 2023-08-25T04:47:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.596+0000 7f34cffff700 1 -- 172.21.15.72:0/1764909328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c80cce30 con 0x7f34c81f1990 2023-08-25T04:47:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.597+0000 7f34cffff700 1 -- 172.21.15.72:0/1764909328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c80c7b00 con 0x7f34c81f1990 2023-08-25T04:47:23.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.598+0000 7f34be7fc700 1 -- 172.21.15.72:0/1764909328 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f34c0011a40 con 0x7f34c81f1990 2023-08-25T04:47:23.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.599+0000 7f34be7fc700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f34ac06a0e0 0x7f34ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:23.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.599+0000 7f34be7fc700 1 -- 172.21.15.72:0/1764909328 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f34c00889b0 con 0x7f34c81f1990 2023-08-25T04:47:23.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.599+0000 7f34cdd9b700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f34ac06a0e0 0x7f34ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:23.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.600+0000 7f34cdd9b700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f34ac06a0e0 0x7f34ac06c5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f34c40090b0 tx=0x7f34c4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:23.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.604+0000 7f34be7fc700 1 -- 172.21.15.72:0/1764909328 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f34c80c7b00 con 0x7f34c81f1990 2023-08-25T04:47:23.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.801+0000 7f34cffff700 1 -- 172.21.15.72:0/1764909328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f34c80cd050 con 0x7f34c81f1990 2023-08-25T04:47:23.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.802+0000 7f34be7fc700 1 -- 172.21.15.72:0/1764909328 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+126 (secure 0 0 0) 0x7f34c0057d40 con 0x7f34c81f1990 2023-08-25T04:47:23.803 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:23.803 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-25T04:47:23.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:23.804 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-25T04:47:23.804 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-25T04:47:23.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:23.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-25T04:47:23.804 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-25T04:47:23.805 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-08-25T04:47:23.805 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:23.805 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-25T04:47:23.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 -- 172.21.15.72:0/1764909328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f34ac06a0e0 msgr2=0x7f34ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f34ac06a0e0 0x7f34ac06c5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f34c40090b0 tx=0x7f34c4008030 comp rx=0 tx=0).stop 2023-08-25T04:47:23.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 -- 172.21.15.72:0/1764909328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c81f1990 msgr2=0x7f34c81f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:23.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c81f1990 0x7f34c81f1e10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f34c0007d10 tx=0x7f34c00114b0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 -- 172.21.15.72:0/1764909328 shutdown_connections 2023-08-25T04:47:23.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f34ac06a0e0 0x7f34ac06c5a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c81f1990 0x7f34c81f1e10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f34b4003a00 0x7f34c81f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 --2- 172.21.15.72:0/1764909328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34c80cbc40 0x7f34c80cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:23.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 -- 172.21.15.72:0/1764909328 >> 172.21.15.72:0/1764909328 conn(0x7f34c8071e10 msgr2=0x7f34c815c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:23.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 -- 172.21.15.72:0/1764909328 shutdown_connections 2023-08-25T04:47:23.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:23.804+0000 7f34cffff700 1 -- 172.21.15.72:0/1764909328 wait complete. 2023-08-25T04:47:23.823 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:47:23.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:47:24.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.023+0000 7f6488dff700 1 Processor -- start 2023-08-25T04:47:24.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.024+0000 7f6488dff700 1 -- start start 2023-08-25T04:47:24.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f6488dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64840cc500 0x7f64840ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:24.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f6488dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64840cc980 0x7f64840cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:24.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f6488dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64840cf300 con 0x7f64840b27c0 2023-08-25T04:47:24.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f6488dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64840cc0e0 con 0x7f64840cc500 2023-08-25T04:47:24.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f6488dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648415db50 con 0x7f64840cc980 2023-08-25T04:47:24.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f647bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64840cc500 0x7f64840ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:24.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f647bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64840cc500 0x7f64840ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52754/0 (socket says 172.21.15.72:52754) 2023-08-25T04:47:24.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f647bfff700 1 -- 172.21.15.72:0/3471098848 learned_addr learned my addr 172.21.15.72:0/3471098848 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f6482d9d700 1 --2- 172.21.15.72:0/3471098848 >> v2:172.21.15.137:3300/0 conn(0x7f64840cc980 0x7f64840cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f647bfff700 1 -- 172.21.15.72:0/3471098848 >> v2:172.21.15.137:3300/0 conn(0x7f64840cc980 msgr2=0x7f64840cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f647bfff700 1 --2- 172.21.15.72:0/3471098848 >> v2:172.21.15.137:3300/0 conn(0x7f64840cc980 0x7f64840cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f647bfff700 1 -- 172.21.15.72:0/3471098848 >> v1:172.21.15.72:6789/0 conn(0x7f64840b27c0 legacy=0x7f64840b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f647bfff700 1 -- 172.21.15.72:0/3471098848 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64840cb7c0 con 0x7f64840cc500 2023-08-25T04:47:24.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.025+0000 7f6481d9b700 1 -- 172.21.15.72:0/3471098848 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707887090 0 0) 0x7f64840cf300 con 0x7f64840b27c0 2023-08-25T04:47:24.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.026+0000 7f647bfff700 1 --2- 172.21.15.72:0/3471098848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840cc500 0x7f64840ce880 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f648406d590 tx=0x7f646c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bcebede15a667a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:24.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.026+0000 7f6481d9b700 1 -- 172.21.15.72:0/3471098848 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00b870 con 0x7f64840cc500 2023-08-25T04:47:24.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.026+0000 7f6481d9b700 1 -- 172.21.15.72:0/3471098848 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c00b9d0 con 0x7f64840cc500 2023-08-25T04:47:24.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.026+0000 7f6481d9b700 1 -- 172.21.15.72:0/3471098848 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00bd60 con 0x7f64840cc500 2023-08-25T04:47:24.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.026+0000 7f6488dff700 1 -- 172.21.15.72:0/3471098848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840cc500 msgr2=0x7f64840ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:24.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.026+0000 7f6488dff700 1 --2- 172.21.15.72:0/3471098848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840cc500 0x7f64840ce880 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f648406d590 tx=0x7f646c009bd0 comp rx=0 tx=0).stop 2023-08-25T04:47:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.027+0000 7f6488dff700 1 -- 172.21.15.72:0/3471098848 shutdown_connections 2023-08-25T04:47:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.027+0000 7f6488dff700 1 --2- 172.21.15.72:0/3471098848 >> v2:172.21.15.137:3300/0 conn(0x7f64840cc980 0x7f64840cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.027+0000 7f6488dff700 1 --2- 172.21.15.72:0/3471098848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840cc500 0x7f64840ce880 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.027+0000 7f6488dff700 1 -- 172.21.15.72:0/3471098848 >> 172.21.15.72:0/3471098848 conn(0x7f64840cd7c0 msgr2=0x7f64840cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.027+0000 7f6488dff700 1 -- 172.21.15.72:0/3471098848 shutdown_connections 2023-08-25T04:47:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.027+0000 7f6488dff700 1 -- 172.21.15.72:0/3471098848 wait complete. 2023-08-25T04:47:24.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.028+0000 7f6488dff700 1 Processor -- start 2023-08-25T04:47:24.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.029+0000 7f6488dff700 1 -- start start 2023-08-25T04:47:24.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.029+0000 7f6488dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840b27c0 0x7f648414f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:24.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.029+0000 7f6488dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64840cc500 0x7f64840c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:24.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.029+0000 7f6488dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64840cc980 0x7f64840b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:24.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f6488dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64840b3960 con 0x7f64840b27c0 2023-08-25T04:47:24.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f6488dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64840c67e0 con 0x7f64840cc980 2023-08-25T04:47:24.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f6488dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64841f6070 con 0x7f64840cc500 2023-08-25T04:47:24.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f648259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840b27c0 0x7f648414f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:24.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f648259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840b27c0 0x7f648414f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52768/0 (socket says 172.21.15.72:52768) 2023-08-25T04:47:24.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f648259c700 1 -- 172.21.15.72:0/3941435988 learned_addr learned my addr 172.21.15.72:0/3941435988 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:24.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f6482d9d700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64840cc980 0x7f64840b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:24.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f647bfff700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64840cc500 0x7f64840c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:24.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f648259c700 1 -- 172.21.15.72:0/3941435988 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64840cc500 msgr2=0x7f64840c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f648259c700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64840cc500 0x7f64840c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f648259c700 1 -- 172.21.15.72:0/3941435988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64840cc980 msgr2=0x7f64840b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f648259c700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64840cc980 0x7f64840b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f648259c700 1 -- 172.21.15.72:0/3941435988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c009550 con 0x7f64840b27c0 2023-08-25T04:47:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f6482d9d700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64840cc980 0x7f64840b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f647bfff700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64840cc500 0x7f64840c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.030+0000 7f648259c700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840b27c0 0x7f648414f4e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f647400c750 tx=0x7f647400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.031+0000 7f647affd700 1 -- 172.21.15.72:0/3941435988 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740054e0 con 0x7f64840b27c0 2023-08-25T04:47:24.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.031+0000 7f647affd700 1 -- 172.21.15.72:0/3941435988 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6474003680 con 0x7f64840b27c0 2023-08-25T04:47:24.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.031+0000 7f6488dff700 1 -- 172.21.15.72:0/3941435988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64840c6500 con 0x7f64840b27c0 2023-08-25T04:47:24.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.031+0000 7f647affd700 1 -- 172.21.15.72:0/3941435988 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474003a30 con 0x7f64840b27c0 2023-08-25T04:47:24.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.031+0000 7f6488dff700 1 -- 172.21.15.72:0/3941435988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64841f65f0 con 0x7f64840b27c0 2023-08-25T04:47:24.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.032+0000 7f6488dff700 1 -- 172.21.15.72:0/3941435988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64841f5ed0 con 0x7f64840b27c0 2023-08-25T04:47:24.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.033+0000 7f647affd700 1 -- 172.21.15.72:0/3941435988 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6474003b90 con 0x7f64840b27c0 2023-08-25T04:47:24.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.034+0000 7f647affd700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f646406a110 0x7f646406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:24.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.034+0000 7f647affd700 1 -- 172.21.15.72:0/3941435988 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6474087990 con 0x7f64840b27c0 2023-08-25T04:47:24.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.034+0000 7f647bfff700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f646406a110 0x7f646406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:24.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.035+0000 7f647bfff700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f646406a110 0x7f646406c5d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f64840aff10 tx=0x7f646c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:24.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.039+0000 7f647affd700 1 -- 172.21.15.72:0/3941435988 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f64841f5ed0 con 0x7f64840b27c0 2023-08-25T04:47:24.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.234+0000 7f6488dff700 1 -- 172.21.15.72:0/3941435988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f64841f5ed0 con 0x7f64840b27c0 2023-08-25T04:47:24.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.946+0000 7f647affd700 1 -- 172.21.15.72:0/3941435988 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7f64841f5ed0 con 0x7f64840b27c0 2023-08-25T04:47:24.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.951+0000 7f6488dff700 1 -- 172.21.15.72:0/3941435988 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f646406a110 msgr2=0x7f646406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.951+0000 7f6488dff700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f646406a110 0x7f646406c5d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f64840aff10 tx=0x7f646c008030 comp rx=0 tx=0).stop 2023-08-25T04:47:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.951+0000 7f6488dff700 1 -- 172.21.15.72:0/3941435988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840b27c0 msgr2=0x7f648414f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.951+0000 7f6488dff700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840b27c0 0x7f648414f4e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f647400c750 tx=0x7f647400cb10 comp rx=0 tx=0).stop 2023-08-25T04:47:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.952+0000 7f6488dff700 1 -- 172.21.15.72:0/3941435988 shutdown_connections 2023-08-25T04:47:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.952+0000 7f6488dff700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f646406a110 0x7f646406c5d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.952+0000 7f6488dff700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64840cc980 0x7f64840b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.952+0000 7f6488dff700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840b27c0 0x7f648414f4e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:24.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.952+0000 7f6488dff700 1 --2- 172.21.15.72:0/3941435988 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64840cc500 0x7f64840c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:24.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.952+0000 7f6488dff700 1 -- 172.21.15.72:0/3941435988 >> 172.21.15.72:0/3941435988 conn(0x7f64840cd7c0 msgr2=0x7f6484160c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:24.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.953+0000 7f6488dff700 1 -- 172.21.15.72:0/3941435988 shutdown_connections 2023-08-25T04:47:24.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:24.954+0000 7f6488dff700 1 -- 172.21.15.72:0/3941435988 wait complete. 2023-08-25T04:47:24.956 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-25T04:47:24.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:47:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.179+0000 7fc1821ff700 1 Processor -- start 2023-08-25T04:47:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.179+0000 7fc1821ff700 1 -- start start 2023-08-25T04:47:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.180+0000 7fc1821ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0b89f0 0x7fc17c0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc1821ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c0d19a0 con 0x7fc17c15d170 2023-08-25T04:47:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc1821ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c0d1c80 con 0x7fc17c0ce090 2023-08-25T04:47:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc1821ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0ce500 con 0x7fc17c0b89f0 2023-08-25T04:47:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc17c15d170 0x7fc17c0d1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57226/0 (socket says 172.21.15.72:57226) 2023-08-25T04:47:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17b7fe700 1 -- 172.21.15.72:0/2657683214 learned_addr learned my addr 172.21.15.72:0/2657683214 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc173fff700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0b89f0 0x7fc17c0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853619846 0 0) 0x7fc17c0d19a0 con 0x7fc17c15d170 2023-08-25T04:47:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1680035b0 con 0x7fc17c15d170 2023-08-25T04:47:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050817938 0 0) 0x7fc17c0d1c80 con 0x7fc17c0ce090 2023-08-25T04:47:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc17c0d19a0 con 0x7fc17c0ce090 2023-08-25T04:47:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622301924 0 0) 0x7fc1680035b0 con 0x7fc17c15d170 2023-08-25T04:47:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0b89f0 msgr2=0x7fc17c0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17affd700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0b89f0 0x7fc17c0cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 >> v1:172.21.15.137:6789/0 conn(0x7fc17c0ce090 legacy=0x7fc17c0b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.181+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c0d1f60 con 0x7fc17c15d170 2023-08-25T04:47:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7fc16c001670 con 0x7fc17c15d170 2023-08-25T04:47:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc173fff700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0b89f0 0x7fc17c0cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 >> v1:172.21.15.72:6789/0 conn(0x7fc17c15d170 legacy=0x7fc17c0d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc17affd700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0b89f0 0x7fc168003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:25.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc17affd700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 0x7fc168004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:25.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc17affd700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc168004d90 0x7fc168005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:25.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0ce500 con 0x7fc168004100 2023-08-25T04:47:25.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16800ba70 con 0x7fc168004d90 2023-08-25T04:47:25.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16800bc30 con 0x7fc17c0b89f0 2023-08-25T04:47:25.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc173fff700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 0x7fc168004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:25.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc17b7fe700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0b89f0 0x7fc168003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:25.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc17bfff700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc168004d90 0x7fc168005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc173fff700 1 -- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0b89f0 msgr2=0x7fc168003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc173fff700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0b89f0 0x7fc168003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc173fff700 1 -- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc168004d90 msgr2=0x7fc168005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc173fff700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc168004d90 0x7fc168005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.182+0000 7fc173fff700 1 -- 172.21.15.72:0/2657683214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640094a0 con 0x7fc168004100 2023-08-25T04:47:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.183+0000 7fc173fff700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 0x7fc168004850 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc164009cf0 tx=0x7fc168005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b47f4afb50535b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.183+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164004030 con 0x7fc168004100 2023-08-25T04:47:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.183+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164004190 con 0x7fc168004100 2023-08-25T04:47:25.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.183+0000 7fc17affd700 1 -- 172.21.15.72:0/2657683214 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164004500 con 0x7fc168004100 2023-08-25T04:47:25.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.183+0000 7fc1821ff700 1 -- 172.21.15.72:0/2657683214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 msgr2=0x7fc168004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:25.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.183+0000 7fc1821ff700 1 --2- 172.21.15.72:0/2657683214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 0x7fc168004850 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc164009cf0 tx=0x7fc168005880 comp rx=0 tx=0).stop 2023-08-25T04:47:25.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.183+0000 7fc17bfff700 1 -- 172.21.15.72:0/2657683214 reap_dead start 2023-08-25T04:47:25.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.183+0000 7fc1821ff700 1 -- 172.21.15.72:0/2657683214 shutdown_connections 2023-08-25T04:47:25.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.183+0000 7fc1821ff700 1 -- 172.21.15.72:0/2657683214 >> 172.21.15.72:0/2657683214 conn(0x7fc17c071e10 msgr2=0x7fc17c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:25.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.183+0000 7fc1821ff700 1 -- 172.21.15.72:0/2657683214 shutdown_connections 2023-08-25T04:47:25.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.184+0000 7fc1821ff700 1 -- 172.21.15.72:0/2657683214 wait complete. 2023-08-25T04:47:25.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.185+0000 7fc1821ff700 1 Processor -- start 2023-08-25T04:47:25.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.185+0000 7fc1821ff700 1 -- start start 2023-08-25T04:47:25.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.186+0000 7fc1821ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 0x7fc17c1efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:25.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.186+0000 7fc1821ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc17c1f31e0 0x7fc17c0cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:25.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.186+0000 7fc1821ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0cc200 0x7fc17c15e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:25.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.186+0000 7fc1821ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0cc680 con 0x7fc168004100 2023-08-25T04:47:25.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.186+0000 7fc1821ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0ca1f0 con 0x7fc17c1f31e0 2023-08-25T04:47:25.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.186+0000 7fc1821ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0ca4d0 con 0x7fc17c0cc200 2023-08-25T04:47:25.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.186+0000 7fc17b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 0x7fc17c1efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:25.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.186+0000 7fc17b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 0x7fc17c1efd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52782/0 (socket says 172.21.15.72:52782) 2023-08-25T04:47:25.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.186+0000 7fc17b7fe700 1 -- 172.21.15.72:0/3641253513 learned_addr learned my addr 172.21.15.72:0/3641253513 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:25.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc173fff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc17c1f31e0 0x7fc17c0cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:25.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc17bfff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0cc200 0x7fc17c15e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:25.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc17b7fe700 1 -- 172.21.15.72:0/3641253513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0cc200 msgr2=0x7fc17c15e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:25.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc17b7fe700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0cc200 0x7fc17c15e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:25.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc17b7fe700 1 -- 172.21.15.72:0/3641253513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc17c1f31e0 msgr2=0x7fc17c0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:25.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc17b7fe700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc17c1f31e0 0x7fc17c0cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:25.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc17b7fe700 1 -- 172.21.15.72:0/3641253513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c0ca7b0 con 0x7fc168004100 2023-08-25T04:47:25.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc173fff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc17c1f31e0 0x7fc17c0cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:25.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc17b7fe700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 0x7fc17c1efd40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc16c008360 tx=0x7fc16c008720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:25.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc178ff9700 1 -- 172.21.15.72:0/3641253513 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00ea50 con 0x7fc168004100 2023-08-25T04:47:25.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc178ff9700 1 -- 172.21.15.72:0/3641253513 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c00ebb0 con 0x7fc168004100 2023-08-25T04:47:25.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc1821ff700 1 -- 172.21.15.72:0/3641253513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c0caa90 con 0x7fc168004100 2023-08-25T04:47:25.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.187+0000 7fc178ff9700 1 -- 172.21.15.72:0/3641253513 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c001ce0 con 0x7fc168004100 2023-08-25T04:47:25.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.188+0000 7fc1821ff700 1 -- 172.21.15.72:0/3641253513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c0b7290 con 0x7fc168004100 2023-08-25T04:47:25.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.188+0000 7fc1821ff700 1 -- 172.21.15.72:0/3641253513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c06a2f0 con 0x7fc168004100 2023-08-25T04:47:25.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.190+0000 7fc178ff9700 1 -- 172.21.15.72:0/3641253513 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc16c01d460 con 0x7fc168004100 2023-08-25T04:47:25.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.191+0000 7fc178ff9700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc15c06a0e0 0x7fc15c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:25.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.191+0000 7fc178ff9700 1 -- 172.21.15.72:0/3641253513 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fc16c089100 con 0x7fc168004100 2023-08-25T04:47:25.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.191+0000 7fc173fff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc15c06a0e0 0x7fc15c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:25.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.191+0000 7fc173fff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc15c06a0e0 0x7fc15c06c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc164000c00 tx=0x7fc164008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:25.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.194+0000 7fc178ff9700 1 -- 172.21.15.72:0/3641253513 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc16c054870 con 0x7fc168004100 2023-08-25T04:47:25.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.391+0000 7fc1821ff700 1 -- 172.21.15.72:0/3641253513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc17c04e620 con 0x7fc168004100 2023-08-25T04:47:25.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.957+0000 7fc178ff9700 1 -- 172.21.15.72:0/3641253513 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc16c057e90 con 0x7fc168004100 2023-08-25T04:47:25.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.965+0000 7fc1821ff700 1 -- 172.21.15.72:0/3641253513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc15c06a0e0 msgr2=0x7fc15c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:25.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.965+0000 7fc1821ff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc15c06a0e0 0x7fc15c06c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc164000c00 tx=0x7fc164008030 comp rx=0 tx=0).stop 2023-08-25T04:47:25.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.965+0000 7fc1821ff700 1 -- 172.21.15.72:0/3641253513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 msgr2=0x7fc17c1efd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:25.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.965+0000 7fc1821ff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 0x7fc17c1efd40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc16c008360 tx=0x7fc16c008720 comp rx=0 tx=0).stop 2023-08-25T04:47:25.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.965+0000 7fc1821ff700 1 -- 172.21.15.72:0/3641253513 shutdown_connections 2023-08-25T04:47:25.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.965+0000 7fc1821ff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fc15c06a0e0 0x7fc15c06c5a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:25.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.965+0000 7fc1821ff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc17c0cc200 0x7fc17c15e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:25.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.965+0000 7fc1821ff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc168004100 0x7fc17c1efd40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:25.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.965+0000 7fc1821ff700 1 --2- 172.21.15.72:0/3641253513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc17c1f31e0 0x7fc17c0cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:25.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.966+0000 7fc1821ff700 1 -- 172.21.15.72:0/3641253513 >> 172.21.15.72:0/3641253513 conn(0x7fc17c071e10 msgr2=0x7fc17c0c71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:25.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.967+0000 7fc1821ff700 1 -- 172.21.15.72:0/3641253513 shutdown_connections 2023-08-25T04:47:25.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:25.968+0000 7fc1821ff700 1 -- 172.21.15.72:0/3641253513 wait complete. 2023-08-25T04:47:25.974 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-25T04:47:25.993 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:47:26.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.192+0000 7f0c1f5ff700 1 Processor -- start 2023-08-25T04:47:26.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.192+0000 7f0c1f5ff700 1 -- start start 2023-08-25T04:47:26.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.193+0000 7f0c1f5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c180d10c0 0x7f0c180b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:26.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.193+0000 7f0c1f5ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0c180b4d40 0x7f0c180b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:26.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.193+0000 7f0c1f5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c180b8d10 con 0x7f0c1815d000 2023-08-25T04:47:26.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.193+0000 7f0c1f5ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c180b56f0 con 0x7f0c180b4d40 2023-08-25T04:47:26.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.193+0000 7f0c1f5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180b5190 con 0x7f0c180d10c0 2023-08-25T04:47:26.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.193+0000 7f0c1d39b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0c1815d000 0x7f0c180b8600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57234/0 (socket says 172.21.15.72:57234) 2023-08-25T04:47:26.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.193+0000 7f0c1d39b700 1 -- 172.21.15.72:0/3143489649 learned_addr learned my addr 172.21.15.72:0/3143489649 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:26.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c1db9c700 1 --2- 172.21.15.72:0/3143489649 >> v2:172.21.15.137:3300/0 conn(0x7f0c180b4d40 0x7f0c180b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:26.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c1cb9a700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c180d10c0 0x7f0c180b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:26.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413910785 0 0) 0x7f0c180b8d10 con 0x7f0c1815d000 2023-08-25T04:47:26.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c040035b0 con 0x7f0c1815d000 2023-08-25T04:47:26.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 195799188 0 0) 0x7f0c040035b0 con 0x7f0c1815d000 2023-08-25T04:47:26.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c180d10c0 msgr2=0x7f0c180b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:26.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c180d10c0 0x7f0c180b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:26.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 >> v2:172.21.15.137:3300/0 conn(0x7f0c180b4d40 msgr2=0x7f0c180b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:26.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 --2- 172.21.15.72:0/3143489649 >> v2:172.21.15.137:3300/0 conn(0x7f0c180b4d40 0x7f0c180b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:26.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180b6e90 con 0x7f0c1815d000 2023-08-25T04:47:26.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f0c14001670 con 0x7f0c1815d000 2023-08-25T04:47:26.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c1db9c700 1 --2- 172.21.15.72:0/3143489649 >> v2:172.21.15.137:3300/0 conn(0x7f0c180b4d40 0x7f0c180b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:26.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 >> v1:172.21.15.72:6789/0 conn(0x7f0c1815d000 legacy=0x7f0c180b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:26.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c04003a00 0x7f0c04003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:26.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c040043f0 0x7f0c040048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:26.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 0x7f0c0400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:26.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180b5190 con 0x7f0c04004f40 2023-08-25T04:47:26.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0400bf50 con 0x7f0c040043f0 2023-08-25T04:47:26.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0400c090 con 0x7f0c04003a00 2023-08-25T04:47:26.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c1cb9a700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c180d10c0 0x7f0c180b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:26.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.194+0000 7f0c1db9c700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 0x7f0c0400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:26.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c1d39b700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c04003a00 0x7f0c04003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:26.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c1cb9a700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c040043f0 0x7f0c040048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:26.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c1db9c700 1 -- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c04003a00 msgr2=0x7f0c04003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:26.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c1db9c700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c04003a00 0x7f0c04003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:26.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c1db9c700 1 -- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c040043f0 msgr2=0x7f0c040048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:26.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c1db9c700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c040043f0 0x7f0c040048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:26.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c1db9c700 1 -- 172.21.15.72:0/3143489649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c040035b0 con 0x7f0c04004f40 2023-08-25T04:47:26.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c1cb9a700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c040043f0 0x7f0c040048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:26.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c1db9c700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 0x7f0c0400ba10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000e350 tx=0x7f0c04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c803a0e5ac7992c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:26.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000edf0 con 0x7f0c04004f40 2023-08-25T04:47:26.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000f040 con 0x7f0c04004f40 2023-08-25T04:47:26.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.195+0000 7f0c0ffff700 1 -- 172.21.15.72:0/3143489649 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c100146a0 con 0x7f0c04004f40 2023-08-25T04:47:26.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.196+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/3143489649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 msgr2=0x7f0c0400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:26.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.196+0000 7f0c1f5ff700 1 --2- 172.21.15.72:0/3143489649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 0x7f0c0400ba10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000e350 tx=0x7f0c04005880 comp rx=0 tx=0).stop 2023-08-25T04:47:26.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.196+0000 7f0c1db9c700 1 -- 172.21.15.72:0/3143489649 reap_dead start 2023-08-25T04:47:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.196+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/3143489649 shutdown_connections 2023-08-25T04:47:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.196+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/3143489649 >> 172.21.15.72:0/3143489649 conn(0x7f0c18071e10 msgr2=0x7f0c18072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.196+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/3143489649 shutdown_connections 2023-08-25T04:47:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.196+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/3143489649 wait complete. 2023-08-25T04:47:26.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.198+0000 7f0c1f5ff700 1 Processor -- start 2023-08-25T04:47:26.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.198+0000 7f0c1f5ff700 1 -- start start 2023-08-25T04:47:26.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1f5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 0x7f0c1815f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:26.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1f5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c180c9e50 0x7f0c18154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:26.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1f5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c181f5dc0 0x7f0c181f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:26.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1f5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180cb040 con 0x7f0c04004f40 2023-08-25T04:47:26.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1f5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1815c610 con 0x7f0c181f5dc0 2023-08-25T04:47:26.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1f5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1815f910 con 0x7f0c180c9e50 2023-08-25T04:47:26.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1d39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 0x7f0c1815f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:26.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1d39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 0x7f0c1815f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52800/0 (socket says 172.21.15.72:52800) 2023-08-25T04:47:26.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1d39b700 1 -- 172.21.15.72:0/1585428441 learned_addr learned my addr 172.21.15.72:0/1585428441 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:26.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1cb9a700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c180c9e50 0x7f0c18154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:26.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1db9c700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c181f5dc0 0x7f0c181f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:26.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1d39b700 1 -- 172.21.15.72:0/1585428441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c180c9e50 msgr2=0x7f0c18154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:26.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1d39b700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c180c9e50 0x7f0c18154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:26.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.199+0000 7f0c1d39b700 1 -- 172.21.15.72:0/1585428441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c181f5dc0 msgr2=0x7f0c181f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:26.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.200+0000 7f0c1d39b700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c181f5dc0 0x7f0c181f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:26.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.200+0000 7f0c1d39b700 1 -- 172.21.15.72:0/1585428441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c181f5b80 con 0x7f0c04004f40 2023-08-25T04:47:26.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.200+0000 7f0c1d39b700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 0x7f0c1815f3d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0c14007310 tx=0x7f0c14007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:26.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.200+0000 7f0c0dffb700 1 -- 172.21.15.72:0/1585428441 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c14007ca0 con 0x7f0c04004f40 2023-08-25T04:47:26.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.200+0000 7f0c0dffb700 1 -- 172.21.15.72:0/1585428441 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c14007800 con 0x7f0c04004f40 2023-08-25T04:47:26.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.200+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/1585428441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c180ca3c0 con 0x7f0c04004f40 2023-08-25T04:47:26.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.200+0000 7f0c0dffb700 1 -- 172.21.15.72:0/1585428441 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400fb10 con 0x7f0c04004f40 2023-08-25T04:47:26.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.200+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/1585428441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c180ca980 con 0x7f0c04004f40 2023-08-25T04:47:26.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.201+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/1585428441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c180cb180 con 0x7f0c04004f40 2023-08-25T04:47:26.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.202+0000 7f0c0dffb700 1 -- 172.21.15.72:0/1585428441 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0c1400fc70 con 0x7f0c04004f40 2023-08-25T04:47:26.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.203+0000 7f0c0dffb700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0bfc06a0e0 0x7f0bfc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:26.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.203+0000 7f0c0dffb700 1 -- 172.21.15.72:0/1585428441 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f0c14088740 con 0x7f0c04004f40 2023-08-25T04:47:26.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.203+0000 7f0c1cb9a700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0bfc06a0e0 0x7f0bfc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:26.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.204+0000 7f0c1cb9a700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0bfc06a0e0 0x7f0bfc06c5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c180b85a0 tx=0x7f0c08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:26.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.208+0000 7f0c0dffb700 1 -- 172.21.15.72:0/1585428441 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0c180cb180 con 0x7f0c04004f40 2023-08-25T04:47:26.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.448+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/1585428441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0c180cb180 con 0x7f0c04004f40 2023-08-25T04:47:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.955+0000 7f0c0dffb700 1 -- 172.21.15.72:0/1585428441 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0c180cb180 con 0x7f0c04004f40 2023-08-25T04:47:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.961+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/1585428441 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0bfc06a0e0 msgr2=0x7f0bfc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.961+0000 7f0c1f5ff700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0bfc06a0e0 0x7f0bfc06c5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c180b85a0 tx=0x7f0c08008040 comp rx=0 tx=0).stop 2023-08-25T04:47:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.961+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/1585428441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 msgr2=0x7f0c1815f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.961+0000 7f0c1f5ff700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 0x7f0c1815f3d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0c14007310 tx=0x7f0c14007620 comp rx=0 tx=0).stop 2023-08-25T04:47:26.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.963+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/1585428441 shutdown_connections 2023-08-25T04:47:26.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.963+0000 7f0c1f5ff700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f0bfc06a0e0 0x7f0bfc06c5a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:26.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.963+0000 7f0c1f5ff700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c181f5dc0 0x7f0c181f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:26.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.963+0000 7f0c1f5ff700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c04004f40 0x7f0c1815f3d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:26.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.963+0000 7f0c1f5ff700 1 --2- 172.21.15.72:0/1585428441 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0c180c9e50 0x7f0c18154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.963+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/1585428441 >> 172.21.15.72:0/1585428441 conn(0x7f0c18071e10 msgr2=0x7f0c180cd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.964+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/1585428441 shutdown_connections 2023-08-25T04:47:26.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:26.965+0000 7f0c1f5ff700 1 -- 172.21.15.72:0/1585428441 wait complete. 2023-08-25T04:47:26.983 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 6 and data pool 7 2023-08-25T04:47:27.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:47:27.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.205+0000 7f11223ff700 1 Processor -- start 2023-08-25T04:47:27.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.205+0000 7f11223ff700 1 -- start start 2023-08-25T04:47:27.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.206+0000 7f11223ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f111c159410 0x7f111c070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.206+0000 7f11223ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f111c0adc00 0x7f111c070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f11223ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111c0c44f0 con 0x7f111c06de30 2023-08-25T04:47:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f11223ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c0c40d0 con 0x7f111c159410 2023-08-25T04:47:27.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f11223ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c0ae150 con 0x7f111c0adc00 2023-08-25T04:47:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f111bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f111c159410 0x7f111c070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f111bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f111c159410 0x7f111c070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52812/0 (socket says 172.21.15.72:52812) 2023-08-25T04:47:27.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f112099c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f111c06de30 0x7f111c06c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57248/0 (socket says 172.21.15.72:57248) 2023-08-25T04:47:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f111bfff700 1 -- 172.21.15.72:0/309798148 learned_addr learned my addr 172.21.15.72:0/309798148 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f111b7fe700 1 --2- 172.21.15.72:0/309798148 >> v2:172.21.15.137:3300/0 conn(0x7f111c0adc00 0x7f111c070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f111affd700 1 -- 172.21.15.72:0/309798148 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189606962 0 0) 0x7f111c0c44f0 con 0x7f111c06de30 2023-08-25T04:47:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f111bfff700 1 -- 172.21.15.72:0/309798148 >> v2:172.21.15.137:3300/0 conn(0x7f111c0adc00 msgr2=0x7f111c070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f111bfff700 1 --2- 172.21.15.72:0/309798148 >> v2:172.21.15.137:3300/0 conn(0x7f111c0adc00 0x7f111c070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f111bfff700 1 -- 172.21.15.72:0/309798148 >> v1:172.21.15.72:6789/0 conn(0x7f111c06de30 legacy=0x7f111c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f111bfff700 1 -- 172.21.15.72:0/309798148 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0c3a10 con 0x7f111c159410 2023-08-25T04:47:27.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.207+0000 7f111b7fe700 1 --2- 172.21.15.72:0/309798148 >> v2:172.21.15.137:3300/0 conn(0x7f111c0adc00 0x7f111c070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:27.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f111bfff700 1 --2- 172.21.15.72:0/309798148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c159410 0x7f111c070890 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f111c0b4ba0 tx=0x7f110c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318d02087acda615 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:27.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f111affd700 1 -- 172.21.15.72:0/309798148 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c00dc20 con 0x7f111c159410 2023-08-25T04:47:27.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f111affd700 1 -- 172.21.15.72:0/309798148 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c00dd80 con 0x7f111c159410 2023-08-25T04:47:27.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f111affd700 1 -- 172.21.15.72:0/309798148 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c017630 con 0x7f111c159410 2023-08-25T04:47:27.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f11223ff700 1 -- 172.21.15.72:0/309798148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c159410 msgr2=0x7f111c070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f11223ff700 1 --2- 172.21.15.72:0/309798148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c159410 0x7f111c070890 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f111c0b4ba0 tx=0x7f110c00be70 comp rx=0 tx=0).stop 2023-08-25T04:47:27.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f11223ff700 1 -- 172.21.15.72:0/309798148 shutdown_connections 2023-08-25T04:47:27.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f11223ff700 1 --2- 172.21.15.72:0/309798148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c159410 0x7f111c070890 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f11223ff700 1 --2- 172.21.15.72:0/309798148 >> v2:172.21.15.137:3300/0 conn(0x7f111c0adc00 0x7f111c070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f11223ff700 1 -- 172.21.15.72:0/309798148 >> 172.21.15.72:0/309798148 conn(0x7f111c0ce990 msgr2=0x7f111c0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:27.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.208+0000 7f11223ff700 1 -- 172.21.15.72:0/309798148 shutdown_connections 2023-08-25T04:47:27.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.209+0000 7f11223ff700 1 -- 172.21.15.72:0/309798148 wait complete. 2023-08-25T04:47:27.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.210+0000 7f11223ff700 1 Processor -- start 2023-08-25T04:47:27.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.210+0000 7f11223ff700 1 -- start start 2023-08-25T04:47:27.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.211+0000 7f11223ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f111c06de30 0x7f111c13daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.211+0000 7f11223ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c0adc00 0x7f111c13c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.211+0000 7f11223ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f111c159410 0x7f111c13ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.211+0000 7f11223ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c13cc80 con 0x7f111c0adc00 2023-08-25T04:47:27.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.211+0000 7f11223ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c13b6a0 con 0x7f111c06de30 2023-08-25T04:47:27.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.211+0000 7f11223ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c13b980 con 0x7f111c159410 2023-08-25T04:47:27.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.211+0000 7f111b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c0adc00 0x7f111c13c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f111b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c0adc00 0x7f111c13c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52818/0 (socket says 172.21.15.72:52818) 2023-08-25T04:47:27.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f111b7fe700 1 -- 172.21.15.72:0/1410763570 learned_addr learned my addr 172.21.15.72:0/1410763570 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:27.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f111bfff700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f111c06de30 0x7f111c13daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f112099c700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f111c159410 0x7f111c13ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f111b7fe700 1 -- 172.21.15.72:0/1410763570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f111c159410 msgr2=0x7f111c13ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f111b7fe700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f111c159410 0x7f111c13ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f111b7fe700 1 -- 172.21.15.72:0/1410763570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f111c06de30 msgr2=0x7f111c13daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f111b7fe700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f111c06de30 0x7f111c13daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f111b7fe700 1 -- 172.21.15.72:0/1410763570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c00b7f0 con 0x7f111c0adc00 2023-08-25T04:47:27.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f111b7fe700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c0adc00 0x7f111c13c740 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f111000e810 tx=0x7f111000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:27.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f1118ff9700 1 -- 172.21.15.72:0/1410763570 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110004230 con 0x7f111c0adc00 2023-08-25T04:47:27.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f1118ff9700 1 -- 172.21.15.72:0/1410763570 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1110004390 con 0x7f111c0adc00 2023-08-25T04:47:27.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.212+0000 7f1118ff9700 1 -- 172.21.15.72:0/1410763570 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11100036a0 con 0x7f111c0adc00 2023-08-25T04:47:27.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.213+0000 7f11223ff700 1 -- 172.21.15.72:0/1410763570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c13bc60 con 0x7f111c0adc00 2023-08-25T04:47:27.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.213+0000 7f11223ff700 1 -- 172.21.15.72:0/1410763570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c13c220 con 0x7f111c0adc00 2023-08-25T04:47:27.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.214+0000 7f11223ff700 1 -- 172.21.15.72:0/1410763570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c13c440 con 0x7f111c0adc00 2023-08-25T04:47:27.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.215+0000 7f1118ff9700 1 -- 172.21.15.72:0/1410763570 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1110003800 con 0x7f111c0adc00 2023-08-25T04:47:27.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.215+0000 7f1118ff9700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f110806a0e0 0x7f110806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.216+0000 7f1118ff9700 1 -- 172.21.15.72:0/1410763570 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1110088240 con 0x7f111c0adc00 2023-08-25T04:47:27.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.216+0000 7f111bfff700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f110806a0e0 0x7f110806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.216+0000 7f111bfff700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f110806a0e0 0x7f110806c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f110c019040 tx=0x7f110c00bf90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:27.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.220+0000 7f1118ff9700 1 -- 172.21.15.72:0/1410763570 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1110053750 con 0x7f111c0adc00 2023-08-25T04:47:27.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.416+0000 7f11223ff700 1 -- 172.21.15.72:0/1410763570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f111c04e620 con 0x7f111c0adc00 2023-08-25T04:47:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.418+0000 7f1118ff9700 1 -- 172.21.15.72:0/1410763570 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18455 (secure 0 0 0) 0x7f1110056d70 con 0x7f111c0adc00 2023-08-25T04:47:27.419 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:27.419 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":39,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:47:26.449603+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:47:24.274013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-08-25T04:47:25.430249+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:47:27.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 -- 172.21.15.72:0/1410763570 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f110806a0e0 msgr2=0x7f110806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f110806a0e0 0x7f110806c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f110c019040 tx=0x7f110c00bf90 comp rx=0 tx=0).stop 2023-08-25T04:47:27.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 -- 172.21.15.72:0/1410763570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c0adc00 msgr2=0x7f111c13c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c0adc00 0x7f111c13c740 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f111000e810 tx=0x7f111000ebd0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 -- 172.21.15.72:0/1410763570 shutdown_connections 2023-08-25T04:47:27.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f110806a0e0 0x7f110806c5a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f111c159410 0x7f111c13ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f111c06de30 0x7f111c13daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 --2- 172.21.15.72:0/1410763570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f111c0adc00 0x7f111c13c740 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 -- 172.21.15.72:0/1410763570 >> 172.21.15.72:0/1410763570 conn(0x7f111c0ce990 msgr2=0x7f111c0cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:27.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 -- 172.21.15.72:0/1410763570 shutdown_connections 2023-08-25T04:47:27.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.420+0000 7f11223ff700 1 -- 172.21.15.72:0/1410763570 wait complete. 2023-08-25T04:47:27.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:47:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.634+0000 7fcefa1ff700 1 Processor -- start 2023-08-25T04:47:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.635+0000 7fcefa1ff700 1 -- start start 2023-08-25T04:47:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcefa1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcef415d130 0x7fcef40d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcefa1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcef40b86b0 0x7fcef40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcefa1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef40d1780 con 0x7fcef40b47c0 2023-08-25T04:47:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcefa1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40d1a60 con 0x7fcef40b86b0 2023-08-25T04:47:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcefa1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40d1d40 con 0x7fcef415d130 2023-08-25T04:47:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcef37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcef40b47c0 0x7fcef40b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57258/0 (socket says 172.21.15.72:57258) 2023-08-25T04:47:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcef37fe700 1 -- 172.21.15.72:0/1788502901 learned_addr learned my addr 172.21.15.72:0/1788502901 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcef3fff700 1 --2- 172.21.15.72:0/1788502901 >> v2:172.21.15.72:3300/0 conn(0x7fcef40b86b0 0x7fcef40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcef2ffd700 1 --2- 172.21.15.72:0/1788502901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcef415d130 0x7fcef40d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcef27fc700 1 -- 172.21.15.72:0/1788502901 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264885912 0 0) 0x7fcef40d1780 con 0x7fcef40b47c0 2023-08-25T04:47:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.636+0000 7fcef27fc700 1 -- 172.21.15.72:0/1788502901 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcedc0035b0 con 0x7fcef40b47c0 2023-08-25T04:47:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.637+0000 7fcef3fff700 1 -- 172.21.15.72:0/1788502901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcef415d130 msgr2=0x7fcef40d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.637+0000 7fcef3fff700 1 --2- 172.21.15.72:0/1788502901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcef415d130 0x7fcef40d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.637+0000 7fcef3fff700 1 -- 172.21.15.72:0/1788502901 >> v1:172.21.15.72:6789/0 conn(0x7fcef40b47c0 legacy=0x7fcef40b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.637+0000 7fcef3fff700 1 -- 172.21.15.72:0/1788502901 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef40d2020 con 0x7fcef40b86b0 2023-08-25T04:47:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.637+0000 7fcef3fff700 1 --2- 172.21.15.72:0/1788502901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 0x7fcef40b5da0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fceec009d90 tx=0x7fceec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b1acc9bec8a9c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.637+0000 7fcef27fc700 1 -- 172.21.15.72:0/1788502901 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec00e070 con 0x7fcef40b86b0 2023-08-25T04:47:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.637+0000 7fcef27fc700 1 -- 172.21.15.72:0/1788502901 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec00bb20 con 0x7fcef40b86b0 2023-08-25T04:47:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.637+0000 7fcef27fc700 1 -- 172.21.15.72:0/1788502901 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec012430 con 0x7fcef40b86b0 2023-08-25T04:47:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.637+0000 7fcefa1ff700 1 -- 172.21.15.72:0/1788502901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 msgr2=0x7fcef40b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.637+0000 7fcefa1ff700 1 --2- 172.21.15.72:0/1788502901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 0x7fcef40b5da0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fceec009d90 tx=0x7fceec00b330 comp rx=0 tx=0).stop 2023-08-25T04:47:27.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.638+0000 7fcefa1ff700 1 -- 172.21.15.72:0/1788502901 shutdown_connections 2023-08-25T04:47:27.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.638+0000 7fcefa1ff700 1 --2- 172.21.15.72:0/1788502901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 0x7fcef40b5da0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.638+0000 7fcefa1ff700 1 --2- 172.21.15.72:0/1788502901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcef415d130 0x7fcef40d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.638+0000 7fcefa1ff700 1 -- 172.21.15.72:0/1788502901 >> 172.21.15.72:0/1788502901 conn(0x7fcef4072050 msgr2=0x7fcef40d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:27.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.638+0000 7fcefa1ff700 1 -- 172.21.15.72:0/1788502901 shutdown_connections 2023-08-25T04:47:27.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.638+0000 7fcefa1ff700 1 -- 172.21.15.72:0/1788502901 wait complete. 2023-08-25T04:47:27.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.639+0000 7fcefa1ff700 1 Processor -- start 2023-08-25T04:47:27.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.640+0000 7fcefa1ff700 1 -- start start 2023-08-25T04:47:27.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.640+0000 7fcefa1ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcef40b47c0 0x7fcef414f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.640+0000 7fcefa1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 0x7fcef40c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.640+0000 7fcefa1ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcef415d130 0x7fcef4151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.640+0000 7fcefa1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40cb450 con 0x7fcef40b86b0 2023-08-25T04:47:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.640+0000 7fcefa1ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40ca860 con 0x7fcef415d130 2023-08-25T04:47:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.640+0000 7fcefa1ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40c8ab0 con 0x7fcef40b47c0 2023-08-25T04:47:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 0x7fcef40c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 0x7fcef40c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52840/0 (socket says 172.21.15.72:52840) 2023-08-25T04:47:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef2ffd700 1 -- 172.21.15.72:0/2675004362 learned_addr learned my addr 172.21.15.72:0/2675004362 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef2ffd700 1 -- 172.21.15.72:0/2675004362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcef40b47c0 msgr2=0x7fcef414f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef2ffd700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcef40b47c0 0x7fcef414f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef2ffd700 1 -- 172.21.15.72:0/2675004362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcef415d130 msgr2=0x7fcef4151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef3fff700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcef415d130 0x7fcef4151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef2ffd700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcef415d130 0x7fcef4151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef2ffd700 1 -- 172.21.15.72:0/2675004362 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec009a70 con 0x7fcef40b86b0 2023-08-25T04:47:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef3fff700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcef415d130 0x7fcef4151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.641+0000 7fcef2ffd700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 0x7fcef40c8570 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcee800e870 tx=0x7fcee800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.642+0000 7fcedbfff700 1 -- 172.21.15.72:0/2675004362 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8009590 con 0x7fcef40b86b0 2023-08-25T04:47:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.642+0000 7fcedbfff700 1 -- 172.21.15.72:0/2675004362 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee800ee70 con 0x7fcef40b86b0 2023-08-25T04:47:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.642+0000 7fcedbfff700 1 -- 172.21.15.72:0/2675004362 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee800ca50 con 0x7fcef40b86b0 2023-08-25T04:47:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.642+0000 7fcefa1ff700 1 -- 172.21.15.72:0/2675004362 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef40caab0 con 0x7fcef40b86b0 2023-08-25T04:47:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.642+0000 7fcefa1ff700 1 -- 172.21.15.72:0/2675004362 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef40cb070 con 0x7fcef40b86b0 2023-08-25T04:47:27.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.643+0000 7fcefa1ff700 1 -- 172.21.15.72:0/2675004362 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef404e620 con 0x7fcef40b86b0 2023-08-25T04:47:27.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.644+0000 7fcedbfff700 1 -- 172.21.15.72:0/2675004362 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcee800cbb0 con 0x7fcef40b86b0 2023-08-25T04:47:27.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.645+0000 7fcedbfff700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcee006a0e0 0x7fcee006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:27.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.645+0000 7fcedbfff700 1 -- 172.21.15.72:0/2675004362 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcee80885f0 con 0x7fcef40b86b0 2023-08-25T04:47:27.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.645+0000 7fcef37fe700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcee006a0e0 0x7fcee006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:27.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.645+0000 7fcef37fe700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcee006a0e0 0x7fcee006c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcee40016b0 tx=0x7fcee40079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:27.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.649+0000 7fcedbfff700 1 -- 172.21.15.72:0/2675004362 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcee80576c0 con 0x7fcef40b86b0 2023-08-25T04:47:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.847+0000 7fcefa1ff700 1 -- 172.21.15.72:0/2675004362 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcef4154840 con 0x7fcef40b86b0 2023-08-25T04:47:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.848+0000 7fcedbfff700 1 -- 172.21.15.72:0/2675004362 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18455 (secure 0 0 0) 0x7fcee800ce60 con 0x7fcef40b86b0 2023-08-25T04:47:27.850 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:27.850 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":39,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:47:26.449603+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:47:24.274013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-08-25T04:47:25.430249+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:47:27.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 -- 172.21.15.72:0/2675004362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcee006a0e0 msgr2=0x7fcee006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcee006a0e0 0x7fcee006c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcee40016b0 tx=0x7fcee40079c0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 -- 172.21.15.72:0/2675004362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 msgr2=0x7fcef40c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:27.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 0x7fcef40c8570 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcee800e870 tx=0x7fcee800ec30 comp rx=0 tx=0).stop 2023-08-25T04:47:27.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 -- 172.21.15.72:0/2675004362 shutdown_connections 2023-08-25T04:47:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcee006a0e0 0x7fcee006c5a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcef415d130 0x7fcef4151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcef40b47c0 0x7fcef414f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 --2- 172.21.15.72:0/2675004362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcef40b86b0 0x7fcef40c8570 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 -- 172.21.15.72:0/2675004362 >> 172.21.15.72:0/2675004362 conn(0x7fcef4072050 msgr2=0x7fcef415b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 -- 172.21.15.72:0/2675004362 shutdown_connections 2023-08-25T04:47:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:27.851+0000 7fcefa1ff700 1 -- 172.21.15.72:0/2675004362 wait complete. 2023-08-25T04:47:27.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:47:27.923 INFO:tasks.ceph.mds.d.smithi137.stderr:2023-08-25T04:47:27.923+0000 7f474fff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:47:28.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.071+0000 7fa6b93ff700 1 Processor -- start 2023-08-25T04:47:28.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.071+0000 7fa6b93ff700 1 -- start start 2023-08-25T04:47:28.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.072+0000 7fa6b93ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6b40d10c0 0x7fa6b40b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:28.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.072+0000 7fa6b93ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa6b40b4d40 0x7fa6b40b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:28.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.072+0000 7fa6b93ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b40b8d10 con 0x7fa6b415d000 2023-08-25T04:47:28.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.072+0000 7fa6b93ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b40b56f0 con 0x7fa6b40d10c0 2023-08-25T04:47:28.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.072+0000 7fa6b93ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b40b6e90 con 0x7fa6b40b4d40 2023-08-25T04:47:28.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.072+0000 7fa6b27fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6b40d10c0 0x7fa6b40b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:28.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.072+0000 7fa6b27fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6b40d10c0 0x7fa6b40b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52852/0 (socket says 172.21.15.72:52852) 2023-08-25T04:47:28.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.072+0000 7fa6b27fc700 1 -- 172.21.15.72:0/4051907535 learned_addr learned my addr 172.21.15.72:0/4051907535 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:28.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.073+0000 7fa6b37fe700 1 --2- 172.21.15.72:0/4051907535 >> v2:172.21.15.137:3300/0 conn(0x7fa6b40b4d40 0x7fa6b40b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:28.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.073+0000 7fa6b27fc700 1 -- 172.21.15.72:0/4051907535 >> v2:172.21.15.137:3300/0 conn(0x7fa6b40b4d40 msgr2=0x7fa6b40b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:28.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.073+0000 7fa6b27fc700 1 --2- 172.21.15.72:0/4051907535 >> v2:172.21.15.137:3300/0 conn(0x7fa6b40b4d40 0x7fa6b40b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:28.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.073+0000 7fa6b27fc700 1 -- 172.21.15.72:0/4051907535 >> v1:172.21.15.137:6789/0 conn(0x7fa6b415d000 legacy=0x7fa6b40b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:28.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.073+0000 7fa6b27fc700 1 -- 172.21.15.72:0/4051907535 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b40b5170 con 0x7fa6b40d10c0 2023-08-25T04:47:28.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.073+0000 7fa6b27fc700 1 --2- 172.21.15.72:0/4051907535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40d10c0 0x7fa6b40b4800 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40c9c10 tx=0x7fa6a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad89606576484d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:28.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.073+0000 7fa6b1ffb700 1 -- 172.21.15.72:0/4051907535 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8004230 con 0x7fa6b40d10c0 2023-08-25T04:47:28.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.073+0000 7fa6b1ffb700 1 -- 172.21.15.72:0/4051907535 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a8004390 con 0x7fa6b40d10c0 2023-08-25T04:47:28.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.073+0000 7fa6b1ffb700 1 -- 172.21.15.72:0/4051907535 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80036a0 con 0x7fa6b40d10c0 2023-08-25T04:47:28.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.074+0000 7fa6b93ff700 1 -- 172.21.15.72:0/4051907535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40d10c0 msgr2=0x7fa6b40b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:28.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.074+0000 7fa6b93ff700 1 --2- 172.21.15.72:0/4051907535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40d10c0 0x7fa6b40b4800 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40c9c10 tx=0x7fa6a8009bd0 comp rx=0 tx=0).stop 2023-08-25T04:47:28.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.074+0000 7fa6b93ff700 1 -- 172.21.15.72:0/4051907535 shutdown_connections 2023-08-25T04:47:28.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.074+0000 7fa6b93ff700 1 --2- 172.21.15.72:0/4051907535 >> v2:172.21.15.137:3300/0 conn(0x7fa6b40b4d40 0x7fa6b40b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:28.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.074+0000 7fa6b93ff700 1 --2- 172.21.15.72:0/4051907535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40d10c0 0x7fa6b40b4800 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:28.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.074+0000 7fa6b93ff700 1 -- 172.21.15.72:0/4051907535 >> 172.21.15.72:0/4051907535 conn(0x7fa6b4071e10 msgr2=0x7fa6b4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:28.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.074+0000 7fa6b93ff700 1 -- 172.21.15.72:0/4051907535 shutdown_connections 2023-08-25T04:47:28.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.074+0000 7fa6b93ff700 1 -- 172.21.15.72:0/4051907535 wait complete. 2023-08-25T04:47:28.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.076+0000 7fa6b93ff700 1 Processor -- start 2023-08-25T04:47:28.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.076+0000 7fa6b93ff700 1 -- start start 2023-08-25T04:47:28.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b93ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40b4d40 0x7fa6b40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:28.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b93ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6b40d10c0 0x7fa6b4157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:28.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b93ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b415d000 0x7fa6b41f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:28.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b93ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b41593e0 con 0x7fa6b40b4d40 2023-08-25T04:47:28.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b93ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40c9270 con 0x7fa6b415d000 2023-08-25T04:47:28.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b93ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b4159680 con 0x7fa6b40d10c0 2023-08-25T04:47:28.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40b4d40 0x7fa6b40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:28.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40b4d40 0x7fa6b40c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52854/0 (socket says 172.21.15.72:52854) 2023-08-25T04:47:28.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b2ffd700 1 -- 172.21.15.72:0/3003197294 learned_addr learned my addr 172.21.15.72:0/3003197294 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:28.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b27fc700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6b40d10c0 0x7fa6b4157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:28.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b37fe700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b415d000 0x7fa6b41f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:28.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b2ffd700 1 -- 172.21.15.72:0/3003197294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6b40d10c0 msgr2=0x7fa6b4157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:28.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b2ffd700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6b40d10c0 0x7fa6b4157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:28.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b2ffd700 1 -- 172.21.15.72:0/3003197294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b415d000 msgr2=0x7fa6b41f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:28.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b2ffd700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b415d000 0x7fa6b41f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:28.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.077+0000 7fa6b2ffd700 1 -- 172.21.15.72:0/3003197294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a8009550 con 0x7fa6b40b4d40 2023-08-25T04:47:28.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.078+0000 7fa6b2ffd700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40b4d40 0x7fa6b40c82d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400c4b0 tx=0x7fa6a400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:28.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.078+0000 7fa69b7fe700 1 -- 172.21.15.72:0/3003197294 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4011790 con 0x7fa6b40b4d40 2023-08-25T04:47:28.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.078+0000 7fa69b7fe700 1 -- 172.21.15.72:0/3003197294 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a4011910 con 0x7fa6b40b4d40 2023-08-25T04:47:28.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.078+0000 7fa6b93ff700 1 -- 172.21.15.72:0/3003197294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b40b22a0 con 0x7fa6b40b4d40 2023-08-25T04:47:28.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.078+0000 7fa69b7fe700 1 -- 172.21.15.72:0/3003197294 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4011cc0 con 0x7fa6b40b4d40 2023-08-25T04:47:28.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.078+0000 7fa6b93ff700 1 -- 172.21.15.72:0/3003197294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b40c8cb0 con 0x7fa6b40b4d40 2023-08-25T04:47:28.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.079+0000 7fa6b93ff700 1 -- 172.21.15.72:0/3003197294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b406a2f0 con 0x7fa6b40b4d40 2023-08-25T04:47:28.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.080+0000 7fa69b7fe700 1 -- 172.21.15.72:0/3003197294 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa6a401c460 con 0x7fa6b40b4d40 2023-08-25T04:47:28.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.081+0000 7fa69b7fe700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6a006a0e0 0x7fa6a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:28.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.081+0000 7fa69b7fe700 1 -- 172.21.15.72:0/3003197294 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa6a4088430 con 0x7fa6b40b4d40 2023-08-25T04:47:28.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.081+0000 7fa6b27fc700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6a006a0e0 0x7fa6a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:28.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.082+0000 7fa6b27fc700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6a006a0e0 0x7fa6a006c5a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009130 tx=0x7fa6a8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:28.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.085+0000 7fa69b7fe700 1 -- 172.21.15.72:0/3003197294 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa6a40539d0 con 0x7fa6b40b4d40 2023-08-25T04:47:28.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.325+0000 7fa6b93ff700 1 -- 172.21.15.72:0/3003197294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa6b408a000 con 0x7fa6b40b4d40 2023-08-25T04:47:28.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.982+0000 7fa69b7fe700 1 -- 172.21.15.72:0/3003197294 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa6a4056ff0 con 0x7fa6b40b4d40 2023-08-25T04:47:28.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 -- 172.21.15.72:0/3003197294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6a006a0e0 msgr2=0x7fa6a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:28.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6a006a0e0 0x7fa6a006c5a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009130 tx=0x7fa6a8008030 comp rx=0 tx=0).stop 2023-08-25T04:47:28.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 -- 172.21.15.72:0/3003197294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40b4d40 msgr2=0x7fa6b40c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:28.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40b4d40 0x7fa6b40c82d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400c4b0 tx=0x7fa6a400c870 comp rx=0 tx=0).stop 2023-08-25T04:47:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 -- 172.21.15.72:0/3003197294 shutdown_connections 2023-08-25T04:47:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fa6a006a0e0 0x7fa6a006c5a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6b415d000 0x7fa6b41f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6b40b4d40 0x7fa6b40c82d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 --2- 172.21.15.72:0/3003197294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa6b40d10c0 0x7fa6b4157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 -- 172.21.15.72:0/3003197294 >> 172.21.15.72:0/3003197294 conn(0x7fa6b4071e10 msgr2=0x7fa6b40b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 -- 172.21.15.72:0/3003197294 shutdown_connections 2023-08-25T04:47:28.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:28.985+0000 7fa6b93ff700 1 -- 172.21.15.72:0/3003197294 wait complete. 2023-08-25T04:47:29.006 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T04:47:29.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:47:29.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.206+0000 7f72595ff700 1 Processor -- start 2023-08-25T04:47:29.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.206+0000 7f72595ff700 1 -- start start 2023-08-25T04:47:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.207+0000 7f72595ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f72540ade30 0x7f72540ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.207+0000 7f72595ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415da20 0x7f7254070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f72595ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72540ca020 con 0x7f7254070ed0 2023-08-25T04:47:29.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f72595ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7254071360 con 0x7f72540ade30 2023-08-25T04:47:29.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f72595ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72540ae750 con 0x7f725415da20 2023-08-25T04:47:29.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f72537fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7254070ed0 0x7f725406c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57272/0 (socket says 172.21.15.72:57272) 2023-08-25T04:47:29.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f72537fe700 1 -- 172.21.15.72:0/3028741708 learned_addr learned my addr 172.21.15.72:0/3028741708 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f7252ffd700 1 --2- 172.21.15.72:0/3028741708 >> v2:172.21.15.137:3300/0 conn(0x7f72540ade30 0x7f72540ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f72527fc700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415da20 0x7f7254070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779290392 0 0) 0x7f72540ca020 con 0x7f7254070ed0 2023-08-25T04:47:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f723c0035b0 con 0x7f7254070ed0 2023-08-25T04:47:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2569766538 0 0) 0x7f723c0035b0 con 0x7f7254070ed0 2023-08-25T04:47:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415da20 msgr2=0x7f7254070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f7251ffb700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415da20 0x7f7254070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 >> v2:172.21.15.137:3300/0 conn(0x7f72540ade30 msgr2=0x7f72540ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.208+0000 7f7251ffb700 1 --2- 172.21.15.72:0/3028741708 >> v2:172.21.15.137:3300/0 conn(0x7f72540ade30 0x7f72540ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540ae9d0 con 0x7f7254070ed0 2023-08-25T04:47:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1557965131 0 0) 0x7f724c0019f0 con 0x7f7254070ed0 2023-08-25T04:47:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 >> v1:172.21.15.72:6789/0 conn(0x7f7254070ed0 legacy=0x7f725406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7251ffb700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415da20 0x7f723c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7251ffb700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f723c003f80 0x7f723c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7251ffb700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f723c004d90 0x7f723c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254071360 con 0x7f723c003f80 2023-08-25T04:47:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72540ae750 con 0x7f723c004d90 2023-08-25T04:47:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723c00ba10 con 0x7f725415da20 2023-08-25T04:47:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f72527fc700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f723c003f80 0x7f723c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7252ffd700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415da20 0x7f723c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f72537fe700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f723c004d90 0x7f723c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f72527fc700 1 -- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415da20 msgr2=0x7f723c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f72527fc700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415da20 0x7f723c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f72527fc700 1 -- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f723c004d90 msgr2=0x7f723c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f72527fc700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f723c004d90 0x7f723c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f72527fc700 1 -- 172.21.15.72:0/3028741708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c0035b0 con 0x7f723c003f80 2023-08-25T04:47:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.209+0000 7f7252ffd700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415da20 0x7f723c003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f72527fc700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f723c003f80 0x7f723c004850 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7248009b60 tx=0x7f723c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc46f2275aa8c79 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800e660 con 0x7f723c003f80 2023-08-25T04:47:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724800e7c0 con 0x7f723c003f80 2023-08-25T04:47:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f7251ffb700 1 -- 172.21.15.72:0/3028741708 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800eb30 con 0x7f723c003f80 2023-08-25T04:47:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f72595ff700 1 -- 172.21.15.72:0/3028741708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f723c003f80 msgr2=0x7f723c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f72595ff700 1 --2- 172.21.15.72:0/3028741708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f723c003f80 0x7f723c004850 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7248009b60 tx=0x7f723c005880 comp rx=0 tx=0).stop 2023-08-25T04:47:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f72537fe700 1 -- 172.21.15.72:0/3028741708 reap_dead start 2023-08-25T04:47:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f72595ff700 1 -- 172.21.15.72:0/3028741708 shutdown_connections 2023-08-25T04:47:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f72595ff700 1 -- 172.21.15.72:0/3028741708 >> 172.21.15.72:0/3028741708 conn(0x7f725406a710 msgr2=0x7f725406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f72595ff700 1 -- 172.21.15.72:0/3028741708 shutdown_connections 2023-08-25T04:47:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.210+0000 7f72595ff700 1 -- 172.21.15.72:0/3028741708 wait complete. 2023-08-25T04:47:29.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.212+0000 7f72595ff700 1 Processor -- start 2023-08-25T04:47:29.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.212+0000 7f72595ff700 1 -- start start 2023-08-25T04:47:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.213+0000 7f72595ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f723c003f80 0x7f7254167d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.213+0000 7f72595ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72541662b0 0x7f725415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.213+0000 7f72595ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415b970 0x7f725414df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.213+0000 7f72595ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254168250 con 0x7f72541662b0 2023-08-25T04:47:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.213+0000 7f72595ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254167880 con 0x7f723c003f80 2023-08-25T04:47:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.213+0000 7f72595ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7254166c70 con 0x7f725415b970 2023-08-25T04:47:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.213+0000 7f72527fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72541662b0 0x7f725415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.213+0000 7f72527fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72541662b0 0x7f725415b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52882/0 (socket says 172.21.15.72:52882) 2023-08-25T04:47:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.213+0000 7f72527fc700 1 -- 172.21.15.72:0/2745563281 learned_addr learned my addr 172.21.15.72:0/2745563281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f7252ffd700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f723c003f80 0x7f7254167d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f72537fe700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415b970 0x7f725414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f72527fc700 1 -- 172.21.15.72:0/2745563281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415b970 msgr2=0x7f725414df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f72527fc700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415b970 0x7f725414df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f72527fc700 1 -- 172.21.15.72:0/2745563281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f723c003f80 msgr2=0x7f7254167d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f72527fc700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f723c003f80 0x7f7254167d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f72527fc700 1 -- 172.21.15.72:0/2745563281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7254166f50 con 0x7f72541662b0 2023-08-25T04:47:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f72537fe700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415b970 0x7f725414df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f72527fc700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72541662b0 0x7f725415b430 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7248000c00 tx=0x7f72480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f723b7fe700 1 -- 172.21.15.72:0/2745563281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800e660 con 0x7f72541662b0 2023-08-25T04:47:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f723b7fe700 1 -- 172.21.15.72:0/2745563281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7248003ad0 con 0x7f72541662b0 2023-08-25T04:47:29.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f72595ff700 1 -- 172.21.15.72:0/2745563281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7254167230 con 0x7f72541662b0 2023-08-25T04:47:29.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f723b7fe700 1 -- 172.21.15.72:0/2745563281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248003e80 con 0x7f72541662b0 2023-08-25T04:47:29.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.214+0000 7f72595ff700 1 -- 172.21.15.72:0/2745563281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725415ada0 con 0x7f72541662b0 2023-08-25T04:47:29.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.215+0000 7f72595ff700 1 -- 172.21.15.72:0/2745563281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7254167a10 con 0x7f72541662b0 2023-08-25T04:47:29.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.216+0000 7f723b7fe700 1 -- 172.21.15.72:0/2745563281 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7248013470 con 0x7f72541662b0 2023-08-25T04:47:29.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.217+0000 7f723b7fe700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f724006a0e0 0x7f724006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:29.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.217+0000 7f723b7fe700 1 -- 172.21.15.72:0/2745563281 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7248089f00 con 0x7f72541662b0 2023-08-25T04:47:29.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.217+0000 7f7252ffd700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f724006a0e0 0x7f724006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:29.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.218+0000 7f7252ffd700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f724006a0e0 0x7f724006c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7244009bb0 tx=0x7f7244008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:29.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.222+0000 7f723b7fe700 1 -- 172.21.15.72:0/2745563281 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f72480555c0 con 0x7f72541662b0 2023-08-25T04:47:29.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.462+0000 7f72595ff700 1 -- 172.21.15.72:0/2745563281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7254072320 con 0x7f72541662b0 2023-08-25T04:47:29.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.988+0000 7f723b7fe700 1 -- 172.21.15.72:0/2745563281 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7248058be0 con 0x7f72541662b0 2023-08-25T04:47:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 -- 172.21.15.72:0/2745563281 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f724006a0e0 msgr2=0x7f724006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f724006a0e0 0x7f724006c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7244009bb0 tx=0x7f7244008040 comp rx=0 tx=0).stop 2023-08-25T04:47:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 -- 172.21.15.72:0/2745563281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72541662b0 msgr2=0x7f725415b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72541662b0 0x7f725415b430 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7248000c00 tx=0x7f72480047c0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 -- 172.21.15.72:0/2745563281 shutdown_connections 2023-08-25T04:47:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f724006a0e0 0x7f724006c5a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f725415b970 0x7f725414df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f723c003f80 0x7f7254167d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 --2- 172.21.15.72:0/2745563281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72541662b0 0x7f725415b430 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 -- 172.21.15.72:0/2745563281 >> 172.21.15.72:0/2745563281 conn(0x7f725406a710 msgr2=0x7f725414fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 -- 172.21.15.72:0/2745563281 shutdown_connections 2023-08-25T04:47:29.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:29.991+0000 7f72595ff700 1 -- 172.21.15.72:0/2745563281 wait complete. 2023-08-25T04:47:30.012 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:47:30.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:47:30.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.209+0000 7fbab55ff700 1 Processor -- start 2023-08-25T04:47:30.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.209+0000 7fbab55ff700 1 -- start start 2023-08-25T04:47:30.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.210+0000 7fbab55ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbab0159410 0x7fbab0070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.210+0000 7fbab55ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab00adc00 0x7fbab0070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.210+0000 7fbab55ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbab006de30 0x7fbab006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.210+0000 7fbab55ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab00c40d0 con 0x7fbab0159410 2023-08-25T04:47:30.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.210+0000 7fbab55ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab00c44f0 con 0x7fbab006de30 2023-08-25T04:47:30.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.210+0000 7fbab55ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab00ae150 con 0x7fbab00adc00 2023-08-25T04:47:30.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.210+0000 7fbaaeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbab0159410 0x7fbab0070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaaeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbab0159410 0x7fbab0070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52884/0 (socket says 172.21.15.72:52884) 2023-08-25T04:47:30.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaaeffd700 1 -- 172.21.15.72:0/3791210263 learned_addr learned my addr 172.21.15.72:0/3791210263 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:30.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaa7fff700 1 --2- 172.21.15.72:0/3791210263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab00adc00 0x7fbab0070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaaf7fe700 1 --2- 172.21.15.72:0/3791210263 >> v2:172.21.15.137:3300/0 conn(0x7fbab006de30 0x7fbab006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaaeffd700 1 -- 172.21.15.72:0/3791210263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab00adc00 msgr2=0x7fbab0070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:30.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaaeffd700 1 --2- 172.21.15.72:0/3791210263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab00adc00 0x7fbab0070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaaeffd700 1 -- 172.21.15.72:0/3791210263 >> v2:172.21.15.137:3300/0 conn(0x7fbab006de30 msgr2=0x7fbab006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:30.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaaeffd700 1 --2- 172.21.15.72:0/3791210263 >> v2:172.21.15.137:3300/0 conn(0x7fbab006de30 0x7fbab006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaaeffd700 1 -- 172.21.15.72:0/3791210263 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab00c3a10 con 0x7fbab0159410 2023-08-25T04:47:30.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaa7fff700 1 --2- 172.21.15.72:0/3791210263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab00adc00 0x7fbab0070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:30.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaaf7fe700 1 --2- 172.21.15.72:0/3791210263 >> v2:172.21.15.137:3300/0 conn(0x7fbab006de30 0x7fbab006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:30.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaaeffd700 1 --2- 172.21.15.72:0/3791210263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab0159410 0x7fbab0070890 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbab00ae060 tx=0x7fbaa000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d05407173883fb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:30.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.211+0000 7fbaae7fc700 1 -- 172.21.15.72:0/3791210263 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000dd30 con 0x7fbab0159410 2023-08-25T04:47:30.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbaae7fc700 1 -- 172.21.15.72:0/3791210263 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa000de90 con 0x7fbab0159410 2023-08-25T04:47:30.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbaae7fc700 1 -- 172.21.15.72:0/3791210263 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0010690 con 0x7fbab0159410 2023-08-25T04:47:30.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbab55ff700 1 -- 172.21.15.72:0/3791210263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab0159410 msgr2=0x7fbab0070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbab55ff700 1 --2- 172.21.15.72:0/3791210263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab0159410 0x7fbab0070890 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbab00ae060 tx=0x7fbaa000be70 comp rx=0 tx=0).stop 2023-08-25T04:47:30.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbab55ff700 1 -- 172.21.15.72:0/3791210263 shutdown_connections 2023-08-25T04:47:30.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbab55ff700 1 --2- 172.21.15.72:0/3791210263 >> v2:172.21.15.137:3300/0 conn(0x7fbab006de30 0x7fbab006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbab55ff700 1 --2- 172.21.15.72:0/3791210263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab0159410 0x7fbab0070890 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbab55ff700 1 --2- 172.21.15.72:0/3791210263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab00adc00 0x7fbab0070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbab55ff700 1 -- 172.21.15.72:0/3791210263 >> 172.21.15.72:0/3791210263 conn(0x7fbab00ce990 msgr2=0x7fbab00ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:30.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbab55ff700 1 -- 172.21.15.72:0/3791210263 shutdown_connections 2023-08-25T04:47:30.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.212+0000 7fbab55ff700 1 -- 172.21.15.72:0/3791210263 wait complete. 2023-08-25T04:47:30.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.215+0000 7fbab55ff700 1 Processor -- start 2023-08-25T04:47:30.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.215+0000 7fbab55ff700 1 -- start start 2023-08-25T04:47:30.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.216+0000 7fbab55ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab006de30 0x7fbab01597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.216+0000 7fbab55ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbab00adc00 0x7fbab00b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.216+0000 7fbab55ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab0159410 0x7fbab00b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.216+0000 7fbab55ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab015adb0 con 0x7fbab006de30 2023-08-25T04:47:30.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.216+0000 7fbab55ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab015a1d0 con 0x7fbab00adc00 2023-08-25T04:47:30.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.216+0000 7fbab55ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab015a4b0 con 0x7fbab0159410 2023-08-25T04:47:30.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.216+0000 7fbaaeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab006de30 0x7fbab01597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.216+0000 7fbaaeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab006de30 0x7fbab01597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52900/0 (socket says 172.21.15.72:52900) 2023-08-25T04:47:30.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.216+0000 7fbaaeffd700 1 -- 172.21.15.72:0/2158297545 learned_addr learned my addr 172.21.15.72:0/2158297545 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:30.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaa7fff700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbab00adc00 0x7fbab00b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaaf7fe700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab0159410 0x7fbab00b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaaeffd700 1 -- 172.21.15.72:0/2158297545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab0159410 msgr2=0x7fbab00b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaaeffd700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab0159410 0x7fbab00b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaaeffd700 1 -- 172.21.15.72:0/2158297545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbab00adc00 msgr2=0x7fbab00b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaaeffd700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbab00adc00 0x7fbab00b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaaeffd700 1 -- 172.21.15.72:0/2158297545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa000b7f0 con 0x7fbab006de30 2023-08-25T04:47:30.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaa7fff700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbab00adc00 0x7fbab00b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:30.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaaf7fe700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab0159410 0x7fbab00b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:30.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaaeffd700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab006de30 0x7fbab01597f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000beb0 tx=0x7fbaa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:30.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaa77fe700 1 -- 172.21.15.72:0/2158297545 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa001f070 con 0x7fbab006de30 2023-08-25T04:47:30.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaa77fe700 1 -- 172.21.15.72:0/2158297545 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa0003b20 con 0x7fbab006de30 2023-08-25T04:47:30.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbaa77fe700 1 -- 172.21.15.72:0/2158297545 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0010470 con 0x7fbab006de30 2023-08-25T04:47:30.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbab55ff700 1 -- 172.21.15.72:0/2158297545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab015a790 con 0x7fbab006de30 2023-08-25T04:47:30.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.217+0000 7fbab55ff700 1 -- 172.21.15.72:0/2158297545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab0142150 con 0x7fbab006de30 2023-08-25T04:47:30.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.218+0000 7fbab55ff700 1 -- 172.21.15.72:0/2158297545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab015b240 con 0x7fbab006de30 2023-08-25T04:47:30.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.219+0000 7fbaa77fe700 1 -- 172.21.15.72:0/2158297545 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbaa0019400 con 0x7fbab006de30 2023-08-25T04:47:30.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.220+0000 7fbaa77fe700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba9006a0e0 0x7fba9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.220+0000 7fbaa77fe700 1 -- 172.21.15.72:0/2158297545 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbaa008bad0 con 0x7fbab006de30 2023-08-25T04:47:30.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.220+0000 7fbaa7fff700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba9006a0e0 0x7fba9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.221+0000 7fbaa7fff700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba9006a0e0 0x7fba9006c5a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbab00b0e60 tx=0x7fba98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:30.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.224+0000 7fbaa77fe700 1 -- 172.21.15.72:0/2158297545 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbab015b240 con 0x7fbab006de30 2023-08-25T04:47:30.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.461+0000 7fbab55ff700 1 -- 172.21.15.72:0/2158297545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbab015b240 con 0x7fbab006de30 2023-08-25T04:47:30.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.462+0000 7fbaa77fe700 1 -- 172.21.15.72:0/2158297545 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4881 (secure 0 0 0) 0x7fbab015b240 con 0x7fbab006de30 2023-08-25T04:47:30.463 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:30.463 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2948105792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2948105792},{"type":"v1","addr":"172.21.15.72:6837","nonce":2948105792}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3708335854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3708335854},{"type":"v1","addr":"172.21.15.137:6834","nonce":3708335854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3308589916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3308589916},{"type":"v1","addr":"172.21.15.72:6836","nonce":3308589916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:47:26.449921+0000","modified":"2023-08-25T04:47:29.982198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6835/2622594168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2622594168},{"type":"v1","addr":"172.21.15.137:6835","nonce":2622594168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-25T04:47:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 -- 172.21.15.72:0/2158297545 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba9006a0e0 msgr2=0x7fba9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba9006a0e0 0x7fba9006c5a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbab00b0e60 tx=0x7fba98008040 comp rx=0 tx=0).stop 2023-08-25T04:47:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 -- 172.21.15.72:0/2158297545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab006de30 msgr2=0x7fbab01597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab006de30 0x7fbab01597f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000beb0 tx=0x7fbaa0004750 comp rx=0 tx=0).stop 2023-08-25T04:47:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 -- 172.21.15.72:0/2158297545 shutdown_connections 2023-08-25T04:47:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fba9006a0e0 0x7fba9006c5a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbab0159410 0x7fbab00b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbab006de30 0x7fbab01597f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 --2- 172.21.15.72:0/2158297545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbab00adc00 0x7fbab00b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 -- 172.21.15.72:0/2158297545 >> 172.21.15.72:0/2158297545 conn(0x7fbab00ce990 msgr2=0x7fbab014f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 -- 172.21.15.72:0/2158297545 shutdown_connections 2023-08-25T04:47:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.465+0000 7fbab55ff700 1 -- 172.21.15.72:0/2158297545 wait complete. 2023-08-25T04:47:30.468 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 16 2023-08-25T04:47:30.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:47:30.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.679+0000 7ff682fff700 1 Processor -- start 2023-08-25T04:47:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.679+0000 7ff682fff700 1 -- start start 2023-08-25T04:47:30.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.680+0000 7ff682fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff67c0cda40 0x7ff67c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.680+0000 7ff682fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c0d1fe0 con 0x7ff67c15ce60 2023-08-25T04:47:30.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.680+0000 7ff682fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c0d13d0 con 0x7ff67c0d0df0 2023-08-25T04:47:30.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.680+0000 7ff682fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0d2b80 con 0x7ff67c0cda40 2023-08-25T04:47:30.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.680+0000 7ff68159c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff67c0cda40 0x7ff67c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.681+0000 7ff68159c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff67c0cda40 0x7ff67c0cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52906/0 (socket says 172.21.15.72:52906) 2023-08-25T04:47:30.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.681+0000 7ff68159c700 1 -- 172.21.15.72:0/2888146193 learned_addr learned my addr 172.21.15.72:0/2888146193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:30.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.681+0000 7ff68159c700 1 -- 172.21.15.72:0/2888146193 >> v1:172.21.15.137:6789/0 conn(0x7ff67c0d0df0 legacy=0x7ff67c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.681+0000 7ff68159c700 1 -- 172.21.15.72:0/2888146193 >> v1:172.21.15.72:6789/0 conn(0x7ff67c15ce60 legacy=0x7ff67c0b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.681+0000 7ff68159c700 1 -- 172.21.15.72:0/2888146193 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0d16b0 con 0x7ff67c0cda40 2023-08-25T04:47:30.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.681+0000 7ff68159c700 1 --2- 172.21.15.72:0/2888146193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0cda40 0x7ff67c0cdeb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff674009e50 tx=0x7ff67400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13732a960e1566f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:30.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.681+0000 7ff67b7fe700 1 -- 172.21.15.72:0/2888146193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400e070 con 0x7ff67c0cda40 2023-08-25T04:47:30.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.681+0000 7ff67b7fe700 1 -- 172.21.15.72:0/2888146193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67400b9c0 con 0x7ff67c0cda40 2023-08-25T04:47:30.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.681+0000 7ff67b7fe700 1 -- 172.21.15.72:0/2888146193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400bd70 con 0x7ff67c0cda40 2023-08-25T04:47:30.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.682+0000 7ff682fff700 1 -- 172.21.15.72:0/2888146193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0cda40 msgr2=0x7ff67c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.682+0000 7ff682fff700 1 --2- 172.21.15.72:0/2888146193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0cda40 0x7ff67c0cdeb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff674009e50 tx=0x7ff67400b330 comp rx=0 tx=0).stop 2023-08-25T04:47:30.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.682+0000 7ff682fff700 1 -- 172.21.15.72:0/2888146193 shutdown_connections 2023-08-25T04:47:30.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.682+0000 7ff682fff700 1 --2- 172.21.15.72:0/2888146193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0cda40 0x7ff67c0cdeb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.682+0000 7ff682fff700 1 -- 172.21.15.72:0/2888146193 >> 172.21.15.72:0/2888146193 conn(0x7ff67c071e10 msgr2=0x7ff67c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:30.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.682+0000 7ff682fff700 1 -- 172.21.15.72:0/2888146193 shutdown_connections 2023-08-25T04:47:30.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.682+0000 7ff682fff700 1 -- 172.21.15.72:0/2888146193 wait complete. 2023-08-25T04:47:30.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.684+0000 7ff682fff700 1 Processor -- start 2023-08-25T04:47:30.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.684+0000 7ff682fff700 1 -- start start 2023-08-25T04:47:30.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff682fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff67c0cda40 0x7ff67c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff682fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0d0df0 0x7ff67c0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff682fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff67c15ce60 0x7ff67c1f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff682fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c7db0 con 0x7ff67c0d0df0 2023-08-25T04:47:30.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff682fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c8090 con 0x7ff67c15ce60 2023-08-25T04:47:30.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff682fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c8370 con 0x7ff67c0cda40 2023-08-25T04:47:30.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff67bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0d0df0 0x7ff67c0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff67bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0d0df0 0x7ff67c0c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52918/0 (socket says 172.21.15.72:52918) 2023-08-25T04:47:30.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff67bfff700 1 -- 172.21.15.72:0/3523719501 learned_addr learned my addr 172.21.15.72:0/3523719501 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:30.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff68159c700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff67c15ce60 0x7ff67c1f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.685+0000 7ff680d9b700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff67c0cda40 0x7ff67c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff67bfff700 1 -- 172.21.15.72:0/3523719501 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff67c0cda40 msgr2=0x7ff67c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff67bfff700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff67c0cda40 0x7ff67c0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff67bfff700 1 -- 172.21.15.72:0/3523719501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff67c15ce60 msgr2=0x7ff67c1f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff67bfff700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff67c15ce60 0x7ff67c1f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff67bfff700 1 -- 172.21.15.72:0/3523719501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff674009b30 con 0x7ff67c0d0df0 2023-08-25T04:47:30.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff67bfff700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0d0df0 0x7ff67c0c9390 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff66800c450 tx=0x7ff66800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:30.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff6797fa700 1 -- 172.21.15.72:0/3523719501 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680052d0 con 0x7ff67c0d0df0 2023-08-25T04:47:30.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff6797fa700 1 -- 172.21.15.72:0/3523719501 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff668005430 con 0x7ff67c0d0df0 2023-08-25T04:47:30.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff6797fa700 1 -- 172.21.15.72:0/3523719501 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680038c0 con 0x7ff67c0d0df0 2023-08-25T04:47:30.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff682fff700 1 -- 172.21.15.72:0/3523719501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c0c8650 con 0x7ff67c0d0df0 2023-08-25T04:47:30.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.686+0000 7ff682fff700 1 -- 172.21.15.72:0/3523719501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c15fea0 con 0x7ff67c0d0df0 2023-08-25T04:47:30.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.687+0000 7ff682fff700 1 -- 172.21.15.72:0/3523719501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c0ce370 con 0x7ff67c0d0df0 2023-08-25T04:47:30.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.688+0000 7ff6797fa700 1 -- 172.21.15.72:0/3523719501 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff668003a20 con 0x7ff67c0d0df0 2023-08-25T04:47:30.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.689+0000 7ff6797fa700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff66006a0e0 0x7ff66006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:30.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.689+0000 7ff6797fa700 1 -- 172.21.15.72:0/3523719501 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff668087a40 con 0x7ff67c0d0df0 2023-08-25T04:47:30.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.690+0000 7ff680d9b700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff66006a0e0 0x7ff66006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:30.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.690+0000 7ff680d9b700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff66006a0e0 0x7ff66006c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff670007fd0 tx=0x7ff670009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:30.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.693+0000 7ff6797fa700 1 -- 172.21.15.72:0/3523719501 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff668052f50 con 0x7ff67c0d0df0 2023-08-25T04:47:30.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.892+0000 7ff682fff700 1 -- 172.21.15.72:0/3523719501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff67c04e620 con 0x7ff67c0d0df0 2023-08-25T04:47:30.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.893+0000 7ff6797fa700 1 -- 172.21.15.72:0/3523719501 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18442 (secure 0 0 0) 0x7ff66800ce60 con 0x7ff67c0d0df0 2023-08-25T04:47:30.894 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:30.895 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","created":"2023-08-25T04:45:12.638424+0000","modified":"2023-08-25T04:47:27.966067+0000","last_up_change":"2023-08-25T04:45:24.747887+0000","last_in_change":"2023-08-25T04:45:16.151544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-25T04:45:25.331085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-25T04:45:25.911226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:47:24.274013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-08-25T04:47:25.430249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49e4adfe-93dd-4c4d-ac81-3a22fa022560","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6809","nonce":3711160113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6811","nonce":3711160113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6815","nonce":3711160113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":3711160113},{"type":"v1","addr":"172.21.15.72:6813","nonce":3711160113}]},"public_addr":"172.21.15.72:6809/3711160113","cluster_addr":"172.21.15.72:6811/3711160113","heartbeat_back_addr":"172.21.15.72:6815/3711160113","heartbeat_front_addr":"172.21.15.72:6813/3711160113","state":["exists","up"]},{"osd":1,"uuid":"10424aa9-0e4e-45fe-9ea4-5a9feb833c47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6817","nonce":1825299555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6821","nonce":1825299555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6829","nonce":1825299555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":1825299555},{"type":"v1","addr":"172.21.15.72:6825","nonce":1825299555}]},"public_addr":"172.21.15.72:6817/1825299555","cluster_addr":"172.21.15.72:6821/1825299555","heartbeat_back_addr":"172.21.15.72:6829/1825299555","heartbeat_front_addr":"172.21.15.72:6825/1825299555","state":["exists","up"]},{"osd":2,"uuid":"cc19cb37-3f4b-49e4-821f-d17e72c31af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6801","nonce":3772137413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6803","nonce":3772137413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6807","nonce":3772137413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3772137413},{"type":"v1","addr":"172.21.15.72:6805","nonce":3772137413}]},"public_addr":"172.21.15.72:6801/3772137413","cluster_addr":"172.21.15.72:6803/3772137413","heartbeat_back_addr":"172.21.15.72:6807/3772137413","heartbeat_front_addr":"172.21.15.72:6805/3772137413","state":["exists","up"]},{"osd":3,"uuid":"02f4db2b-3677-4549-907a-bda8b3c43272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6820","nonce":3896481440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6824","nonce":3896481440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6831","nonce":3896481440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3896481440},{"type":"v1","addr":"172.21.15.72:6828","nonce":3896481440}]},"public_addr":"172.21.15.72:6820/3896481440","cluster_addr":"172.21.15.72:6824/3896481440","heartbeat_back_addr":"172.21.15.72:6831/3896481440","heartbeat_front_addr":"172.21.15.72:6828/3896481440","state":["exists","up"]},{"osd":4,"uuid":"b0bf2795-9ea7-4796-bbb9-1340d4af8c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6825","nonce":3706321311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6827","nonce":3706321311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6831","nonce":3706321311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3706321311},{"type":"v1","addr":"172.21.15.137:6829","nonce":3706321311}]},"public_addr":"172.21.15.137:6825/3706321311","cluster_addr":"172.21.15.137:6827/3706321311","heartbeat_back_addr":"172.21.15.137:6831/3706321311","heartbeat_front_addr":"172.21.15.137:6829/3706321311","state":["exists","up"]},{"osd":5,"uuid":"4b332a5c-432c-42ed-86b8-4c4aed4ad634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6801","nonce":1114533448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6803","nonce":1114533448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6807","nonce":1114533448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1114533448},{"type":"v1","addr":"172.21.15.137:6805","nonce":1114533448}]},"public_addr":"172.21.15.137:6801/1114533448","cluster_addr":"172.21.15.137:6803/1114533448","heartbeat_back_addr":"172.21.15.137:6807/1114533448","heartbeat_front_addr":"172.21.15.137:6805/1114533448","state":["exists","up"]},{"osd":6,"uuid":"6743bebc-9f70-4a48-ad13-6d028c6fadc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6809","nonce":2642428945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6811","nonce":2642428945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6815","nonce":2642428945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2642428945},{"type":"v1","addr":"172.21.15.137:6813","nonce":2642428945}]},"public_addr":"172.21.15.137:6809/2642428945","cluster_addr":"172.21.15.137:6811/2642428945","heartbeat_back_addr":"172.21.15.137:6815/2642428945","heartbeat_front_addr":"172.21.15.137:6813/2642428945","state":["exists","up"]},{"osd":7,"uuid":"09b80551-f07b-43ba-9f98-7430f71f1dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6817","nonce":610369633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6819","nonce":610369633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6823","nonce":610369633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":610369633},{"type":"v1","addr":"172.21.15.137:6821","nonce":610369633}]},"public_addr":"172.21.15.137:6817/610369633","cluster_addr":"172.21.15.137:6819/610369633","heartbeat_back_addr":"172.21.15.137:6823/610369633","heartbeat_front_addr":"172.21.15.137:6821/610369633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.719449+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.511865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.445856+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.739822+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.780926+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.684420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.748894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:45:21.429238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:47:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.895+0000 7ff682fff700 1 -- 172.21.15.72:0/3523719501 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff66006a0e0 msgr2=0x7ff66006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.895+0000 7ff682fff700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff66006a0e0 0x7ff66006c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff670007fd0 tx=0x7ff670009040 comp rx=0 tx=0).stop 2023-08-25T04:47:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.895+0000 7ff682fff700 1 -- 172.21.15.72:0/3523719501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0d0df0 msgr2=0x7ff67c0c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.895+0000 7ff682fff700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0d0df0 0x7ff67c0c9390 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff66800c450 tx=0x7ff66800c760 comp rx=0 tx=0).stop 2023-08-25T04:47:30.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.896+0000 7ff682fff700 1 -- 172.21.15.72:0/3523719501 shutdown_connections 2023-08-25T04:47:30.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.896+0000 7ff682fff700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff66006a0e0 0x7ff66006c5a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.896+0000 7ff682fff700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff67c15ce60 0x7ff67c1f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.896+0000 7ff682fff700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff67c0cda40 0x7ff67c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.896+0000 7ff682fff700 1 --2- 172.21.15.72:0/3523719501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff67c0d0df0 0x7ff67c0c9390 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:30.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.896+0000 7ff682fff700 1 -- 172.21.15.72:0/3523719501 >> 172.21.15.72:0/3523719501 conn(0x7ff67c071e10 msgr2=0x7ff67c0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:30.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.896+0000 7ff682fff700 1 -- 172.21.15.72:0/3523719501 shutdown_connections 2023-08-25T04:47:30.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:30.896+0000 7ff682fff700 1 -- 172.21.15.72:0/3523719501 wait complete. 2023-08-25T04:47:30.915 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:47:30.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:47:31.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.112+0000 7f7fec5ff700 1 Processor -- start 2023-08-25T04:47:31.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.112+0000 7f7fec5ff700 1 -- start start 2023-08-25T04:47:31.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.113+0000 7f7fec5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe415ce60 0x7f7fe40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.113+0000 7f7fec5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe40d1fe0 con 0x7f7fe40cda40 2023-08-25T04:47:31.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.113+0000 7f7fec5ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe40d13d0 con 0x7f7fe40b8770 2023-08-25T04:47:31.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.113+0000 7f7fec5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40d2b80 con 0x7f7fe415ce60 2023-08-25T04:47:31.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7feab9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7fe40cda40 0x7f7fe40b5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57298/0 (socket says 172.21.15.72:57298) 2023-08-25T04:47:31.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7feab9c700 1 -- 172.21.15.72:0/1588045183 learned_addr learned my addr 172.21.15.72:0/1588045183 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:31.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7fea39b700 1 --2- 172.21.15.72:0/1588045183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe415ce60 0x7f7fe40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7fe9399700 1 -- 172.21.15.72:0/1588045183 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306566910 0 0) 0x7f7fe40d1fe0 con 0x7f7fe40cda40 2023-08-25T04:47:31.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7fe9399700 1 -- 172.21.15.72:0/1588045183 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd00035b0 con 0x7f7fe40cda40 2023-08-25T04:47:31.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7fe9399700 1 -- 172.21.15.72:0/1588045183 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819425179 0 0) 0x7f7fe40d13d0 con 0x7f7fe40b8770 2023-08-25T04:47:31.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7fe9399700 1 -- 172.21.15.72:0/1588045183 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fe40d1fe0 con 0x7f7fe40b8770 2023-08-25T04:47:31.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7fea39b700 1 -- 172.21.15.72:0/1588045183 >> v1:172.21.15.137:6789/0 conn(0x7f7fe40b8770 legacy=0x7f7fe40d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7fea39b700 1 -- 172.21.15.72:0/1588045183 >> v1:172.21.15.72:6789/0 conn(0x7f7fe40cda40 legacy=0x7f7fe40b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7fe9399700 1 -- 172.21.15.72:0/1588045183 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 787727042 0 0) 0x7f7fd00035b0 con 0x7f7fe40cda40 2023-08-25T04:47:31.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.114+0000 7f7fea39b700 1 -- 172.21.15.72:0/1588045183 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe40d16b0 con 0x7f7fe415ce60 2023-08-25T04:47:31.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.115+0000 7f7fea39b700 1 --2- 172.21.15.72:0/1588045183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe415ce60 0x7f7fe40d0df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009870 tx=0x7f7fe0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c87a468a859ad75 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:31.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.115+0000 7f7fe9399700 1 -- 172.21.15.72:0/1588045183 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc0019f0 con 0x7f7fe415ce60 2023-08-25T04:47:31.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.115+0000 7f7fe9399700 1 -- 172.21.15.72:0/1588045183 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe0004030 con 0x7f7fe415ce60 2023-08-25T04:47:31.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.115+0000 7f7fe9399700 1 -- 172.21.15.72:0/1588045183 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00043c0 con 0x7f7fe415ce60 2023-08-25T04:47:31.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.116+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1588045183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe415ce60 msgr2=0x7f7fe40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.116+0000 7f7fec5ff700 1 --2- 172.21.15.72:0/1588045183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe415ce60 0x7f7fe40d0df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009870 tx=0x7f7fe0009b80 comp rx=0 tx=0).stop 2023-08-25T04:47:31.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.116+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1588045183 shutdown_connections 2023-08-25T04:47:31.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.116+0000 7f7fec5ff700 1 --2- 172.21.15.72:0/1588045183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe415ce60 0x7f7fe40d0df0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.116+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1588045183 >> 172.21.15.72:0/1588045183 conn(0x7f7fe4071e10 msgr2=0x7f7fe4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:31.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.116+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1588045183 shutdown_connections 2023-08-25T04:47:31.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.116+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1588045183 wait complete. 2023-08-25T04:47:31.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.117+0000 7f7fec5ff700 1 Processor -- start 2023-08-25T04:47:31.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.118+0000 7f7fec5ff700 1 -- start start 2023-08-25T04:47:31.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.118+0000 7f7fec5ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fe40b8770 0x7f7fe4155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7fec5ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe40cda40 0x7f7fe40d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7fec5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe415ce60 0x7f7fe40d3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7fec5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40cb640 con 0x7f7fe415ce60 2023-08-25T04:47:31.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7fec5ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40cb900 con 0x7f7fe40b8770 2023-08-25T04:47:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7fec5ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40cbbe0 con 0x7f7fe40cda40 2023-08-25T04:47:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7feab9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe415ce60 0x7f7fe40d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7feab9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe415ce60 0x7f7fe40d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52920/0 (socket says 172.21.15.72:52920) 2023-08-25T04:47:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7feab9c700 1 -- 172.21.15.72:0/1250932836 learned_addr learned my addr 172.21.15.72:0/1250932836 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7fea39b700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fe40b8770 0x7f7fe4155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7fe9b9a700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe40cda40 0x7f7fe40d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7feab9c700 1 -- 172.21.15.72:0/1250932836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe40cda40 msgr2=0x7f7fe40d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7feab9c700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe40cda40 0x7f7fe40d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7feab9c700 1 -- 172.21.15.72:0/1250932836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fe40b8770 msgr2=0x7f7fe4155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7feab9c700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fe40b8770 0x7f7fe4155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7feab9c700 1 -- 172.21.15.72:0/1250932836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe00094a0 con 0x7f7fe415ce60 2023-08-25T04:47:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7fe9b9a700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe40cda40 0x7f7fe40d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.119+0000 7f7feab9c700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe415ce60 0x7f7fe40d3240 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0017f0 tx=0x7f7fdc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.120+0000 7f7fdaffd700 1 -- 172.21.15.72:0/1250932836 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc00ac20 con 0x7f7fe415ce60 2023-08-25T04:47:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.120+0000 7f7fdaffd700 1 -- 172.21.15.72:0/1250932836 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc00ada0 con 0x7f7fe415ce60 2023-08-25T04:47:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.120+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1250932836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe40cbec0 con 0x7f7fe415ce60 2023-08-25T04:47:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.120+0000 7f7fdaffd700 1 -- 172.21.15.72:0/1250932836 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc007310 con 0x7f7fe415ce60 2023-08-25T04:47:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.120+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1250932836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe4155770 con 0x7f7fe415ce60 2023-08-25T04:47:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.121+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1250932836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe40cc3e0 con 0x7f7fe415ce60 2023-08-25T04:47:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.122+0000 7f7fdaffd700 1 -- 172.21.15.72:0/1250932836 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7fdc007470 con 0x7f7fe415ce60 2023-08-25T04:47:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.123+0000 7f7fdaffd700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7fc806a0e0 0x7f7fc806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.123+0000 7f7fdaffd700 1 -- 172.21.15.72:0/1250932836 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7fdc088240 con 0x7f7fe415ce60 2023-08-25T04:47:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.123+0000 7f7fea39b700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7fc806a0e0 0x7f7fc806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.123+0000 7f7fea39b700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7fc806a0e0 0x7f7fc806c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00097c0 tx=0x7f7fe0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:31.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.127+0000 7f7fdaffd700 1 -- 172.21.15.72:0/1250932836 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7fe40cc3e0 con 0x7f7fe415ce60 2023-08-25T04:47:31.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.320+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1250932836 --> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fe40d1c70 con 0x7f7fc806a0e0 2023-08-25T04:47:31.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.330+0000 7f7fdaffd700 1 -- 172.21.15.72:0/1250932836 <== mgr.4101 v2:172.21.15.72:6832/1377484023 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295993 (secure 0 0 0) 0x7f7fe00042a0 con 0x7f7fc806a0e0 2023-08-25T04:47:31.334 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:31.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.334+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1250932836 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7fc806a0e0 msgr2=0x7f7fc806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.334+0000 7f7fec5ff700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7fc806a0e0 0x7f7fc806c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00097c0 tx=0x7f7fe0008030 comp rx=0 tx=0).stop 2023-08-25T04:47:31.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.335+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1250932836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe415ce60 msgr2=0x7f7fe40d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.335+0000 7f7fec5ff700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe415ce60 0x7f7fe40d3240 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0017f0 tx=0x7f7fdc00a060 comp rx=0 tx=0).stop 2023-08-25T04:47:31.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.335+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1250932836 shutdown_connections 2023-08-25T04:47:31.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.335+0000 7f7fec5ff700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f7fc806a0e0 0x7f7fc806c5a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.335+0000 7f7fec5ff700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe415ce60 0x7f7fe40d3240 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.335+0000 7f7fec5ff700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7fe40b8770 0x7f7fe4155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.335+0000 7f7fec5ff700 1 --2- 172.21.15.72:0/1250932836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7fe40cda40 0x7f7fe40d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.335+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1250932836 >> 172.21.15.72:0/1250932836 conn(0x7f7fe4071e10 msgr2=0x7f7fe40b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.335+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1250932836 shutdown_connections 2023-08-25T04:47:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.335+0000 7f7fec5ff700 1 -- 172.21.15.72:0/1250932836 wait complete. 2023-08-25T04:47:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-25T04:47:31.353 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-08-25T04:47:29.884419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220620,"kb_used_data":4388,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754100,"statfs":{"total":773094113280,"available":772868198400,"internally_reserved":0,"allocated":4493312,"data_stored":2626088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.938686"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.893042+0000","last_change":"2023-08-25T04:45:26.770775+0000","last_active":"2023-08-25T04:47:18.893042+0000","last_peered":"2023-08-25T04:47:18.893042+0000","last_clean":"2023-08-25T04:47:18.893042+0000","last_became_active":"2023-08-25T04:45:26.770447+0000","last_became_peered":"2023-08-25T04:45:26.770447+0000","last_unstale":"2023-08-25T04:47:18.893042+0000","last_undegraded":"2023-08-25T04:47:18.893042+0000","last_fullsized":"2023-08-25T04:47:18.893042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:47.083723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.479699+0000","last_change":"2023-08-25T04:45:26.768222+0000","last_active":"2023-08-25T04:47:18.479699+0000","last_peered":"2023-08-25T04:47:18.479699+0000","last_clean":"2023-08-25T04:47:18.479699+0000","last_became_active":"2023-08-25T04:45:26.767875+0000","last_became_peered":"2023-08-25T04:45:26.767875+0000","last_unstale":"2023-08-25T04:47:18.479699+0000","last_undegraded":"2023-08-25T04:47:18.479699+0000","last_fullsized":"2023-08-25T04:47:18.479699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:47:33.102158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.892114+0000","last_change":"2023-08-25T04:45:26.767948+0000","last_active":"2023-08-25T04:47:18.892114+0000","last_peered":"2023-08-25T04:47:18.892114+0000","last_clean":"2023-08-25T04:47:18.892114+0000","last_became_active":"2023-08-25T04:45:26.767496+0000","last_became_peered":"2023-08-25T04:45:26.767496+0000","last_unstale":"2023-08-25T04:47:18.892114+0000","last_undegraded":"2023-08-25T04:47:18.892114+0000","last_fullsized":"2023-08-25T04:47:18.892114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:29.617635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":195,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.480195+0000","last_change":"2023-08-25T04:45:27.771979+0000","last_active":"2023-08-25T04:47:18.480195+0000","last_peered":"2023-08-25T04:47:18.480195+0000","last_clean":"2023-08-25T04:47:18.480195+0000","last_became_active":"2023-08-25T04:45:27.770968+0000","last_became_peered":"2023-08-25T04:45:27.770968+0000","last_unstale":"2023-08-25T04:47:18.480195+0000","last_undegraded":"2023-08-25T04:47:18.480195+0000","last_fullsized":"2023-08-25T04:47:18.480195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_clean_scrub_stamp":"2023-08-25T04:45:26.752521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:04:38.263048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.480196+0000","last_change":"2023-08-25T04:45:26.807286+0000","last_active":"2023-08-25T04:47:18.480196+0000","last_peered":"2023-08-25T04:47:18.480196+0000","last_clean":"2023-08-25T04:47:18.480196+0000","last_became_active":"2023-08-25T04:45:26.806698+0000","last_became_peered":"2023-08-25T04:45:26.806698+0000","last_unstale":"2023-08-25T04:47:18.480196+0000","last_undegraded":"2023-08-25T04:47:18.480196+0000","last_fullsized":"2023-08-25T04:47:18.480196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:31.023488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.480190+0000","last_change":"2023-08-25T04:45:26.807096+0000","last_active":"2023-08-25T04:47:18.480190+0000","last_peered":"2023-08-25T04:47:18.480190+0000","last_clean":"2023-08-25T04:47:18.480190+0000","last_became_active":"2023-08-25T04:45:26.806713+0000","last_became_peered":"2023-08-25T04:45:26.806713+0000","last_unstale":"2023-08-25T04:47:18.480190+0000","last_undegraded":"2023-08-25T04:47:18.480190+0000","last_fullsized":"2023-08-25T04:47:18.480190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:31:06.829067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.893205+0000","last_change":"2023-08-25T04:45:26.807065+0000","last_active":"2023-08-25T04:47:18.893205+0000","last_peered":"2023-08-25T04:47:18.893205+0000","last_clean":"2023-08-25T04:47:18.893205+0000","last_became_active":"2023-08-25T04:45:26.806737+0000","last_became_peered":"2023-08-25T04:45:26.806737+0000","last_unstale":"2023-08-25T04:47:18.893205+0000","last_undegraded":"2023-08-25T04:47:18.893205+0000","last_fullsized":"2023-08-25T04:47:18.893205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:08:22.692950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.893441+0000","last_change":"2023-08-25T04:45:26.807090+0000","last_active":"2023-08-25T04:47:18.893441+0000","last_peered":"2023-08-25T04:47:18.893441+0000","last_clean":"2023-08-25T04:47:18.893441+0000","last_became_active":"2023-08-25T04:45:26.806685+0000","last_became_peered":"2023-08-25T04:45:26.806685+0000","last_unstale":"2023-08-25T04:47:18.893441+0000","last_undegraded":"2023-08-25T04:47:18.893441+0000","last_fullsized":"2023-08-25T04:47:18.893441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:35:14.864292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.893388+0000","last_change":"2023-08-25T04:45:26.768150+0000","last_active":"2023-08-25T04:47:18.893388+0000","last_peered":"2023-08-25T04:47:18.893388+0000","last_clean":"2023-08-25T04:47:18.893388+0000","last_became_active":"2023-08-25T04:45:26.767845+0000","last_became_peered":"2023-08-25T04:45:26.767845+0000","last_unstale":"2023-08-25T04:47:18.893388+0000","last_undegraded":"2023-08-25T04:47:18.893388+0000","last_fullsized":"2023-08-25T04:47:18.893388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:26:14.715064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1007616,"data_stored":771154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":11.452,"5min":11.452,"15min":11.452},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":7.3620000000000001,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":7.4550000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.751},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.90400000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":9.3689999999999998,"5min":9.3689999999999998,"15min":9.3689999999999998},"last":0.95799999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":1.016},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.92700000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.88700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":180786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.86699999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.754},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.628}]},{"osd":4,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.83799999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.79100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":771154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.505}]},{"osd":2,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52600000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.75},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":179850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5030000000000001,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.438},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":4.6020000000000003,"5min":4.6020000000000003,"15min":4.6020000000000003},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":4.5679999999999996,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.629},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.752}]},{"osd":7,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.4580000000000002,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.56299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":413696,"data_stored":180786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":15.301,"5min":15.301,"15min":15.301},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":15.334,"5min":15.334,"15min":15.334},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.1050000000000004,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.498},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":15.172000000000001,"5min":15.172000000000001,"15min":15.172000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":15.266,"5min":15.266,"15min":15.266},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.0469999999999997,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":15.227,"5min":15.227,"15min":15.227},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":4.077,"5min":4.077,"15min":4.077},"last":0.85799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":180786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":12.221,"5min":12.221,"15min":12.221},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":10.331,"5min":10.331,"15min":10.331},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":10.361000000000001,"5min":10.361000000000001,"15min":10.361000000000001},"last":0.495},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.295999999999999,"5min":10.295999999999999,"15min":10.295999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":11.097,"5min":11.097,"15min":11.097},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.753},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":10.252000000000001,"5min":10.252000000000001,"15min":10.252000000000001},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":11.058999999999999,"5min":11.058999999999999,"15min":11.058999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":10.206,"5min":10.206,"15min":10.206},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":11.013,"5min":11.013,"15min":11.013},"last":0.77100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":413696,"data_stored":180786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71199999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.62},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.747}]},{"osd":5,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.88500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":180786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.432},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.627},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.35899999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:47:31.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:47:31.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.588+0000 7fcc74fff700 1 Processor -- start 2023-08-25T04:47:31.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.588+0000 7fcc74fff700 1 -- start start 2023-08-25T04:47:31.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.589+0000 7fcc74fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcc7015d040 0x7fcc700ca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc74fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 0x7fcc7006a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc74fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc700ce9f0 con 0x7fcc700cd820 2023-08-25T04:47:31.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc74fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7006acc0 con 0x7fcc7015d040 2023-08-25T04:47:31.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc74fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc700cdde0 con 0x7fcc7006a2f0 2023-08-25T04:47:31.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc67fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcc700cd820 0x7fcc701616c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57308/0 (socket says 172.21.15.72:57308) 2023-08-25T04:47:31.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc67fff700 1 -- 172.21.15.72:0/86185121 learned_addr learned my addr 172.21.15.72:0/86185121 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc6e59c700 1 --2- 172.21.15.72:0/86185121 >> v2:172.21.15.137:3300/0 conn(0x7fcc7015d040 0x7fcc700ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc6ed9d700 1 --2- 172.21.15.72:0/86185121 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 0x7fcc7006a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc6dd9b700 1 -- 172.21.15.72:0/86185121 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889105981 0 0) 0x7fcc700ce9f0 con 0x7fcc700cd820 2023-08-25T04:47:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc6dd9b700 1 -- 172.21.15.72:0/86185121 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc5c0035b0 con 0x7fcc700cd820 2023-08-25T04:47:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc6e59c700 1 -- 172.21.15.72:0/86185121 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 msgr2=0x7fcc7006a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc6e59c700 1 --2- 172.21.15.72:0/86185121 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 0x7fcc7006a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc6e59c700 1 -- 172.21.15.72:0/86185121 >> v1:172.21.15.72:6789/0 conn(0x7fcc700cd820 legacy=0x7fcc701616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.590+0000 7fcc6e59c700 1 -- 172.21.15.72:0/86185121 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc700ce0c0 con 0x7fcc7015d040 2023-08-25T04:47:31.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.591+0000 7fcc6e59c700 1 --2- 172.21.15.72:0/86185121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc7015d040 0x7fcc700ca790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009840 tx=0x7fcc60009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f7936eb802ce8e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:31.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.591+0000 7fcc6dd9b700 1 -- 172.21.15.72:0/86185121 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc60011830 con 0x7fcc7015d040 2023-08-25T04:47:31.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.591+0000 7fcc6dd9b700 1 -- 172.21.15.72:0/86185121 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc60011990 con 0x7fcc7015d040 2023-08-25T04:47:31.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.591+0000 7fcc6dd9b700 1 -- 172.21.15.72:0/86185121 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc60011d00 con 0x7fcc7015d040 2023-08-25T04:47:31.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.592+0000 7fcc74fff700 1 -- 172.21.15.72:0/86185121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc7015d040 msgr2=0x7fcc700ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.592+0000 7fcc74fff700 1 --2- 172.21.15.72:0/86185121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc7015d040 0x7fcc700ca790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009840 tx=0x7fcc60009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:31.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.592+0000 7fcc74fff700 1 -- 172.21.15.72:0/86185121 shutdown_connections 2023-08-25T04:47:31.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.592+0000 7fcc74fff700 1 --2- 172.21.15.72:0/86185121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc7015d040 0x7fcc700ca790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.592+0000 7fcc74fff700 1 --2- 172.21.15.72:0/86185121 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 0x7fcc7006a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.592+0000 7fcc74fff700 1 -- 172.21.15.72:0/86185121 >> 172.21.15.72:0/86185121 conn(0x7fcc7006db30 msgr2=0x7fcc7006df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:31.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.592+0000 7fcc74fff700 1 -- 172.21.15.72:0/86185121 shutdown_connections 2023-08-25T04:47:31.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.592+0000 7fcc74fff700 1 -- 172.21.15.72:0/86185121 wait complete. 2023-08-25T04:47:31.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.593+0000 7fcc74fff700 1 Processor -- start 2023-08-25T04:47:31.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.594+0000 7fcc74fff700 1 -- start start 2023-08-25T04:47:31.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc74fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 0x7fcc700b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc74fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc700cd820 0x7fcc701e8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc74fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc7015d040 0x7fcc700c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc74fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc701e88c0 con 0x7fcc7015d040 2023-08-25T04:47:31.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc74fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc700b36c0 con 0x7fcc700cd820 2023-08-25T04:47:31.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc74fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc700b39a0 con 0x7fcc7006a2f0 2023-08-25T04:47:31.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc6ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc7015d040 0x7fcc700c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc6ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc7015d040 0x7fcc700c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52934/0 (socket says 172.21.15.72:52934) 2023-08-25T04:47:31.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc6ed9d700 1 -- 172.21.15.72:0/56475386 learned_addr learned my addr 172.21.15.72:0/56475386 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:31.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc6e59c700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 0x7fcc700b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.595+0000 7fcc67fff700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc700cd820 0x7fcc701e8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc6ed9d700 1 -- 172.21.15.72:0/56475386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 msgr2=0x7fcc700b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc6ed9d700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 0x7fcc700b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc6ed9d700 1 -- 172.21.15.72:0/56475386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc700cd820 msgr2=0x7fcc701e8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc6ed9d700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc700cd820 0x7fcc701e8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc6ed9d700 1 -- 172.21.15.72:0/56475386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600094a0 con 0x7fcc7015d040 2023-08-25T04:47:31.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc6e59c700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 0x7fcc700b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:31.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc6ed9d700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc7015d040 0x7fcc700c8f50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800efc0 tx=0x7fcc6800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:31.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc66ffd700 1 -- 172.21.15.72:0/56475386 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68009ba0 con 0x7fcc7015d040 2023-08-25T04:47:31.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc66ffd700 1 -- 172.21.15.72:0/56475386 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6800f040 con 0x7fcc7015d040 2023-08-25T04:47:31.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc74fff700 1 -- 172.21.15.72:0/56475386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc700b3c80 con 0x7fcc7015d040 2023-08-25T04:47:31.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc66ffd700 1 -- 172.21.15.72:0/56475386 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68014480 con 0x7fcc7015d040 2023-08-25T04:47:31.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.596+0000 7fcc74fff700 1 -- 172.21.15.72:0/56475386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc700b4240 con 0x7fcc7015d040 2023-08-25T04:47:31.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.597+0000 7fcc74fff700 1 -- 172.21.15.72:0/56475386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc700ce380 con 0x7fcc7015d040 2023-08-25T04:47:31.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.598+0000 7fcc66ffd700 1 -- 172.21.15.72:0/56475386 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcc680145e0 con 0x7fcc7015d040 2023-08-25T04:47:31.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.599+0000 7fcc66ffd700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc5006a0e0 0x7fcc5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:31.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.599+0000 7fcc66ffd700 1 -- 172.21.15.72:0/56475386 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcc68088ed0 con 0x7fcc7015d040 2023-08-25T04:47:31.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.599+0000 7fcc6e59c700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc5006a0e0 0x7fcc5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:31.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.600+0000 7fcc6e59c700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc5006a0e0 0x7fcc5006c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcc60000c00 tx=0x7fcc60008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:31.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.603+0000 7fcc66ffd700 1 -- 172.21.15.72:0/56475386 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcc700ce380 con 0x7fcc7015d040 2023-08-25T04:47:31.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.795+0000 7fcc74fff700 1 -- 172.21.15.72:0/56475386 --> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc700ce680 con 0x7fcc5006a0e0 2023-08-25T04:47:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.803+0000 7fcc66ffd700 1 -- 172.21.15.72:0/56475386 <== mgr.4101 v2:172.21.15.72:6832/1377484023 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295993 (secure 0 0 0) 0x7fcc60011630 con 0x7fcc5006a0e0 2023-08-25T04:47:31.807 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:31.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 -- 172.21.15.72:0/56475386 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc5006a0e0 msgr2=0x7fcc5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc5006a0e0 0x7fcc5006c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcc60000c00 tx=0x7fcc60008030 comp rx=0 tx=0).stop 2023-08-25T04:47:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 -- 172.21.15.72:0/56475386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc7015d040 msgr2=0x7fcc700c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc7015d040 0x7fcc700c8f50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800efc0 tx=0x7fcc6800c3a0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 -- 172.21.15.72:0/56475386 shutdown_connections 2023-08-25T04:47:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fcc5006a0e0 0x7fcc5006c5a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc7015d040 0x7fcc700c8f50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc7006a2f0 0x7fcc700b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 --2- 172.21.15.72:0/56475386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc700cd820 0x7fcc701e8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:31.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 -- 172.21.15.72:0/56475386 >> 172.21.15.72:0/56475386 conn(0x7fcc7006db30 msgr2=0x7fcc700cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:31.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.807+0000 7fcc74fff700 1 -- 172.21.15.72:0/56475386 shutdown_connections 2023-08-25T04:47:31.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:31.808+0000 7fcc74fff700 1 -- 172.21.15.72:0/56475386 wait complete. 2023-08-25T04:47:31.810 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-25T04:47:31.826 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-08-25T04:47:29.884419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220620,"kb_used_data":4388,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754100,"statfs":{"total":773094113280,"available":772868198400,"internally_reserved":0,"allocated":4493312,"data_stored":2626088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.938686"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.893042+0000","last_change":"2023-08-25T04:45:26.770775+0000","last_active":"2023-08-25T04:47:18.893042+0000","last_peered":"2023-08-25T04:47:18.893042+0000","last_clean":"2023-08-25T04:47:18.893042+0000","last_became_active":"2023-08-25T04:45:26.770447+0000","last_became_peered":"2023-08-25T04:45:26.770447+0000","last_unstale":"2023-08-25T04:47:18.893042+0000","last_undegraded":"2023-08-25T04:47:18.893042+0000","last_fullsized":"2023-08-25T04:47:18.893042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:47.083723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.479699+0000","last_change":"2023-08-25T04:45:26.768222+0000","last_active":"2023-08-25T04:47:18.479699+0000","last_peered":"2023-08-25T04:47:18.479699+0000","last_clean":"2023-08-25T04:47:18.479699+0000","last_became_active":"2023-08-25T04:45:26.767875+0000","last_became_peered":"2023-08-25T04:45:26.767875+0000","last_unstale":"2023-08-25T04:47:18.479699+0000","last_undegraded":"2023-08-25T04:47:18.479699+0000","last_fullsized":"2023-08-25T04:47:18.479699+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:47:33.102158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.892114+0000","last_change":"2023-08-25T04:45:26.767948+0000","last_active":"2023-08-25T04:47:18.892114+0000","last_peered":"2023-08-25T04:47:18.892114+0000","last_clean":"2023-08-25T04:47:18.892114+0000","last_became_active":"2023-08-25T04:45:26.767496+0000","last_became_peered":"2023-08-25T04:45:26.767496+0000","last_unstale":"2023-08-25T04:47:18.892114+0000","last_undegraded":"2023-08-25T04:47:18.892114+0000","last_fullsized":"2023-08-25T04:47:18.892114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:29.617635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":195,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.480195+0000","last_change":"2023-08-25T04:45:27.771979+0000","last_active":"2023-08-25T04:47:18.480195+0000","last_peered":"2023-08-25T04:47:18.480195+0000","last_clean":"2023-08-25T04:47:18.480195+0000","last_became_active":"2023-08-25T04:45:27.770968+0000","last_became_peered":"2023-08-25T04:45:27.770968+0000","last_unstale":"2023-08-25T04:47:18.480195+0000","last_undegraded":"2023-08-25T04:47:18.480195+0000","last_fullsized":"2023-08-25T04:47:18.480195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_clean_scrub_stamp":"2023-08-25T04:45:26.752521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:04:38.263048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.480196+0000","last_change":"2023-08-25T04:45:26.807286+0000","last_active":"2023-08-25T04:47:18.480196+0000","last_peered":"2023-08-25T04:47:18.480196+0000","last_clean":"2023-08-25T04:47:18.480196+0000","last_became_active":"2023-08-25T04:45:26.806698+0000","last_became_peered":"2023-08-25T04:45:26.806698+0000","last_unstale":"2023-08-25T04:47:18.480196+0000","last_undegraded":"2023-08-25T04:47:18.480196+0000","last_fullsized":"2023-08-25T04:47:18.480196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:31.023488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.480190+0000","last_change":"2023-08-25T04:45:26.807096+0000","last_active":"2023-08-25T04:47:18.480190+0000","last_peered":"2023-08-25T04:47:18.480190+0000","last_clean":"2023-08-25T04:47:18.480190+0000","last_became_active":"2023-08-25T04:45:26.806713+0000","last_became_peered":"2023-08-25T04:45:26.806713+0000","last_unstale":"2023-08-25T04:47:18.480190+0000","last_undegraded":"2023-08-25T04:47:18.480190+0000","last_fullsized":"2023-08-25T04:47:18.480190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:31:06.829067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.893205+0000","last_change":"2023-08-25T04:45:26.807065+0000","last_active":"2023-08-25T04:47:18.893205+0000","last_peered":"2023-08-25T04:47:18.893205+0000","last_clean":"2023-08-25T04:47:18.893205+0000","last_became_active":"2023-08-25T04:45:26.806737+0000","last_became_peered":"2023-08-25T04:45:26.806737+0000","last_unstale":"2023-08-25T04:47:18.893205+0000","last_undegraded":"2023-08-25T04:47:18.893205+0000","last_fullsized":"2023-08-25T04:47:18.893205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:08:22.692950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.893441+0000","last_change":"2023-08-25T04:45:26.807090+0000","last_active":"2023-08-25T04:47:18.893441+0000","last_peered":"2023-08-25T04:47:18.893441+0000","last_clean":"2023-08-25T04:47:18.893441+0000","last_became_active":"2023-08-25T04:45:26.806685+0000","last_became_peered":"2023-08-25T04:45:26.806685+0000","last_unstale":"2023-08-25T04:47:18.893441+0000","last_undegraded":"2023-08-25T04:47:18.893441+0000","last_fullsized":"2023-08-25T04:47:18.893441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:35:14.864292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:25.943611+0000","last_change":"2023-08-25T04:47:25.943611+0000","last_active":"2023-08-25T04:47:25.943611+0000","last_peered":"2023-08-25T04:47:25.943611+0000","last_clean":"2023-08-25T04:47:25.943611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:25.943611+0000","last_undegraded":"2023-08-25T04:47:25.943611+0000","last_fullsized":"2023-08-25T04:47:25.943611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:47:24.932549+0000","last_change":"2023-08-25T04:47:24.932549+0000","last_active":"2023-08-25T04:47:24.932549+0000","last_peered":"2023-08-25T04:47:24.932549+0000","last_clean":"2023-08-25T04:47:24.932549+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:47:24.932549+0000","last_undegraded":"2023-08-25T04:47:24.932549+0000","last_fullsized":"2023-08-25T04:47:24.932549+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-25T04:47:18.893388+0000","last_change":"2023-08-25T04:45:26.768150+0000","last_active":"2023-08-25T04:47:18.893388+0000","last_peered":"2023-08-25T04:47:18.893388+0000","last_clean":"2023-08-25T04:47:18.893388+0000","last_became_active":"2023-08-25T04:45:26.767845+0000","last_became_peered":"2023-08-25T04:45:26.767845+0000","last_unstale":"2023-08-25T04:47:18.893388+0000","last_undegraded":"2023-08-25T04:47:18.893388+0000","last_fullsized":"2023-08-25T04:47:18.893388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:26:14.715064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1007616,"data_stored":771154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":11.452,"5min":11.452,"15min":11.452},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":7.3620000000000001,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":7.4550000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.751},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.90400000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":9.3689999999999998,"5min":9.3689999999999998,"15min":9.3689999999999998},"last":0.95799999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":1.016},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.92700000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.88700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":180786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.86699999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.754},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.628}]},{"osd":4,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.83799999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:46:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.79100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":771154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.505}]},{"osd":2,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52600000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.75},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":179850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5030000000000001,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.438},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":4.6020000000000003,"5min":4.6020000000000003,"15min":4.6020000000000003},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":4.5679999999999996,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.629},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.752}]},{"osd":7,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.4580000000000002,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.56299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":413696,"data_stored":180786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":15.301,"5min":15.301,"15min":15.301},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":15.334,"5min":15.334,"15min":15.334},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.1050000000000004,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.498},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":15.172000000000001,"5min":15.172000000000001,"15min":15.172000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":15.266,"5min":15.266,"15min":15.266},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.0469999999999997,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:46:28 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":15.227,"5min":15.227,"15min":15.227},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":4.077,"5min":4.077,"15min":4.077},"last":0.85799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":180786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":12.221,"5min":12.221,"15min":12.221},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":10.331,"5min":10.331,"15min":10.331},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":10.361000000000001,"5min":10.361000000000001,"15min":10.361000000000001},"last":0.495},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.295999999999999,"5min":10.295999999999999,"15min":10.295999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":11.097,"5min":11.097,"15min":11.097},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.753},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":10.252000000000001,"5min":10.252000000000001,"15min":10.252000000000001},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":11.058999999999999,"5min":11.058999999999999,"15min":11.058999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":10.206,"5min":10.206,"15min":10.206},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":11.013,"5min":11.013,"15min":11.013},"last":0.77100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":413696,"data_stored":180786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71199999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.62},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.747}]},{"osd":5,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:46:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.88500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":180786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.432},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.627},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.35899999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:47:31.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:47:32.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.062+0000 7f2e8d19d700 1 Processor -- start 2023-08-25T04:47:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.063+0000 7f2e8d19d700 1 -- start start 2023-08-25T04:47:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.064+0000 7f2e8d19d700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e88142890 0x7f2e88071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.064+0000 7f2e8d19d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e880cec60 0x7f2e880b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.064+0000 7f2e8d19d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e881431f0 con 0x7f2e880ce7e0 2023-08-25T04:47:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.064+0000 7f2e8d19d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8806d290 con 0x7f2e880cec60 2023-08-25T04:47:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.064+0000 7f2e8d19d700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8806d570 con 0x7f2e88142890 2023-08-25T04:47:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.064+0000 7f2e877fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2e880ce7e0 0x7f2e880b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57312/0 (socket says 172.21.15.72:57312) 2023-08-25T04:47:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.064+0000 7f2e877fe700 1 -- 172.21.15.72:0/2455165916 learned_addr learned my addr 172.21.15.72:0/2455165916 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.064+0000 7f2e8c99c700 1 --2- 172.21.15.72:0/2455165916 >> v2:172.21.15.72:3300/0 conn(0x7f2e880cec60 0x7f2e880b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.064+0000 7f2e87fff700 1 --2- 172.21.15.72:0/2455165916 >> v2:172.21.15.137:3300/0 conn(0x7f2e88142890 0x7f2e88071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.065+0000 7f2e86ffd700 1 -- 172.21.15.72:0/2455165916 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704130319 0 0) 0x7f2e881431f0 con 0x7f2e880ce7e0 2023-08-25T04:47:32.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.065+0000 7f2e86ffd700 1 -- 172.21.15.72:0/2455165916 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e700035b0 con 0x7f2e880ce7e0 2023-08-25T04:47:32.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.065+0000 7f2e8c99c700 1 -- 172.21.15.72:0/2455165916 >> v2:172.21.15.137:3300/0 conn(0x7f2e88142890 msgr2=0x7f2e88071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:32.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.065+0000 7f2e8c99c700 1 --2- 172.21.15.72:0/2455165916 >> v2:172.21.15.137:3300/0 conn(0x7f2e88142890 0x7f2e88071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.065+0000 7f2e8c99c700 1 -- 172.21.15.72:0/2455165916 >> v1:172.21.15.72:6789/0 conn(0x7f2e880ce7e0 legacy=0x7f2e880b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.065+0000 7f2e8c99c700 1 -- 172.21.15.72:0/2455165916 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8806d850 con 0x7f2e880cec60 2023-08-25T04:47:32.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.065+0000 7f2e8c99c700 1 --2- 172.21.15.72:0/2455165916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e880cec60 0x7f2e880b1f80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2e8806eca0 tx=0x7f2e8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838228669e4e7391 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:32.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.065+0000 7f2e86ffd700 1 -- 172.21.15.72:0/2455165916 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8000bd20 con 0x7f2e880cec60 2023-08-25T04:47:32.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.065+0000 7f2e86ffd700 1 -- 172.21.15.72:0/2455165916 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8000be80 con 0x7f2e880cec60 2023-08-25T04:47:32.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.065+0000 7f2e86ffd700 1 -- 172.21.15.72:0/2455165916 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e800116a0 con 0x7f2e880cec60 2023-08-25T04:47:32.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.066+0000 7f2e8d19d700 1 -- 172.21.15.72:0/2455165916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e880cec60 msgr2=0x7f2e880b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.066+0000 7f2e8d19d700 1 --2- 172.21.15.72:0/2455165916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e880cec60 0x7f2e880b1f80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2e8806eca0 tx=0x7f2e8000b330 comp rx=0 tx=0).stop 2023-08-25T04:47:32.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.066+0000 7f2e8d19d700 1 -- 172.21.15.72:0/2455165916 shutdown_connections 2023-08-25T04:47:32.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.066+0000 7f2e8d19d700 1 --2- 172.21.15.72:0/2455165916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e880cec60 0x7f2e880b1f80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.066+0000 7f2e8d19d700 1 --2- 172.21.15.72:0/2455165916 >> v2:172.21.15.137:3300/0 conn(0x7f2e88142890 0x7f2e88071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.066+0000 7f2e8d19d700 1 -- 172.21.15.72:0/2455165916 >> 172.21.15.72:0/2455165916 conn(0x7f2e8806a2f0 msgr2=0x7f2e8806a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:32.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.066+0000 7f2e8d19d700 1 -- 172.21.15.72:0/2455165916 shutdown_connections 2023-08-25T04:47:32.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.066+0000 7f2e8d19d700 1 -- 172.21.15.72:0/2455165916 wait complete. 2023-08-25T04:47:32.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.068+0000 7f2e8d19d700 1 Processor -- start 2023-08-25T04:47:32.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.068+0000 7f2e8d19d700 1 -- start start 2023-08-25T04:47:32.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8d19d700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e880ce7e0 0x7f2e8812e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8d19d700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e880cec60 0x7f2e881f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8d19d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e88142890 0x7f2e8813e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8d19d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e881f2510 con 0x7f2e88142890 2023-08-25T04:47:32.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8d19d700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8812e840 con 0x7f2e880ce7e0 2023-08-25T04:47:32.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8d19d700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e881f1890 con 0x7f2e880cec60 2023-08-25T04:47:32.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8c99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e88142890 0x7f2e8813e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8c99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e88142890 0x7f2e8813e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52952/0 (socket says 172.21.15.72:52952) 2023-08-25T04:47:32.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8c99c700 1 -- 172.21.15.72:0/1433153396 learned_addr learned my addr 172.21.15.72:0/1433153396 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:32.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e87fff700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e880ce7e0 0x7f2e8812e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e877fe700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e880cec60 0x7f2e881f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8c99c700 1 -- 172.21.15.72:0/1433153396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e880cec60 msgr2=0x7f2e881f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8c99c700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e880cec60 0x7f2e881f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8c99c700 1 -- 172.21.15.72:0/1433153396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e880ce7e0 msgr2=0x7f2e8812e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8c99c700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e880ce7e0 0x7f2e8812e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.069+0000 7f2e8c99c700 1 -- 172.21.15.72:0/1433153396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e80009a70 con 0x7f2e88142890 2023-08-25T04:47:32.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.070+0000 7f2e8c99c700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e88142890 0x7f2e8813e9c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2e8806e9b0 tx=0x7f2e80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:32.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.070+0000 7f2e84ff9700 1 -- 172.21.15.72:0/1433153396 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80020070 con 0x7f2e88142890 2023-08-25T04:47:32.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.070+0000 7f2e84ff9700 1 -- 172.21.15.72:0/1433153396 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e80003e10 con 0x7f2e88142890 2023-08-25T04:47:32.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.070+0000 7f2e8d19d700 1 -- 172.21.15.72:0/1433153396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e881f1b70 con 0x7f2e88142890 2023-08-25T04:47:32.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.070+0000 7f2e84ff9700 1 -- 172.21.15.72:0/1433153396 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80004850 con 0x7f2e88142890 2023-08-25T04:47:32.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.070+0000 7f2e8d19d700 1 -- 172.21.15.72:0/1433153396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e881f2130 con 0x7f2e88142890 2023-08-25T04:47:32.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.071+0000 7f2e8d19d700 1 -- 172.21.15.72:0/1433153396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e88142c70 con 0x7f2e88142890 2023-08-25T04:47:32.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.072+0000 7f2e84ff9700 1 -- 172.21.15.72:0/1433153396 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2e80011460 con 0x7f2e88142890 2023-08-25T04:47:32.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.073+0000 7f2e84ff9700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e7406a0e0 0x7f2e7406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.073+0000 7f2e84ff9700 1 -- 172.21.15.72:0/1433153396 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2e8008bbe0 con 0x7f2e88142890 2023-08-25T04:47:32.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.073+0000 7f2e87fff700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e7406a0e0 0x7f2e7406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.074+0000 7f2e87fff700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e7406a0e0 0x7f2e7406c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009b40 tx=0x7f2e78009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:32.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.077+0000 7f2e84ff9700 1 -- 172.21.15.72:0/1433153396 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2e800572a0 con 0x7f2e88142890 2023-08-25T04:47:32.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:32.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:32.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.277+0000 7f2e8d19d700 1 -- 172.21.15.72:0/1433153396 --> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e8806de10 con 0x7f2e7406a0e0 2023-08-25T04:47:32.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.286+0000 7f2e84ff9700 1 -- 172.21.15.72:0/1433153396 <== mgr.4101 v2:172.21.15.72:6832/1377484023 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311242 (secure 0 0 0) 0x7f2e78011810 con 0x7f2e7406a0e0 2023-08-25T04:47:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:32.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.290+0000 7f2e8d19d700 1 -- 172.21.15.72:0/1433153396 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e7406a0e0 msgr2=0x7f2e7406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.290+0000 7f2e8d19d700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e7406a0e0 0x7f2e7406c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009b40 tx=0x7f2e78009210 comp rx=0 tx=0).stop 2023-08-25T04:47:32.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.290+0000 7f2e8d19d700 1 -- 172.21.15.72:0/1433153396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e88142890 msgr2=0x7f2e8813e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.290+0000 7f2e8d19d700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e88142890 0x7f2e8813e9c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2e8806e9b0 tx=0x7f2e80004ad0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.291+0000 7f2e8d19d700 1 -- 172.21.15.72:0/1433153396 shutdown_connections 2023-08-25T04:47:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.291+0000 7f2e8d19d700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f2e7406a0e0 0x7f2e7406c5a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.291+0000 7f2e8d19d700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e88142890 0x7f2e8813e9c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.291+0000 7f2e8d19d700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e880ce7e0 0x7f2e8812e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.291+0000 7f2e8d19d700 1 --2- 172.21.15.72:0/1433153396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2e880cec60 0x7f2e881f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.291+0000 7f2e8d19d700 1 -- 172.21.15.72:0/1433153396 >> 172.21.15.72:0/1433153396 conn(0x7f2e8806a2f0 msgr2=0x7f2e8813d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.291+0000 7f2e8d19d700 1 -- 172.21.15.72:0/1433153396 shutdown_connections 2023-08-25T04:47:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.291+0000 7f2e8d19d700 1 -- 172.21.15.72:0/1433153396 wait complete. 2023-08-25T04:47:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-25T04:47:32.310 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-08-25T04:47:31.884784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221020,"kb_used_data":4836,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753700,"statfs":{"total":773094113280,"available":772867788800,"internally_reserved":0,"allocated":4952064,"data_stored":2853716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000963"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294603+0000","last_change":"2023-08-25T04:47:26.982995+0000","last_active":"2023-08-25T04:47:28.294603+0000","last_peered":"2023-08-25T04:47:28.294603+0000","last_clean":"2023-08-25T04:47:28.294603+0000","last_became_active":"2023-08-25T04:47:26.982727+0000","last_became_peered":"2023-08-25T04:47:26.982727+0000","last_unstale":"2023-08-25T04:47:28.294603+0000","last_undegraded":"2023-08-25T04:47:28.294603+0000","last_fullsized":"2023-08-25T04:47:28.294603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:53.481683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341037+0000","last_change":"2023-08-25T04:47:26.988003+0000","last_active":"2023-08-25T04:47:28.341037+0000","last_peered":"2023-08-25T04:47:28.341037+0000","last_clean":"2023-08-25T04:47:28.341037+0000","last_became_active":"2023-08-25T04:47:26.987700+0000","last_became_peered":"2023-08-25T04:47:26.987700+0000","last_unstale":"2023-08-25T04:47:28.341037+0000","last_undegraded":"2023-08-25T04:47:28.341037+0000","last_fullsized":"2023-08-25T04:47:28.341037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:53:43.139603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975585+0000","last_change":"2023-08-25T04:47:26.978024+0000","last_active":"2023-08-25T04:47:27.975585+0000","last_peered":"2023-08-25T04:47:27.975585+0000","last_clean":"2023-08-25T04:47:27.975585+0000","last_became_active":"2023-08-25T04:47:26.977730+0000","last_became_peered":"2023-08-25T04:47:26.977730+0000","last_unstale":"2023-08-25T04:47:27.975585+0000","last_undegraded":"2023-08-25T04:47:27.975585+0000","last_fullsized":"2023-08-25T04:47:27.975585+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:41.065771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341618+0000","last_change":"2023-08-25T04:47:26.989008+0000","last_active":"2023-08-25T04:47:28.341618+0000","last_peered":"2023-08-25T04:47:28.341618+0000","last_clean":"2023-08-25T04:47:28.341618+0000","last_became_active":"2023-08-25T04:47:26.988744+0000","last_became_peered":"2023-08-25T04:47:26.988744+0000","last_unstale":"2023-08-25T04:47:28.341618+0000","last_undegraded":"2023-08-25T04:47:28.341618+0000","last_fullsized":"2023-08-25T04:47:28.341618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:36.006069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340966+0000","last_change":"2023-08-25T04:47:26.988400+0000","last_active":"2023-08-25T04:47:28.340966+0000","last_peered":"2023-08-25T04:47:28.340966+0000","last_clean":"2023-08-25T04:47:28.340966+0000","last_became_active":"2023-08-25T04:47:26.987934+0000","last_became_peered":"2023-08-25T04:47:26.987934+0000","last_unstale":"2023-08-25T04:47:28.340966+0000","last_undegraded":"2023-08-25T04:47:28.340966+0000","last_fullsized":"2023-08-25T04:47:28.340966+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:32:36.570940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340954+0000","last_change":"2023-08-25T04:47:26.981019+0000","last_active":"2023-08-25T04:47:28.340954+0000","last_peered":"2023-08-25T04:47:28.340954+0000","last_clean":"2023-08-25T04:47:28.340954+0000","last_became_active":"2023-08-25T04:47:26.980380+0000","last_became_peered":"2023-08-25T04:47:26.980380+0000","last_unstale":"2023-08-25T04:47:28.340954+0000","last_undegraded":"2023-08-25T04:47:28.340954+0000","last_fullsized":"2023-08-25T04:47:28.340954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:45:55.400195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294060+0000","last_change":"2023-08-25T04:47:26.985656+0000","last_active":"2023-08-25T04:47:28.294060+0000","last_peered":"2023-08-25T04:47:28.294060+0000","last_clean":"2023-08-25T04:47:28.294060+0000","last_became_active":"2023-08-25T04:47:26.985393+0000","last_became_peered":"2023-08-25T04:47:26.985393+0000","last_unstale":"2023-08-25T04:47:28.294060+0000","last_undegraded":"2023-08-25T04:47:28.294060+0000","last_fullsized":"2023-08-25T04:47:28.294060+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:36.006069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340524+0000","last_change":"2023-08-25T04:47:26.985469+0000","last_active":"2023-08-25T04:47:28.340524+0000","last_peered":"2023-08-25T04:47:28.340524+0000","last_clean":"2023-08-25T04:47:28.340524+0000","last_became_active":"2023-08-25T04:47:26.985070+0000","last_became_peered":"2023-08-25T04:47:26.985070+0000","last_unstale":"2023-08-25T04:47:28.340524+0000","last_undegraded":"2023-08-25T04:47:28.340524+0000","last_fullsized":"2023-08-25T04:47:28.340524+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:53:43.139603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340976+0000","last_change":"2023-08-25T04:47:26.985447+0000","last_active":"2023-08-25T04:47:28.340976+0000","last_peered":"2023-08-25T04:47:28.340976+0000","last_clean":"2023-08-25T04:47:28.340976+0000","last_became_active":"2023-08-25T04:47:26.984958+0000","last_became_peered":"2023-08-25T04:47:26.984958+0000","last_unstale":"2023-08-25T04:47:28.340976+0000","last_undegraded":"2023-08-25T04:47:28.340976+0000","last_fullsized":"2023-08-25T04:47:28.340976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:11:55.009324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341478+0000","last_change":"2023-08-25T04:47:26.987892+0000","last_active":"2023-08-25T04:47:28.341478+0000","last_peered":"2023-08-25T04:47:28.341478+0000","last_clean":"2023-08-25T04:47:28.341478+0000","last_became_active":"2023-08-25T04:47:26.987056+0000","last_became_peered":"2023-08-25T04:47:26.987056+0000","last_unstale":"2023-08-25T04:47:28.341478+0000","last_undegraded":"2023-08-25T04:47:28.341478+0000","last_fullsized":"2023-08-25T04:47:28.341478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:45:40.705043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341177+0000","last_change":"2023-08-25T04:47:26.985842+0000","last_active":"2023-08-25T04:47:28.341177+0000","last_peered":"2023-08-25T04:47:28.341177+0000","last_clean":"2023-08-25T04:47:28.341177+0000","last_became_active":"2023-08-25T04:47:26.985578+0000","last_became_peered":"2023-08-25T04:47:26.985578+0000","last_unstale":"2023-08-25T04:47:28.341177+0000","last_undegraded":"2023-08-25T04:47:28.341177+0000","last_fullsized":"2023-08-25T04:47:28.341177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:55.346115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341050+0000","last_change":"2023-08-25T04:47:26.983685+0000","last_active":"2023-08-25T04:47:28.341050+0000","last_peered":"2023-08-25T04:47:28.341050+0000","last_clean":"2023-08-25T04:47:28.341050+0000","last_became_active":"2023-08-25T04:47:26.983422+0000","last_became_peered":"2023-08-25T04:47:26.983422+0000","last_unstale":"2023-08-25T04:47:28.341050+0000","last_undegraded":"2023-08-25T04:47:28.341050+0000","last_fullsized":"2023-08-25T04:47:28.341050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:57.393362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976282+0000","last_change":"2023-08-25T04:47:26.977763+0000","last_active":"2023-08-25T04:47:27.976282+0000","last_peered":"2023-08-25T04:47:27.976282+0000","last_clean":"2023-08-25T04:47:27.976282+0000","last_became_active":"2023-08-25T04:47:26.977388+0000","last_became_peered":"2023-08-25T04:47:26.977388+0000","last_unstale":"2023-08-25T04:47:27.976282+0000","last_undegraded":"2023-08-25T04:47:27.976282+0000","last_fullsized":"2023-08-25T04:47:27.976282+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:45.092836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340791+0000","last_change":"2023-08-25T04:47:26.981972+0000","last_active":"2023-08-25T04:47:28.340791+0000","last_peered":"2023-08-25T04:47:28.340791+0000","last_clean":"2023-08-25T04:47:28.340791+0000","last_became_active":"2023-08-25T04:47:26.981708+0000","last_became_peered":"2023-08-25T04:47:26.981708+0000","last_unstale":"2023-08-25T04:47:28.340791+0000","last_undegraded":"2023-08-25T04:47:28.340791+0000","last_fullsized":"2023-08-25T04:47:28.340791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:49.812067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340649+0000","last_change":"2023-08-25T04:47:26.977754+0000","last_active":"2023-08-25T04:47:28.340649+0000","last_peered":"2023-08-25T04:47:28.340649+0000","last_clean":"2023-08-25T04:47:28.340649+0000","last_became_active":"2023-08-25T04:47:26.977351+0000","last_became_peered":"2023-08-25T04:47:26.977351+0000","last_unstale":"2023-08-25T04:47:28.340649+0000","last_undegraded":"2023-08-25T04:47:28.340649+0000","last_fullsized":"2023-08-25T04:47:28.340649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:38:12.076567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341670+0000","last_change":"2023-08-25T04:47:26.988892+0000","last_active":"2023-08-25T04:47:28.341670+0000","last_peered":"2023-08-25T04:47:28.341670+0000","last_clean":"2023-08-25T04:47:28.341670+0000","last_became_active":"2023-08-25T04:47:26.988572+0000","last_became_peered":"2023-08-25T04:47:26.988572+0000","last_unstale":"2023-08-25T04:47:28.341670+0000","last_undegraded":"2023-08-25T04:47:28.341670+0000","last_fullsized":"2023-08-25T04:47:28.341670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:20.446754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975794+0000","last_change":"2023-08-25T04:47:26.984861+0000","last_active":"2023-08-25T04:47:27.975794+0000","last_peered":"2023-08-25T04:47:27.975794+0000","last_clean":"2023-08-25T04:47:27.975794+0000","last_became_active":"2023-08-25T04:47:26.984585+0000","last_became_peered":"2023-08-25T04:47:26.984585+0000","last_unstale":"2023-08-25T04:47:27.975794+0000","last_undegraded":"2023-08-25T04:47:27.975794+0000","last_fullsized":"2023-08-25T04:47:27.975794+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:03.461961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975688+0000","last_change":"2023-08-25T04:47:26.990440+0000","last_active":"2023-08-25T04:47:27.975688+0000","last_peered":"2023-08-25T04:47:27.975688+0000","last_clean":"2023-08-25T04:47:27.975688+0000","last_became_active":"2023-08-25T04:47:26.989788+0000","last_became_peered":"2023-08-25T04:47:26.989788+0000","last_unstale":"2023-08-25T04:47:27.975688+0000","last_undegraded":"2023-08-25T04:47:27.975688+0000","last_fullsized":"2023-08-25T04:47:27.975688+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:28:36.259995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341887+0000","last_change":"2023-08-25T04:47:26.989865+0000","last_active":"2023-08-25T04:47:28.341887+0000","last_peered":"2023-08-25T04:47:28.341887+0000","last_clean":"2023-08-25T04:47:28.341887+0000","last_became_active":"2023-08-25T04:47:26.989231+0000","last_became_peered":"2023-08-25T04:47:26.989231+0000","last_unstale":"2023-08-25T04:47:28.341887+0000","last_undegraded":"2023-08-25T04:47:28.341887+0000","last_fullsized":"2023-08-25T04:47:28.341887+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:22.682596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976338+0000","last_change":"2023-08-25T04:47:26.988384+0000","last_active":"2023-08-25T04:47:27.976338+0000","last_peered":"2023-08-25T04:47:27.976338+0000","last_clean":"2023-08-25T04:47:27.976338+0000","last_became_active":"2023-08-25T04:47:26.988017+0000","last_became_peered":"2023-08-25T04:47:26.988017+0000","last_unstale":"2023-08-25T04:47:27.976338+0000","last_undegraded":"2023-08-25T04:47:27.976338+0000","last_fullsized":"2023-08-25T04:47:27.976338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:38:10.143520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341036+0000","last_change":"2023-08-25T04:47:26.978324+0000","last_active":"2023-08-25T04:47:28.341036+0000","last_peered":"2023-08-25T04:47:28.341036+0000","last_clean":"2023-08-25T04:47:28.341036+0000","last_became_active":"2023-08-25T04:47:26.978012+0000","last_became_peered":"2023-08-25T04:47:26.978012+0000","last_unstale":"2023-08-25T04:47:28.341036+0000","last_undegraded":"2023-08-25T04:47:28.341036+0000","last_fullsized":"2023-08-25T04:47:28.341036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:29:05.010756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340905+0000","last_change":"2023-08-25T04:47:26.987052+0000","last_active":"2023-08-25T04:47:28.340905+0000","last_peered":"2023-08-25T04:47:28.340905+0000","last_clean":"2023-08-25T04:47:28.340905+0000","last_became_active":"2023-08-25T04:47:26.986724+0000","last_became_peered":"2023-08-25T04:47:26.986724+0000","last_unstale":"2023-08-25T04:47:28.340905+0000","last_undegraded":"2023-08-25T04:47:28.340905+0000","last_fullsized":"2023-08-25T04:47:28.340905+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:50.544585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341883+0000","last_change":"2023-08-25T04:47:26.977397+0000","last_active":"2023-08-25T04:47:28.341883+0000","last_peered":"2023-08-25T04:47:28.341883+0000","last_clean":"2023-08-25T04:47:28.341883+0000","last_became_active":"2023-08-25T04:47:26.977090+0000","last_became_peered":"2023-08-25T04:47:26.977090+0000","last_unstale":"2023-08-25T04:47:28.341883+0000","last_undegraded":"2023-08-25T04:47:28.341883+0000","last_fullsized":"2023-08-25T04:47:28.341883+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:21.083145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341643+0000","last_change":"2023-08-25T04:47:26.981380+0000","last_active":"2023-08-25T04:47:28.341643+0000","last_peered":"2023-08-25T04:47:28.341643+0000","last_clean":"2023-08-25T04:47:28.341643+0000","last_became_active":"2023-08-25T04:47:26.978223+0000","last_became_peered":"2023-08-25T04:47:26.978223+0000","last_unstale":"2023-08-25T04:47:28.341643+0000","last_undegraded":"2023-08-25T04:47:28.341643+0000","last_fullsized":"2023-08-25T04:47:28.341643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:46:29.811351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342454+0000","last_change":"2023-08-25T04:47:26.981535+0000","last_active":"2023-08-25T04:47:28.342454+0000","last_peered":"2023-08-25T04:47:28.342454+0000","last_clean":"2023-08-25T04:47:28.342454+0000","last_became_active":"2023-08-25T04:47:26.978209+0000","last_became_peered":"2023-08-25T04:47:26.978209+0000","last_unstale":"2023-08-25T04:47:28.342454+0000","last_undegraded":"2023-08-25T04:47:28.342454+0000","last_fullsized":"2023-08-25T04:47:28.342454+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:48:23.597645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976508+0000","last_change":"2023-08-25T04:47:26.978254+0000","last_active":"2023-08-25T04:47:27.976508+0000","last_peered":"2023-08-25T04:47:27.976508+0000","last_clean":"2023-08-25T04:47:27.976508+0000","last_became_active":"2023-08-25T04:47:26.977832+0000","last_became_peered":"2023-08-25T04:47:26.977832+0000","last_unstale":"2023-08-25T04:47:27.976508+0000","last_undegraded":"2023-08-25T04:47:27.976508+0000","last_fullsized":"2023-08-25T04:47:27.976508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:14:53.241633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975542+0000","last_change":"2023-08-25T04:47:26.980662+0000","last_active":"2023-08-25T04:47:27.975542+0000","last_peered":"2023-08-25T04:47:27.975542+0000","last_clean":"2023-08-25T04:47:27.975542+0000","last_became_active":"2023-08-25T04:47:26.980361+0000","last_became_peered":"2023-08-25T04:47:26.980361+0000","last_unstale":"2023-08-25T04:47:27.975542+0000","last_undegraded":"2023-08-25T04:47:27.975542+0000","last_fullsized":"2023-08-25T04:47:27.975542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:16:57.255524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341121+0000","last_change":"2023-08-25T04:47:26.983735+0000","last_active":"2023-08-25T04:47:28.341121+0000","last_peered":"2023-08-25T04:47:28.341121+0000","last_clean":"2023-08-25T04:47:28.341121+0000","last_became_active":"2023-08-25T04:47:26.983039+0000","last_became_peered":"2023-08-25T04:47:26.983039+0000","last_unstale":"2023-08-25T04:47:28.341121+0000","last_undegraded":"2023-08-25T04:47:28.341121+0000","last_fullsized":"2023-08-25T04:47:28.341121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:16.891540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342087+0000","last_change":"2023-08-25T04:47:26.977939+0000","last_active":"2023-08-25T04:47:28.342087+0000","last_peered":"2023-08-25T04:47:28.342087+0000","last_clean":"2023-08-25T04:47:28.342087+0000","last_became_active":"2023-08-25T04:47:26.977257+0000","last_became_peered":"2023-08-25T04:47:26.977257+0000","last_unstale":"2023-08-25T04:47:28.342087+0000","last_undegraded":"2023-08-25T04:47:28.342087+0000","last_fullsized":"2023-08-25T04:47:28.342087+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:10.965788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975485+0000","last_change":"2023-08-25T04:47:26.976981+0000","last_active":"2023-08-25T04:47:27.975485+0000","last_peered":"2023-08-25T04:47:27.975485+0000","last_clean":"2023-08-25T04:47:27.975485+0000","last_became_active":"2023-08-25T04:47:26.976612+0000","last_became_peered":"2023-08-25T04:47:26.976612+0000","last_unstale":"2023-08-25T04:47:27.975485+0000","last_undegraded":"2023-08-25T04:47:27.975485+0000","last_fullsized":"2023-08-25T04:47:27.975485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:36:46.894406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340528+0000","last_change":"2023-08-25T04:47:26.969444+0000","last_active":"2023-08-25T04:47:28.340528+0000","last_peered":"2023-08-25T04:47:28.340528+0000","last_clean":"2023-08-25T04:47:28.340528+0000","last_became_active":"2023-08-25T04:47:26.969173+0000","last_became_peered":"2023-08-25T04:47:26.969173+0000","last_unstale":"2023-08-25T04:47:28.340528+0000","last_undegraded":"2023-08-25T04:47:28.340528+0000","last_fullsized":"2023-08-25T04:47:28.340528+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:47.277439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976154+0000","last_change":"2023-08-25T04:47:26.978554+0000","last_active":"2023-08-25T04:47:27.976154+0000","last_peered":"2023-08-25T04:47:27.976154+0000","last_clean":"2023-08-25T04:47:27.976154+0000","last_became_active":"2023-08-25T04:47:26.978262+0000","last_became_peered":"2023-08-25T04:47:26.978262+0000","last_unstale":"2023-08-25T04:47:27.976154+0000","last_undegraded":"2023-08-25T04:47:27.976154+0000","last_fullsized":"2023-08-25T04:47:27.976154+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:05:20.610402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977668+0000","last_change":"2023-08-25T04:47:26.974422+0000","last_active":"2023-08-25T04:47:27.977668+0000","last_peered":"2023-08-25T04:47:27.977668+0000","last_clean":"2023-08-25T04:47:27.977668+0000","last_became_active":"2023-08-25T04:47:26.974160+0000","last_became_peered":"2023-08-25T04:47:26.974160+0000","last_unstale":"2023-08-25T04:47:27.977668+0000","last_undegraded":"2023-08-25T04:47:27.977668+0000","last_fullsized":"2023-08-25T04:47:27.977668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:31.957260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341549+0000","last_change":"2023-08-25T04:47:25.980609+0000","last_active":"2023-08-25T04:47:28.341549+0000","last_peered":"2023-08-25T04:47:28.341549+0000","last_clean":"2023-08-25T04:47:28.341549+0000","last_became_active":"2023-08-25T04:47:25.980263+0000","last_became_peered":"2023-08-25T04:47:25.980263+0000","last_unstale":"2023-08-25T04:47:28.341549+0000","last_undegraded":"2023-08-25T04:47:28.341549+0000","last_fullsized":"2023-08-25T04:47:28.341549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:01:06.959657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342080+0000","last_change":"2023-08-25T04:47:26.982572+0000","last_active":"2023-08-25T04:47:28.342080+0000","last_peered":"2023-08-25T04:47:28.342080+0000","last_clean":"2023-08-25T04:47:28.342080+0000","last_became_active":"2023-08-25T04:47:26.982111+0000","last_became_peered":"2023-08-25T04:47:26.982111+0000","last_unstale":"2023-08-25T04:47:28.342080+0000","last_undegraded":"2023-08-25T04:47:28.342080+0000","last_fullsized":"2023-08-25T04:47:28.342080+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:59.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975855+0000","last_change":"2023-08-25T04:47:25.978241+0000","last_active":"2023-08-25T04:47:27.975855+0000","last_peered":"2023-08-25T04:47:27.975855+0000","last_clean":"2023-08-25T04:47:27.975855+0000","last_became_active":"2023-08-25T04:47:25.977884+0000","last_became_peered":"2023-08-25T04:47:25.977884+0000","last_unstale":"2023-08-25T04:47:27.975855+0000","last_undegraded":"2023-08-25T04:47:27.975855+0000","last_fullsized":"2023-08-25T04:47:27.975855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:27.621536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341255+0000","last_change":"2023-08-25T04:47:26.978961+0000","last_active":"2023-08-25T04:47:28.341255+0000","last_peered":"2023-08-25T04:47:28.341255+0000","last_clean":"2023-08-25T04:47:28.341255+0000","last_became_active":"2023-08-25T04:47:26.978321+0000","last_became_peered":"2023-08-25T04:47:26.978321+0000","last_unstale":"2023-08-25T04:47:28.341255+0000","last_undegraded":"2023-08-25T04:47:28.341255+0000","last_fullsized":"2023-08-25T04:47:28.341255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:44.538494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977652+0000","last_change":"2023-08-25T04:47:25.976559+0000","last_active":"2023-08-25T04:47:27.977652+0000","last_peered":"2023-08-25T04:47:27.977652+0000","last_clean":"2023-08-25T04:47:27.977652+0000","last_became_active":"2023-08-25T04:47:25.976228+0000","last_became_peered":"2023-08-25T04:47:25.976228+0000","last_unstale":"2023-08-25T04:47:27.977652+0000","last_undegraded":"2023-08-25T04:47:27.977652+0000","last_fullsized":"2023-08-25T04:47:27.977652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:09.879462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977515+0000","last_change":"2023-08-25T04:47:26.968523+0000","last_active":"2023-08-25T04:47:27.977515+0000","last_peered":"2023-08-25T04:47:27.977515+0000","last_clean":"2023-08-25T04:47:27.977515+0000","last_became_active":"2023-08-25T04:47:26.968257+0000","last_became_peered":"2023-08-25T04:47:26.968257+0000","last_unstale":"2023-08-25T04:47:27.977515+0000","last_undegraded":"2023-08-25T04:47:27.977515+0000","last_fullsized":"2023-08-25T04:47:27.977515+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:31.140867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294287+0000","last_change":"2023-08-25T04:47:25.976878+0000","last_active":"2023-08-25T04:47:28.294287+0000","last_peered":"2023-08-25T04:47:28.294287+0000","last_clean":"2023-08-25T04:47:28.294287+0000","last_became_active":"2023-08-25T04:47:25.976504+0000","last_became_peered":"2023-08-25T04:47:25.976504+0000","last_unstale":"2023-08-25T04:47:28.294287+0000","last_undegraded":"2023-08-25T04:47:28.294287+0000","last_fullsized":"2023-08-25T04:47:28.294287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:46:02.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975487+0000","last_change":"2023-08-25T04:47:26.985387+0000","last_active":"2023-08-25T04:47:27.975487+0000","last_peered":"2023-08-25T04:47:27.975487+0000","last_clean":"2023-08-25T04:47:27.975487+0000","last_became_active":"2023-08-25T04:47:26.985122+0000","last_became_peered":"2023-08-25T04:47:26.985122+0000","last_unstale":"2023-08-25T04:47:27.975487+0000","last_undegraded":"2023-08-25T04:47:27.975487+0000","last_fullsized":"2023-08-25T04:47:27.975487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:27.798939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341423+0000","last_change":"2023-08-25T04:47:25.979893+0000","last_active":"2023-08-25T04:47:28.341423+0000","last_peered":"2023-08-25T04:47:28.341423+0000","last_clean":"2023-08-25T04:47:28.341423+0000","last_became_active":"2023-08-25T04:47:25.979617+0000","last_became_peered":"2023-08-25T04:47:25.979617+0000","last_unstale":"2023-08-25T04:47:28.341423+0000","last_undegraded":"2023-08-25T04:47:28.341423+0000","last_fullsized":"2023-08-25T04:47:28.341423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:11:16.172391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341251+0000","last_change":"2023-08-25T04:47:26.986407+0000","last_active":"2023-08-25T04:47:28.341251+0000","last_peered":"2023-08-25T04:47:28.341251+0000","last_clean":"2023-08-25T04:47:28.341251+0000","last_became_active":"2023-08-25T04:47:26.986108+0000","last_became_peered":"2023-08-25T04:47:26.986108+0000","last_unstale":"2023-08-25T04:47:28.341251+0000","last_undegraded":"2023-08-25T04:47:28.341251+0000","last_fullsized":"2023-08-25T04:47:28.341251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:05:14.141084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975703+0000","last_change":"2023-08-25T04:47:25.978780+0000","last_active":"2023-08-25T04:47:27.975703+0000","last_peered":"2023-08-25T04:47:27.975703+0000","last_clean":"2023-08-25T04:47:27.975703+0000","last_became_active":"2023-08-25T04:47:25.978452+0000","last_became_peered":"2023-08-25T04:47:25.978452+0000","last_unstale":"2023-08-25T04:47:27.975703+0000","last_undegraded":"2023-08-25T04:47:27.975703+0000","last_fullsized":"2023-08-25T04:47:27.975703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:32:01.383995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340590+0000","last_change":"2023-08-25T04:47:26.984823+0000","last_active":"2023-08-25T04:47:28.340590+0000","last_peered":"2023-08-25T04:47:28.340590+0000","last_clean":"2023-08-25T04:47:28.340590+0000","last_became_active":"2023-08-25T04:47:26.984411+0000","last_became_peered":"2023-08-25T04:47:26.984411+0000","last_unstale":"2023-08-25T04:47:28.340590+0000","last_undegraded":"2023-08-25T04:47:28.340590+0000","last_fullsized":"2023-08-25T04:47:28.340590+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:16.891540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340739+0000","last_change":"2023-08-25T04:47:25.975904+0000","last_active":"2023-08-25T04:47:28.340739+0000","last_peered":"2023-08-25T04:47:28.340739+0000","last_clean":"2023-08-25T04:47:28.340739+0000","last_became_active":"2023-08-25T04:47:25.975509+0000","last_became_peered":"2023-08-25T04:47:25.975509+0000","last_unstale":"2023-08-25T04:47:28.340739+0000","last_undegraded":"2023-08-25T04:47:28.340739+0000","last_fullsized":"2023-08-25T04:47:28.340739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:40.923779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341920+0000","last_change":"2023-08-25T04:47:26.977244+0000","last_active":"2023-08-25T04:47:28.341920+0000","last_peered":"2023-08-25T04:47:28.341920+0000","last_clean":"2023-08-25T04:47:28.341920+0000","last_became_active":"2023-08-25T04:47:26.976972+0000","last_became_peered":"2023-08-25T04:47:26.976972+0000","last_unstale":"2023-08-25T04:47:28.341920+0000","last_undegraded":"2023-08-25T04:47:28.341920+0000","last_fullsized":"2023-08-25T04:47:28.341920+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:07:19.646305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340652+0000","last_change":"2023-08-25T04:47:25.971325+0000","last_active":"2023-08-25T04:47:28.340652+0000","last_peered":"2023-08-25T04:47:28.340652+0000","last_clean":"2023-08-25T04:47:28.340652+0000","last_became_active":"2023-08-25T04:47:25.971037+0000","last_became_peered":"2023-08-25T04:47:25.971037+0000","last_unstale":"2023-08-25T04:47:28.340652+0000","last_undegraded":"2023-08-25T04:47:28.340652+0000","last_fullsized":"2023-08-25T04:47:28.340652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:43.527432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975781+0000","last_change":"2023-08-25T04:47:26.990654+0000","last_active":"2023-08-25T04:47:27.975781+0000","last_peered":"2023-08-25T04:47:27.975781+0000","last_clean":"2023-08-25T04:47:27.975781+0000","last_became_active":"2023-08-25T04:47:26.990126+0000","last_became_peered":"2023-08-25T04:47:26.990126+0000","last_unstale":"2023-08-25T04:47:27.975781+0000","last_undegraded":"2023-08-25T04:47:27.975781+0000","last_fullsized":"2023-08-25T04:47:27.975781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:55:53.634899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975930+0000","last_change":"2023-08-25T04:47:25.971687+0000","last_active":"2023-08-25T04:47:27.975930+0000","last_peered":"2023-08-25T04:47:27.975930+0000","last_clean":"2023-08-25T04:47:27.975930+0000","last_became_active":"2023-08-25T04:47:25.971381+0000","last_became_peered":"2023-08-25T04:47:25.971381+0000","last_unstale":"2023-08-25T04:47:27.975930+0000","last_undegraded":"2023-08-25T04:47:27.975930+0000","last_fullsized":"2023-08-25T04:47:27.975930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:09:34.650925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294521+0000","last_change":"2023-08-25T04:47:26.986097+0000","last_active":"2023-08-25T04:47:28.294521+0000","last_peered":"2023-08-25T04:47:28.294521+0000","last_clean":"2023-08-25T04:47:28.294521+0000","last_became_active":"2023-08-25T04:47:26.985775+0000","last_became_peered":"2023-08-25T04:47:26.985775+0000","last_unstale":"2023-08-25T04:47:28.294521+0000","last_undegraded":"2023-08-25T04:47:28.294521+0000","last_fullsized":"2023-08-25T04:47:28.294521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:29.201880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341595+0000","last_change":"2023-08-25T04:47:25.971366+0000","last_active":"2023-08-25T04:47:28.341595+0000","last_peered":"2023-08-25T04:47:28.341595+0000","last_clean":"2023-08-25T04:47:28.341595+0000","last_became_active":"2023-08-25T04:47:25.971008+0000","last_became_peered":"2023-08-25T04:47:25.971008+0000","last_unstale":"2023-08-25T04:47:28.341595+0000","last_undegraded":"2023-08-25T04:47:28.341595+0000","last_fullsized":"2023-08-25T04:47:28.341595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:15.719795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340862+0000","last_change":"2023-08-25T04:47:26.982459+0000","last_active":"2023-08-25T04:47:28.340862+0000","last_peered":"2023-08-25T04:47:28.340862+0000","last_clean":"2023-08-25T04:47:28.340862+0000","last_became_active":"2023-08-25T04:47:26.982167+0000","last_became_peered":"2023-08-25T04:47:26.982167+0000","last_unstale":"2023-08-25T04:47:28.340862+0000","last_undegraded":"2023-08-25T04:47:28.340862+0000","last_fullsized":"2023-08-25T04:47:28.340862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:17:30.799221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294556+0000","last_change":"2023-08-25T04:47:25.976089+0000","last_active":"2023-08-25T04:47:28.294556+0000","last_peered":"2023-08-25T04:47:28.294556+0000","last_clean":"2023-08-25T04:47:28.294556+0000","last_became_active":"2023-08-25T04:47:25.975784+0000","last_became_peered":"2023-08-25T04:47:25.975784+0000","last_unstale":"2023-08-25T04:47:28.294556+0000","last_undegraded":"2023-08-25T04:47:28.294556+0000","last_fullsized":"2023-08-25T04:47:28.294556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:28:29.070405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294408+0000","last_change":"2023-08-25T04:47:26.985729+0000","last_active":"2023-08-25T04:47:28.294408+0000","last_peered":"2023-08-25T04:47:28.294408+0000","last_clean":"2023-08-25T04:47:28.294408+0000","last_became_active":"2023-08-25T04:47:26.985443+0000","last_became_peered":"2023-08-25T04:47:26.985443+0000","last_unstale":"2023-08-25T04:47:28.294408+0000","last_undegraded":"2023-08-25T04:47:28.294408+0000","last_fullsized":"2023-08-25T04:47:28.294408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:43:19.454137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976535+0000","last_change":"2023-08-25T04:47:25.973449+0000","last_active":"2023-08-25T04:47:27.976535+0000","last_peered":"2023-08-25T04:47:27.976535+0000","last_clean":"2023-08-25T04:47:27.976535+0000","last_became_active":"2023-08-25T04:47:25.973163+0000","last_became_peered":"2023-08-25T04:47:25.973163+0000","last_unstale":"2023-08-25T04:47:27.976535+0000","last_undegraded":"2023-08-25T04:47:27.976535+0000","last_fullsized":"2023-08-25T04:47:27.976535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:01.040705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342289+0000","last_change":"2023-08-25T04:47:26.989632+0000","last_active":"2023-08-25T04:47:28.342289+0000","last_peered":"2023-08-25T04:47:28.342289+0000","last_clean":"2023-08-25T04:47:28.342289+0000","last_became_active":"2023-08-25T04:47:26.988893+0000","last_became_peered":"2023-08-25T04:47:26.988893+0000","last_unstale":"2023-08-25T04:47:28.342289+0000","last_undegraded":"2023-08-25T04:47:28.342289+0000","last_fullsized":"2023-08-25T04:47:28.342289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:23.475124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341274+0000","last_change":"2023-08-25T04:47:25.974503+0000","last_active":"2023-08-25T04:47:28.341274+0000","last_peered":"2023-08-25T04:47:28.341274+0000","last_clean":"2023-08-25T04:47:28.341274+0000","last_became_active":"2023-08-25T04:47:25.974229+0000","last_became_peered":"2023-08-25T04:47:25.974229+0000","last_unstale":"2023-08-25T04:47:28.341274+0000","last_undegraded":"2023-08-25T04:47:28.341274+0000","last_fullsized":"2023-08-25T04:47:28.341274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:59:46.261855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341299+0000","last_change":"2023-08-25T04:47:26.986856+0000","last_active":"2023-08-25T04:47:28.341299+0000","last_peered":"2023-08-25T04:47:28.341299+0000","last_clean":"2023-08-25T04:47:28.341299+0000","last_became_active":"2023-08-25T04:47:26.986593+0000","last_became_peered":"2023-08-25T04:47:26.986593+0000","last_unstale":"2023-08-25T04:47:28.341299+0000","last_undegraded":"2023-08-25T04:47:28.341299+0000","last_fullsized":"2023-08-25T04:47:28.341299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:55.854167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294249+0000","last_change":"2023-08-25T04:47:25.969371+0000","last_active":"2023-08-25T04:47:28.294249+0000","last_peered":"2023-08-25T04:47:28.294249+0000","last_clean":"2023-08-25T04:47:28.294249+0000","last_became_active":"2023-08-25T04:47:25.969053+0000","last_became_peered":"2023-08-25T04:47:25.969053+0000","last_unstale":"2023-08-25T04:47:28.294249+0000","last_undegraded":"2023-08-25T04:47:28.294249+0000","last_fullsized":"2023-08-25T04:47:28.294249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:42.347250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340525+0000","last_change":"2023-08-25T04:47:26.966638+0000","last_active":"2023-08-25T04:47:28.340525+0000","last_peered":"2023-08-25T04:47:28.340525+0000","last_clean":"2023-08-25T04:47:28.340525+0000","last_became_active":"2023-08-25T04:47:26.966357+0000","last_became_peered":"2023-08-25T04:47:26.966357+0000","last_unstale":"2023-08-25T04:47:28.340525+0000","last_undegraded":"2023-08-25T04:47:28.340525+0000","last_fullsized":"2023-08-25T04:47:28.340525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:26:49.336901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340955+0000","last_change":"2023-08-25T04:47:25.975122+0000","last_active":"2023-08-25T04:47:28.340955+0000","last_peered":"2023-08-25T04:47:28.340955+0000","last_clean":"2023-08-25T04:47:28.340955+0000","last_became_active":"2023-08-25T04:47:25.974779+0000","last_became_peered":"2023-08-25T04:47:25.974779+0000","last_unstale":"2023-08-25T04:47:28.340955+0000","last_undegraded":"2023-08-25T04:47:28.340955+0000","last_fullsized":"2023-08-25T04:47:28.340955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:04:34.933981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294245+0000","last_change":"2023-08-25T04:47:26.985086+0000","last_active":"2023-08-25T04:47:28.294245+0000","last_peered":"2023-08-25T04:47:28.294245+0000","last_clean":"2023-08-25T04:47:28.294245+0000","last_became_active":"2023-08-25T04:47:26.984816+0000","last_became_peered":"2023-08-25T04:47:26.984816+0000","last_unstale":"2023-08-25T04:47:28.294245+0000","last_undegraded":"2023-08-25T04:47:28.294245+0000","last_fullsized":"2023-08-25T04:47:28.294245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:49.216946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340713+0000","last_change":"2023-08-25T04:47:25.971179+0000","last_active":"2023-08-25T04:47:28.340713+0000","last_peered":"2023-08-25T04:47:28.340713+0000","last_clean":"2023-08-25T04:47:28.340713+0000","last_became_active":"2023-08-25T04:47:25.970906+0000","last_became_peered":"2023-08-25T04:47:25.970906+0000","last_unstale":"2023-08-25T04:47:28.340713+0000","last_undegraded":"2023-08-25T04:47:28.340713+0000","last_fullsized":"2023-08-25T04:47:28.340713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:30:08.454351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976432+0000","last_change":"2023-08-25T04:47:26.978084+0000","last_active":"2023-08-25T04:47:27.976432+0000","last_peered":"2023-08-25T04:47:27.976432+0000","last_clean":"2023-08-25T04:47:27.976432+0000","last_became_active":"2023-08-25T04:47:26.977503+0000","last_became_peered":"2023-08-25T04:47:26.977503+0000","last_unstale":"2023-08-25T04:47:27.976432+0000","last_undegraded":"2023-08-25T04:47:27.976432+0000","last_fullsized":"2023-08-25T04:47:27.976432+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:54.378367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976212+0000","last_change":"2023-08-25T04:47:25.975496+0000","last_active":"2023-08-25T04:47:27.976212+0000","last_peered":"2023-08-25T04:47:27.976212+0000","last_clean":"2023-08-25T04:47:27.976212+0000","last_became_active":"2023-08-25T04:47:25.975245+0000","last_became_peered":"2023-08-25T04:47:25.975245+0000","last_unstale":"2023-08-25T04:47:27.976212+0000","last_undegraded":"2023-08-25T04:47:27.976212+0000","last_fullsized":"2023-08-25T04:47:27.976212+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:14.912050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341105+0000","last_change":"2023-08-25T04:47:26.993959+0000","last_active":"2023-08-25T04:47:28.341105+0000","last_peered":"2023-08-25T04:47:28.341105+0000","last_clean":"2023-08-25T04:47:28.341105+0000","last_became_active":"2023-08-25T04:47:26.993698+0000","last_became_peered":"2023-08-25T04:47:26.993698+0000","last_unstale":"2023-08-25T04:47:28.341105+0000","last_undegraded":"2023-08-25T04:47:28.341105+0000","last_fullsized":"2023-08-25T04:47:28.341105+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:16:53.101551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975905+0000","last_change":"2023-08-25T04:47:25.972518+0000","last_active":"2023-08-25T04:47:27.975905+0000","last_peered":"2023-08-25T04:47:27.975905+0000","last_clean":"2023-08-25T04:47:27.975905+0000","last_became_active":"2023-08-25T04:47:25.972235+0000","last_became_peered":"2023-08-25T04:47:25.972235+0000","last_unstale":"2023-08-25T04:47:27.975905+0000","last_undegraded":"2023-08-25T04:47:27.975905+0000","last_fullsized":"2023-08-25T04:47:27.975905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:30.017074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342087+0000","last_change":"2023-08-25T04:47:26.974035+0000","last_active":"2023-08-25T04:47:28.342087+0000","last_peered":"2023-08-25T04:47:28.342087+0000","last_clean":"2023-08-25T04:47:28.342087+0000","last_became_active":"2023-08-25T04:47:26.973088+0000","last_became_peered":"2023-08-25T04:47:26.973088+0000","last_unstale":"2023-08-25T04:47:28.342087+0000","last_undegraded":"2023-08-25T04:47:28.342087+0000","last_fullsized":"2023-08-25T04:47:28.342087+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:44.067685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341130+0000","last_change":"2023-08-25T04:47:25.972042+0000","last_active":"2023-08-25T04:47:28.341130+0000","last_peered":"2023-08-25T04:47:28.341130+0000","last_clean":"2023-08-25T04:47:28.341130+0000","last_became_active":"2023-08-25T04:47:25.971712+0000","last_became_peered":"2023-08-25T04:47:25.971712+0000","last_unstale":"2023-08-25T04:47:28.341130+0000","last_undegraded":"2023-08-25T04:47:28.341130+0000","last_fullsized":"2023-08-25T04:47:28.341130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:49.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342277+0000","last_change":"2023-08-25T04:47:26.981715+0000","last_active":"2023-08-25T04:47:28.342277+0000","last_peered":"2023-08-25T04:47:28.342277+0000","last_clean":"2023-08-25T04:47:28.342277+0000","last_became_active":"2023-08-25T04:47:26.977826+0000","last_became_peered":"2023-08-25T04:47:26.977826+0000","last_unstale":"2023-08-25T04:47:28.342277+0000","last_undegraded":"2023-08-25T04:47:28.342277+0000","last_fullsized":"2023-08-25T04:47:28.342277+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:32.750816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341374+0000","last_change":"2023-08-25T04:47:25.980540+0000","last_active":"2023-08-25T04:47:28.341374+0000","last_peered":"2023-08-25T04:47:28.341374+0000","last_clean":"2023-08-25T04:47:28.341374+0000","last_became_active":"2023-08-25T04:47:25.980257+0000","last_became_peered":"2023-08-25T04:47:25.980257+0000","last_unstale":"2023-08-25T04:47:28.341374+0000","last_undegraded":"2023-08-25T04:47:28.341374+0000","last_fullsized":"2023-08-25T04:47:28.341374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:52.134514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340880+0000","last_change":"2023-08-25T04:47:26.981214+0000","last_active":"2023-08-25T04:47:28.340880+0000","last_peered":"2023-08-25T04:47:28.340880+0000","last_clean":"2023-08-25T04:47:28.340880+0000","last_became_active":"2023-08-25T04:47:26.980728+0000","last_became_peered":"2023-08-25T04:47:26.980728+0000","last_unstale":"2023-08-25T04:47:28.340880+0000","last_undegraded":"2023-08-25T04:47:28.340880+0000","last_fullsized":"2023-08-25T04:47:28.340880+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:58.970685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341303+0000","last_change":"2023-08-25T04:47:25.975365+0000","last_active":"2023-08-25T04:47:28.341303+0000","last_peered":"2023-08-25T04:47:28.341303+0000","last_clean":"2023-08-25T04:47:28.341303+0000","last_became_active":"2023-08-25T04:47:25.975108+0000","last_became_peered":"2023-08-25T04:47:25.975108+0000","last_unstale":"2023-08-25T04:47:28.341303+0000","last_undegraded":"2023-08-25T04:47:28.341303+0000","last_fullsized":"2023-08-25T04:47:28.341303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:47:33.402199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977230+0000","last_change":"2023-08-25T04:47:26.969633+0000","last_active":"2023-08-25T04:47:27.977230+0000","last_peered":"2023-08-25T04:47:27.977230+0000","last_clean":"2023-08-25T04:47:27.977230+0000","last_became_active":"2023-08-25T04:47:26.969363+0000","last_became_peered":"2023-08-25T04:47:26.969363+0000","last_unstale":"2023-08-25T04:47:27.977230+0000","last_undegraded":"2023-08-25T04:47:27.977230+0000","last_fullsized":"2023-08-25T04:47:27.977230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:07.022783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340778+0000","last_change":"2023-08-25T04:47:25.975363+0000","last_active":"2023-08-25T04:47:28.340778+0000","last_peered":"2023-08-25T04:47:28.340778+0000","last_clean":"2023-08-25T04:47:28.340778+0000","last_became_active":"2023-08-25T04:47:25.975084+0000","last_became_peered":"2023-08-25T04:47:25.975084+0000","last_unstale":"2023-08-25T04:47:28.340778+0000","last_undegraded":"2023-08-25T04:47:28.340778+0000","last_fullsized":"2023-08-25T04:47:28.340778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:58.243694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976283+0000","last_change":"2023-08-25T04:47:26.978269+0000","last_active":"2023-08-25T04:47:27.976283+0000","last_peered":"2023-08-25T04:47:27.976283+0000","last_clean":"2023-08-25T04:47:27.976283+0000","last_became_active":"2023-08-25T04:47:26.978005+0000","last_became_peered":"2023-08-25T04:47:26.978005+0000","last_unstale":"2023-08-25T04:47:27.976283+0000","last_undegraded":"2023-08-25T04:47:27.976283+0000","last_fullsized":"2023-08-25T04:47:27.976283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:52:04.634158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340919+0000","last_change":"2023-08-25T04:47:25.972001+0000","last_active":"2023-08-25T04:47:28.340919+0000","last_peered":"2023-08-25T04:47:28.340919+0000","last_clean":"2023-08-25T04:47:28.340919+0000","last_became_active":"2023-08-25T04:47:25.971700+0000","last_became_peered":"2023-08-25T04:47:25.971700+0000","last_unstale":"2023-08-25T04:47:28.340919+0000","last_undegraded":"2023-08-25T04:47:28.340919+0000","last_fullsized":"2023-08-25T04:47:28.340919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:58:46.076860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341066+0000","last_change":"2023-08-25T04:47:26.985686+0000","last_active":"2023-08-25T04:47:28.341066+0000","last_peered":"2023-08-25T04:47:28.341066+0000","last_clean":"2023-08-25T04:47:28.341066+0000","last_became_active":"2023-08-25T04:47:26.985426+0000","last_became_peered":"2023-08-25T04:47:26.985426+0000","last_unstale":"2023-08-25T04:47:28.341066+0000","last_undegraded":"2023-08-25T04:47:28.341066+0000","last_fullsized":"2023-08-25T04:47:28.341066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:00:35.491498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.293870+0000","last_change":"2023-08-25T04:47:25.972786+0000","last_active":"2023-08-25T04:47:28.293870+0000","last_peered":"2023-08-25T04:47:28.293870+0000","last_clean":"2023-08-25T04:47:28.293870+0000","last_became_active":"2023-08-25T04:47:25.972447+0000","last_became_peered":"2023-08-25T04:47:25.972447+0000","last_unstale":"2023-08-25T04:47:28.293870+0000","last_undegraded":"2023-08-25T04:47:28.293870+0000","last_fullsized":"2023-08-25T04:47:28.293870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:15.719795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341168+0000","last_change":"2023-08-25T04:47:26.981663+0000","last_active":"2023-08-25T04:47:28.341168+0000","last_peered":"2023-08-25T04:47:28.341168+0000","last_clean":"2023-08-25T04:47:28.341168+0000","last_became_active":"2023-08-25T04:47:26.981215+0000","last_became_peered":"2023-08-25T04:47:26.981215+0000","last_unstale":"2023-08-25T04:47:28.341168+0000","last_undegraded":"2023-08-25T04:47:28.341168+0000","last_fullsized":"2023-08-25T04:47:28.341168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:04.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975662+0000","last_change":"2023-08-25T04:47:25.974374+0000","last_active":"2023-08-25T04:47:27.975662+0000","last_peered":"2023-08-25T04:47:27.975662+0000","last_clean":"2023-08-25T04:47:27.975662+0000","last_became_active":"2023-08-25T04:47:25.974076+0000","last_became_peered":"2023-08-25T04:47:25.974076+0000","last_unstale":"2023-08-25T04:47:27.975662+0000","last_undegraded":"2023-08-25T04:47:27.975662+0000","last_fullsized":"2023-08-25T04:47:27.975662+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:55.920824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975670+0000","last_change":"2023-08-25T04:45:26.770775+0000","last_active":"2023-08-25T04:47:27.975670+0000","last_peered":"2023-08-25T04:47:27.975670+0000","last_clean":"2023-08-25T04:47:27.975670+0000","last_became_active":"2023-08-25T04:45:26.770447+0000","last_became_peered":"2023-08-25T04:45:26.770447+0000","last_unstale":"2023-08-25T04:47:27.975670+0000","last_undegraded":"2023-08-25T04:47:27.975670+0000","last_fullsized":"2023-08-25T04:47:27.975670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:05.207799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341007+0000","last_change":"2023-08-25T04:47:26.976963+0000","last_active":"2023-08-25T04:47:28.341007+0000","last_peered":"2023-08-25T04:47:28.341007+0000","last_clean":"2023-08-25T04:47:28.341007+0000","last_became_active":"2023-08-25T04:47:26.976708+0000","last_became_peered":"2023-08-25T04:47:26.976708+0000","last_unstale":"2023-08-25T04:47:28.341007+0000","last_undegraded":"2023-08-25T04:47:28.341007+0000","last_fullsized":"2023-08-25T04:47:28.341007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:20.114996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294474+0000","last_change":"2023-08-25T04:47:25.977339+0000","last_active":"2023-08-25T04:47:28.294474+0000","last_peered":"2023-08-25T04:47:28.294474+0000","last_clean":"2023-08-25T04:47:28.294474+0000","last_became_active":"2023-08-25T04:47:25.976992+0000","last_became_peered":"2023-08-25T04:47:25.976992+0000","last_unstale":"2023-08-25T04:47:28.294474+0000","last_undegraded":"2023-08-25T04:47:28.294474+0000","last_fullsized":"2023-08-25T04:47:28.294474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:25.928178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341453+0000","last_change":"2023-08-25T04:45:26.768222+0000","last_active":"2023-08-25T04:47:28.341453+0000","last_peered":"2023-08-25T04:47:28.341453+0000","last_clean":"2023-08-25T04:47:28.341453+0000","last_became_active":"2023-08-25T04:45:26.767875+0000","last_became_peered":"2023-08-25T04:45:26.767875+0000","last_unstale":"2023-08-25T04:47:28.341453+0000","last_undegraded":"2023-08-25T04:47:28.341453+0000","last_fullsized":"2023-08-25T04:47:28.341453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:43:48.980977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294423+0000","last_change":"2023-08-25T04:47:26.979143+0000","last_active":"2023-08-25T04:47:28.294423+0000","last_peered":"2023-08-25T04:47:28.294423+0000","last_clean":"2023-08-25T04:47:28.294423+0000","last_became_active":"2023-08-25T04:47:26.978851+0000","last_became_peered":"2023-08-25T04:47:26.978851+0000","last_unstale":"2023-08-25T04:47:28.294423+0000","last_undegraded":"2023-08-25T04:47:28.294423+0000","last_fullsized":"2023-08-25T04:47:28.294423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:55:55.890714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977190+0000","last_change":"2023-08-25T04:47:25.976678+0000","last_active":"2023-08-25T04:47:27.977190+0000","last_peered":"2023-08-25T04:47:27.977190+0000","last_clean":"2023-08-25T04:47:27.977190+0000","last_became_active":"2023-08-25T04:47:25.976396+0000","last_became_peered":"2023-08-25T04:47:25.976396+0000","last_unstale":"2023-08-25T04:47:27.977190+0000","last_undegraded":"2023-08-25T04:47:27.977190+0000","last_fullsized":"2023-08-25T04:47:27.977190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:02:43.618423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977309+0000","last_change":"2023-08-25T04:45:26.767948+0000","last_active":"2023-08-25T04:47:27.977309+0000","last_peered":"2023-08-25T04:47:27.977309+0000","last_clean":"2023-08-25T04:47:27.977309+0000","last_became_active":"2023-08-25T04:45:26.767496+0000","last_became_peered":"2023-08-25T04:45:26.767496+0000","last_unstale":"2023-08-25T04:47:27.977309+0000","last_undegraded":"2023-08-25T04:47:27.977309+0000","last_fullsized":"2023-08-25T04:47:27.977309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:04:37.260422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":204,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294146+0000","last_change":"2023-08-25T04:45:27.771979+0000","last_active":"2023-08-25T04:47:28.294146+0000","last_peered":"2023-08-25T04:47:28.294146+0000","last_clean":"2023-08-25T04:47:28.294146+0000","last_became_active":"2023-08-25T04:45:27.770968+0000","last_became_peered":"2023-08-25T04:45:27.770968+0000","last_unstale":"2023-08-25T04:47:28.294146+0000","last_undegraded":"2023-08-25T04:47:28.294146+0000","last_fullsized":"2023-08-25T04:47:28.294146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_clean_scrub_stamp":"2023-08-25T04:45:26.752521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:45.223643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341528+0000","last_change":"2023-08-25T04:47:26.986062+0000","last_active":"2023-08-25T04:47:28.341528+0000","last_peered":"2023-08-25T04:47:28.341528+0000","last_clean":"2023-08-25T04:47:28.341528+0000","last_became_active":"2023-08-25T04:47:26.985718+0000","last_became_peered":"2023-08-25T04:47:26.985718+0000","last_unstale":"2023-08-25T04:47:28.341528+0000","last_undegraded":"2023-08-25T04:47:28.341528+0000","last_fullsized":"2023-08-25T04:47:28.341528+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:18:26.307820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294587+0000","last_change":"2023-08-25T04:47:25.974765+0000","last_active":"2023-08-25T04:47:28.294587+0000","last_peered":"2023-08-25T04:47:28.294587+0000","last_clean":"2023-08-25T04:47:28.294587+0000","last_became_active":"2023-08-25T04:47:25.974490+0000","last_became_peered":"2023-08-25T04:47:25.974490+0000","last_unstale":"2023-08-25T04:47:28.294587+0000","last_undegraded":"2023-08-25T04:47:28.294587+0000","last_fullsized":"2023-08-25T04:47:28.294587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:49:57.377910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294304+0000","last_change":"2023-08-25T04:45:26.807286+0000","last_active":"2023-08-25T04:47:28.294304+0000","last_peered":"2023-08-25T04:47:28.294304+0000","last_clean":"2023-08-25T04:47:28.294304+0000","last_became_active":"2023-08-25T04:45:26.806698+0000","last_became_peered":"2023-08-25T04:45:26.806698+0000","last_unstale":"2023-08-25T04:47:28.294304+0000","last_undegraded":"2023-08-25T04:47:28.294304+0000","last_fullsized":"2023-08-25T04:47:28.294304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:16.619190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341608+0000","last_change":"2023-08-25T04:47:26.986435+0000","last_active":"2023-08-25T04:47:28.341608+0000","last_peered":"2023-08-25T04:47:28.341608+0000","last_clean":"2023-08-25T04:47:28.341608+0000","last_became_active":"2023-08-25T04:47:26.985036+0000","last_became_peered":"2023-08-25T04:47:26.985036+0000","last_unstale":"2023-08-25T04:47:28.341608+0000","last_undegraded":"2023-08-25T04:47:28.341608+0000","last_fullsized":"2023-08-25T04:47:28.341608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:05:39.659358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341311+0000","last_change":"2023-08-25T04:47:25.975191+0000","last_active":"2023-08-25T04:47:28.341311+0000","last_peered":"2023-08-25T04:47:28.341311+0000","last_clean":"2023-08-25T04:47:28.341311+0000","last_became_active":"2023-08-25T04:47:25.974782+0000","last_became_peered":"2023-08-25T04:47:25.974782+0000","last_unstale":"2023-08-25T04:47:28.341311+0000","last_undegraded":"2023-08-25T04:47:28.341311+0000","last_fullsized":"2023-08-25T04:47:28.341311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:30:08.454351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294026+0000","last_change":"2023-08-25T04:45:26.807096+0000","last_active":"2023-08-25T04:47:28.294026+0000","last_peered":"2023-08-25T04:47:28.294026+0000","last_clean":"2023-08-25T04:47:28.294026+0000","last_became_active":"2023-08-25T04:45:26.806713+0000","last_became_peered":"2023-08-25T04:45:26.806713+0000","last_unstale":"2023-08-25T04:47:28.294026+0000","last_undegraded":"2023-08-25T04:47:28.294026+0000","last_fullsized":"2023-08-25T04:47:28.294026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:03:39.465642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342292+0000","last_change":"2023-08-25T04:47:26.990475+0000","last_active":"2023-08-25T04:47:28.342292+0000","last_peered":"2023-08-25T04:47:28.342292+0000","last_clean":"2023-08-25T04:47:28.342292+0000","last_became_active":"2023-08-25T04:47:26.990221+0000","last_became_peered":"2023-08-25T04:47:26.990221+0000","last_unstale":"2023-08-25T04:47:28.342292+0000","last_undegraded":"2023-08-25T04:47:28.342292+0000","last_fullsized":"2023-08-25T04:47:28.342292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:50:36.546904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341491+0000","last_change":"2023-08-25T04:47:25.974503+0000","last_active":"2023-08-25T04:47:28.341491+0000","last_peered":"2023-08-25T04:47:28.341491+0000","last_clean":"2023-08-25T04:47:28.341491+0000","last_became_active":"2023-08-25T04:47:25.974239+0000","last_became_peered":"2023-08-25T04:47:25.974239+0000","last_unstale":"2023-08-25T04:47:28.341491+0000","last_undegraded":"2023-08-25T04:47:28.341491+0000","last_fullsized":"2023-08-25T04:47:28.341491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:52.498724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340716+0000","last_change":"2023-08-25T04:45:26.807065+0000","last_active":"2023-08-25T04:47:28.340716+0000","last_peered":"2023-08-25T04:47:28.340716+0000","last_clean":"2023-08-25T04:47:28.340716+0000","last_became_active":"2023-08-25T04:45:26.806737+0000","last_became_peered":"2023-08-25T04:45:26.806737+0000","last_unstale":"2023-08-25T04:47:28.340716+0000","last_undegraded":"2023-08-25T04:47:28.340716+0000","last_fullsized":"2023-08-25T04:47:28.340716+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:15:35.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340694+0000","last_change":"2023-08-25T04:47:26.975927+0000","last_active":"2023-08-25T04:47:28.340694+0000","last_peered":"2023-08-25T04:47:28.340694+0000","last_clean":"2023-08-25T04:47:28.340694+0000","last_became_active":"2023-08-25T04:47:26.975639+0000","last_became_peered":"2023-08-25T04:47:26.975639+0000","last_unstale":"2023-08-25T04:47:28.340694+0000","last_undegraded":"2023-08-25T04:47:28.340694+0000","last_fullsized":"2023-08-25T04:47:28.340694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:38.476033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977216+0000","last_change":"2023-08-25T04:47:25.976252+0000","last_active":"2023-08-25T04:47:27.977216+0000","last_peered":"2023-08-25T04:47:27.977216+0000","last_clean":"2023-08-25T04:47:27.977216+0000","last_became_active":"2023-08-25T04:47:25.975844+0000","last_became_peered":"2023-08-25T04:47:25.975844+0000","last_unstale":"2023-08-25T04:47:27.977216+0000","last_undegraded":"2023-08-25T04:47:27.977216+0000","last_fullsized":"2023-08-25T04:47:27.977216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:21:30.206142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342085+0000","last_change":"2023-08-25T04:45:26.807090+0000","last_active":"2023-08-25T04:47:28.342085+0000","last_peered":"2023-08-25T04:47:28.342085+0000","last_clean":"2023-08-25T04:47:28.342085+0000","last_became_active":"2023-08-25T04:45:26.806685+0000","last_became_peered":"2023-08-25T04:45:26.806685+0000","last_unstale":"2023-08-25T04:47:28.342085+0000","last_undegraded":"2023-08-25T04:47:28.342085+0000","last_fullsized":"2023-08-25T04:47:28.342085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:39.345242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975802+0000","last_change":"2023-08-25T04:47:26.975225+0000","last_active":"2023-08-25T04:47:27.975802+0000","last_peered":"2023-08-25T04:47:27.975802+0000","last_clean":"2023-08-25T04:47:27.975802+0000","last_became_active":"2023-08-25T04:47:26.974877+0000","last_became_peered":"2023-08-25T04:47:26.974877+0000","last_unstale":"2023-08-25T04:47:27.975802+0000","last_undegraded":"2023-08-25T04:47:27.975802+0000","last_fullsized":"2023-08-25T04:47:27.975802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:06:17.864760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340768+0000","last_change":"2023-08-25T04:47:25.974342+0000","last_active":"2023-08-25T04:47:28.340768+0000","last_peered":"2023-08-25T04:47:28.340768+0000","last_clean":"2023-08-25T04:47:28.340768+0000","last_became_active":"2023-08-25T04:47:25.974066+0000","last_became_peered":"2023-08-25T04:47:25.974066+0000","last_unstale":"2023-08-25T04:47:28.340768+0000","last_undegraded":"2023-08-25T04:47:28.340768+0000","last_fullsized":"2023-08-25T04:47:28.340768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:39:34.566353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342415+0000","last_change":"2023-08-25T04:45:26.768150+0000","last_active":"2023-08-25T04:47:28.342415+0000","last_peered":"2023-08-25T04:47:28.342415+0000","last_clean":"2023-08-25T04:47:28.342415+0000","last_became_active":"2023-08-25T04:45:26.767845+0000","last_became_peered":"2023-08-25T04:45:26.767845+0000","last_unstale":"2023-08-25T04:47:28.342415+0000","last_undegraded":"2023-08-25T04:47:28.342415+0000","last_fullsized":"2023-08-25T04:47:28.342415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:17.114194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":799095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66900000000000004,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76500000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.121,"15min":1.1919999999999999},"min":{"1min":0.36399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91700000000000004,"5min":11.452,"15min":11.452},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81499999999999995,"5min":1.528,"15min":1.528},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.93999999999999995,"15min":0.98799999999999999},"min":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89200000000000002,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.96699999999999997,"15min":1.014},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93600000000000005,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90400000000000003,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90500000000000003,"5min":1.694,"15min":1.694},"last":0.747},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.109,"15min":1.165},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.95799999999999996,"5min":9.3689999999999998,"15min":9.3689999999999998},"last":0.85399999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.70799999999999996,"15min":0.69899999999999995},"min":{"1min":0.45400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.497,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97699999999999998,"5min":1.03,"15min":1.03},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0820000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.02},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89700000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.878}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":209309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86699999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":0.871,"15min":0.871},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.76800000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.76800000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.94699999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":1.042,"15min":1.042},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.67500000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91100000000000003,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76400000000000001,"15min":0.76200000000000001},"min":{"1min":0.625,"5min":0.5,"15min":0.5},"max":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.625,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93100000000000005,"5min":1.171,"15min":1.171},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":799075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60499999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.437,"15min":0.437},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.443},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.495,"15min":0.499},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38300000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74299999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":0.998,"15min":0.998},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2849999999999999,"5min":1.357,"15min":1.357},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":0.80900000000000005},"min":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1890000000000001,"5min":1.3,"15min":1.3},"last":0.874},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.032,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.82099999999999995,"15min":0.83299999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.103,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.84599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":207735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":0.998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.63900000000000001,"15min":0.66500000000000004},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95299999999999996,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.50900000000000001,"15min":0.51800000000000002},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.89200000000000002,"5min":4.6020000000000003,"15min":4.6020000000000003},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.52000000000000002,"15min":0.53800000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57699999999999996,"5min":1.611,"15min":1.611},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91800000000000004,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.83699999999999997,"15min":0.86199999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.113,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0049999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76700000000000002,"15min":0.77400000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1719999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0209999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.091,"5min":1.236,"15min":1.236},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.88500000000000001,"15min":0.91700000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0589999999999999,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.92500000000000004,"15min":0.95499999999999996},"min":{"1min":0.61799999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.998,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.82699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":210271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47899999999999998,"15min":0.49099999999999999},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.52200000000000002,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":1.111,"15min":1.2210000000000001},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.56299999999999994,"5min":15.301,"15min":15.301},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59899999999999998,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.1499999999999999,"15min":1.2629999999999999},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.54800000000000004,"5min":15.334,"15min":15.334},"last":0.55300000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.63200000000000001,"15min":0.66200000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.55300000000000005,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.443},{"interface":"front","average":{"1min":0.5,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.58399999999999996,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.65400000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.512,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":1.4079999999999999,"15min":1.506},"min":{"1min":0.54700000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.163,"5min":15.172000000000001,"15min":15.172000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.90600000000000003,"15min":0.92100000000000004},"min":{"1min":0.56399999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.23,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.875,"15min":0.877},"min":{"1min":0.60399999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.474,"5min":1.956,"15min":1.956},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.4330000000000001,"15min":1.53},"min":{"1min":0.54400000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.431,"5min":15.266,"15min":15.266},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95799999999999996,"15min":0.97399999999999998},"min":{"1min":0.65500000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5309999999999999,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.83599999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.4650000000000001,"15min":1.5669999999999999},"min":{"1min":0.57499999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.401,"5min":15.227,"15min":15.227},"last":0.746},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.96899999999999997,"15min":0.98599999999999999},"min":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.411,"5min":4.077,"15min":4.077},"last":0.86299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":209275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.93700000000000006,"15min":1.0289999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":12.221,"15min":12.221},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.872,"15min":0.94999999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.499,"5min":10.331,"15min":10.331},"last":0.48699999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.48999999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.377},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.59999999999999998,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.95799999999999996,"15min":1.04},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.56399999999999995,"5min":10.361000000000001,"15min":10.361000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.59999999999999998,"15min":0.61799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72699999999999998,"5min":1.589,"15min":1.589},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":1.1279999999999999,"15min":1.202},"min":{"1min":0.53000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.86899999999999999,"5min":10.295999999999999,"15min":10.295999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.56200000000000006,"5min":0.503,"15min":0.503},"max":{"1min":0.90500000000000003,"5min":11.097,"15min":11.097},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90000000000000002,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":1.139,"15min":1.2070000000000001},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90800000000000003,"5min":10.252000000000001,"15min":10.252000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":1.179,"15min":1.2509999999999999},"min":{"1min":0.59399999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93799999999999994,"5min":11.058999999999999,"15min":11.058999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0109999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":1.171,"15min":1.2430000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.92000000000000004,"5min":10.206,"15min":10.206},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":1.1950000000000001,"15min":1.2729999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95799999999999996,"5min":11.013,"15min":11.013},"last":0.56399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":210249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.46300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.63400000000000001,"15min":0.625},"min":{"1min":0.432,"5min":0.31,"15min":0.31},"max":{"1min":0.84799999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.47399999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85399999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.625},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.56699999999999995,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.86299999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.53900000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.82499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88500000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.496,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0049999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.51300000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88500000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.84899999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91200000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.625,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96299999999999997,"5min":1.339,"15min":1.339},"last":0.95999999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72799999999999998,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98199999999999998,"5min":0.997,"15min":0.997},"last":0.88},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.59299999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.026,"5min":1.145,"15min":1.145},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":208707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.78600000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.871},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.748}]},{"osd":4,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.62}]},{"osd":6,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.85099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:47:32.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T04:47:32.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.543+0000 7f5063fff700 1 Processor -- start 2023-08-25T04:47:32.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.544+0000 7f5063fff700 1 -- start start 2023-08-25T04:47:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.545+0000 7f5063fff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f505c15d240 0x7f505c0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.545+0000 7f5063fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505c0cb2a0 con 0x7f505c0cf970 2023-08-25T04:47:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.545+0000 7f5063fff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505c0cfe80 con 0x7f505c0cbd60 2023-08-25T04:47:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.545+0000 7f5063fff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c0d0160 con 0x7f505c15d240 2023-08-25T04:47:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.545+0000 7f506159a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f505c0cf970 0x7f505c0cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57320/0 (socket says 172.21.15.72:57320) 2023-08-25T04:47:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.545+0000 7f506159a700 1 -- 172.21.15.72:0/2685136812 learned_addr learned my addr 172.21.15.72:0/2685136812 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:32.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.545+0000 7f5061d9b700 1 --2- 172.21.15.72:0/2685136812 >> v2:172.21.15.137:3300/0 conn(0x7f505c15d240 0x7f505c0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5060d99700 1 -- 172.21.15.72:0/2685136812 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742363595 0 0) 0x7f505c0cb2a0 con 0x7f505c0cf970 2023-08-25T04:47:32.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5060d99700 1 -- 172.21.15.72:0/2685136812 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50480035b0 con 0x7f505c0cf970 2023-08-25T04:47:32.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5060d99700 1 -- 172.21.15.72:0/2685136812 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334894676 0 0) 0x7f505c0cfe80 con 0x7f505c0cbd60 2023-08-25T04:47:32.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5060d99700 1 -- 172.21.15.72:0/2685136812 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f505c0cb2a0 con 0x7f505c0cbd60 2023-08-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5061d9b700 1 -- 172.21.15.72:0/2685136812 >> v1:172.21.15.137:6789/0 conn(0x7f505c0cbd60 legacy=0x7f505c0cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5061d9b700 1 -- 172.21.15.72:0/2685136812 >> v1:172.21.15.72:6789/0 conn(0x7f505c0cf970 legacy=0x7f505c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5061d9b700 1 -- 172.21.15.72:0/2685136812 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c0cb560 con 0x7f505c15d240 2023-08-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5061d9b700 1 --2- 172.21.15.72:0/2685136812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f505c15d240 0x7f505c0cd4d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5058009840 tx=0x7f5058009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b3ff2cc59bb94b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5060d99700 1 -- 172.21.15.72:0/2685136812 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058011830 con 0x7f505c15d240 2023-08-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5060d99700 1 -- 172.21.15.72:0/2685136812 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5058011990 con 0x7f505c15d240 2023-08-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.546+0000 7f5060d99700 1 -- 172.21.15.72:0/2685136812 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058011d20 con 0x7f505c15d240 2023-08-25T04:47:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.547+0000 7f5063fff700 1 -- 172.21.15.72:0/2685136812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f505c15d240 msgr2=0x7f505c0cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.547+0000 7f5063fff700 1 --2- 172.21.15.72:0/2685136812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f505c15d240 0x7f505c0cd4d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5058009840 tx=0x7f5058009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.547+0000 7f5063fff700 1 -- 172.21.15.72:0/2685136812 shutdown_connections 2023-08-25T04:47:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.547+0000 7f5063fff700 1 --2- 172.21.15.72:0/2685136812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f505c15d240 0x7f505c0cd4d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.547+0000 7f5063fff700 1 -- 172.21.15.72:0/2685136812 >> 172.21.15.72:0/2685136812 conn(0x7f505c0d0c50 msgr2=0x7f505c0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.547+0000 7f5063fff700 1 -- 172.21.15.72:0/2685136812 shutdown_connections 2023-08-25T04:47:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.547+0000 7f5063fff700 1 -- 172.21.15.72:0/2685136812 wait complete. 2023-08-25T04:47:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.549+0000 7f5063fff700 1 Processor -- start 2023-08-25T04:47:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.549+0000 7f5063fff700 1 -- start start 2023-08-25T04:47:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5063fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505c0cbd60 0x7f505c160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5063fff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f505c0cf970 0x7f505c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5063fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f505c15d240 0x7f505c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5063fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c15a830 con 0x7f505c0cbd60 2023-08-25T04:47:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5063fff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0b4160 con 0x7f505c0cf970 2023-08-25T04:47:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5063fff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0b3c60 con 0x7f505c15d240 2023-08-25T04:47:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5061d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505c0cbd60 0x7f505c160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5061d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505c0cbd60 0x7f505c160590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52962/0 (socket says 172.21.15.72:52962) 2023-08-25T04:47:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5061d9b700 1 -- 172.21.15.72:0/1507938102 learned_addr learned my addr 172.21.15.72:0/1507938102 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f506159a700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f505c0cf970 0x7f505c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f506259c700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f505c15d240 0x7f505c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5061d9b700 1 -- 172.21.15.72:0/1507938102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f505c15d240 msgr2=0x7f505c0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5061d9b700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f505c15d240 0x7f505c0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5061d9b700 1 -- 172.21.15.72:0/1507938102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f505c0cf970 msgr2=0x7f505c15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5061d9b700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f505c0cf970 0x7f505c15a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.550+0000 7f5061d9b700 1 -- 172.21.15.72:0/1507938102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580094a0 con 0x7f505c0cbd60 2023-08-25T04:47:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.551+0000 7f5061d9b700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505c0cbd60 0x7f505c160590 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f50580090b0 tx=0x7f5058004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.551+0000 7f50527fc700 1 -- 172.21.15.72:0/1507938102 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505801a860 con 0x7f505c0cbd60 2023-08-25T04:47:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.551+0000 7f50527fc700 1 -- 172.21.15.72:0/1507938102 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505801a9c0 con 0x7f505c0cbd60 2023-08-25T04:47:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.551+0000 7f5063fff700 1 -- 172.21.15.72:0/1507938102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c0b4370 con 0x7f505c0cbd60 2023-08-25T04:47:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.551+0000 7f50527fc700 1 -- 172.21.15.72:0/1507938102 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505801ad30 con 0x7f505c0cbd60 2023-08-25T04:47:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.551+0000 7f5063fff700 1 -- 172.21.15.72:0/1507938102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c0b4930 con 0x7f505c0cbd60 2023-08-25T04:47:32.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.552+0000 7f5063fff700 1 -- 172.21.15.72:0/1507938102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505c04e620 con 0x7f505c0cbd60 2023-08-25T04:47:32.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.553+0000 7f50527fc700 1 -- 172.21.15.72:0/1507938102 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5058022070 con 0x7f505c0cbd60 2023-08-25T04:47:32.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.554+0000 7f50527fc700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f504006a0e0 0x7f504006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:32.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.554+0000 7f50527fc700 1 -- 172.21.15.72:0/1507938102 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5058089850 con 0x7f505c0cbd60 2023-08-25T04:47:32.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.554+0000 7f506159a700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f504006a0e0 0x7f504006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:32.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.555+0000 7f506159a700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f504006a0e0 0x7f504006c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f505c0d1260 tx=0x7f504c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:32.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.559+0000 7f50527fc700 1 -- 172.21.15.72:0/1507938102 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5058054fb0 con 0x7f505c0cbd60 2023-08-25T04:47:32.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.839+0000 7f5063fff700 1 -- 172.21.15.72:0/1507938102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f505c0cf030 con 0x7f505c0cbd60 2023-08-25T04:47:32.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.840+0000 7f50527fc700 1 -- 172.21.15.72:0/1507938102 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1014 (secure 0 0 0) 0x7f50580585d0 con 0x7f505c0cbd60 2023-08-25T04:47:32.841 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:32.841 INFO:teuthology.orchestra.run.smithi072.stdout:{"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":140,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1692938724,"num_in_osds":8,"osd_in_since":1692938716,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592778,"bytes_used":226324480,"bytes_avail":772867788800,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5646}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-25T04:46:39.874540+0000","services":{}},"progress_events":{}} 2023-08-25T04:47:32.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 -- 172.21.15.72:0/1507938102 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f504006a0e0 msgr2=0x7f504006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f504006a0e0 0x7f504006c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f505c0d1260 tx=0x7f504c009040 comp rx=0 tx=0).stop 2023-08-25T04:47:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 -- 172.21.15.72:0/1507938102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505c0cbd60 msgr2=0x7f505c160590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505c0cbd60 0x7f505c160590 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f50580090b0 tx=0x7f5058004750 comp rx=0 tx=0).stop 2023-08-25T04:47:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 -- 172.21.15.72:0/1507938102 shutdown_connections 2023-08-25T04:47:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f504006a0e0 0x7f504006c5a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f505c15d240 0x7f505c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f505c0cbd60 0x7f505c160590 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 --2- 172.21.15.72:0/1507938102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f505c0cf970 0x7f505c15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:32.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 -- 172.21.15.72:0/1507938102 >> 172.21.15.72:0/1507938102 conn(0x7f505c0d0c50 msgr2=0x7f505c06ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:32.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 -- 172.21.15.72:0/1507938102 shutdown_connections 2023-08-25T04:47:32.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:32.842+0000 7f5063fff700 1 -- 172.21.15.72:0/1507938102 wait complete. 2023-08-25T04:47:32.861 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T04:47:32.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:47:33.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.056+0000 7fd4dddff700 1 Processor -- start 2023-08-25T04:47:33.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.056+0000 7fd4dddff700 1 -- start start 2023-08-25T04:47:33.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.058+0000 7fd4dddff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4d8159b90 0x7fd4d80b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:33.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.058+0000 7fd4dddff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80ce3c0 0x7fd4d80c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:33.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.058+0000 7fd4dddff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d80c48f0 con 0x7fd4d80b0ab0 2023-08-25T04:47:33.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.058+0000 7fd4dddff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d80c5470 con 0x7fd4d8159b90 2023-08-25T04:47:33.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.058+0000 7fd4dddff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8159f70 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.058+0000 7fd4d7fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80ce3c0 0x7fd4d80c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:33.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.058+0000 7fd4d7fff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80ce3c0 0x7fd4d80c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:45888/0 (socket says 172.21.15.72:45888) 2023-08-25T04:47:33.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.058+0000 7fd4d77fe700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4d8159b90 0x7fd4d80b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:33.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.058+0000 7fd4d7fff700 1 -- 172.21.15.72:0/1783723886 learned_addr learned my addr 172.21.15.72:0/1783723886 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:33.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.058+0000 7fd4d6ffd700 1 --1- 172.21.15.72:0/1783723886 >> v1:172.21.15.137:6789/0 conn(0x7fd4d80b0ab0 0x7fd4d80cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:43116/0 (socket says 172.21.15.72:43116) 2023-08-25T04:47:33.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.059+0000 7fd4d7fff700 1 -- 172.21.15.72:0/1783723886 >> v2:172.21.15.137:3300/0 conn(0x7fd4d8159b90 msgr2=0x7fd4d80b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:33.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.059+0000 7fd4d7fff700 1 --2- 172.21.15.72:0/1783723886 >> v2:172.21.15.137:3300/0 conn(0x7fd4d8159b90 0x7fd4d80b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:33.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.059+0000 7fd4d7fff700 1 -- 172.21.15.72:0/1783723886 >> v1:172.21.15.137:6789/0 conn(0x7fd4d80b0ab0 legacy=0x7fd4d80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:33.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.059+0000 7fd4d7fff700 1 -- 172.21.15.72:0/1783723886 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d80c4b40 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.059+0000 7fd4d67fc700 1 -- 172.21.15.72:0/1783723886 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802660722 0 0) 0x7fd4d80c48f0 con 0x7fd4d80b0ab0 2023-08-25T04:47:33.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.059+0000 7fd4d7fff700 1 --2- 172.21.15.72:0/1783723886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80ce3c0 0x7fd4d80c8f50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009e50 tx=0x7fd4d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6be5cbc647b4f027 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:33.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.059+0000 7fd4d67fc700 1 -- 172.21.15.72:0/1783723886 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d000e070 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.059+0000 7fd4d67fc700 1 -- 172.21.15.72:0/1783723886 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d000b910 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.059+0000 7fd4d67fc700 1 -- 172.21.15.72:0/1783723886 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d000bcc0 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.060+0000 7fd4dddff700 1 -- 172.21.15.72:0/1783723886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80ce3c0 msgr2=0x7fd4d80c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:33.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.060+0000 7fd4dddff700 1 --2- 172.21.15.72:0/1783723886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80ce3c0 0x7fd4d80c8f50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009e50 tx=0x7fd4d000b330 comp rx=0 tx=0).stop 2023-08-25T04:47:33.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.060+0000 7fd4dddff700 1 -- 172.21.15.72:0/1783723886 shutdown_connections 2023-08-25T04:47:33.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.060+0000 7fd4dddff700 1 --2- 172.21.15.72:0/1783723886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80ce3c0 0x7fd4d80c8f50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:33.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.060+0000 7fd4dddff700 1 --2- 172.21.15.72:0/1783723886 >> v2:172.21.15.137:3300/0 conn(0x7fd4d8159b90 0x7fd4d80b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:33.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.060+0000 7fd4dddff700 1 -- 172.21.15.72:0/1783723886 >> 172.21.15.72:0/1783723886 conn(0x7fd4d80ce990 msgr2=0x7fd4d80ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:33.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.060+0000 7fd4dddff700 1 -- 172.21.15.72:0/1783723886 shutdown_connections 2023-08-25T04:47:33.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.060+0000 7fd4dddff700 1 -- 172.21.15.72:0/1783723886 wait complete. 2023-08-25T04:47:33.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.062+0000 7fd4dddff700 1 Processor -- start 2023-08-25T04:47:33.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.062+0000 7fd4dddff700 1 -- start start 2023-08-25T04:47:33.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4dddff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80b0ab0 0x7fd4d814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:33.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4dddff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80ce3c0 0x7fd4d815c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:33.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4dddff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4d8159b90 0x7fd4d815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:33.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4dddff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80c80f0 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4dddff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80c5b70 con 0x7fd4d8159b90 2023-08-25T04:47:33.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4dddff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80c5e50 con 0x7fd4d80b0ab0 2023-08-25T04:47:33.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4d6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80ce3c0 0x7fd4d815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:33.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80b0ab0 0x7fd4d814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4d6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80ce3c0 0x7fd4d815c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47348/0 (socket says 172.21.15.72:47348) 2023-08-25T04:47:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4d6ffd700 1 -- 172.21.15.72:0/593453193 learned_addr learned my addr 172.21.15.72:0/593453193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.063+0000 7fd4d7fff700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4d8159b90 0x7fd4d815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4d6ffd700 1 -- 172.21.15.72:0/593453193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80b0ab0 msgr2=0x7fd4d814e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4d6ffd700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80b0ab0 0x7fd4d814e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4d6ffd700 1 -- 172.21.15.72:0/593453193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4d8159b90 msgr2=0x7fd4d815c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4d6ffd700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4d8159b90 0x7fd4d815c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:33.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4d6ffd700 1 -- 172.21.15.72:0/593453193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d0009b30 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4d6ffd700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80ce3c0 0x7fd4d815c370 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0011e0 tx=0x7fd4cc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4bffff700 1 -- 172.21.15.72:0/593453193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc004c80 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4bffff700 1 -- 172.21.15.72:0/593453193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc004e00 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4dddff700 1 -- 172.21.15.72:0/593453193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d80c6130 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4bffff700 1 -- 172.21.15.72:0/593453193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc007310 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.064+0000 7fd4dddff700 1 -- 172.21.15.72:0/593453193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d80c6930 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.065+0000 7fd4dddff700 1 -- 172.21.15.72:0/593453193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d80c5cb0 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.066+0000 7fd4bffff700 1 -- 172.21.15.72:0/593453193 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd4cc007470 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.067+0000 7fd4bffff700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd4c406a0e0 0x7fd4c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:33.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.067+0000 7fd4bffff700 1 -- 172.21.15.72:0/593453193 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd4cc088320 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.067+0000 7fd4d77fe700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd4c406a0e0 0x7fd4c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:33.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.068+0000 7fd4d77fe700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd4c406a0e0 0x7fd4c406c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8154870 tx=0x7fd4c8009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:33.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.071+0000 7fd4bffff700 1 -- 172.21.15.72:0/593453193 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd4d80c5cb0 con 0x7fd4d80ce3c0 2023-08-25T04:47:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.264+0000 7fd4dddff700 1 -- 172.21.15.72:0/593453193 --> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4d80c5100 con 0x7fd4c406a0e0 2023-08-25T04:47:33.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.273+0000 7fd4bffff700 1 -- 172.21.15.72:0/593453193 <== mgr.4101 v2:172.21.15.72:6832/1377484023 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311242 (secure 0 0 0) 0x7fd4c8011840 con 0x7fd4c406a0e0 2023-08-25T04:47:33.277 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:33.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.277+0000 7fd4dddff700 1 -- 172.21.15.72:0/593453193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd4c406a0e0 msgr2=0x7fd4c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:33.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.277+0000 7fd4dddff700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd4c406a0e0 0x7fd4c406c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8154870 tx=0x7fd4c8009210 comp rx=0 tx=0).stop 2023-08-25T04:47:33.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.277+0000 7fd4dddff700 1 -- 172.21.15.72:0/593453193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80ce3c0 msgr2=0x7fd4d815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:33.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.277+0000 7fd4dddff700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80ce3c0 0x7fd4d815c370 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0011e0 tx=0x7fd4cc00ca30 comp rx=0 tx=0).stop 2023-08-25T04:47:33.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.277+0000 7fd4dddff700 1 -- 172.21.15.72:0/593453193 shutdown_connections 2023-08-25T04:47:33.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.277+0000 7fd4dddff700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd4c406a0e0 0x7fd4c406c5a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:33.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.277+0000 7fd4dddff700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4d8159b90 0x7fd4d815c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:33.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.277+0000 7fd4dddff700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4d80b0ab0 0x7fd4d814e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:33.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.277+0000 7fd4dddff700 1 --2- 172.21.15.72:0/593453193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d80ce3c0 0x7fd4d815c370 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:33.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.277+0000 7fd4dddff700 1 -- 172.21.15.72:0/593453193 >> 172.21.15.72:0/593453193 conn(0x7fd4d80ce990 msgr2=0x7fd4d8072df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:33.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.278+0000 7fd4dddff700 1 -- 172.21.15.72:0/593453193 shutdown_connections 2023-08-25T04:47:33.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:33.278+0000 7fd4dddff700 1 -- 172.21.15.72:0/593453193 wait complete. 2023-08-25T04:47:33.281 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-25T04:47:33.297 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-08-25T04:47:31.884784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221020,"kb_used_data":4836,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753700,"statfs":{"total":773094113280,"available":772867788800,"internally_reserved":0,"allocated":4952064,"data_stored":2853716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000963"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294603+0000","last_change":"2023-08-25T04:47:26.982995+0000","last_active":"2023-08-25T04:47:28.294603+0000","last_peered":"2023-08-25T04:47:28.294603+0000","last_clean":"2023-08-25T04:47:28.294603+0000","last_became_active":"2023-08-25T04:47:26.982727+0000","last_became_peered":"2023-08-25T04:47:26.982727+0000","last_unstale":"2023-08-25T04:47:28.294603+0000","last_undegraded":"2023-08-25T04:47:28.294603+0000","last_fullsized":"2023-08-25T04:47:28.294603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:53.481683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341037+0000","last_change":"2023-08-25T04:47:26.988003+0000","last_active":"2023-08-25T04:47:28.341037+0000","last_peered":"2023-08-25T04:47:28.341037+0000","last_clean":"2023-08-25T04:47:28.341037+0000","last_became_active":"2023-08-25T04:47:26.987700+0000","last_became_peered":"2023-08-25T04:47:26.987700+0000","last_unstale":"2023-08-25T04:47:28.341037+0000","last_undegraded":"2023-08-25T04:47:28.341037+0000","last_fullsized":"2023-08-25T04:47:28.341037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:53:43.139603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975585+0000","last_change":"2023-08-25T04:47:26.978024+0000","last_active":"2023-08-25T04:47:27.975585+0000","last_peered":"2023-08-25T04:47:27.975585+0000","last_clean":"2023-08-25T04:47:27.975585+0000","last_became_active":"2023-08-25T04:47:26.977730+0000","last_became_peered":"2023-08-25T04:47:26.977730+0000","last_unstale":"2023-08-25T04:47:27.975585+0000","last_undegraded":"2023-08-25T04:47:27.975585+0000","last_fullsized":"2023-08-25T04:47:27.975585+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:41.065771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341618+0000","last_change":"2023-08-25T04:47:26.989008+0000","last_active":"2023-08-25T04:47:28.341618+0000","last_peered":"2023-08-25T04:47:28.341618+0000","last_clean":"2023-08-25T04:47:28.341618+0000","last_became_active":"2023-08-25T04:47:26.988744+0000","last_became_peered":"2023-08-25T04:47:26.988744+0000","last_unstale":"2023-08-25T04:47:28.341618+0000","last_undegraded":"2023-08-25T04:47:28.341618+0000","last_fullsized":"2023-08-25T04:47:28.341618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:36.006069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340966+0000","last_change":"2023-08-25T04:47:26.988400+0000","last_active":"2023-08-25T04:47:28.340966+0000","last_peered":"2023-08-25T04:47:28.340966+0000","last_clean":"2023-08-25T04:47:28.340966+0000","last_became_active":"2023-08-25T04:47:26.987934+0000","last_became_peered":"2023-08-25T04:47:26.987934+0000","last_unstale":"2023-08-25T04:47:28.340966+0000","last_undegraded":"2023-08-25T04:47:28.340966+0000","last_fullsized":"2023-08-25T04:47:28.340966+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:32:36.570940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340954+0000","last_change":"2023-08-25T04:47:26.981019+0000","last_active":"2023-08-25T04:47:28.340954+0000","last_peered":"2023-08-25T04:47:28.340954+0000","last_clean":"2023-08-25T04:47:28.340954+0000","last_became_active":"2023-08-25T04:47:26.980380+0000","last_became_peered":"2023-08-25T04:47:26.980380+0000","last_unstale":"2023-08-25T04:47:28.340954+0000","last_undegraded":"2023-08-25T04:47:28.340954+0000","last_fullsized":"2023-08-25T04:47:28.340954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:45:55.400195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294060+0000","last_change":"2023-08-25T04:47:26.985656+0000","last_active":"2023-08-25T04:47:28.294060+0000","last_peered":"2023-08-25T04:47:28.294060+0000","last_clean":"2023-08-25T04:47:28.294060+0000","last_became_active":"2023-08-25T04:47:26.985393+0000","last_became_peered":"2023-08-25T04:47:26.985393+0000","last_unstale":"2023-08-25T04:47:28.294060+0000","last_undegraded":"2023-08-25T04:47:28.294060+0000","last_fullsized":"2023-08-25T04:47:28.294060+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:36.006069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340524+0000","last_change":"2023-08-25T04:47:26.985469+0000","last_active":"2023-08-25T04:47:28.340524+0000","last_peered":"2023-08-25T04:47:28.340524+0000","last_clean":"2023-08-25T04:47:28.340524+0000","last_became_active":"2023-08-25T04:47:26.985070+0000","last_became_peered":"2023-08-25T04:47:26.985070+0000","last_unstale":"2023-08-25T04:47:28.340524+0000","last_undegraded":"2023-08-25T04:47:28.340524+0000","last_fullsized":"2023-08-25T04:47:28.340524+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:53:43.139603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340976+0000","last_change":"2023-08-25T04:47:26.985447+0000","last_active":"2023-08-25T04:47:28.340976+0000","last_peered":"2023-08-25T04:47:28.340976+0000","last_clean":"2023-08-25T04:47:28.340976+0000","last_became_active":"2023-08-25T04:47:26.984958+0000","last_became_peered":"2023-08-25T04:47:26.984958+0000","last_unstale":"2023-08-25T04:47:28.340976+0000","last_undegraded":"2023-08-25T04:47:28.340976+0000","last_fullsized":"2023-08-25T04:47:28.340976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:11:55.009324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341478+0000","last_change":"2023-08-25T04:47:26.987892+0000","last_active":"2023-08-25T04:47:28.341478+0000","last_peered":"2023-08-25T04:47:28.341478+0000","last_clean":"2023-08-25T04:47:28.341478+0000","last_became_active":"2023-08-25T04:47:26.987056+0000","last_became_peered":"2023-08-25T04:47:26.987056+0000","last_unstale":"2023-08-25T04:47:28.341478+0000","last_undegraded":"2023-08-25T04:47:28.341478+0000","last_fullsized":"2023-08-25T04:47:28.341478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:45:40.705043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341177+0000","last_change":"2023-08-25T04:47:26.985842+0000","last_active":"2023-08-25T04:47:28.341177+0000","last_peered":"2023-08-25T04:47:28.341177+0000","last_clean":"2023-08-25T04:47:28.341177+0000","last_became_active":"2023-08-25T04:47:26.985578+0000","last_became_peered":"2023-08-25T04:47:26.985578+0000","last_unstale":"2023-08-25T04:47:28.341177+0000","last_undegraded":"2023-08-25T04:47:28.341177+0000","last_fullsized":"2023-08-25T04:47:28.341177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:55.346115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341050+0000","last_change":"2023-08-25T04:47:26.983685+0000","last_active":"2023-08-25T04:47:28.341050+0000","last_peered":"2023-08-25T04:47:28.341050+0000","last_clean":"2023-08-25T04:47:28.341050+0000","last_became_active":"2023-08-25T04:47:26.983422+0000","last_became_peered":"2023-08-25T04:47:26.983422+0000","last_unstale":"2023-08-25T04:47:28.341050+0000","last_undegraded":"2023-08-25T04:47:28.341050+0000","last_fullsized":"2023-08-25T04:47:28.341050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:57.393362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976282+0000","last_change":"2023-08-25T04:47:26.977763+0000","last_active":"2023-08-25T04:47:27.976282+0000","last_peered":"2023-08-25T04:47:27.976282+0000","last_clean":"2023-08-25T04:47:27.976282+0000","last_became_active":"2023-08-25T04:47:26.977388+0000","last_became_peered":"2023-08-25T04:47:26.977388+0000","last_unstale":"2023-08-25T04:47:27.976282+0000","last_undegraded":"2023-08-25T04:47:27.976282+0000","last_fullsized":"2023-08-25T04:47:27.976282+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:45.092836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340791+0000","last_change":"2023-08-25T04:47:26.981972+0000","last_active":"2023-08-25T04:47:28.340791+0000","last_peered":"2023-08-25T04:47:28.340791+0000","last_clean":"2023-08-25T04:47:28.340791+0000","last_became_active":"2023-08-25T04:47:26.981708+0000","last_became_peered":"2023-08-25T04:47:26.981708+0000","last_unstale":"2023-08-25T04:47:28.340791+0000","last_undegraded":"2023-08-25T04:47:28.340791+0000","last_fullsized":"2023-08-25T04:47:28.340791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:49.812067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340649+0000","last_change":"2023-08-25T04:47:26.977754+0000","last_active":"2023-08-25T04:47:28.340649+0000","last_peered":"2023-08-25T04:47:28.340649+0000","last_clean":"2023-08-25T04:47:28.340649+0000","last_became_active":"2023-08-25T04:47:26.977351+0000","last_became_peered":"2023-08-25T04:47:26.977351+0000","last_unstale":"2023-08-25T04:47:28.340649+0000","last_undegraded":"2023-08-25T04:47:28.340649+0000","last_fullsized":"2023-08-25T04:47:28.340649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:38:12.076567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341670+0000","last_change":"2023-08-25T04:47:26.988892+0000","last_active":"2023-08-25T04:47:28.341670+0000","last_peered":"2023-08-25T04:47:28.341670+0000","last_clean":"2023-08-25T04:47:28.341670+0000","last_became_active":"2023-08-25T04:47:26.988572+0000","last_became_peered":"2023-08-25T04:47:26.988572+0000","last_unstale":"2023-08-25T04:47:28.341670+0000","last_undegraded":"2023-08-25T04:47:28.341670+0000","last_fullsized":"2023-08-25T04:47:28.341670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:20.446754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975794+0000","last_change":"2023-08-25T04:47:26.984861+0000","last_active":"2023-08-25T04:47:27.975794+0000","last_peered":"2023-08-25T04:47:27.975794+0000","last_clean":"2023-08-25T04:47:27.975794+0000","last_became_active":"2023-08-25T04:47:26.984585+0000","last_became_peered":"2023-08-25T04:47:26.984585+0000","last_unstale":"2023-08-25T04:47:27.975794+0000","last_undegraded":"2023-08-25T04:47:27.975794+0000","last_fullsized":"2023-08-25T04:47:27.975794+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:03.461961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975688+0000","last_change":"2023-08-25T04:47:26.990440+0000","last_active":"2023-08-25T04:47:27.975688+0000","last_peered":"2023-08-25T04:47:27.975688+0000","last_clean":"2023-08-25T04:47:27.975688+0000","last_became_active":"2023-08-25T04:47:26.989788+0000","last_became_peered":"2023-08-25T04:47:26.989788+0000","last_unstale":"2023-08-25T04:47:27.975688+0000","last_undegraded":"2023-08-25T04:47:27.975688+0000","last_fullsized":"2023-08-25T04:47:27.975688+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:28:36.259995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341887+0000","last_change":"2023-08-25T04:47:26.989865+0000","last_active":"2023-08-25T04:47:28.341887+0000","last_peered":"2023-08-25T04:47:28.341887+0000","last_clean":"2023-08-25T04:47:28.341887+0000","last_became_active":"2023-08-25T04:47:26.989231+0000","last_became_peered":"2023-08-25T04:47:26.989231+0000","last_unstale":"2023-08-25T04:47:28.341887+0000","last_undegraded":"2023-08-25T04:47:28.341887+0000","last_fullsized":"2023-08-25T04:47:28.341887+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:22.682596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976338+0000","last_change":"2023-08-25T04:47:26.988384+0000","last_active":"2023-08-25T04:47:27.976338+0000","last_peered":"2023-08-25T04:47:27.976338+0000","last_clean":"2023-08-25T04:47:27.976338+0000","last_became_active":"2023-08-25T04:47:26.988017+0000","last_became_peered":"2023-08-25T04:47:26.988017+0000","last_unstale":"2023-08-25T04:47:27.976338+0000","last_undegraded":"2023-08-25T04:47:27.976338+0000","last_fullsized":"2023-08-25T04:47:27.976338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:38:10.143520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341036+0000","last_change":"2023-08-25T04:47:26.978324+0000","last_active":"2023-08-25T04:47:28.341036+0000","last_peered":"2023-08-25T04:47:28.341036+0000","last_clean":"2023-08-25T04:47:28.341036+0000","last_became_active":"2023-08-25T04:47:26.978012+0000","last_became_peered":"2023-08-25T04:47:26.978012+0000","last_unstale":"2023-08-25T04:47:28.341036+0000","last_undegraded":"2023-08-25T04:47:28.341036+0000","last_fullsized":"2023-08-25T04:47:28.341036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:29:05.010756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340905+0000","last_change":"2023-08-25T04:47:26.987052+0000","last_active":"2023-08-25T04:47:28.340905+0000","last_peered":"2023-08-25T04:47:28.340905+0000","last_clean":"2023-08-25T04:47:28.340905+0000","last_became_active":"2023-08-25T04:47:26.986724+0000","last_became_peered":"2023-08-25T04:47:26.986724+0000","last_unstale":"2023-08-25T04:47:28.340905+0000","last_undegraded":"2023-08-25T04:47:28.340905+0000","last_fullsized":"2023-08-25T04:47:28.340905+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:50.544585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341883+0000","last_change":"2023-08-25T04:47:26.977397+0000","last_active":"2023-08-25T04:47:28.341883+0000","last_peered":"2023-08-25T04:47:28.341883+0000","last_clean":"2023-08-25T04:47:28.341883+0000","last_became_active":"2023-08-25T04:47:26.977090+0000","last_became_peered":"2023-08-25T04:47:26.977090+0000","last_unstale":"2023-08-25T04:47:28.341883+0000","last_undegraded":"2023-08-25T04:47:28.341883+0000","last_fullsized":"2023-08-25T04:47:28.341883+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:21.083145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341643+0000","last_change":"2023-08-25T04:47:26.981380+0000","last_active":"2023-08-25T04:47:28.341643+0000","last_peered":"2023-08-25T04:47:28.341643+0000","last_clean":"2023-08-25T04:47:28.341643+0000","last_became_active":"2023-08-25T04:47:26.978223+0000","last_became_peered":"2023-08-25T04:47:26.978223+0000","last_unstale":"2023-08-25T04:47:28.341643+0000","last_undegraded":"2023-08-25T04:47:28.341643+0000","last_fullsized":"2023-08-25T04:47:28.341643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:46:29.811351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342454+0000","last_change":"2023-08-25T04:47:26.981535+0000","last_active":"2023-08-25T04:47:28.342454+0000","last_peered":"2023-08-25T04:47:28.342454+0000","last_clean":"2023-08-25T04:47:28.342454+0000","last_became_active":"2023-08-25T04:47:26.978209+0000","last_became_peered":"2023-08-25T04:47:26.978209+0000","last_unstale":"2023-08-25T04:47:28.342454+0000","last_undegraded":"2023-08-25T04:47:28.342454+0000","last_fullsized":"2023-08-25T04:47:28.342454+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:48:23.597645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976508+0000","last_change":"2023-08-25T04:47:26.978254+0000","last_active":"2023-08-25T04:47:27.976508+0000","last_peered":"2023-08-25T04:47:27.976508+0000","last_clean":"2023-08-25T04:47:27.976508+0000","last_became_active":"2023-08-25T04:47:26.977832+0000","last_became_peered":"2023-08-25T04:47:26.977832+0000","last_unstale":"2023-08-25T04:47:27.976508+0000","last_undegraded":"2023-08-25T04:47:27.976508+0000","last_fullsized":"2023-08-25T04:47:27.976508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:14:53.241633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975542+0000","last_change":"2023-08-25T04:47:26.980662+0000","last_active":"2023-08-25T04:47:27.975542+0000","last_peered":"2023-08-25T04:47:27.975542+0000","last_clean":"2023-08-25T04:47:27.975542+0000","last_became_active":"2023-08-25T04:47:26.980361+0000","last_became_peered":"2023-08-25T04:47:26.980361+0000","last_unstale":"2023-08-25T04:47:27.975542+0000","last_undegraded":"2023-08-25T04:47:27.975542+0000","last_fullsized":"2023-08-25T04:47:27.975542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:16:57.255524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341121+0000","last_change":"2023-08-25T04:47:26.983735+0000","last_active":"2023-08-25T04:47:28.341121+0000","last_peered":"2023-08-25T04:47:28.341121+0000","last_clean":"2023-08-25T04:47:28.341121+0000","last_became_active":"2023-08-25T04:47:26.983039+0000","last_became_peered":"2023-08-25T04:47:26.983039+0000","last_unstale":"2023-08-25T04:47:28.341121+0000","last_undegraded":"2023-08-25T04:47:28.341121+0000","last_fullsized":"2023-08-25T04:47:28.341121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:16.891540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342087+0000","last_change":"2023-08-25T04:47:26.977939+0000","last_active":"2023-08-25T04:47:28.342087+0000","last_peered":"2023-08-25T04:47:28.342087+0000","last_clean":"2023-08-25T04:47:28.342087+0000","last_became_active":"2023-08-25T04:47:26.977257+0000","last_became_peered":"2023-08-25T04:47:26.977257+0000","last_unstale":"2023-08-25T04:47:28.342087+0000","last_undegraded":"2023-08-25T04:47:28.342087+0000","last_fullsized":"2023-08-25T04:47:28.342087+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:10.965788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975485+0000","last_change":"2023-08-25T04:47:26.976981+0000","last_active":"2023-08-25T04:47:27.975485+0000","last_peered":"2023-08-25T04:47:27.975485+0000","last_clean":"2023-08-25T04:47:27.975485+0000","last_became_active":"2023-08-25T04:47:26.976612+0000","last_became_peered":"2023-08-25T04:47:26.976612+0000","last_unstale":"2023-08-25T04:47:27.975485+0000","last_undegraded":"2023-08-25T04:47:27.975485+0000","last_fullsized":"2023-08-25T04:47:27.975485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:36:46.894406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340528+0000","last_change":"2023-08-25T04:47:26.969444+0000","last_active":"2023-08-25T04:47:28.340528+0000","last_peered":"2023-08-25T04:47:28.340528+0000","last_clean":"2023-08-25T04:47:28.340528+0000","last_became_active":"2023-08-25T04:47:26.969173+0000","last_became_peered":"2023-08-25T04:47:26.969173+0000","last_unstale":"2023-08-25T04:47:28.340528+0000","last_undegraded":"2023-08-25T04:47:28.340528+0000","last_fullsized":"2023-08-25T04:47:28.340528+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:47.277439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976154+0000","last_change":"2023-08-25T04:47:26.978554+0000","last_active":"2023-08-25T04:47:27.976154+0000","last_peered":"2023-08-25T04:47:27.976154+0000","last_clean":"2023-08-25T04:47:27.976154+0000","last_became_active":"2023-08-25T04:47:26.978262+0000","last_became_peered":"2023-08-25T04:47:26.978262+0000","last_unstale":"2023-08-25T04:47:27.976154+0000","last_undegraded":"2023-08-25T04:47:27.976154+0000","last_fullsized":"2023-08-25T04:47:27.976154+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:05:20.610402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977668+0000","last_change":"2023-08-25T04:47:26.974422+0000","last_active":"2023-08-25T04:47:27.977668+0000","last_peered":"2023-08-25T04:47:27.977668+0000","last_clean":"2023-08-25T04:47:27.977668+0000","last_became_active":"2023-08-25T04:47:26.974160+0000","last_became_peered":"2023-08-25T04:47:26.974160+0000","last_unstale":"2023-08-25T04:47:27.977668+0000","last_undegraded":"2023-08-25T04:47:27.977668+0000","last_fullsized":"2023-08-25T04:47:27.977668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:31.957260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341549+0000","last_change":"2023-08-25T04:47:25.980609+0000","last_active":"2023-08-25T04:47:28.341549+0000","last_peered":"2023-08-25T04:47:28.341549+0000","last_clean":"2023-08-25T04:47:28.341549+0000","last_became_active":"2023-08-25T04:47:25.980263+0000","last_became_peered":"2023-08-25T04:47:25.980263+0000","last_unstale":"2023-08-25T04:47:28.341549+0000","last_undegraded":"2023-08-25T04:47:28.341549+0000","last_fullsized":"2023-08-25T04:47:28.341549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:01:06.959657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342080+0000","last_change":"2023-08-25T04:47:26.982572+0000","last_active":"2023-08-25T04:47:28.342080+0000","last_peered":"2023-08-25T04:47:28.342080+0000","last_clean":"2023-08-25T04:47:28.342080+0000","last_became_active":"2023-08-25T04:47:26.982111+0000","last_became_peered":"2023-08-25T04:47:26.982111+0000","last_unstale":"2023-08-25T04:47:28.342080+0000","last_undegraded":"2023-08-25T04:47:28.342080+0000","last_fullsized":"2023-08-25T04:47:28.342080+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:59.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975855+0000","last_change":"2023-08-25T04:47:25.978241+0000","last_active":"2023-08-25T04:47:27.975855+0000","last_peered":"2023-08-25T04:47:27.975855+0000","last_clean":"2023-08-25T04:47:27.975855+0000","last_became_active":"2023-08-25T04:47:25.977884+0000","last_became_peered":"2023-08-25T04:47:25.977884+0000","last_unstale":"2023-08-25T04:47:27.975855+0000","last_undegraded":"2023-08-25T04:47:27.975855+0000","last_fullsized":"2023-08-25T04:47:27.975855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:27.621536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341255+0000","last_change":"2023-08-25T04:47:26.978961+0000","last_active":"2023-08-25T04:47:28.341255+0000","last_peered":"2023-08-25T04:47:28.341255+0000","last_clean":"2023-08-25T04:47:28.341255+0000","last_became_active":"2023-08-25T04:47:26.978321+0000","last_became_peered":"2023-08-25T04:47:26.978321+0000","last_unstale":"2023-08-25T04:47:28.341255+0000","last_undegraded":"2023-08-25T04:47:28.341255+0000","last_fullsized":"2023-08-25T04:47:28.341255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:44.538494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977652+0000","last_change":"2023-08-25T04:47:25.976559+0000","last_active":"2023-08-25T04:47:27.977652+0000","last_peered":"2023-08-25T04:47:27.977652+0000","last_clean":"2023-08-25T04:47:27.977652+0000","last_became_active":"2023-08-25T04:47:25.976228+0000","last_became_peered":"2023-08-25T04:47:25.976228+0000","last_unstale":"2023-08-25T04:47:27.977652+0000","last_undegraded":"2023-08-25T04:47:27.977652+0000","last_fullsized":"2023-08-25T04:47:27.977652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:09.879462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977515+0000","last_change":"2023-08-25T04:47:26.968523+0000","last_active":"2023-08-25T04:47:27.977515+0000","last_peered":"2023-08-25T04:47:27.977515+0000","last_clean":"2023-08-25T04:47:27.977515+0000","last_became_active":"2023-08-25T04:47:26.968257+0000","last_became_peered":"2023-08-25T04:47:26.968257+0000","last_unstale":"2023-08-25T04:47:27.977515+0000","last_undegraded":"2023-08-25T04:47:27.977515+0000","last_fullsized":"2023-08-25T04:47:27.977515+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:31.140867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294287+0000","last_change":"2023-08-25T04:47:25.976878+0000","last_active":"2023-08-25T04:47:28.294287+0000","last_peered":"2023-08-25T04:47:28.294287+0000","last_clean":"2023-08-25T04:47:28.294287+0000","last_became_active":"2023-08-25T04:47:25.976504+0000","last_became_peered":"2023-08-25T04:47:25.976504+0000","last_unstale":"2023-08-25T04:47:28.294287+0000","last_undegraded":"2023-08-25T04:47:28.294287+0000","last_fullsized":"2023-08-25T04:47:28.294287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:46:02.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975487+0000","last_change":"2023-08-25T04:47:26.985387+0000","last_active":"2023-08-25T04:47:27.975487+0000","last_peered":"2023-08-25T04:47:27.975487+0000","last_clean":"2023-08-25T04:47:27.975487+0000","last_became_active":"2023-08-25T04:47:26.985122+0000","last_became_peered":"2023-08-25T04:47:26.985122+0000","last_unstale":"2023-08-25T04:47:27.975487+0000","last_undegraded":"2023-08-25T04:47:27.975487+0000","last_fullsized":"2023-08-25T04:47:27.975487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:27.798939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341423+0000","last_change":"2023-08-25T04:47:25.979893+0000","last_active":"2023-08-25T04:47:28.341423+0000","last_peered":"2023-08-25T04:47:28.341423+0000","last_clean":"2023-08-25T04:47:28.341423+0000","last_became_active":"2023-08-25T04:47:25.979617+0000","last_became_peered":"2023-08-25T04:47:25.979617+0000","last_unstale":"2023-08-25T04:47:28.341423+0000","last_undegraded":"2023-08-25T04:47:28.341423+0000","last_fullsized":"2023-08-25T04:47:28.341423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:11:16.172391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341251+0000","last_change":"2023-08-25T04:47:26.986407+0000","last_active":"2023-08-25T04:47:28.341251+0000","last_peered":"2023-08-25T04:47:28.341251+0000","last_clean":"2023-08-25T04:47:28.341251+0000","last_became_active":"2023-08-25T04:47:26.986108+0000","last_became_peered":"2023-08-25T04:47:26.986108+0000","last_unstale":"2023-08-25T04:47:28.341251+0000","last_undegraded":"2023-08-25T04:47:28.341251+0000","last_fullsized":"2023-08-25T04:47:28.341251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:05:14.141084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975703+0000","last_change":"2023-08-25T04:47:25.978780+0000","last_active":"2023-08-25T04:47:27.975703+0000","last_peered":"2023-08-25T04:47:27.975703+0000","last_clean":"2023-08-25T04:47:27.975703+0000","last_became_active":"2023-08-25T04:47:25.978452+0000","last_became_peered":"2023-08-25T04:47:25.978452+0000","last_unstale":"2023-08-25T04:47:27.975703+0000","last_undegraded":"2023-08-25T04:47:27.975703+0000","last_fullsized":"2023-08-25T04:47:27.975703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:32:01.383995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340590+0000","last_change":"2023-08-25T04:47:26.984823+0000","last_active":"2023-08-25T04:47:28.340590+0000","last_peered":"2023-08-25T04:47:28.340590+0000","last_clean":"2023-08-25T04:47:28.340590+0000","last_became_active":"2023-08-25T04:47:26.984411+0000","last_became_peered":"2023-08-25T04:47:26.984411+0000","last_unstale":"2023-08-25T04:47:28.340590+0000","last_undegraded":"2023-08-25T04:47:28.340590+0000","last_fullsized":"2023-08-25T04:47:28.340590+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:16.891540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340739+0000","last_change":"2023-08-25T04:47:25.975904+0000","last_active":"2023-08-25T04:47:28.340739+0000","last_peered":"2023-08-25T04:47:28.340739+0000","last_clean":"2023-08-25T04:47:28.340739+0000","last_became_active":"2023-08-25T04:47:25.975509+0000","last_became_peered":"2023-08-25T04:47:25.975509+0000","last_unstale":"2023-08-25T04:47:28.340739+0000","last_undegraded":"2023-08-25T04:47:28.340739+0000","last_fullsized":"2023-08-25T04:47:28.340739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:40.923779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341920+0000","last_change":"2023-08-25T04:47:26.977244+0000","last_active":"2023-08-25T04:47:28.341920+0000","last_peered":"2023-08-25T04:47:28.341920+0000","last_clean":"2023-08-25T04:47:28.341920+0000","last_became_active":"2023-08-25T04:47:26.976972+0000","last_became_peered":"2023-08-25T04:47:26.976972+0000","last_unstale":"2023-08-25T04:47:28.341920+0000","last_undegraded":"2023-08-25T04:47:28.341920+0000","last_fullsized":"2023-08-25T04:47:28.341920+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:07:19.646305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340652+0000","last_change":"2023-08-25T04:47:25.971325+0000","last_active":"2023-08-25T04:47:28.340652+0000","last_peered":"2023-08-25T04:47:28.340652+0000","last_clean":"2023-08-25T04:47:28.340652+0000","last_became_active":"2023-08-25T04:47:25.971037+0000","last_became_peered":"2023-08-25T04:47:25.971037+0000","last_unstale":"2023-08-25T04:47:28.340652+0000","last_undegraded":"2023-08-25T04:47:28.340652+0000","last_fullsized":"2023-08-25T04:47:28.340652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:43.527432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975781+0000","last_change":"2023-08-25T04:47:26.990654+0000","last_active":"2023-08-25T04:47:27.975781+0000","last_peered":"2023-08-25T04:47:27.975781+0000","last_clean":"2023-08-25T04:47:27.975781+0000","last_became_active":"2023-08-25T04:47:26.990126+0000","last_became_peered":"2023-08-25T04:47:26.990126+0000","last_unstale":"2023-08-25T04:47:27.975781+0000","last_undegraded":"2023-08-25T04:47:27.975781+0000","last_fullsized":"2023-08-25T04:47:27.975781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:55:53.634899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975930+0000","last_change":"2023-08-25T04:47:25.971687+0000","last_active":"2023-08-25T04:47:27.975930+0000","last_peered":"2023-08-25T04:47:27.975930+0000","last_clean":"2023-08-25T04:47:27.975930+0000","last_became_active":"2023-08-25T04:47:25.971381+0000","last_became_peered":"2023-08-25T04:47:25.971381+0000","last_unstale":"2023-08-25T04:47:27.975930+0000","last_undegraded":"2023-08-25T04:47:27.975930+0000","last_fullsized":"2023-08-25T04:47:27.975930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:09:34.650925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294521+0000","last_change":"2023-08-25T04:47:26.986097+0000","last_active":"2023-08-25T04:47:28.294521+0000","last_peered":"2023-08-25T04:47:28.294521+0000","last_clean":"2023-08-25T04:47:28.294521+0000","last_became_active":"2023-08-25T04:47:26.985775+0000","last_became_peered":"2023-08-25T04:47:26.985775+0000","last_unstale":"2023-08-25T04:47:28.294521+0000","last_undegraded":"2023-08-25T04:47:28.294521+0000","last_fullsized":"2023-08-25T04:47:28.294521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:29.201880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341595+0000","last_change":"2023-08-25T04:47:25.971366+0000","last_active":"2023-08-25T04:47:28.341595+0000","last_peered":"2023-08-25T04:47:28.341595+0000","last_clean":"2023-08-25T04:47:28.341595+0000","last_became_active":"2023-08-25T04:47:25.971008+0000","last_became_peered":"2023-08-25T04:47:25.971008+0000","last_unstale":"2023-08-25T04:47:28.341595+0000","last_undegraded":"2023-08-25T04:47:28.341595+0000","last_fullsized":"2023-08-25T04:47:28.341595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:15.719795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340862+0000","last_change":"2023-08-25T04:47:26.982459+0000","last_active":"2023-08-25T04:47:28.340862+0000","last_peered":"2023-08-25T04:47:28.340862+0000","last_clean":"2023-08-25T04:47:28.340862+0000","last_became_active":"2023-08-25T04:47:26.982167+0000","last_became_peered":"2023-08-25T04:47:26.982167+0000","last_unstale":"2023-08-25T04:47:28.340862+0000","last_undegraded":"2023-08-25T04:47:28.340862+0000","last_fullsized":"2023-08-25T04:47:28.340862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:17:30.799221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294556+0000","last_change":"2023-08-25T04:47:25.976089+0000","last_active":"2023-08-25T04:47:28.294556+0000","last_peered":"2023-08-25T04:47:28.294556+0000","last_clean":"2023-08-25T04:47:28.294556+0000","last_became_active":"2023-08-25T04:47:25.975784+0000","last_became_peered":"2023-08-25T04:47:25.975784+0000","last_unstale":"2023-08-25T04:47:28.294556+0000","last_undegraded":"2023-08-25T04:47:28.294556+0000","last_fullsized":"2023-08-25T04:47:28.294556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:28:29.070405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294408+0000","last_change":"2023-08-25T04:47:26.985729+0000","last_active":"2023-08-25T04:47:28.294408+0000","last_peered":"2023-08-25T04:47:28.294408+0000","last_clean":"2023-08-25T04:47:28.294408+0000","last_became_active":"2023-08-25T04:47:26.985443+0000","last_became_peered":"2023-08-25T04:47:26.985443+0000","last_unstale":"2023-08-25T04:47:28.294408+0000","last_undegraded":"2023-08-25T04:47:28.294408+0000","last_fullsized":"2023-08-25T04:47:28.294408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:43:19.454137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976535+0000","last_change":"2023-08-25T04:47:25.973449+0000","last_active":"2023-08-25T04:47:27.976535+0000","last_peered":"2023-08-25T04:47:27.976535+0000","last_clean":"2023-08-25T04:47:27.976535+0000","last_became_active":"2023-08-25T04:47:25.973163+0000","last_became_peered":"2023-08-25T04:47:25.973163+0000","last_unstale":"2023-08-25T04:47:27.976535+0000","last_undegraded":"2023-08-25T04:47:27.976535+0000","last_fullsized":"2023-08-25T04:47:27.976535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:01.040705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342289+0000","last_change":"2023-08-25T04:47:26.989632+0000","last_active":"2023-08-25T04:47:28.342289+0000","last_peered":"2023-08-25T04:47:28.342289+0000","last_clean":"2023-08-25T04:47:28.342289+0000","last_became_active":"2023-08-25T04:47:26.988893+0000","last_became_peered":"2023-08-25T04:47:26.988893+0000","last_unstale":"2023-08-25T04:47:28.342289+0000","last_undegraded":"2023-08-25T04:47:28.342289+0000","last_fullsized":"2023-08-25T04:47:28.342289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:23.475124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341274+0000","last_change":"2023-08-25T04:47:25.974503+0000","last_active":"2023-08-25T04:47:28.341274+0000","last_peered":"2023-08-25T04:47:28.341274+0000","last_clean":"2023-08-25T04:47:28.341274+0000","last_became_active":"2023-08-25T04:47:25.974229+0000","last_became_peered":"2023-08-25T04:47:25.974229+0000","last_unstale":"2023-08-25T04:47:28.341274+0000","last_undegraded":"2023-08-25T04:47:28.341274+0000","last_fullsized":"2023-08-25T04:47:28.341274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:59:46.261855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341299+0000","last_change":"2023-08-25T04:47:26.986856+0000","last_active":"2023-08-25T04:47:28.341299+0000","last_peered":"2023-08-25T04:47:28.341299+0000","last_clean":"2023-08-25T04:47:28.341299+0000","last_became_active":"2023-08-25T04:47:26.986593+0000","last_became_peered":"2023-08-25T04:47:26.986593+0000","last_unstale":"2023-08-25T04:47:28.341299+0000","last_undegraded":"2023-08-25T04:47:28.341299+0000","last_fullsized":"2023-08-25T04:47:28.341299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:55.854167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294249+0000","last_change":"2023-08-25T04:47:25.969371+0000","last_active":"2023-08-25T04:47:28.294249+0000","last_peered":"2023-08-25T04:47:28.294249+0000","last_clean":"2023-08-25T04:47:28.294249+0000","last_became_active":"2023-08-25T04:47:25.969053+0000","last_became_peered":"2023-08-25T04:47:25.969053+0000","last_unstale":"2023-08-25T04:47:28.294249+0000","last_undegraded":"2023-08-25T04:47:28.294249+0000","last_fullsized":"2023-08-25T04:47:28.294249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:42.347250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340525+0000","last_change":"2023-08-25T04:47:26.966638+0000","last_active":"2023-08-25T04:47:28.340525+0000","last_peered":"2023-08-25T04:47:28.340525+0000","last_clean":"2023-08-25T04:47:28.340525+0000","last_became_active":"2023-08-25T04:47:26.966357+0000","last_became_peered":"2023-08-25T04:47:26.966357+0000","last_unstale":"2023-08-25T04:47:28.340525+0000","last_undegraded":"2023-08-25T04:47:28.340525+0000","last_fullsized":"2023-08-25T04:47:28.340525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:26:49.336901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340955+0000","last_change":"2023-08-25T04:47:25.975122+0000","last_active":"2023-08-25T04:47:28.340955+0000","last_peered":"2023-08-25T04:47:28.340955+0000","last_clean":"2023-08-25T04:47:28.340955+0000","last_became_active":"2023-08-25T04:47:25.974779+0000","last_became_peered":"2023-08-25T04:47:25.974779+0000","last_unstale":"2023-08-25T04:47:28.340955+0000","last_undegraded":"2023-08-25T04:47:28.340955+0000","last_fullsized":"2023-08-25T04:47:28.340955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:04:34.933981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294245+0000","last_change":"2023-08-25T04:47:26.985086+0000","last_active":"2023-08-25T04:47:28.294245+0000","last_peered":"2023-08-25T04:47:28.294245+0000","last_clean":"2023-08-25T04:47:28.294245+0000","last_became_active":"2023-08-25T04:47:26.984816+0000","last_became_peered":"2023-08-25T04:47:26.984816+0000","last_unstale":"2023-08-25T04:47:28.294245+0000","last_undegraded":"2023-08-25T04:47:28.294245+0000","last_fullsized":"2023-08-25T04:47:28.294245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:49.216946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340713+0000","last_change":"2023-08-25T04:47:25.971179+0000","last_active":"2023-08-25T04:47:28.340713+0000","last_peered":"2023-08-25T04:47:28.340713+0000","last_clean":"2023-08-25T04:47:28.340713+0000","last_became_active":"2023-08-25T04:47:25.970906+0000","last_became_peered":"2023-08-25T04:47:25.970906+0000","last_unstale":"2023-08-25T04:47:28.340713+0000","last_undegraded":"2023-08-25T04:47:28.340713+0000","last_fullsized":"2023-08-25T04:47:28.340713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:30:08.454351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976432+0000","last_change":"2023-08-25T04:47:26.978084+0000","last_active":"2023-08-25T04:47:27.976432+0000","last_peered":"2023-08-25T04:47:27.976432+0000","last_clean":"2023-08-25T04:47:27.976432+0000","last_became_active":"2023-08-25T04:47:26.977503+0000","last_became_peered":"2023-08-25T04:47:26.977503+0000","last_unstale":"2023-08-25T04:47:27.976432+0000","last_undegraded":"2023-08-25T04:47:27.976432+0000","last_fullsized":"2023-08-25T04:47:27.976432+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:54.378367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976212+0000","last_change":"2023-08-25T04:47:25.975496+0000","last_active":"2023-08-25T04:47:27.976212+0000","last_peered":"2023-08-25T04:47:27.976212+0000","last_clean":"2023-08-25T04:47:27.976212+0000","last_became_active":"2023-08-25T04:47:25.975245+0000","last_became_peered":"2023-08-25T04:47:25.975245+0000","last_unstale":"2023-08-25T04:47:27.976212+0000","last_undegraded":"2023-08-25T04:47:27.976212+0000","last_fullsized":"2023-08-25T04:47:27.976212+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:14.912050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341105+0000","last_change":"2023-08-25T04:47:26.993959+0000","last_active":"2023-08-25T04:47:28.341105+0000","last_peered":"2023-08-25T04:47:28.341105+0000","last_clean":"2023-08-25T04:47:28.341105+0000","last_became_active":"2023-08-25T04:47:26.993698+0000","last_became_peered":"2023-08-25T04:47:26.993698+0000","last_unstale":"2023-08-25T04:47:28.341105+0000","last_undegraded":"2023-08-25T04:47:28.341105+0000","last_fullsized":"2023-08-25T04:47:28.341105+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:16:53.101551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975905+0000","last_change":"2023-08-25T04:47:25.972518+0000","last_active":"2023-08-25T04:47:27.975905+0000","last_peered":"2023-08-25T04:47:27.975905+0000","last_clean":"2023-08-25T04:47:27.975905+0000","last_became_active":"2023-08-25T04:47:25.972235+0000","last_became_peered":"2023-08-25T04:47:25.972235+0000","last_unstale":"2023-08-25T04:47:27.975905+0000","last_undegraded":"2023-08-25T04:47:27.975905+0000","last_fullsized":"2023-08-25T04:47:27.975905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:30.017074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342087+0000","last_change":"2023-08-25T04:47:26.974035+0000","last_active":"2023-08-25T04:47:28.342087+0000","last_peered":"2023-08-25T04:47:28.342087+0000","last_clean":"2023-08-25T04:47:28.342087+0000","last_became_active":"2023-08-25T04:47:26.973088+0000","last_became_peered":"2023-08-25T04:47:26.973088+0000","last_unstale":"2023-08-25T04:47:28.342087+0000","last_undegraded":"2023-08-25T04:47:28.342087+0000","last_fullsized":"2023-08-25T04:47:28.342087+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:44.067685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341130+0000","last_change":"2023-08-25T04:47:25.972042+0000","last_active":"2023-08-25T04:47:28.341130+0000","last_peered":"2023-08-25T04:47:28.341130+0000","last_clean":"2023-08-25T04:47:28.341130+0000","last_became_active":"2023-08-25T04:47:25.971712+0000","last_became_peered":"2023-08-25T04:47:25.971712+0000","last_unstale":"2023-08-25T04:47:28.341130+0000","last_undegraded":"2023-08-25T04:47:28.341130+0000","last_fullsized":"2023-08-25T04:47:28.341130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:49.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342277+0000","last_change":"2023-08-25T04:47:26.981715+0000","last_active":"2023-08-25T04:47:28.342277+0000","last_peered":"2023-08-25T04:47:28.342277+0000","last_clean":"2023-08-25T04:47:28.342277+0000","last_became_active":"2023-08-25T04:47:26.977826+0000","last_became_peered":"2023-08-25T04:47:26.977826+0000","last_unstale":"2023-08-25T04:47:28.342277+0000","last_undegraded":"2023-08-25T04:47:28.342277+0000","last_fullsized":"2023-08-25T04:47:28.342277+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:32.750816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341374+0000","last_change":"2023-08-25T04:47:25.980540+0000","last_active":"2023-08-25T04:47:28.341374+0000","last_peered":"2023-08-25T04:47:28.341374+0000","last_clean":"2023-08-25T04:47:28.341374+0000","last_became_active":"2023-08-25T04:47:25.980257+0000","last_became_peered":"2023-08-25T04:47:25.980257+0000","last_unstale":"2023-08-25T04:47:28.341374+0000","last_undegraded":"2023-08-25T04:47:28.341374+0000","last_fullsized":"2023-08-25T04:47:28.341374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:52.134514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340880+0000","last_change":"2023-08-25T04:47:26.981214+0000","last_active":"2023-08-25T04:47:28.340880+0000","last_peered":"2023-08-25T04:47:28.340880+0000","last_clean":"2023-08-25T04:47:28.340880+0000","last_became_active":"2023-08-25T04:47:26.980728+0000","last_became_peered":"2023-08-25T04:47:26.980728+0000","last_unstale":"2023-08-25T04:47:28.340880+0000","last_undegraded":"2023-08-25T04:47:28.340880+0000","last_fullsized":"2023-08-25T04:47:28.340880+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:58.970685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341303+0000","last_change":"2023-08-25T04:47:25.975365+0000","last_active":"2023-08-25T04:47:28.341303+0000","last_peered":"2023-08-25T04:47:28.341303+0000","last_clean":"2023-08-25T04:47:28.341303+0000","last_became_active":"2023-08-25T04:47:25.975108+0000","last_became_peered":"2023-08-25T04:47:25.975108+0000","last_unstale":"2023-08-25T04:47:28.341303+0000","last_undegraded":"2023-08-25T04:47:28.341303+0000","last_fullsized":"2023-08-25T04:47:28.341303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:47:33.402199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977230+0000","last_change":"2023-08-25T04:47:26.969633+0000","last_active":"2023-08-25T04:47:27.977230+0000","last_peered":"2023-08-25T04:47:27.977230+0000","last_clean":"2023-08-25T04:47:27.977230+0000","last_became_active":"2023-08-25T04:47:26.969363+0000","last_became_peered":"2023-08-25T04:47:26.969363+0000","last_unstale":"2023-08-25T04:47:27.977230+0000","last_undegraded":"2023-08-25T04:47:27.977230+0000","last_fullsized":"2023-08-25T04:47:27.977230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:07.022783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340778+0000","last_change":"2023-08-25T04:47:25.975363+0000","last_active":"2023-08-25T04:47:28.340778+0000","last_peered":"2023-08-25T04:47:28.340778+0000","last_clean":"2023-08-25T04:47:28.340778+0000","last_became_active":"2023-08-25T04:47:25.975084+0000","last_became_peered":"2023-08-25T04:47:25.975084+0000","last_unstale":"2023-08-25T04:47:28.340778+0000","last_undegraded":"2023-08-25T04:47:28.340778+0000","last_fullsized":"2023-08-25T04:47:28.340778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:58.243694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976283+0000","last_change":"2023-08-25T04:47:26.978269+0000","last_active":"2023-08-25T04:47:27.976283+0000","last_peered":"2023-08-25T04:47:27.976283+0000","last_clean":"2023-08-25T04:47:27.976283+0000","last_became_active":"2023-08-25T04:47:26.978005+0000","last_became_peered":"2023-08-25T04:47:26.978005+0000","last_unstale":"2023-08-25T04:47:27.976283+0000","last_undegraded":"2023-08-25T04:47:27.976283+0000","last_fullsized":"2023-08-25T04:47:27.976283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:52:04.634158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340919+0000","last_change":"2023-08-25T04:47:25.972001+0000","last_active":"2023-08-25T04:47:28.340919+0000","last_peered":"2023-08-25T04:47:28.340919+0000","last_clean":"2023-08-25T04:47:28.340919+0000","last_became_active":"2023-08-25T04:47:25.971700+0000","last_became_peered":"2023-08-25T04:47:25.971700+0000","last_unstale":"2023-08-25T04:47:28.340919+0000","last_undegraded":"2023-08-25T04:47:28.340919+0000","last_fullsized":"2023-08-25T04:47:28.340919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:58:46.076860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341066+0000","last_change":"2023-08-25T04:47:26.985686+0000","last_active":"2023-08-25T04:47:28.341066+0000","last_peered":"2023-08-25T04:47:28.341066+0000","last_clean":"2023-08-25T04:47:28.341066+0000","last_became_active":"2023-08-25T04:47:26.985426+0000","last_became_peered":"2023-08-25T04:47:26.985426+0000","last_unstale":"2023-08-25T04:47:28.341066+0000","last_undegraded":"2023-08-25T04:47:28.341066+0000","last_fullsized":"2023-08-25T04:47:28.341066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:00:35.491498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.293870+0000","last_change":"2023-08-25T04:47:25.972786+0000","last_active":"2023-08-25T04:47:28.293870+0000","last_peered":"2023-08-25T04:47:28.293870+0000","last_clean":"2023-08-25T04:47:28.293870+0000","last_became_active":"2023-08-25T04:47:25.972447+0000","last_became_peered":"2023-08-25T04:47:25.972447+0000","last_unstale":"2023-08-25T04:47:28.293870+0000","last_undegraded":"2023-08-25T04:47:28.293870+0000","last_fullsized":"2023-08-25T04:47:28.293870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:15.719795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341168+0000","last_change":"2023-08-25T04:47:26.981663+0000","last_active":"2023-08-25T04:47:28.341168+0000","last_peered":"2023-08-25T04:47:28.341168+0000","last_clean":"2023-08-25T04:47:28.341168+0000","last_became_active":"2023-08-25T04:47:26.981215+0000","last_became_peered":"2023-08-25T04:47:26.981215+0000","last_unstale":"2023-08-25T04:47:28.341168+0000","last_undegraded":"2023-08-25T04:47:28.341168+0000","last_fullsized":"2023-08-25T04:47:28.341168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:04.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975662+0000","last_change":"2023-08-25T04:47:25.974374+0000","last_active":"2023-08-25T04:47:27.975662+0000","last_peered":"2023-08-25T04:47:27.975662+0000","last_clean":"2023-08-25T04:47:27.975662+0000","last_became_active":"2023-08-25T04:47:25.974076+0000","last_became_peered":"2023-08-25T04:47:25.974076+0000","last_unstale":"2023-08-25T04:47:27.975662+0000","last_undegraded":"2023-08-25T04:47:27.975662+0000","last_fullsized":"2023-08-25T04:47:27.975662+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:55.920824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975670+0000","last_change":"2023-08-25T04:45:26.770775+0000","last_active":"2023-08-25T04:47:27.975670+0000","last_peered":"2023-08-25T04:47:27.975670+0000","last_clean":"2023-08-25T04:47:27.975670+0000","last_became_active":"2023-08-25T04:45:26.770447+0000","last_became_peered":"2023-08-25T04:45:26.770447+0000","last_unstale":"2023-08-25T04:47:27.975670+0000","last_undegraded":"2023-08-25T04:47:27.975670+0000","last_fullsized":"2023-08-25T04:47:27.975670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:05.207799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341007+0000","last_change":"2023-08-25T04:47:26.976963+0000","last_active":"2023-08-25T04:47:28.341007+0000","last_peered":"2023-08-25T04:47:28.341007+0000","last_clean":"2023-08-25T04:47:28.341007+0000","last_became_active":"2023-08-25T04:47:26.976708+0000","last_became_peered":"2023-08-25T04:47:26.976708+0000","last_unstale":"2023-08-25T04:47:28.341007+0000","last_undegraded":"2023-08-25T04:47:28.341007+0000","last_fullsized":"2023-08-25T04:47:28.341007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:20.114996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294474+0000","last_change":"2023-08-25T04:47:25.977339+0000","last_active":"2023-08-25T04:47:28.294474+0000","last_peered":"2023-08-25T04:47:28.294474+0000","last_clean":"2023-08-25T04:47:28.294474+0000","last_became_active":"2023-08-25T04:47:25.976992+0000","last_became_peered":"2023-08-25T04:47:25.976992+0000","last_unstale":"2023-08-25T04:47:28.294474+0000","last_undegraded":"2023-08-25T04:47:28.294474+0000","last_fullsized":"2023-08-25T04:47:28.294474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:25.928178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341453+0000","last_change":"2023-08-25T04:45:26.768222+0000","last_active":"2023-08-25T04:47:28.341453+0000","last_peered":"2023-08-25T04:47:28.341453+0000","last_clean":"2023-08-25T04:47:28.341453+0000","last_became_active":"2023-08-25T04:45:26.767875+0000","last_became_peered":"2023-08-25T04:45:26.767875+0000","last_unstale":"2023-08-25T04:47:28.341453+0000","last_undegraded":"2023-08-25T04:47:28.341453+0000","last_fullsized":"2023-08-25T04:47:28.341453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:43:48.980977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294423+0000","last_change":"2023-08-25T04:47:26.979143+0000","last_active":"2023-08-25T04:47:28.294423+0000","last_peered":"2023-08-25T04:47:28.294423+0000","last_clean":"2023-08-25T04:47:28.294423+0000","last_became_active":"2023-08-25T04:47:26.978851+0000","last_became_peered":"2023-08-25T04:47:26.978851+0000","last_unstale":"2023-08-25T04:47:28.294423+0000","last_undegraded":"2023-08-25T04:47:28.294423+0000","last_fullsized":"2023-08-25T04:47:28.294423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:55:55.890714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977190+0000","last_change":"2023-08-25T04:47:25.976678+0000","last_active":"2023-08-25T04:47:27.977190+0000","last_peered":"2023-08-25T04:47:27.977190+0000","last_clean":"2023-08-25T04:47:27.977190+0000","last_became_active":"2023-08-25T04:47:25.976396+0000","last_became_peered":"2023-08-25T04:47:25.976396+0000","last_unstale":"2023-08-25T04:47:27.977190+0000","last_undegraded":"2023-08-25T04:47:27.977190+0000","last_fullsized":"2023-08-25T04:47:27.977190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:02:43.618423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977309+0000","last_change":"2023-08-25T04:45:26.767948+0000","last_active":"2023-08-25T04:47:27.977309+0000","last_peered":"2023-08-25T04:47:27.977309+0000","last_clean":"2023-08-25T04:47:27.977309+0000","last_became_active":"2023-08-25T04:45:26.767496+0000","last_became_peered":"2023-08-25T04:45:26.767496+0000","last_unstale":"2023-08-25T04:47:27.977309+0000","last_undegraded":"2023-08-25T04:47:27.977309+0000","last_fullsized":"2023-08-25T04:47:27.977309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:04:37.260422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":204,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294146+0000","last_change":"2023-08-25T04:45:27.771979+0000","last_active":"2023-08-25T04:47:28.294146+0000","last_peered":"2023-08-25T04:47:28.294146+0000","last_clean":"2023-08-25T04:47:28.294146+0000","last_became_active":"2023-08-25T04:45:27.770968+0000","last_became_peered":"2023-08-25T04:45:27.770968+0000","last_unstale":"2023-08-25T04:47:28.294146+0000","last_undegraded":"2023-08-25T04:47:28.294146+0000","last_fullsized":"2023-08-25T04:47:28.294146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_clean_scrub_stamp":"2023-08-25T04:45:26.752521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:45.223643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341528+0000","last_change":"2023-08-25T04:47:26.986062+0000","last_active":"2023-08-25T04:47:28.341528+0000","last_peered":"2023-08-25T04:47:28.341528+0000","last_clean":"2023-08-25T04:47:28.341528+0000","last_became_active":"2023-08-25T04:47:26.985718+0000","last_became_peered":"2023-08-25T04:47:26.985718+0000","last_unstale":"2023-08-25T04:47:28.341528+0000","last_undegraded":"2023-08-25T04:47:28.341528+0000","last_fullsized":"2023-08-25T04:47:28.341528+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:18:26.307820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294587+0000","last_change":"2023-08-25T04:47:25.974765+0000","last_active":"2023-08-25T04:47:28.294587+0000","last_peered":"2023-08-25T04:47:28.294587+0000","last_clean":"2023-08-25T04:47:28.294587+0000","last_became_active":"2023-08-25T04:47:25.974490+0000","last_became_peered":"2023-08-25T04:47:25.974490+0000","last_unstale":"2023-08-25T04:47:28.294587+0000","last_undegraded":"2023-08-25T04:47:28.294587+0000","last_fullsized":"2023-08-25T04:47:28.294587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:49:57.377910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294304+0000","last_change":"2023-08-25T04:45:26.807286+0000","last_active":"2023-08-25T04:47:28.294304+0000","last_peered":"2023-08-25T04:47:28.294304+0000","last_clean":"2023-08-25T04:47:28.294304+0000","last_became_active":"2023-08-25T04:45:26.806698+0000","last_became_peered":"2023-08-25T04:45:26.806698+0000","last_unstale":"2023-08-25T04:47:28.294304+0000","last_undegraded":"2023-08-25T04:47:28.294304+0000","last_fullsized":"2023-08-25T04:47:28.294304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:16.619190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341608+0000","last_change":"2023-08-25T04:47:26.986435+0000","last_active":"2023-08-25T04:47:28.341608+0000","last_peered":"2023-08-25T04:47:28.341608+0000","last_clean":"2023-08-25T04:47:28.341608+0000","last_became_active":"2023-08-25T04:47:26.985036+0000","last_became_peered":"2023-08-25T04:47:26.985036+0000","last_unstale":"2023-08-25T04:47:28.341608+0000","last_undegraded":"2023-08-25T04:47:28.341608+0000","last_fullsized":"2023-08-25T04:47:28.341608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:05:39.659358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341311+0000","last_change":"2023-08-25T04:47:25.975191+0000","last_active":"2023-08-25T04:47:28.341311+0000","last_peered":"2023-08-25T04:47:28.341311+0000","last_clean":"2023-08-25T04:47:28.341311+0000","last_became_active":"2023-08-25T04:47:25.974782+0000","last_became_peered":"2023-08-25T04:47:25.974782+0000","last_unstale":"2023-08-25T04:47:28.341311+0000","last_undegraded":"2023-08-25T04:47:28.341311+0000","last_fullsized":"2023-08-25T04:47:28.341311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:30:08.454351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294026+0000","last_change":"2023-08-25T04:45:26.807096+0000","last_active":"2023-08-25T04:47:28.294026+0000","last_peered":"2023-08-25T04:47:28.294026+0000","last_clean":"2023-08-25T04:47:28.294026+0000","last_became_active":"2023-08-25T04:45:26.806713+0000","last_became_peered":"2023-08-25T04:45:26.806713+0000","last_unstale":"2023-08-25T04:47:28.294026+0000","last_undegraded":"2023-08-25T04:47:28.294026+0000","last_fullsized":"2023-08-25T04:47:28.294026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:03:39.465642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342292+0000","last_change":"2023-08-25T04:47:26.990475+0000","last_active":"2023-08-25T04:47:28.342292+0000","last_peered":"2023-08-25T04:47:28.342292+0000","last_clean":"2023-08-25T04:47:28.342292+0000","last_became_active":"2023-08-25T04:47:26.990221+0000","last_became_peered":"2023-08-25T04:47:26.990221+0000","last_unstale":"2023-08-25T04:47:28.342292+0000","last_undegraded":"2023-08-25T04:47:28.342292+0000","last_fullsized":"2023-08-25T04:47:28.342292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:50:36.546904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341491+0000","last_change":"2023-08-25T04:47:25.974503+0000","last_active":"2023-08-25T04:47:28.341491+0000","last_peered":"2023-08-25T04:47:28.341491+0000","last_clean":"2023-08-25T04:47:28.341491+0000","last_became_active":"2023-08-25T04:47:25.974239+0000","last_became_peered":"2023-08-25T04:47:25.974239+0000","last_unstale":"2023-08-25T04:47:28.341491+0000","last_undegraded":"2023-08-25T04:47:28.341491+0000","last_fullsized":"2023-08-25T04:47:28.341491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:52.498724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340716+0000","last_change":"2023-08-25T04:45:26.807065+0000","last_active":"2023-08-25T04:47:28.340716+0000","last_peered":"2023-08-25T04:47:28.340716+0000","last_clean":"2023-08-25T04:47:28.340716+0000","last_became_active":"2023-08-25T04:45:26.806737+0000","last_became_peered":"2023-08-25T04:45:26.806737+0000","last_unstale":"2023-08-25T04:47:28.340716+0000","last_undegraded":"2023-08-25T04:47:28.340716+0000","last_fullsized":"2023-08-25T04:47:28.340716+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:15:35.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340694+0000","last_change":"2023-08-25T04:47:26.975927+0000","last_active":"2023-08-25T04:47:28.340694+0000","last_peered":"2023-08-25T04:47:28.340694+0000","last_clean":"2023-08-25T04:47:28.340694+0000","last_became_active":"2023-08-25T04:47:26.975639+0000","last_became_peered":"2023-08-25T04:47:26.975639+0000","last_unstale":"2023-08-25T04:47:28.340694+0000","last_undegraded":"2023-08-25T04:47:28.340694+0000","last_fullsized":"2023-08-25T04:47:28.340694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:38.476033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977216+0000","last_change":"2023-08-25T04:47:25.976252+0000","last_active":"2023-08-25T04:47:27.977216+0000","last_peered":"2023-08-25T04:47:27.977216+0000","last_clean":"2023-08-25T04:47:27.977216+0000","last_became_active":"2023-08-25T04:47:25.975844+0000","last_became_peered":"2023-08-25T04:47:25.975844+0000","last_unstale":"2023-08-25T04:47:27.977216+0000","last_undegraded":"2023-08-25T04:47:27.977216+0000","last_fullsized":"2023-08-25T04:47:27.977216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:21:30.206142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342085+0000","last_change":"2023-08-25T04:45:26.807090+0000","last_active":"2023-08-25T04:47:28.342085+0000","last_peered":"2023-08-25T04:47:28.342085+0000","last_clean":"2023-08-25T04:47:28.342085+0000","last_became_active":"2023-08-25T04:45:26.806685+0000","last_became_peered":"2023-08-25T04:45:26.806685+0000","last_unstale":"2023-08-25T04:47:28.342085+0000","last_undegraded":"2023-08-25T04:47:28.342085+0000","last_fullsized":"2023-08-25T04:47:28.342085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:39.345242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975802+0000","last_change":"2023-08-25T04:47:26.975225+0000","last_active":"2023-08-25T04:47:27.975802+0000","last_peered":"2023-08-25T04:47:27.975802+0000","last_clean":"2023-08-25T04:47:27.975802+0000","last_became_active":"2023-08-25T04:47:26.974877+0000","last_became_peered":"2023-08-25T04:47:26.974877+0000","last_unstale":"2023-08-25T04:47:27.975802+0000","last_undegraded":"2023-08-25T04:47:27.975802+0000","last_fullsized":"2023-08-25T04:47:27.975802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:06:17.864760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340768+0000","last_change":"2023-08-25T04:47:25.974342+0000","last_active":"2023-08-25T04:47:28.340768+0000","last_peered":"2023-08-25T04:47:28.340768+0000","last_clean":"2023-08-25T04:47:28.340768+0000","last_became_active":"2023-08-25T04:47:25.974066+0000","last_became_peered":"2023-08-25T04:47:25.974066+0000","last_unstale":"2023-08-25T04:47:28.340768+0000","last_undegraded":"2023-08-25T04:47:28.340768+0000","last_fullsized":"2023-08-25T04:47:28.340768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:39:34.566353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342415+0000","last_change":"2023-08-25T04:45:26.768150+0000","last_active":"2023-08-25T04:47:28.342415+0000","last_peered":"2023-08-25T04:47:28.342415+0000","last_clean":"2023-08-25T04:47:28.342415+0000","last_became_active":"2023-08-25T04:45:26.767845+0000","last_became_peered":"2023-08-25T04:45:26.767845+0000","last_unstale":"2023-08-25T04:47:28.342415+0000","last_undegraded":"2023-08-25T04:47:28.342415+0000","last_fullsized":"2023-08-25T04:47:28.342415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:17.114194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":799095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66900000000000004,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76500000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.121,"15min":1.1919999999999999},"min":{"1min":0.36399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91700000000000004,"5min":11.452,"15min":11.452},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81499999999999995,"5min":1.528,"15min":1.528},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.93999999999999995,"15min":0.98799999999999999},"min":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89200000000000002,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.96699999999999997,"15min":1.014},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93600000000000005,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90400000000000003,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90500000000000003,"5min":1.694,"15min":1.694},"last":0.747},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.109,"15min":1.165},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.95799999999999996,"5min":9.3689999999999998,"15min":9.3689999999999998},"last":0.85399999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.70799999999999996,"15min":0.69899999999999995},"min":{"1min":0.45400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.497,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97699999999999998,"5min":1.03,"15min":1.03},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0820000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.02},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89700000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.878}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":209309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86699999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":0.871,"15min":0.871},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.76800000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.76800000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.94699999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":1.042,"15min":1.042},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.67500000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91100000000000003,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76400000000000001,"15min":0.76200000000000001},"min":{"1min":0.625,"5min":0.5,"15min":0.5},"max":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.625,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93100000000000005,"5min":1.171,"15min":1.171},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":799075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60499999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.437,"15min":0.437},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.443},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.495,"15min":0.499},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38300000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74299999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":0.998,"15min":0.998},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2849999999999999,"5min":1.357,"15min":1.357},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":0.80900000000000005},"min":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1890000000000001,"5min":1.3,"15min":1.3},"last":0.874},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.032,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.82099999999999995,"15min":0.83299999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.103,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.84599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":207735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":0.998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.63900000000000001,"15min":0.66500000000000004},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95299999999999996,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.50900000000000001,"15min":0.51800000000000002},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.89200000000000002,"5min":4.6020000000000003,"15min":4.6020000000000003},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.52000000000000002,"15min":0.53800000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57699999999999996,"5min":1.611,"15min":1.611},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91800000000000004,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.83699999999999997,"15min":0.86199999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.113,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0049999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76700000000000002,"15min":0.77400000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1719999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0209999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.091,"5min":1.236,"15min":1.236},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.88500000000000001,"15min":0.91700000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0589999999999999,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.92500000000000004,"15min":0.95499999999999996},"min":{"1min":0.61799999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.998,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.82699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":210271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47899999999999998,"15min":0.49099999999999999},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.52200000000000002,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":1.111,"15min":1.2210000000000001},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.56299999999999994,"5min":15.301,"15min":15.301},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59899999999999998,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.1499999999999999,"15min":1.2629999999999999},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.54800000000000004,"5min":15.334,"15min":15.334},"last":0.55300000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.63200000000000001,"15min":0.66200000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.55300000000000005,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.443},{"interface":"front","average":{"1min":0.5,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.58399999999999996,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.65400000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.512,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":1.4079999999999999,"15min":1.506},"min":{"1min":0.54700000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.163,"5min":15.172000000000001,"15min":15.172000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.90600000000000003,"15min":0.92100000000000004},"min":{"1min":0.56399999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.23,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.875,"15min":0.877},"min":{"1min":0.60399999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.474,"5min":1.956,"15min":1.956},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.4330000000000001,"15min":1.53},"min":{"1min":0.54400000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.431,"5min":15.266,"15min":15.266},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95799999999999996,"15min":0.97399999999999998},"min":{"1min":0.65500000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5309999999999999,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.83599999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.4650000000000001,"15min":1.5669999999999999},"min":{"1min":0.57499999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.401,"5min":15.227,"15min":15.227},"last":0.746},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.96899999999999997,"15min":0.98599999999999999},"min":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.411,"5min":4.077,"15min":4.077},"last":0.86299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":209275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.93700000000000006,"15min":1.0289999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":12.221,"15min":12.221},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.872,"15min":0.94999999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.499,"5min":10.331,"15min":10.331},"last":0.48699999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.48999999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.377},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.59999999999999998,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.95799999999999996,"15min":1.04},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.56399999999999995,"5min":10.361000000000001,"15min":10.361000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.59999999999999998,"15min":0.61799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72699999999999998,"5min":1.589,"15min":1.589},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":1.1279999999999999,"15min":1.202},"min":{"1min":0.53000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.86899999999999999,"5min":10.295999999999999,"15min":10.295999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.56200000000000006,"5min":0.503,"15min":0.503},"max":{"1min":0.90500000000000003,"5min":11.097,"15min":11.097},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90000000000000002,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":1.139,"15min":1.2070000000000001},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90800000000000003,"5min":10.252000000000001,"15min":10.252000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":1.179,"15min":1.2509999999999999},"min":{"1min":0.59399999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93799999999999994,"5min":11.058999999999999,"15min":11.058999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0109999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":1.171,"15min":1.2430000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.92000000000000004,"5min":10.206,"15min":10.206},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":1.1950000000000001,"15min":1.2729999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95799999999999996,"5min":11.013,"15min":11.013},"last":0.56399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":210249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.46300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.63400000000000001,"15min":0.625},"min":{"1min":0.432,"5min":0.31,"15min":0.31},"max":{"1min":0.84799999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.47399999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85399999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.625},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.56699999999999995,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.86299999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.53900000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.82499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88500000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.496,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0049999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.51300000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88500000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.84899999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91200000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.625,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96299999999999997,"5min":1.339,"15min":1.339},"last":0.95999999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72799999999999998,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98199999999999998,"5min":0.997,"15min":0.997},"last":0.88},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.59299999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.026,"5min":1.145,"15min":1.145},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":208707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.78600000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.871},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.748}]},{"osd":4,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.62}]},{"osd":6,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:46:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.85099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:47:36.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:47:36.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.511+0000 7fdb887ff700 1 Processor -- start 2023-08-25T04:47:36.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.512+0000 7fdb887ff700 1 -- start start 2023-08-25T04:47:36.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb887ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdb8015ce60 0x7fdb800d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:36.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb887ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb800b8770 0x7fdb800d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:36.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb887ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb800cda40 0x7fdb800cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:36.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb887ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb800ce410 con 0x7fdb800cda40 2023-08-25T04:47:36.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb887ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb800d1fe0 con 0x7fdb8015ce60 2023-08-25T04:47:36.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb887ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800d13d0 con 0x7fdb800b8770 2023-08-25T04:47:36.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb86d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb800cda40 0x7fdb800cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:36.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb86d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb800cda40 0x7fdb800cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47364/0 (socket says 172.21.15.72:47364) 2023-08-25T04:47:36.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb86d9c700 1 -- 172.21.15.72:0/682051816 learned_addr learned my addr 172.21.15.72:0/682051816 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:36.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb8659b700 1 --2- 172.21.15.72:0/682051816 >> v2:172.21.15.137:3300/0 conn(0x7fdb8015ce60 0x7fdb800d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:36.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.513+0000 7fdb85d9a700 1 --2- 172.21.15.72:0/682051816 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb800b8770 0x7fdb800d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:36.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.514+0000 7fdb86d9c700 1 -- 172.21.15.72:0/682051816 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb800b8770 msgr2=0x7fdb800d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:36.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.514+0000 7fdb86d9c700 1 --2- 172.21.15.72:0/682051816 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb800b8770 0x7fdb800d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.514+0000 7fdb86d9c700 1 -- 172.21.15.72:0/682051816 >> v2:172.21.15.137:3300/0 conn(0x7fdb8015ce60 msgr2=0x7fdb800d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:36.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.514+0000 7fdb86d9c700 1 --2- 172.21.15.72:0/682051816 >> v2:172.21.15.137:3300/0 conn(0x7fdb8015ce60 0x7fdb800d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.514+0000 7fdb86d9c700 1 -- 172.21.15.72:0/682051816 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800d16b0 con 0x7fdb800cda40 2023-08-25T04:47:36.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.514+0000 7fdb86d9c700 1 --2- 172.21.15.72:0/682051816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 0x7fdb800cded0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdb800d2cd0 tx=0x7fdb7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696e19dcd11103a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:36.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.514+0000 7fdb85599700 1 -- 172.21.15.72:0/682051816 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800e070 con 0x7fdb800cda40 2023-08-25T04:47:36.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.514+0000 7fdb85599700 1 -- 172.21.15.72:0/682051816 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7800b9c0 con 0x7fdb800cda40 2023-08-25T04:47:36.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.514+0000 7fdb85599700 1 -- 172.21.15.72:0/682051816 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800bd70 con 0x7fdb800cda40 2023-08-25T04:47:36.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.515+0000 7fdb887ff700 1 -- 172.21.15.72:0/682051816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 msgr2=0x7fdb800cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:36.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.515+0000 7fdb887ff700 1 --2- 172.21.15.72:0/682051816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 0x7fdb800cded0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdb800d2cd0 tx=0x7fdb7800b330 comp rx=0 tx=0).stop 2023-08-25T04:47:36.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.515+0000 7fdb887ff700 1 -- 172.21.15.72:0/682051816 shutdown_connections 2023-08-25T04:47:36.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.515+0000 7fdb887ff700 1 --2- 172.21.15.72:0/682051816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 0x7fdb800cded0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.515+0000 7fdb887ff700 1 --2- 172.21.15.72:0/682051816 >> v2:172.21.15.137:3300/0 conn(0x7fdb8015ce60 0x7fdb800d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.515+0000 7fdb887ff700 1 --2- 172.21.15.72:0/682051816 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb800b8770 0x7fdb800d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.515+0000 7fdb887ff700 1 -- 172.21.15.72:0/682051816 >> 172.21.15.72:0/682051816 conn(0x7fdb80071e10 msgr2=0x7fdb80072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:36.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.515+0000 7fdb887ff700 1 -- 172.21.15.72:0/682051816 shutdown_connections 2023-08-25T04:47:36.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.515+0000 7fdb887ff700 1 -- 172.21.15.72:0/682051816 wait complete. 2023-08-25T04:47:36.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.517+0000 7fdb887ff700 1 Processor -- start 2023-08-25T04:47:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.517+0000 7fdb887ff700 1 -- start start 2023-08-25T04:47:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.517+0000 7fdb887ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb800b8770 0x7fdb800cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb887ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 0x7fdb8015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb887ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb8015ce60 0x7fdb800cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb887ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800ca770 con 0x7fdb800cda40 2023-08-25T04:47:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb887ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8015eea0 con 0x7fdb800b8770 2023-08-25T04:47:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb887ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8015f180 con 0x7fdb8015ce60 2023-08-25T04:47:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb85d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 0x7fdb8015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb85d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 0x7fdb8015e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47378/0 (socket says 172.21.15.72:47378) 2023-08-25T04:47:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb85d9a700 1 -- 172.21.15.72:0/1345042669 learned_addr learned my addr 172.21.15.72:0/1345042669 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb8659b700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb800b8770 0x7fdb800cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb86d9c700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb8015ce60 0x7fdb800cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb85d9a700 1 -- 172.21.15.72:0/1345042669 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb8015ce60 msgr2=0x7fdb800cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb85d9a700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb8015ce60 0x7fdb800cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb85d9a700 1 -- 172.21.15.72:0/1345042669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb800b8770 msgr2=0x7fdb800cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb85d9a700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb800b8770 0x7fdb800cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.518+0000 7fdb85d9a700 1 -- 172.21.15.72:0/1345042669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb78009b30 con 0x7fdb800cda40 2023-08-25T04:47:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.519+0000 7fdb85d9a700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 0x7fdb8015e420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000d800 tx=0x7fdb7000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.519+0000 7fdb76ffd700 1 -- 172.21.15.72:0/1345042669 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb700125f0 con 0x7fdb800cda40 2023-08-25T04:47:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.519+0000 7fdb76ffd700 1 -- 172.21.15.72:0/1345042669 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70012750 con 0x7fdb800cda40 2023-08-25T04:47:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.519+0000 7fdb887ff700 1 -- 172.21.15.72:0/1345042669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8015f460 con 0x7fdb800cda40 2023-08-25T04:47:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.519+0000 7fdb76ffd700 1 -- 172.21.15.72:0/1345042669 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70012b00 con 0x7fdb800cda40 2023-08-25T04:47:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.519+0000 7fdb887ff700 1 -- 172.21.15.72:0/1345042669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8015f740 con 0x7fdb800cda40 2023-08-25T04:47:36.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.520+0000 7fdb887ff700 1 -- 172.21.15.72:0/1345042669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8004e620 con 0x7fdb800cda40 2023-08-25T04:47:36.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.521+0000 7fdb76ffd700 1 -- 172.21.15.72:0/1345042669 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdb70012c60 con 0x7fdb800cda40 2023-08-25T04:47:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.522+0000 7fdb76ffd700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdb6406a0e0 0x7fdb6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.522+0000 7fdb76ffd700 1 -- 172.21.15.72:0/1345042669 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdb70088a20 con 0x7fdb800cda40 2023-08-25T04:47:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.522+0000 7fdb8659b700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdb6406a0e0 0x7fdb6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.522+0000 7fdb8659b700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdb6406a0e0 0x7fdb6406c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0098b0 tx=0x7fdb7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.526+0000 7fdb76ffd700 1 -- 172.21.15.72:0/1345042669 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdb70053f40 con 0x7fdb800cda40 2023-08-25T04:47:36.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.719+0000 7fdb887ff700 1 -- 172.21.15.72:0/1345042669 --> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb8015f2f0 con 0x7fdb6406a0e0 2023-08-25T04:47:36.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.727+0000 7fdb76ffd700 1 -- 172.21.15.72:0/1345042669 <== mgr.4101 v2:172.21.15.72:6832/1377484023 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310964 (secure 0 0 0) 0x7fdb8015f2f0 con 0x7fdb6406a0e0 2023-08-25T04:47:36.731 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:36.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 -- 172.21.15.72:0/1345042669 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdb6406a0e0 msgr2=0x7fdb6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdb6406a0e0 0x7fdb6406c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0098b0 tx=0x7fdb7c008040 comp rx=0 tx=0).stop 2023-08-25T04:47:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 -- 172.21.15.72:0/1345042669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 msgr2=0x7fdb8015e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 0x7fdb8015e420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000d800 tx=0x7fdb7000db10 comp rx=0 tx=0).stop 2023-08-25T04:47:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 -- 172.21.15.72:0/1345042669 shutdown_connections 2023-08-25T04:47:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fdb6406a0e0 0x7fdb6406c5a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdb8015ce60 0x7fdb800cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb800b8770 0x7fdb800cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 --2- 172.21.15.72:0/1345042669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb800cda40 0x7fdb8015e420 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 -- 172.21.15.72:0/1345042669 >> 172.21.15.72:0/1345042669 conn(0x7fdb80071e10 msgr2=0x7fdb8015b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 -- 172.21.15.72:0/1345042669 shutdown_connections 2023-08-25T04:47:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.732+0000 7fdb887ff700 1 -- 172.21.15.72:0/1345042669 wait complete. 2023-08-25T04:47:36.737 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-25T04:47:36.751 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2023-08-25T04:47:35.885652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221020,"kb_used_data":4836,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753700,"statfs":{"total":773094113280,"available":772867788800,"internally_reserved":0,"allocated":4952064,"data_stored":2853716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.931443"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294603+0000","last_change":"2023-08-25T04:47:26.982995+0000","last_active":"2023-08-25T04:47:28.294603+0000","last_peered":"2023-08-25T04:47:28.294603+0000","last_clean":"2023-08-25T04:47:28.294603+0000","last_became_active":"2023-08-25T04:47:26.982727+0000","last_became_peered":"2023-08-25T04:47:26.982727+0000","last_unstale":"2023-08-25T04:47:28.294603+0000","last_undegraded":"2023-08-25T04:47:28.294603+0000","last_fullsized":"2023-08-25T04:47:28.294603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:53.481683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341037+0000","last_change":"2023-08-25T04:47:26.988003+0000","last_active":"2023-08-25T04:47:28.341037+0000","last_peered":"2023-08-25T04:47:28.341037+0000","last_clean":"2023-08-25T04:47:28.341037+0000","last_became_active":"2023-08-25T04:47:26.987700+0000","last_became_peered":"2023-08-25T04:47:26.987700+0000","last_unstale":"2023-08-25T04:47:28.341037+0000","last_undegraded":"2023-08-25T04:47:28.341037+0000","last_fullsized":"2023-08-25T04:47:28.341037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:53:43.139603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975585+0000","last_change":"2023-08-25T04:47:26.978024+0000","last_active":"2023-08-25T04:47:27.975585+0000","last_peered":"2023-08-25T04:47:27.975585+0000","last_clean":"2023-08-25T04:47:27.975585+0000","last_became_active":"2023-08-25T04:47:26.977730+0000","last_became_peered":"2023-08-25T04:47:26.977730+0000","last_unstale":"2023-08-25T04:47:27.975585+0000","last_undegraded":"2023-08-25T04:47:27.975585+0000","last_fullsized":"2023-08-25T04:47:27.975585+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:41.065771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341618+0000","last_change":"2023-08-25T04:47:26.989008+0000","last_active":"2023-08-25T04:47:28.341618+0000","last_peered":"2023-08-25T04:47:28.341618+0000","last_clean":"2023-08-25T04:47:28.341618+0000","last_became_active":"2023-08-25T04:47:26.988744+0000","last_became_peered":"2023-08-25T04:47:26.988744+0000","last_unstale":"2023-08-25T04:47:28.341618+0000","last_undegraded":"2023-08-25T04:47:28.341618+0000","last_fullsized":"2023-08-25T04:47:28.341618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:36.006069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340966+0000","last_change":"2023-08-25T04:47:26.988400+0000","last_active":"2023-08-25T04:47:28.340966+0000","last_peered":"2023-08-25T04:47:28.340966+0000","last_clean":"2023-08-25T04:47:28.340966+0000","last_became_active":"2023-08-25T04:47:26.987934+0000","last_became_peered":"2023-08-25T04:47:26.987934+0000","last_unstale":"2023-08-25T04:47:28.340966+0000","last_undegraded":"2023-08-25T04:47:28.340966+0000","last_fullsized":"2023-08-25T04:47:28.340966+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:32:36.570940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340954+0000","last_change":"2023-08-25T04:47:26.981019+0000","last_active":"2023-08-25T04:47:28.340954+0000","last_peered":"2023-08-25T04:47:28.340954+0000","last_clean":"2023-08-25T04:47:28.340954+0000","last_became_active":"2023-08-25T04:47:26.980380+0000","last_became_peered":"2023-08-25T04:47:26.980380+0000","last_unstale":"2023-08-25T04:47:28.340954+0000","last_undegraded":"2023-08-25T04:47:28.340954+0000","last_fullsized":"2023-08-25T04:47:28.340954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:45:55.400195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294060+0000","last_change":"2023-08-25T04:47:26.985656+0000","last_active":"2023-08-25T04:47:28.294060+0000","last_peered":"2023-08-25T04:47:28.294060+0000","last_clean":"2023-08-25T04:47:28.294060+0000","last_became_active":"2023-08-25T04:47:26.985393+0000","last_became_peered":"2023-08-25T04:47:26.985393+0000","last_unstale":"2023-08-25T04:47:28.294060+0000","last_undegraded":"2023-08-25T04:47:28.294060+0000","last_fullsized":"2023-08-25T04:47:28.294060+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:36.006069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340524+0000","last_change":"2023-08-25T04:47:26.985469+0000","last_active":"2023-08-25T04:47:28.340524+0000","last_peered":"2023-08-25T04:47:28.340524+0000","last_clean":"2023-08-25T04:47:28.340524+0000","last_became_active":"2023-08-25T04:47:26.985070+0000","last_became_peered":"2023-08-25T04:47:26.985070+0000","last_unstale":"2023-08-25T04:47:28.340524+0000","last_undegraded":"2023-08-25T04:47:28.340524+0000","last_fullsized":"2023-08-25T04:47:28.340524+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:53:43.139603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340976+0000","last_change":"2023-08-25T04:47:26.985447+0000","last_active":"2023-08-25T04:47:28.340976+0000","last_peered":"2023-08-25T04:47:28.340976+0000","last_clean":"2023-08-25T04:47:28.340976+0000","last_became_active":"2023-08-25T04:47:26.984958+0000","last_became_peered":"2023-08-25T04:47:26.984958+0000","last_unstale":"2023-08-25T04:47:28.340976+0000","last_undegraded":"2023-08-25T04:47:28.340976+0000","last_fullsized":"2023-08-25T04:47:28.340976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:11:55.009324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341478+0000","last_change":"2023-08-25T04:47:26.987892+0000","last_active":"2023-08-25T04:47:28.341478+0000","last_peered":"2023-08-25T04:47:28.341478+0000","last_clean":"2023-08-25T04:47:28.341478+0000","last_became_active":"2023-08-25T04:47:26.987056+0000","last_became_peered":"2023-08-25T04:47:26.987056+0000","last_unstale":"2023-08-25T04:47:28.341478+0000","last_undegraded":"2023-08-25T04:47:28.341478+0000","last_fullsized":"2023-08-25T04:47:28.341478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:45:40.705043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341177+0000","last_change":"2023-08-25T04:47:26.985842+0000","last_active":"2023-08-25T04:47:28.341177+0000","last_peered":"2023-08-25T04:47:28.341177+0000","last_clean":"2023-08-25T04:47:28.341177+0000","last_became_active":"2023-08-25T04:47:26.985578+0000","last_became_peered":"2023-08-25T04:47:26.985578+0000","last_unstale":"2023-08-25T04:47:28.341177+0000","last_undegraded":"2023-08-25T04:47:28.341177+0000","last_fullsized":"2023-08-25T04:47:28.341177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:55.346115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341050+0000","last_change":"2023-08-25T04:47:26.983685+0000","last_active":"2023-08-25T04:47:28.341050+0000","last_peered":"2023-08-25T04:47:28.341050+0000","last_clean":"2023-08-25T04:47:28.341050+0000","last_became_active":"2023-08-25T04:47:26.983422+0000","last_became_peered":"2023-08-25T04:47:26.983422+0000","last_unstale":"2023-08-25T04:47:28.341050+0000","last_undegraded":"2023-08-25T04:47:28.341050+0000","last_fullsized":"2023-08-25T04:47:28.341050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:57.393362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976282+0000","last_change":"2023-08-25T04:47:26.977763+0000","last_active":"2023-08-25T04:47:27.976282+0000","last_peered":"2023-08-25T04:47:27.976282+0000","last_clean":"2023-08-25T04:47:27.976282+0000","last_became_active":"2023-08-25T04:47:26.977388+0000","last_became_peered":"2023-08-25T04:47:26.977388+0000","last_unstale":"2023-08-25T04:47:27.976282+0000","last_undegraded":"2023-08-25T04:47:27.976282+0000","last_fullsized":"2023-08-25T04:47:27.976282+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:45.092836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340791+0000","last_change":"2023-08-25T04:47:26.981972+0000","last_active":"2023-08-25T04:47:28.340791+0000","last_peered":"2023-08-25T04:47:28.340791+0000","last_clean":"2023-08-25T04:47:28.340791+0000","last_became_active":"2023-08-25T04:47:26.981708+0000","last_became_peered":"2023-08-25T04:47:26.981708+0000","last_unstale":"2023-08-25T04:47:28.340791+0000","last_undegraded":"2023-08-25T04:47:28.340791+0000","last_fullsized":"2023-08-25T04:47:28.340791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:49.812067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340649+0000","last_change":"2023-08-25T04:47:26.977754+0000","last_active":"2023-08-25T04:47:28.340649+0000","last_peered":"2023-08-25T04:47:28.340649+0000","last_clean":"2023-08-25T04:47:28.340649+0000","last_became_active":"2023-08-25T04:47:26.977351+0000","last_became_peered":"2023-08-25T04:47:26.977351+0000","last_unstale":"2023-08-25T04:47:28.340649+0000","last_undegraded":"2023-08-25T04:47:28.340649+0000","last_fullsized":"2023-08-25T04:47:28.340649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:38:12.076567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341670+0000","last_change":"2023-08-25T04:47:26.988892+0000","last_active":"2023-08-25T04:47:28.341670+0000","last_peered":"2023-08-25T04:47:28.341670+0000","last_clean":"2023-08-25T04:47:28.341670+0000","last_became_active":"2023-08-25T04:47:26.988572+0000","last_became_peered":"2023-08-25T04:47:26.988572+0000","last_unstale":"2023-08-25T04:47:28.341670+0000","last_undegraded":"2023-08-25T04:47:28.341670+0000","last_fullsized":"2023-08-25T04:47:28.341670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:20.446754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975794+0000","last_change":"2023-08-25T04:47:26.984861+0000","last_active":"2023-08-25T04:47:27.975794+0000","last_peered":"2023-08-25T04:47:27.975794+0000","last_clean":"2023-08-25T04:47:27.975794+0000","last_became_active":"2023-08-25T04:47:26.984585+0000","last_became_peered":"2023-08-25T04:47:26.984585+0000","last_unstale":"2023-08-25T04:47:27.975794+0000","last_undegraded":"2023-08-25T04:47:27.975794+0000","last_fullsized":"2023-08-25T04:47:27.975794+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:03.461961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975688+0000","last_change":"2023-08-25T04:47:26.990440+0000","last_active":"2023-08-25T04:47:27.975688+0000","last_peered":"2023-08-25T04:47:27.975688+0000","last_clean":"2023-08-25T04:47:27.975688+0000","last_became_active":"2023-08-25T04:47:26.989788+0000","last_became_peered":"2023-08-25T04:47:26.989788+0000","last_unstale":"2023-08-25T04:47:27.975688+0000","last_undegraded":"2023-08-25T04:47:27.975688+0000","last_fullsized":"2023-08-25T04:47:27.975688+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:28:36.259995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341887+0000","last_change":"2023-08-25T04:47:26.989865+0000","last_active":"2023-08-25T04:47:28.341887+0000","last_peered":"2023-08-25T04:47:28.341887+0000","last_clean":"2023-08-25T04:47:28.341887+0000","last_became_active":"2023-08-25T04:47:26.989231+0000","last_became_peered":"2023-08-25T04:47:26.989231+0000","last_unstale":"2023-08-25T04:47:28.341887+0000","last_undegraded":"2023-08-25T04:47:28.341887+0000","last_fullsized":"2023-08-25T04:47:28.341887+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:22.682596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976338+0000","last_change":"2023-08-25T04:47:26.988384+0000","last_active":"2023-08-25T04:47:27.976338+0000","last_peered":"2023-08-25T04:47:27.976338+0000","last_clean":"2023-08-25T04:47:27.976338+0000","last_became_active":"2023-08-25T04:47:26.988017+0000","last_became_peered":"2023-08-25T04:47:26.988017+0000","last_unstale":"2023-08-25T04:47:27.976338+0000","last_undegraded":"2023-08-25T04:47:27.976338+0000","last_fullsized":"2023-08-25T04:47:27.976338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:38:10.143520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341036+0000","last_change":"2023-08-25T04:47:26.978324+0000","last_active":"2023-08-25T04:47:28.341036+0000","last_peered":"2023-08-25T04:47:28.341036+0000","last_clean":"2023-08-25T04:47:28.341036+0000","last_became_active":"2023-08-25T04:47:26.978012+0000","last_became_peered":"2023-08-25T04:47:26.978012+0000","last_unstale":"2023-08-25T04:47:28.341036+0000","last_undegraded":"2023-08-25T04:47:28.341036+0000","last_fullsized":"2023-08-25T04:47:28.341036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:29:05.010756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340905+0000","last_change":"2023-08-25T04:47:26.987052+0000","last_active":"2023-08-25T04:47:28.340905+0000","last_peered":"2023-08-25T04:47:28.340905+0000","last_clean":"2023-08-25T04:47:28.340905+0000","last_became_active":"2023-08-25T04:47:26.986724+0000","last_became_peered":"2023-08-25T04:47:26.986724+0000","last_unstale":"2023-08-25T04:47:28.340905+0000","last_undegraded":"2023-08-25T04:47:28.340905+0000","last_fullsized":"2023-08-25T04:47:28.340905+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:50.544585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341883+0000","last_change":"2023-08-25T04:47:26.977397+0000","last_active":"2023-08-25T04:47:28.341883+0000","last_peered":"2023-08-25T04:47:28.341883+0000","last_clean":"2023-08-25T04:47:28.341883+0000","last_became_active":"2023-08-25T04:47:26.977090+0000","last_became_peered":"2023-08-25T04:47:26.977090+0000","last_unstale":"2023-08-25T04:47:28.341883+0000","last_undegraded":"2023-08-25T04:47:28.341883+0000","last_fullsized":"2023-08-25T04:47:28.341883+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:21.083145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341643+0000","last_change":"2023-08-25T04:47:26.981380+0000","last_active":"2023-08-25T04:47:28.341643+0000","last_peered":"2023-08-25T04:47:28.341643+0000","last_clean":"2023-08-25T04:47:28.341643+0000","last_became_active":"2023-08-25T04:47:26.978223+0000","last_became_peered":"2023-08-25T04:47:26.978223+0000","last_unstale":"2023-08-25T04:47:28.341643+0000","last_undegraded":"2023-08-25T04:47:28.341643+0000","last_fullsized":"2023-08-25T04:47:28.341643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:46:29.811351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342454+0000","last_change":"2023-08-25T04:47:26.981535+0000","last_active":"2023-08-25T04:47:28.342454+0000","last_peered":"2023-08-25T04:47:28.342454+0000","last_clean":"2023-08-25T04:47:28.342454+0000","last_became_active":"2023-08-25T04:47:26.978209+0000","last_became_peered":"2023-08-25T04:47:26.978209+0000","last_unstale":"2023-08-25T04:47:28.342454+0000","last_undegraded":"2023-08-25T04:47:28.342454+0000","last_fullsized":"2023-08-25T04:47:28.342454+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:48:23.597645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976508+0000","last_change":"2023-08-25T04:47:26.978254+0000","last_active":"2023-08-25T04:47:27.976508+0000","last_peered":"2023-08-25T04:47:27.976508+0000","last_clean":"2023-08-25T04:47:27.976508+0000","last_became_active":"2023-08-25T04:47:26.977832+0000","last_became_peered":"2023-08-25T04:47:26.977832+0000","last_unstale":"2023-08-25T04:47:27.976508+0000","last_undegraded":"2023-08-25T04:47:27.976508+0000","last_fullsized":"2023-08-25T04:47:27.976508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:14:53.241633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975542+0000","last_change":"2023-08-25T04:47:26.980662+0000","last_active":"2023-08-25T04:47:27.975542+0000","last_peered":"2023-08-25T04:47:27.975542+0000","last_clean":"2023-08-25T04:47:27.975542+0000","last_became_active":"2023-08-25T04:47:26.980361+0000","last_became_peered":"2023-08-25T04:47:26.980361+0000","last_unstale":"2023-08-25T04:47:27.975542+0000","last_undegraded":"2023-08-25T04:47:27.975542+0000","last_fullsized":"2023-08-25T04:47:27.975542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:16:57.255524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341121+0000","last_change":"2023-08-25T04:47:26.983735+0000","last_active":"2023-08-25T04:47:28.341121+0000","last_peered":"2023-08-25T04:47:28.341121+0000","last_clean":"2023-08-25T04:47:28.341121+0000","last_became_active":"2023-08-25T04:47:26.983039+0000","last_became_peered":"2023-08-25T04:47:26.983039+0000","last_unstale":"2023-08-25T04:47:28.341121+0000","last_undegraded":"2023-08-25T04:47:28.341121+0000","last_fullsized":"2023-08-25T04:47:28.341121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:16.891540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342087+0000","last_change":"2023-08-25T04:47:26.977939+0000","last_active":"2023-08-25T04:47:28.342087+0000","last_peered":"2023-08-25T04:47:28.342087+0000","last_clean":"2023-08-25T04:47:28.342087+0000","last_became_active":"2023-08-25T04:47:26.977257+0000","last_became_peered":"2023-08-25T04:47:26.977257+0000","last_unstale":"2023-08-25T04:47:28.342087+0000","last_undegraded":"2023-08-25T04:47:28.342087+0000","last_fullsized":"2023-08-25T04:47:28.342087+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:10.965788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975485+0000","last_change":"2023-08-25T04:47:26.976981+0000","last_active":"2023-08-25T04:47:27.975485+0000","last_peered":"2023-08-25T04:47:27.975485+0000","last_clean":"2023-08-25T04:47:27.975485+0000","last_became_active":"2023-08-25T04:47:26.976612+0000","last_became_peered":"2023-08-25T04:47:26.976612+0000","last_unstale":"2023-08-25T04:47:27.975485+0000","last_undegraded":"2023-08-25T04:47:27.975485+0000","last_fullsized":"2023-08-25T04:47:27.975485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:36:46.894406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340528+0000","last_change":"2023-08-25T04:47:26.969444+0000","last_active":"2023-08-25T04:47:28.340528+0000","last_peered":"2023-08-25T04:47:28.340528+0000","last_clean":"2023-08-25T04:47:28.340528+0000","last_became_active":"2023-08-25T04:47:26.969173+0000","last_became_peered":"2023-08-25T04:47:26.969173+0000","last_unstale":"2023-08-25T04:47:28.340528+0000","last_undegraded":"2023-08-25T04:47:28.340528+0000","last_fullsized":"2023-08-25T04:47:28.340528+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:47.277439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976154+0000","last_change":"2023-08-25T04:47:26.978554+0000","last_active":"2023-08-25T04:47:27.976154+0000","last_peered":"2023-08-25T04:47:27.976154+0000","last_clean":"2023-08-25T04:47:27.976154+0000","last_became_active":"2023-08-25T04:47:26.978262+0000","last_became_peered":"2023-08-25T04:47:26.978262+0000","last_unstale":"2023-08-25T04:47:27.976154+0000","last_undegraded":"2023-08-25T04:47:27.976154+0000","last_fullsized":"2023-08-25T04:47:27.976154+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:05:20.610402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977668+0000","last_change":"2023-08-25T04:47:26.974422+0000","last_active":"2023-08-25T04:47:27.977668+0000","last_peered":"2023-08-25T04:47:27.977668+0000","last_clean":"2023-08-25T04:47:27.977668+0000","last_became_active":"2023-08-25T04:47:26.974160+0000","last_became_peered":"2023-08-25T04:47:26.974160+0000","last_unstale":"2023-08-25T04:47:27.977668+0000","last_undegraded":"2023-08-25T04:47:27.977668+0000","last_fullsized":"2023-08-25T04:47:27.977668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:31.957260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'4","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341549+0000","last_change":"2023-08-25T04:47:25.980609+0000","last_active":"2023-08-25T04:47:28.341549+0000","last_peered":"2023-08-25T04:47:28.341549+0000","last_clean":"2023-08-25T04:47:28.341549+0000","last_became_active":"2023-08-25T04:47:25.980263+0000","last_became_peered":"2023-08-25T04:47:25.980263+0000","last_unstale":"2023-08-25T04:47:28.341549+0000","last_undegraded":"2023-08-25T04:47:28.341549+0000","last_fullsized":"2023-08-25T04:47:28.341549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:01:06.959657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342080+0000","last_change":"2023-08-25T04:47:26.982572+0000","last_active":"2023-08-25T04:47:28.342080+0000","last_peered":"2023-08-25T04:47:28.342080+0000","last_clean":"2023-08-25T04:47:28.342080+0000","last_became_active":"2023-08-25T04:47:26.982111+0000","last_became_peered":"2023-08-25T04:47:26.982111+0000","last_unstale":"2023-08-25T04:47:28.342080+0000","last_undegraded":"2023-08-25T04:47:28.342080+0000","last_fullsized":"2023-08-25T04:47:28.342080+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:59.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975855+0000","last_change":"2023-08-25T04:47:25.978241+0000","last_active":"2023-08-25T04:47:27.975855+0000","last_peered":"2023-08-25T04:47:27.975855+0000","last_clean":"2023-08-25T04:47:27.975855+0000","last_became_active":"2023-08-25T04:47:25.977884+0000","last_became_peered":"2023-08-25T04:47:25.977884+0000","last_unstale":"2023-08-25T04:47:27.975855+0000","last_undegraded":"2023-08-25T04:47:27.975855+0000","last_fullsized":"2023-08-25T04:47:27.975855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:27.621536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341255+0000","last_change":"2023-08-25T04:47:26.978961+0000","last_active":"2023-08-25T04:47:28.341255+0000","last_peered":"2023-08-25T04:47:28.341255+0000","last_clean":"2023-08-25T04:47:28.341255+0000","last_became_active":"2023-08-25T04:47:26.978321+0000","last_became_peered":"2023-08-25T04:47:26.978321+0000","last_unstale":"2023-08-25T04:47:28.341255+0000","last_undegraded":"2023-08-25T04:47:28.341255+0000","last_fullsized":"2023-08-25T04:47:28.341255+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:44.538494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977652+0000","last_change":"2023-08-25T04:47:25.976559+0000","last_active":"2023-08-25T04:47:27.977652+0000","last_peered":"2023-08-25T04:47:27.977652+0000","last_clean":"2023-08-25T04:47:27.977652+0000","last_became_active":"2023-08-25T04:47:25.976228+0000","last_became_peered":"2023-08-25T04:47:25.976228+0000","last_unstale":"2023-08-25T04:47:27.977652+0000","last_undegraded":"2023-08-25T04:47:27.977652+0000","last_fullsized":"2023-08-25T04:47:27.977652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:09.879462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977515+0000","last_change":"2023-08-25T04:47:26.968523+0000","last_active":"2023-08-25T04:47:27.977515+0000","last_peered":"2023-08-25T04:47:27.977515+0000","last_clean":"2023-08-25T04:47:27.977515+0000","last_became_active":"2023-08-25T04:47:26.968257+0000","last_became_peered":"2023-08-25T04:47:26.968257+0000","last_unstale":"2023-08-25T04:47:27.977515+0000","last_undegraded":"2023-08-25T04:47:27.977515+0000","last_fullsized":"2023-08-25T04:47:27.977515+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:31.140867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294287+0000","last_change":"2023-08-25T04:47:25.976878+0000","last_active":"2023-08-25T04:47:28.294287+0000","last_peered":"2023-08-25T04:47:28.294287+0000","last_clean":"2023-08-25T04:47:28.294287+0000","last_became_active":"2023-08-25T04:47:25.976504+0000","last_became_peered":"2023-08-25T04:47:25.976504+0000","last_unstale":"2023-08-25T04:47:28.294287+0000","last_undegraded":"2023-08-25T04:47:28.294287+0000","last_fullsized":"2023-08-25T04:47:28.294287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:46:02.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975487+0000","last_change":"2023-08-25T04:47:26.985387+0000","last_active":"2023-08-25T04:47:27.975487+0000","last_peered":"2023-08-25T04:47:27.975487+0000","last_clean":"2023-08-25T04:47:27.975487+0000","last_became_active":"2023-08-25T04:47:26.985122+0000","last_became_peered":"2023-08-25T04:47:26.985122+0000","last_unstale":"2023-08-25T04:47:27.975487+0000","last_undegraded":"2023-08-25T04:47:27.975487+0000","last_fullsized":"2023-08-25T04:47:27.975487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:27.798939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341423+0000","last_change":"2023-08-25T04:47:25.979893+0000","last_active":"2023-08-25T04:47:28.341423+0000","last_peered":"2023-08-25T04:47:28.341423+0000","last_clean":"2023-08-25T04:47:28.341423+0000","last_became_active":"2023-08-25T04:47:25.979617+0000","last_became_peered":"2023-08-25T04:47:25.979617+0000","last_unstale":"2023-08-25T04:47:28.341423+0000","last_undegraded":"2023-08-25T04:47:28.341423+0000","last_fullsized":"2023-08-25T04:47:28.341423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:11:16.172391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341251+0000","last_change":"2023-08-25T04:47:26.986407+0000","last_active":"2023-08-25T04:47:28.341251+0000","last_peered":"2023-08-25T04:47:28.341251+0000","last_clean":"2023-08-25T04:47:28.341251+0000","last_became_active":"2023-08-25T04:47:26.986108+0000","last_became_peered":"2023-08-25T04:47:26.986108+0000","last_unstale":"2023-08-25T04:47:28.341251+0000","last_undegraded":"2023-08-25T04:47:28.341251+0000","last_fullsized":"2023-08-25T04:47:28.341251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:05:14.141084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975703+0000","last_change":"2023-08-25T04:47:25.978780+0000","last_active":"2023-08-25T04:47:27.975703+0000","last_peered":"2023-08-25T04:47:27.975703+0000","last_clean":"2023-08-25T04:47:27.975703+0000","last_became_active":"2023-08-25T04:47:25.978452+0000","last_became_peered":"2023-08-25T04:47:25.978452+0000","last_unstale":"2023-08-25T04:47:27.975703+0000","last_undegraded":"2023-08-25T04:47:27.975703+0000","last_fullsized":"2023-08-25T04:47:27.975703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:32:01.383995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340590+0000","last_change":"2023-08-25T04:47:26.984823+0000","last_active":"2023-08-25T04:47:28.340590+0000","last_peered":"2023-08-25T04:47:28.340590+0000","last_clean":"2023-08-25T04:47:28.340590+0000","last_became_active":"2023-08-25T04:47:26.984411+0000","last_became_peered":"2023-08-25T04:47:26.984411+0000","last_unstale":"2023-08-25T04:47:28.340590+0000","last_undegraded":"2023-08-25T04:47:28.340590+0000","last_fullsized":"2023-08-25T04:47:28.340590+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:16.891540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340739+0000","last_change":"2023-08-25T04:47:25.975904+0000","last_active":"2023-08-25T04:47:28.340739+0000","last_peered":"2023-08-25T04:47:28.340739+0000","last_clean":"2023-08-25T04:47:28.340739+0000","last_became_active":"2023-08-25T04:47:25.975509+0000","last_became_peered":"2023-08-25T04:47:25.975509+0000","last_unstale":"2023-08-25T04:47:28.340739+0000","last_undegraded":"2023-08-25T04:47:28.340739+0000","last_fullsized":"2023-08-25T04:47:28.340739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:40.923779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341920+0000","last_change":"2023-08-25T04:47:26.977244+0000","last_active":"2023-08-25T04:47:28.341920+0000","last_peered":"2023-08-25T04:47:28.341920+0000","last_clean":"2023-08-25T04:47:28.341920+0000","last_became_active":"2023-08-25T04:47:26.976972+0000","last_became_peered":"2023-08-25T04:47:26.976972+0000","last_unstale":"2023-08-25T04:47:28.341920+0000","last_undegraded":"2023-08-25T04:47:28.341920+0000","last_fullsized":"2023-08-25T04:47:28.341920+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:07:19.646305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340652+0000","last_change":"2023-08-25T04:47:25.971325+0000","last_active":"2023-08-25T04:47:28.340652+0000","last_peered":"2023-08-25T04:47:28.340652+0000","last_clean":"2023-08-25T04:47:28.340652+0000","last_became_active":"2023-08-25T04:47:25.971037+0000","last_became_peered":"2023-08-25T04:47:25.971037+0000","last_unstale":"2023-08-25T04:47:28.340652+0000","last_undegraded":"2023-08-25T04:47:28.340652+0000","last_fullsized":"2023-08-25T04:47:28.340652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:43.527432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975781+0000","last_change":"2023-08-25T04:47:26.990654+0000","last_active":"2023-08-25T04:47:27.975781+0000","last_peered":"2023-08-25T04:47:27.975781+0000","last_clean":"2023-08-25T04:47:27.975781+0000","last_became_active":"2023-08-25T04:47:26.990126+0000","last_became_peered":"2023-08-25T04:47:26.990126+0000","last_unstale":"2023-08-25T04:47:27.975781+0000","last_undegraded":"2023-08-25T04:47:27.975781+0000","last_fullsized":"2023-08-25T04:47:27.975781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:55:53.634899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975930+0000","last_change":"2023-08-25T04:47:25.971687+0000","last_active":"2023-08-25T04:47:27.975930+0000","last_peered":"2023-08-25T04:47:27.975930+0000","last_clean":"2023-08-25T04:47:27.975930+0000","last_became_active":"2023-08-25T04:47:25.971381+0000","last_became_peered":"2023-08-25T04:47:25.971381+0000","last_unstale":"2023-08-25T04:47:27.975930+0000","last_undegraded":"2023-08-25T04:47:27.975930+0000","last_fullsized":"2023-08-25T04:47:27.975930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:09:34.650925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294521+0000","last_change":"2023-08-25T04:47:26.986097+0000","last_active":"2023-08-25T04:47:28.294521+0000","last_peered":"2023-08-25T04:47:28.294521+0000","last_clean":"2023-08-25T04:47:28.294521+0000","last_became_active":"2023-08-25T04:47:26.985775+0000","last_became_peered":"2023-08-25T04:47:26.985775+0000","last_unstale":"2023-08-25T04:47:28.294521+0000","last_undegraded":"2023-08-25T04:47:28.294521+0000","last_fullsized":"2023-08-25T04:47:28.294521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:29.201880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341595+0000","last_change":"2023-08-25T04:47:25.971366+0000","last_active":"2023-08-25T04:47:28.341595+0000","last_peered":"2023-08-25T04:47:28.341595+0000","last_clean":"2023-08-25T04:47:28.341595+0000","last_became_active":"2023-08-25T04:47:25.971008+0000","last_became_peered":"2023-08-25T04:47:25.971008+0000","last_unstale":"2023-08-25T04:47:28.341595+0000","last_undegraded":"2023-08-25T04:47:28.341595+0000","last_fullsized":"2023-08-25T04:47:28.341595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:15.719795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340862+0000","last_change":"2023-08-25T04:47:26.982459+0000","last_active":"2023-08-25T04:47:28.340862+0000","last_peered":"2023-08-25T04:47:28.340862+0000","last_clean":"2023-08-25T04:47:28.340862+0000","last_became_active":"2023-08-25T04:47:26.982167+0000","last_became_peered":"2023-08-25T04:47:26.982167+0000","last_unstale":"2023-08-25T04:47:28.340862+0000","last_undegraded":"2023-08-25T04:47:28.340862+0000","last_fullsized":"2023-08-25T04:47:28.340862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:17:30.799221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294556+0000","last_change":"2023-08-25T04:47:25.976089+0000","last_active":"2023-08-25T04:47:28.294556+0000","last_peered":"2023-08-25T04:47:28.294556+0000","last_clean":"2023-08-25T04:47:28.294556+0000","last_became_active":"2023-08-25T04:47:25.975784+0000","last_became_peered":"2023-08-25T04:47:25.975784+0000","last_unstale":"2023-08-25T04:47:28.294556+0000","last_undegraded":"2023-08-25T04:47:28.294556+0000","last_fullsized":"2023-08-25T04:47:28.294556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:28:29.070405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294408+0000","last_change":"2023-08-25T04:47:26.985729+0000","last_active":"2023-08-25T04:47:28.294408+0000","last_peered":"2023-08-25T04:47:28.294408+0000","last_clean":"2023-08-25T04:47:28.294408+0000","last_became_active":"2023-08-25T04:47:26.985443+0000","last_became_peered":"2023-08-25T04:47:26.985443+0000","last_unstale":"2023-08-25T04:47:28.294408+0000","last_undegraded":"2023-08-25T04:47:28.294408+0000","last_fullsized":"2023-08-25T04:47:28.294408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:43:19.454137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'6","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976535+0000","last_change":"2023-08-25T04:47:25.973449+0000","last_active":"2023-08-25T04:47:27.976535+0000","last_peered":"2023-08-25T04:47:27.976535+0000","last_clean":"2023-08-25T04:47:27.976535+0000","last_became_active":"2023-08-25T04:47:25.973163+0000","last_became_peered":"2023-08-25T04:47:25.973163+0000","last_unstale":"2023-08-25T04:47:27.976535+0000","last_undegraded":"2023-08-25T04:47:27.976535+0000","last_fullsized":"2023-08-25T04:47:27.976535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:01.040705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342289+0000","last_change":"2023-08-25T04:47:26.989632+0000","last_active":"2023-08-25T04:47:28.342289+0000","last_peered":"2023-08-25T04:47:28.342289+0000","last_clean":"2023-08-25T04:47:28.342289+0000","last_became_active":"2023-08-25T04:47:26.988893+0000","last_became_peered":"2023-08-25T04:47:26.988893+0000","last_unstale":"2023-08-25T04:47:28.342289+0000","last_undegraded":"2023-08-25T04:47:28.342289+0000","last_fullsized":"2023-08-25T04:47:28.342289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:35:23.475124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341274+0000","last_change":"2023-08-25T04:47:25.974503+0000","last_active":"2023-08-25T04:47:28.341274+0000","last_peered":"2023-08-25T04:47:28.341274+0000","last_clean":"2023-08-25T04:47:28.341274+0000","last_became_active":"2023-08-25T04:47:25.974229+0000","last_became_peered":"2023-08-25T04:47:25.974229+0000","last_unstale":"2023-08-25T04:47:28.341274+0000","last_undegraded":"2023-08-25T04:47:28.341274+0000","last_fullsized":"2023-08-25T04:47:28.341274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:59:46.261855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341299+0000","last_change":"2023-08-25T04:47:26.986856+0000","last_active":"2023-08-25T04:47:28.341299+0000","last_peered":"2023-08-25T04:47:28.341299+0000","last_clean":"2023-08-25T04:47:28.341299+0000","last_became_active":"2023-08-25T04:47:26.986593+0000","last_became_peered":"2023-08-25T04:47:26.986593+0000","last_unstale":"2023-08-25T04:47:28.341299+0000","last_undegraded":"2023-08-25T04:47:28.341299+0000","last_fullsized":"2023-08-25T04:47:28.341299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:55.854167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294249+0000","last_change":"2023-08-25T04:47:25.969371+0000","last_active":"2023-08-25T04:47:28.294249+0000","last_peered":"2023-08-25T04:47:28.294249+0000","last_clean":"2023-08-25T04:47:28.294249+0000","last_became_active":"2023-08-25T04:47:25.969053+0000","last_became_peered":"2023-08-25T04:47:25.969053+0000","last_unstale":"2023-08-25T04:47:28.294249+0000","last_undegraded":"2023-08-25T04:47:28.294249+0000","last_fullsized":"2023-08-25T04:47:28.294249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:42.347250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340525+0000","last_change":"2023-08-25T04:47:26.966638+0000","last_active":"2023-08-25T04:47:28.340525+0000","last_peered":"2023-08-25T04:47:28.340525+0000","last_clean":"2023-08-25T04:47:28.340525+0000","last_became_active":"2023-08-25T04:47:26.966357+0000","last_became_peered":"2023-08-25T04:47:26.966357+0000","last_unstale":"2023-08-25T04:47:28.340525+0000","last_undegraded":"2023-08-25T04:47:28.340525+0000","last_fullsized":"2023-08-25T04:47:28.340525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:26:49.336901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340955+0000","last_change":"2023-08-25T04:47:25.975122+0000","last_active":"2023-08-25T04:47:28.340955+0000","last_peered":"2023-08-25T04:47:28.340955+0000","last_clean":"2023-08-25T04:47:28.340955+0000","last_became_active":"2023-08-25T04:47:25.974779+0000","last_became_peered":"2023-08-25T04:47:25.974779+0000","last_unstale":"2023-08-25T04:47:28.340955+0000","last_undegraded":"2023-08-25T04:47:28.340955+0000","last_fullsized":"2023-08-25T04:47:28.340955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:04:34.933981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294245+0000","last_change":"2023-08-25T04:47:26.985086+0000","last_active":"2023-08-25T04:47:28.294245+0000","last_peered":"2023-08-25T04:47:28.294245+0000","last_clean":"2023-08-25T04:47:28.294245+0000","last_became_active":"2023-08-25T04:47:26.984816+0000","last_became_peered":"2023-08-25T04:47:26.984816+0000","last_unstale":"2023-08-25T04:47:28.294245+0000","last_undegraded":"2023-08-25T04:47:28.294245+0000","last_fullsized":"2023-08-25T04:47:28.294245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:49.216946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340713+0000","last_change":"2023-08-25T04:47:25.971179+0000","last_active":"2023-08-25T04:47:28.340713+0000","last_peered":"2023-08-25T04:47:28.340713+0000","last_clean":"2023-08-25T04:47:28.340713+0000","last_became_active":"2023-08-25T04:47:25.970906+0000","last_became_peered":"2023-08-25T04:47:25.970906+0000","last_unstale":"2023-08-25T04:47:28.340713+0000","last_undegraded":"2023-08-25T04:47:28.340713+0000","last_fullsized":"2023-08-25T04:47:28.340713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:30:08.454351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976432+0000","last_change":"2023-08-25T04:47:26.978084+0000","last_active":"2023-08-25T04:47:27.976432+0000","last_peered":"2023-08-25T04:47:27.976432+0000","last_clean":"2023-08-25T04:47:27.976432+0000","last_became_active":"2023-08-25T04:47:26.977503+0000","last_became_peered":"2023-08-25T04:47:26.977503+0000","last_unstale":"2023-08-25T04:47:27.976432+0000","last_undegraded":"2023-08-25T04:47:27.976432+0000","last_fullsized":"2023-08-25T04:47:27.976432+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:54.378367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976212+0000","last_change":"2023-08-25T04:47:25.975496+0000","last_active":"2023-08-25T04:47:27.976212+0000","last_peered":"2023-08-25T04:47:27.976212+0000","last_clean":"2023-08-25T04:47:27.976212+0000","last_became_active":"2023-08-25T04:47:25.975245+0000","last_became_peered":"2023-08-25T04:47:25.975245+0000","last_unstale":"2023-08-25T04:47:27.976212+0000","last_undegraded":"2023-08-25T04:47:27.976212+0000","last_fullsized":"2023-08-25T04:47:27.976212+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:14.912050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341105+0000","last_change":"2023-08-25T04:47:26.993959+0000","last_active":"2023-08-25T04:47:28.341105+0000","last_peered":"2023-08-25T04:47:28.341105+0000","last_clean":"2023-08-25T04:47:28.341105+0000","last_became_active":"2023-08-25T04:47:26.993698+0000","last_became_peered":"2023-08-25T04:47:26.993698+0000","last_unstale":"2023-08-25T04:47:28.341105+0000","last_undegraded":"2023-08-25T04:47:28.341105+0000","last_fullsized":"2023-08-25T04:47:28.341105+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:16:53.101551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975905+0000","last_change":"2023-08-25T04:47:25.972518+0000","last_active":"2023-08-25T04:47:27.975905+0000","last_peered":"2023-08-25T04:47:27.975905+0000","last_clean":"2023-08-25T04:47:27.975905+0000","last_became_active":"2023-08-25T04:47:25.972235+0000","last_became_peered":"2023-08-25T04:47:25.972235+0000","last_unstale":"2023-08-25T04:47:27.975905+0000","last_undegraded":"2023-08-25T04:47:27.975905+0000","last_fullsized":"2023-08-25T04:47:27.975905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:30.017074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342087+0000","last_change":"2023-08-25T04:47:26.974035+0000","last_active":"2023-08-25T04:47:28.342087+0000","last_peered":"2023-08-25T04:47:28.342087+0000","last_clean":"2023-08-25T04:47:28.342087+0000","last_became_active":"2023-08-25T04:47:26.973088+0000","last_became_peered":"2023-08-25T04:47:26.973088+0000","last_unstale":"2023-08-25T04:47:28.342087+0000","last_undegraded":"2023-08-25T04:47:28.342087+0000","last_fullsized":"2023-08-25T04:47:28.342087+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:44.067685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341130+0000","last_change":"2023-08-25T04:47:25.972042+0000","last_active":"2023-08-25T04:47:28.341130+0000","last_peered":"2023-08-25T04:47:28.341130+0000","last_clean":"2023-08-25T04:47:28.341130+0000","last_became_active":"2023-08-25T04:47:25.971712+0000","last_became_peered":"2023-08-25T04:47:25.971712+0000","last_unstale":"2023-08-25T04:47:28.341130+0000","last_undegraded":"2023-08-25T04:47:28.341130+0000","last_fullsized":"2023-08-25T04:47:28.341130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:49.212372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342277+0000","last_change":"2023-08-25T04:47:26.981715+0000","last_active":"2023-08-25T04:47:28.342277+0000","last_peered":"2023-08-25T04:47:28.342277+0000","last_clean":"2023-08-25T04:47:28.342277+0000","last_became_active":"2023-08-25T04:47:26.977826+0000","last_became_peered":"2023-08-25T04:47:26.977826+0000","last_unstale":"2023-08-25T04:47:28.342277+0000","last_undegraded":"2023-08-25T04:47:28.342277+0000","last_fullsized":"2023-08-25T04:47:28.342277+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:32.750816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341374+0000","last_change":"2023-08-25T04:47:25.980540+0000","last_active":"2023-08-25T04:47:28.341374+0000","last_peered":"2023-08-25T04:47:28.341374+0000","last_clean":"2023-08-25T04:47:28.341374+0000","last_became_active":"2023-08-25T04:47:25.980257+0000","last_became_peered":"2023-08-25T04:47:25.980257+0000","last_unstale":"2023-08-25T04:47:28.341374+0000","last_undegraded":"2023-08-25T04:47:28.341374+0000","last_fullsized":"2023-08-25T04:47:28.341374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:52.134514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340880+0000","last_change":"2023-08-25T04:47:26.981214+0000","last_active":"2023-08-25T04:47:28.340880+0000","last_peered":"2023-08-25T04:47:28.340880+0000","last_clean":"2023-08-25T04:47:28.340880+0000","last_became_active":"2023-08-25T04:47:26.980728+0000","last_became_peered":"2023-08-25T04:47:26.980728+0000","last_unstale":"2023-08-25T04:47:28.340880+0000","last_undegraded":"2023-08-25T04:47:28.340880+0000","last_fullsized":"2023-08-25T04:47:28.340880+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:58.970685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341303+0000","last_change":"2023-08-25T04:47:25.975365+0000","last_active":"2023-08-25T04:47:28.341303+0000","last_peered":"2023-08-25T04:47:28.341303+0000","last_clean":"2023-08-25T04:47:28.341303+0000","last_became_active":"2023-08-25T04:47:25.975108+0000","last_became_peered":"2023-08-25T04:47:25.975108+0000","last_unstale":"2023-08-25T04:47:28.341303+0000","last_undegraded":"2023-08-25T04:47:28.341303+0000","last_fullsized":"2023-08-25T04:47:28.341303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:47:33.402199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977230+0000","last_change":"2023-08-25T04:47:26.969633+0000","last_active":"2023-08-25T04:47:27.977230+0000","last_peered":"2023-08-25T04:47:27.977230+0000","last_clean":"2023-08-25T04:47:27.977230+0000","last_became_active":"2023-08-25T04:47:26.969363+0000","last_became_peered":"2023-08-25T04:47:26.969363+0000","last_unstale":"2023-08-25T04:47:27.977230+0000","last_undegraded":"2023-08-25T04:47:27.977230+0000","last_fullsized":"2023-08-25T04:47:27.977230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:33:07.022783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340778+0000","last_change":"2023-08-25T04:47:25.975363+0000","last_active":"2023-08-25T04:47:28.340778+0000","last_peered":"2023-08-25T04:47:28.340778+0000","last_clean":"2023-08-25T04:47:28.340778+0000","last_became_active":"2023-08-25T04:47:25.975084+0000","last_became_peered":"2023-08-25T04:47:25.975084+0000","last_unstale":"2023-08-25T04:47:28.340778+0000","last_undegraded":"2023-08-25T04:47:28.340778+0000","last_fullsized":"2023-08-25T04:47:28.340778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:58.243694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.976283+0000","last_change":"2023-08-25T04:47:26.978269+0000","last_active":"2023-08-25T04:47:27.976283+0000","last_peered":"2023-08-25T04:47:27.976283+0000","last_clean":"2023-08-25T04:47:27.976283+0000","last_became_active":"2023-08-25T04:47:26.978005+0000","last_became_peered":"2023-08-25T04:47:26.978005+0000","last_unstale":"2023-08-25T04:47:27.976283+0000","last_undegraded":"2023-08-25T04:47:27.976283+0000","last_fullsized":"2023-08-25T04:47:27.976283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:52:04.634158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340919+0000","last_change":"2023-08-25T04:47:25.972001+0000","last_active":"2023-08-25T04:47:28.340919+0000","last_peered":"2023-08-25T04:47:28.340919+0000","last_clean":"2023-08-25T04:47:28.340919+0000","last_became_active":"2023-08-25T04:47:25.971700+0000","last_became_peered":"2023-08-25T04:47:25.971700+0000","last_unstale":"2023-08-25T04:47:28.340919+0000","last_undegraded":"2023-08-25T04:47:28.340919+0000","last_fullsized":"2023-08-25T04:47:28.340919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:58:46.076860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341066+0000","last_change":"2023-08-25T04:47:26.985686+0000","last_active":"2023-08-25T04:47:28.341066+0000","last_peered":"2023-08-25T04:47:28.341066+0000","last_clean":"2023-08-25T04:47:28.341066+0000","last_became_active":"2023-08-25T04:47:26.985426+0000","last_became_peered":"2023-08-25T04:47:26.985426+0000","last_unstale":"2023-08-25T04:47:28.341066+0000","last_undegraded":"2023-08-25T04:47:28.341066+0000","last_fullsized":"2023-08-25T04:47:28.341066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:00:35.491498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.293870+0000","last_change":"2023-08-25T04:47:25.972786+0000","last_active":"2023-08-25T04:47:28.293870+0000","last_peered":"2023-08-25T04:47:28.293870+0000","last_clean":"2023-08-25T04:47:28.293870+0000","last_became_active":"2023-08-25T04:47:25.972447+0000","last_became_peered":"2023-08-25T04:47:25.972447+0000","last_unstale":"2023-08-25T04:47:28.293870+0000","last_undegraded":"2023-08-25T04:47:28.293870+0000","last_fullsized":"2023-08-25T04:47:28.293870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:15.719795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341168+0000","last_change":"2023-08-25T04:47:26.981663+0000","last_active":"2023-08-25T04:47:28.341168+0000","last_peered":"2023-08-25T04:47:28.341168+0000","last_clean":"2023-08-25T04:47:28.341168+0000","last_became_active":"2023-08-25T04:47:26.981215+0000","last_became_peered":"2023-08-25T04:47:26.981215+0000","last_unstale":"2023-08-25T04:47:28.341168+0000","last_undegraded":"2023-08-25T04:47:28.341168+0000","last_fullsized":"2023-08-25T04:47:28.341168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:04.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975662+0000","last_change":"2023-08-25T04:47:25.974374+0000","last_active":"2023-08-25T04:47:27.975662+0000","last_peered":"2023-08-25T04:47:27.975662+0000","last_clean":"2023-08-25T04:47:27.975662+0000","last_became_active":"2023-08-25T04:47:25.974076+0000","last_became_peered":"2023-08-25T04:47:25.974076+0000","last_unstale":"2023-08-25T04:47:27.975662+0000","last_undegraded":"2023-08-25T04:47:27.975662+0000","last_fullsized":"2023-08-25T04:47:27.975662+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:55.920824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975711+0000","last_change":"2023-08-25T04:45:26.770775+0000","last_active":"2023-08-25T04:47:27.975711+0000","last_peered":"2023-08-25T04:47:27.975711+0000","last_clean":"2023-08-25T04:47:27.975711+0000","last_became_active":"2023-08-25T04:45:26.770447+0000","last_became_peered":"2023-08-25T04:45:26.770447+0000","last_unstale":"2023-08-25T04:47:27.975711+0000","last_undegraded":"2023-08-25T04:47:27.975711+0000","last_fullsized":"2023-08-25T04:47:27.975711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:05.207799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341007+0000","last_change":"2023-08-25T04:47:26.976963+0000","last_active":"2023-08-25T04:47:28.341007+0000","last_peered":"2023-08-25T04:47:28.341007+0000","last_clean":"2023-08-25T04:47:28.341007+0000","last_became_active":"2023-08-25T04:47:26.976708+0000","last_became_peered":"2023-08-25T04:47:26.976708+0000","last_unstale":"2023-08-25T04:47:28.341007+0000","last_undegraded":"2023-08-25T04:47:28.341007+0000","last_fullsized":"2023-08-25T04:47:28.341007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:20.114996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294474+0000","last_change":"2023-08-25T04:47:25.977339+0000","last_active":"2023-08-25T04:47:28.294474+0000","last_peered":"2023-08-25T04:47:28.294474+0000","last_clean":"2023-08-25T04:47:28.294474+0000","last_became_active":"2023-08-25T04:47:25.976992+0000","last_became_peered":"2023-08-25T04:47:25.976992+0000","last_unstale":"2023-08-25T04:47:28.294474+0000","last_undegraded":"2023-08-25T04:47:28.294474+0000","last_fullsized":"2023-08-25T04:47:28.294474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:25.928178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341492+0000","last_change":"2023-08-25T04:45:26.768222+0000","last_active":"2023-08-25T04:47:28.341492+0000","last_peered":"2023-08-25T04:47:28.341492+0000","last_clean":"2023-08-25T04:47:28.341492+0000","last_became_active":"2023-08-25T04:45:26.767875+0000","last_became_peered":"2023-08-25T04:45:26.767875+0000","last_unstale":"2023-08-25T04:47:28.341492+0000","last_undegraded":"2023-08-25T04:47:28.341492+0000","last_fullsized":"2023-08-25T04:47:28.341492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:43:48.980977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294423+0000","last_change":"2023-08-25T04:47:26.979143+0000","last_active":"2023-08-25T04:47:28.294423+0000","last_peered":"2023-08-25T04:47:28.294423+0000","last_clean":"2023-08-25T04:47:28.294423+0000","last_became_active":"2023-08-25T04:47:26.978851+0000","last_became_peered":"2023-08-25T04:47:26.978851+0000","last_unstale":"2023-08-25T04:47:28.294423+0000","last_undegraded":"2023-08-25T04:47:28.294423+0000","last_fullsized":"2023-08-25T04:47:28.294423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:55:55.890714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977190+0000","last_change":"2023-08-25T04:47:25.976678+0000","last_active":"2023-08-25T04:47:27.977190+0000","last_peered":"2023-08-25T04:47:27.977190+0000","last_clean":"2023-08-25T04:47:27.977190+0000","last_became_active":"2023-08-25T04:47:25.976396+0000","last_became_peered":"2023-08-25T04:47:25.976396+0000","last_unstale":"2023-08-25T04:47:27.977190+0000","last_undegraded":"2023-08-25T04:47:27.977190+0000","last_fullsized":"2023-08-25T04:47:27.977190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:02:43.618423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977348+0000","last_change":"2023-08-25T04:45:26.767948+0000","last_active":"2023-08-25T04:47:27.977348+0000","last_peered":"2023-08-25T04:47:27.977348+0000","last_clean":"2023-08-25T04:47:27.977348+0000","last_became_active":"2023-08-25T04:45:26.767496+0000","last_became_peered":"2023-08-25T04:45:26.767496+0000","last_unstale":"2023-08-25T04:47:27.977348+0000","last_undegraded":"2023-08-25T04:47:27.977348+0000","last_fullsized":"2023-08-25T04:47:27.977348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:04:37.260422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":204,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294146+0000","last_change":"2023-08-25T04:45:27.771979+0000","last_active":"2023-08-25T04:47:28.294146+0000","last_peered":"2023-08-25T04:47:28.294146+0000","last_clean":"2023-08-25T04:47:28.294146+0000","last_became_active":"2023-08-25T04:45:27.770968+0000","last_became_peered":"2023-08-25T04:45:27.770968+0000","last_unstale":"2023-08-25T04:47:28.294146+0000","last_undegraded":"2023-08-25T04:47:28.294146+0000","last_fullsized":"2023-08-25T04:47:28.294146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:26.752521+0000","last_clean_scrub_stamp":"2023-08-25T04:45:26.752521+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:45.223643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341528+0000","last_change":"2023-08-25T04:47:26.986062+0000","last_active":"2023-08-25T04:47:28.341528+0000","last_peered":"2023-08-25T04:47:28.341528+0000","last_clean":"2023-08-25T04:47:28.341528+0000","last_became_active":"2023-08-25T04:47:26.985718+0000","last_became_peered":"2023-08-25T04:47:26.985718+0000","last_unstale":"2023-08-25T04:47:28.341528+0000","last_undegraded":"2023-08-25T04:47:28.341528+0000","last_fullsized":"2023-08-25T04:47:28.341528+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:18:26.307820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294587+0000","last_change":"2023-08-25T04:47:25.974765+0000","last_active":"2023-08-25T04:47:28.294587+0000","last_peered":"2023-08-25T04:47:28.294587+0000","last_clean":"2023-08-25T04:47:28.294587+0000","last_became_active":"2023-08-25T04:47:25.974490+0000","last_became_peered":"2023-08-25T04:47:25.974490+0000","last_unstale":"2023-08-25T04:47:28.294587+0000","last_undegraded":"2023-08-25T04:47:28.294587+0000","last_fullsized":"2023-08-25T04:47:28.294587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:49:57.377910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294357+0000","last_change":"2023-08-25T04:45:26.807286+0000","last_active":"2023-08-25T04:47:28.294357+0000","last_peered":"2023-08-25T04:47:28.294357+0000","last_clean":"2023-08-25T04:47:28.294357+0000","last_became_active":"2023-08-25T04:45:26.806698+0000","last_became_peered":"2023-08-25T04:45:26.806698+0000","last_unstale":"2023-08-25T04:47:28.294357+0000","last_undegraded":"2023-08-25T04:47:28.294357+0000","last_fullsized":"2023-08-25T04:47:28.294357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:16.619190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341608+0000","last_change":"2023-08-25T04:47:26.986435+0000","last_active":"2023-08-25T04:47:28.341608+0000","last_peered":"2023-08-25T04:47:28.341608+0000","last_clean":"2023-08-25T04:47:28.341608+0000","last_became_active":"2023-08-25T04:47:26.985036+0000","last_became_peered":"2023-08-25T04:47:26.985036+0000","last_unstale":"2023-08-25T04:47:28.341608+0000","last_undegraded":"2023-08-25T04:47:28.341608+0000","last_fullsized":"2023-08-25T04:47:28.341608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:05:39.659358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.341311+0000","last_change":"2023-08-25T04:47:25.975191+0000","last_active":"2023-08-25T04:47:28.341311+0000","last_peered":"2023-08-25T04:47:28.341311+0000","last_clean":"2023-08-25T04:47:28.341311+0000","last_became_active":"2023-08-25T04:47:25.974782+0000","last_became_peered":"2023-08-25T04:47:25.974782+0000","last_unstale":"2023-08-25T04:47:28.341311+0000","last_undegraded":"2023-08-25T04:47:28.341311+0000","last_fullsized":"2023-08-25T04:47:28.341311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:30:08.454351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.294026+0000","last_change":"2023-08-25T04:45:26.807096+0000","last_active":"2023-08-25T04:47:28.294026+0000","last_peered":"2023-08-25T04:47:28.294026+0000","last_clean":"2023-08-25T04:47:28.294026+0000","last_became_active":"2023-08-25T04:45:26.806713+0000","last_became_peered":"2023-08-25T04:45:26.806713+0000","last_unstale":"2023-08-25T04:47:28.294026+0000","last_undegraded":"2023-08-25T04:47:28.294026+0000","last_fullsized":"2023-08-25T04:47:28.294026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:03:39.465642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342292+0000","last_change":"2023-08-25T04:47:26.990475+0000","last_active":"2023-08-25T04:47:28.342292+0000","last_peered":"2023-08-25T04:47:28.342292+0000","last_clean":"2023-08-25T04:47:28.342292+0000","last_became_active":"2023-08-25T04:47:26.990221+0000","last_became_peered":"2023-08-25T04:47:26.990221+0000","last_unstale":"2023-08-25T04:47:28.342292+0000","last_undegraded":"2023-08-25T04:47:28.342292+0000","last_fullsized":"2023-08-25T04:47:28.342292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:50:36.546904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:29.944900+0000","last_change":"2023-08-25T04:47:25.974503+0000","last_active":"2023-08-25T04:47:29.944900+0000","last_peered":"2023-08-25T04:47:29.944900+0000","last_clean":"2023-08-25T04:47:29.944900+0000","last_became_active":"2023-08-25T04:47:25.974239+0000","last_became_peered":"2023-08-25T04:47:25.974239+0000","last_unstale":"2023-08-25T04:47:29.944900+0000","last_undegraded":"2023-08-25T04:47:29.944900+0000","last_fullsized":"2023-08-25T04:47:29.944900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:52.498724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340768+0000","last_change":"2023-08-25T04:45:26.807065+0000","last_active":"2023-08-25T04:47:28.340768+0000","last_peered":"2023-08-25T04:47:28.340768+0000","last_clean":"2023-08-25T04:47:28.340768+0000","last_became_active":"2023-08-25T04:45:26.806737+0000","last_became_peered":"2023-08-25T04:45:26.806737+0000","last_unstale":"2023-08-25T04:47:28.340768+0000","last_undegraded":"2023-08-25T04:47:28.340768+0000","last_fullsized":"2023-08-25T04:47:28.340768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:15:35.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340694+0000","last_change":"2023-08-25T04:47:26.975927+0000","last_active":"2023-08-25T04:47:28.340694+0000","last_peered":"2023-08-25T04:47:28.340694+0000","last_clean":"2023-08-25T04:47:28.340694+0000","last_became_active":"2023-08-25T04:47:26.975639+0000","last_became_peered":"2023-08-25T04:47:26.975639+0000","last_unstale":"2023-08-25T04:47:28.340694+0000","last_undegraded":"2023-08-25T04:47:28.340694+0000","last_fullsized":"2023-08-25T04:47:28.340694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:38.476033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.977216+0000","last_change":"2023-08-25T04:47:25.976252+0000","last_active":"2023-08-25T04:47:27.977216+0000","last_peered":"2023-08-25T04:47:27.977216+0000","last_clean":"2023-08-25T04:47:27.977216+0000","last_became_active":"2023-08-25T04:47:25.975844+0000","last_became_peered":"2023-08-25T04:47:25.975844+0000","last_unstale":"2023-08-25T04:47:27.977216+0000","last_undegraded":"2023-08-25T04:47:27.977216+0000","last_fullsized":"2023-08-25T04:47:27.977216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:21:30.206142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342085+0000","last_change":"2023-08-25T04:45:26.807090+0000","last_active":"2023-08-25T04:47:28.342085+0000","last_peered":"2023-08-25T04:47:28.342085+0000","last_clean":"2023-08-25T04:47:28.342085+0000","last_became_active":"2023-08-25T04:45:26.806685+0000","last_became_peered":"2023-08-25T04:45:26.806685+0000","last_unstale":"2023-08-25T04:47:28.342085+0000","last_undegraded":"2023-08-25T04:47:28.342085+0000","last_fullsized":"2023-08-25T04:47:28.342085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:39.345242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:27.975802+0000","last_change":"2023-08-25T04:47:26.975225+0000","last_active":"2023-08-25T04:47:27.975802+0000","last_peered":"2023-08-25T04:47:27.975802+0000","last_clean":"2023-08-25T04:47:27.975802+0000","last_became_active":"2023-08-25T04:47:26.974877+0000","last_became_peered":"2023-08-25T04:47:26.974877+0000","last_unstale":"2023-08-25T04:47:27.975802+0000","last_undegraded":"2023-08-25T04:47:27.975802+0000","last_fullsized":"2023-08-25T04:47:27.975802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:25.943611+0000","last_clean_scrub_stamp":"2023-08-25T04:47:25.943611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:06:17.864760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.340768+0000","last_change":"2023-08-25T04:47:25.974342+0000","last_active":"2023-08-25T04:47:28.340768+0000","last_peered":"2023-08-25T04:47:28.340768+0000","last_clean":"2023-08-25T04:47:28.340768+0000","last_became_active":"2023-08-25T04:47:25.974066+0000","last_became_peered":"2023-08-25T04:47:25.974066+0000","last_unstale":"2023-08-25T04:47:28.340768+0000","last_undegraded":"2023-08-25T04:47:28.340768+0000","last_fullsized":"2023-08-25T04:47:28.340768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:47:24.932549+0000","last_clean_scrub_stamp":"2023-08-25T04:47:24.932549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:39:34.566353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-25T04:47:28.342415+0000","last_change":"2023-08-25T04:45:26.768150+0000","last_active":"2023-08-25T04:47:28.342415+0000","last_peered":"2023-08-25T04:47:28.342415+0000","last_clean":"2023-08-25T04:47:28.342415+0000","last_became_active":"2023-08-25T04:45:26.767845+0000","last_became_peered":"2023-08-25T04:45:26.767845+0000","last_unstale":"2023-08-25T04:47:28.342415+0000","last_undegraded":"2023-08-25T04:47:28.342415+0000","last_fullsized":"2023-08-25T04:47:28.342415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:45:25.749895+0000","last_clean_scrub_stamp":"2023-08-25T04:45:25.749895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:17.114194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":799095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66900000000000004,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76500000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.121,"15min":1.1919999999999999},"min":{"1min":0.36399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91700000000000004,"5min":11.452,"15min":11.452},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81499999999999995,"5min":1.528,"15min":1.528},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.93999999999999995,"15min":0.98799999999999999},"min":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89200000000000002,"5min":7.3620000000000001,"15min":7.3620000000000001},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.96699999999999997,"15min":1.014},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93600000000000005,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.90400000000000003,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.73099999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90500000000000003,"5min":1.694,"15min":1.694},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.109,"15min":1.165},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.95799999999999996,"5min":9.3689999999999998,"15min":9.3689999999999998},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.70799999999999996,"15min":0.69899999999999995},"min":{"1min":0.45400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.497,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97699999999999998,"5min":1.03,"15min":1.03},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0820000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89700000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.81999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":209309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.84199999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86699999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":0.871,"15min":0.871},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.76800000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.76800000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.94699999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.754}]},{"osd":5,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83899999999999997,"5min":1.042,"15min":1.042},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.67500000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91100000000000003,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.872}]},{"osd":7,"last update":"Fri Aug 25 04:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76400000000000001,"15min":0.76200000000000001},"min":{"1min":0.625,"5min":0.5,"15min":0.5},"max":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.625,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93100000000000005,"5min":1.171,"15min":1.171},"last":0.78600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":799075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.435,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60499999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.437,"15min":0.437},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.495,"15min":0.499},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.623}]},{"osd":3,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74299999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":0.998,"15min":0.998},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79800000000000004,"15min":0.81100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2849999999999999,"5min":1.357,"15min":1.357},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.96099999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80000000000000004,"15min":0.80900000000000005},"min":{"1min":0.60199999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1890000000000001,"5min":1.3,"15min":1.3},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79900000000000004,"15min":0.80900000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.032,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.0069999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:47:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.82099999999999995,"15min":0.83299999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.103,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.038}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":207735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":0.998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.63900000000000001,"15min":0.66500000000000004},"min":{"1min":0.372,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95299999999999996,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.49099999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.50900000000000001,"15min":0.51800000000000002},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.61499999999999999,"15min":0.63900000000000001},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.89200000000000002,"5min":4.6020000000000003,"15min":4.6020000000000003},"last":0.441}]},{"osd":3,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.52000000000000002,"15min":0.53800000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57699999999999996,"5min":1.611,"15min":1.611},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91800000000000004,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.83699999999999997,"15min":0.86199999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.113,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0049999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.629}]},{"osd":5,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.76700000000000002,"15min":0.77400000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1719999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0209999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.753,"15min":0.76000000000000001},"min":{"1min":0.57499999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.091,"5min":1.236,"15min":1.236},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.88500000000000001,"15min":0.91700000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0589999999999999,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Aug 25 04:47:27 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.92500000000000004,"15min":0.95499999999999996},"min":{"1min":0.61799999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.998,"5min":4.4580000000000002,"15min":4.4580000000000002},"last":0.754},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96099999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.55200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":210271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47899999999999998,"15min":0.49099999999999999},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.52200000000000002,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":1.111,"15min":1.2210000000000001},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.56299999999999994,"5min":15.301,"15min":15.301},"last":0.442}]},{"osd":1,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59899999999999998,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.1499999999999999,"15min":1.2629999999999999},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.54800000000000004,"5min":15.334,"15min":15.334},"last":0.501}]},{"osd":3,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.63200000000000001,"15min":0.66200000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.55300000000000005,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.61799999999999999,"15min":0.63800000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.58399999999999996,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.65400000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.512,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":1.4079999999999999,"15min":1.506},"min":{"1min":0.54700000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.163,"5min":15.172000000000001,"15min":15.172000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.90600000000000003,"15min":0.92100000000000004},"min":{"1min":0.56399999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.23,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.875,"15min":0.877},"min":{"1min":0.60399999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.474,"5min":1.956,"15min":1.956},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.4330000000000001,"15min":1.53},"min":{"1min":0.54400000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.431,"5min":15.266,"15min":15.266},"last":0.751},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95799999999999996,"15min":0.97399999999999998},"min":{"1min":0.65500000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5309999999999999,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.60799999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.4650000000000001,"15min":1.5669999999999999},"min":{"1min":0.57499999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.401,"5min":15.227,"15min":15.227},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.96899999999999997,"15min":0.98599999999999999},"min":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.411,"5min":4.077,"15min":4.077},"last":0.72699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":209275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.93700000000000006,"15min":1.0289999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56299999999999994,"5min":12.221,"15min":12.221},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.872,"15min":0.94999999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.499,"5min":10.331,"15min":10.331},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.48999999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.59999999999999998,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.95799999999999996,"15min":1.04},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.56399999999999995,"5min":10.361000000000001,"15min":10.361000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.495,"5min":0.59999999999999998,"15min":0.61799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72699999999999998,"5min":1.589,"15min":1.589},"last":0.752}]},{"osd":4,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":1.1279999999999999,"15min":1.202},"min":{"1min":0.53000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.86899999999999999,"5min":10.295999999999999,"15min":10.295999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.56200000000000006,"5min":0.503,"15min":0.503},"max":{"1min":0.90500000000000003,"5min":11.097,"15min":11.097},"last":0.99299999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90000000000000002,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":1.139,"15min":1.2070000000000001},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90800000000000003,"5min":10.252000000000001,"15min":10.252000000000001},"last":0.97599999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":1.179,"15min":1.2509999999999999},"min":{"1min":0.59399999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93799999999999994,"5min":11.058999999999999,"15min":11.058999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0109999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0109999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:47:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":1.171,"15min":1.2430000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.92000000000000004,"5min":10.206,"15min":10.206},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":1.1950000000000001,"15min":1.2729999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95799999999999996,"5min":11.013,"15min":11.013},"last":0.89000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":210249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.46300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.63400000000000001,"15min":0.625},"min":{"1min":0.432,"5min":0.31,"15min":0.31},"max":{"1min":0.84799999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.47399999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85399999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.56699999999999995,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.53900000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.82499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88500000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.496,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85299999999999998,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.46800000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0049999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68899999999999995,"15min":0.68999999999999995},"min":{"1min":0.51300000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88500000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53200000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91200000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.625,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96299999999999997,"5min":1.339,"15min":1.339},"last":0.499}]},{"osd":7,"last update":"Fri Aug 25 04:47:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72799999999999998,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98199999999999998,"5min":0.997,"15min":0.997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.59299999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.026,"5min":1.145,"15min":1.145},"last":0.72399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":208707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80200000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82499999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.628},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68000000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.875,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.504}]},{"osd":3,"last update":"Fri Aug 25 04:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.83499999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.349,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.79300000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.43099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94799999999999995,"5min":1.157,"15min":1.157},"last":0.57799999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89300000000000002,"5min":1.407,"15min":1.407},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91700000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Aug 25 04:47:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.51200000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1,"5min":1.256,"15min":1.256},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.95699999999999996,"5min":1.778,"15min":1.778},"last":0.73599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:47:36.760 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:47:36.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T04:47:36.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.993+0000 7f1935dff700 1 Processor -- start 2023-08-25T04:47:36.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.993+0000 7f1935dff700 1 -- start start 2023-08-25T04:47:36.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.994+0000 7f1935dff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f193015d170 0x7f19300d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:36.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.994+0000 7f1935dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f19300b89f0 0x7f19300cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:36.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.994+0000 7f1935dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19300ce4a0 con 0x7f19300ce090 2023-08-25T04:47:36.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.994+0000 7f1935dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19300d19a0 con 0x7f19300b89f0 2023-08-25T04:47:36.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.994+0000 7f1935dff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19300d1c80 con 0x7f193015d170 2023-08-25T04:47:36.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.994+0000 7f192effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f19300b89f0 0x7f19300cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.994+0000 7f192ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f19300ce090 0x7f19300b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51126/0 (socket says 172.21.15.72:51126) 2023-08-25T04:47:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.994+0000 7f192ffff700 1 -- 172.21.15.72:0/2039970085 learned_addr learned my addr 172.21.15.72:0/2039970085 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.994+0000 7f192f7fe700 1 --2- 172.21.15.72:0/2039970085 >> v2:172.21.15.137:3300/0 conn(0x7f193015d170 0x7f19300d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.995+0000 7f192e7fc700 1 -- 172.21.15.72:0/2039970085 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891453166 0 0) 0x7f19300ce4a0 con 0x7f19300ce090 2023-08-25T04:47:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.995+0000 7f192e7fc700 1 -- 172.21.15.72:0/2039970085 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19180035b0 con 0x7f19300ce090 2023-08-25T04:47:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.995+0000 7f192effd700 1 -- 172.21.15.72:0/2039970085 >> v2:172.21.15.137:3300/0 conn(0x7f193015d170 msgr2=0x7f19300d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.995+0000 7f192effd700 1 --2- 172.21.15.72:0/2039970085 >> v2:172.21.15.137:3300/0 conn(0x7f193015d170 0x7f19300d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.995+0000 7f192effd700 1 -- 172.21.15.72:0/2039970085 >> v1:172.21.15.72:6789/0 conn(0x7f19300ce090 legacy=0x7f19300b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:36.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.995+0000 7f192effd700 1 -- 172.21.15.72:0/2039970085 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19300d1f60 con 0x7f19300b89f0 2023-08-25T04:47:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.995+0000 7f192effd700 1 --2- 172.21.15.72:0/2039970085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19300b89f0 0x7f19300cdb50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f19300d3e80 tx=0x7f1924009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba8678f8bb1495 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.995+0000 7f192e7fc700 1 -- 172.21.15.72:0/2039970085 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924011830 con 0x7f19300b89f0 2023-08-25T04:47:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.995+0000 7f192e7fc700 1 -- 172.21.15.72:0/2039970085 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1924011990 con 0x7f19300b89f0 2023-08-25T04:47:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.995+0000 7f192e7fc700 1 -- 172.21.15.72:0/2039970085 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924011d20 con 0x7f19300b89f0 2023-08-25T04:47:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.996+0000 7f1935dff700 1 -- 172.21.15.72:0/2039970085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19300b89f0 msgr2=0x7f19300cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.996+0000 7f1935dff700 1 --2- 172.21.15.72:0/2039970085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19300b89f0 0x7f19300cdb50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f19300d3e80 tx=0x7f1924009b20 comp rx=0 tx=0).stop 2023-08-25T04:47:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.996+0000 7f1935dff700 1 -- 172.21.15.72:0/2039970085 shutdown_connections 2023-08-25T04:47:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.996+0000 7f1935dff700 1 --2- 172.21.15.72:0/2039970085 >> v2:172.21.15.137:3300/0 conn(0x7f193015d170 0x7f19300d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.996+0000 7f1935dff700 1 --2- 172.21.15.72:0/2039970085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19300b89f0 0x7f19300cdb50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.996+0000 7f1935dff700 1 -- 172.21.15.72:0/2039970085 >> 172.21.15.72:0/2039970085 conn(0x7f1930071e10 msgr2=0x7f1930072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.996+0000 7f1935dff700 1 -- 172.21.15.72:0/2039970085 shutdown_connections 2023-08-25T04:47:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.996+0000 7f1935dff700 1 -- 172.21.15.72:0/2039970085 wait complete. 2023-08-25T04:47:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.998+0000 7f1935dff700 1 Processor -- start 2023-08-25T04:47:37.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.998+0000 7f1935dff700 1 -- start start 2023-08-25T04:47:37.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f1935dff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19300b89f0 0x7f19301f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:37.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f1935dff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19300ce090 0x7f19301f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:37.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f1935dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f193015d170 0x7f19301f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:37.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f1935dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193015a520 con 0x7f193015d170 2023-08-25T04:47:37.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f1935dff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19300b27e0 con 0x7f19300b89f0 2023-08-25T04:47:37.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f1935dff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19300b3040 con 0x7f19300ce090 2023-08-25T04:47:37.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f192ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f193015d170 0x7f19301f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:37.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f192ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f193015d170 0x7f19301f6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47410/0 (socket says 172.21.15.72:47410) 2023-08-25T04:47:37.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f192ffff700 1 -- 172.21.15.72:0/22708537 learned_addr learned my addr 172.21.15.72:0/22708537 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:37.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f192effd700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19300ce090 0x7f19301f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:37.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:36.999+0000 7f192f7fe700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19300b89f0 0x7f19301f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:37.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f192ffff700 1 -- 172.21.15.72:0/22708537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19300ce090 msgr2=0x7f19301f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:37.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f192ffff700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19300ce090 0x7f19301f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f192ffff700 1 -- 172.21.15.72:0/22708537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19300b89f0 msgr2=0x7f19301f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:37.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f192ffff700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19300b89f0 0x7f19301f1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f192ffff700 1 -- 172.21.15.72:0/22708537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240094a0 con 0x7f193015d170 2023-08-25T04:47:37.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f192effd700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19300ce090 0x7f19301f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:37.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f192f7fe700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19300b89f0 0x7f19301f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:37.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f192ffff700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f193015d170 0x7f19301f6260 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f192800cb40 tx=0x7f192800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:37.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f1917fff700 1 -- 172.21.15.72:0/22708537 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800ab50 con 0x7f193015d170 2023-08-25T04:47:37.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f1917fff700 1 -- 172.21.15.72:0/22708537 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192800acb0 con 0x7f193015d170 2023-08-25T04:47:37.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f1935dff700 1 -- 172.21.15.72:0/22708537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19301f6aa0 con 0x7f193015d170 2023-08-25T04:47:37.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f1917fff700 1 -- 172.21.15.72:0/22708537 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928012620 con 0x7f193015d170 2023-08-25T04:47:37.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.000+0000 7f1935dff700 1 -- 172.21.15.72:0/22708537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19300b2cd0 con 0x7f193015d170 2023-08-25T04:47:37.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.001+0000 7f1935dff700 1 -- 172.21.15.72:0/22708537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193006a2f0 con 0x7f193015d170 2023-08-25T04:47:37.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.002+0000 7f1917fff700 1 -- 172.21.15.72:0/22708537 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f192801b3b0 con 0x7f193015d170 2023-08-25T04:47:37.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.003+0000 7f1917fff700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191c06a0e0 0x7f191c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:37.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.003+0000 7f1917fff700 1 -- 172.21.15.72:0/22708537 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1928088460 con 0x7f193015d170 2023-08-25T04:47:37.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.003+0000 7f192f7fe700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191c06a0e0 0x7f191c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:37.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.004+0000 7f192f7fe700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191c06a0e0 0x7f191c06c5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1920009b60 tx=0x7f1920008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:37.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.007+0000 7f1917fff700 1 -- 172.21.15.72:0/22708537 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1928053a00 con 0x7f193015d170 2023-08-25T04:47:37.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.283+0000 7f1935dff700 1 -- 172.21.15.72:0/22708537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f193004e620 con 0x7f193015d170 2023-08-25T04:47:37.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.287+0000 7f1917fff700 1 -- 172.21.15.72:0/22708537 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1928057020 con 0x7f193015d170 2023-08-25T04:47:37.287 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-08-25T04:47:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCzMehkm9HlCRAAFQVBmTswDkoqPJVY2o1K/Q== 2023-08-25T04:47:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2023-08-25T04:47:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2023-08-25T04:47:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T04:47:37.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 -- 172.21.15.72:0/22708537 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191c06a0e0 msgr2=0x7f191c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:37.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191c06a0e0 0x7f191c06c5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1920009b60 tx=0x7f1920008040 comp rx=0 tx=0).stop 2023-08-25T04:47:37.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 -- 172.21.15.72:0/22708537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f193015d170 msgr2=0x7f19301f6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:37.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f193015d170 0x7f19301f6260 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f192800cb40 tx=0x7f192800cf00 comp rx=0 tx=0).stop 2023-08-25T04:47:37.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 -- 172.21.15.72:0/22708537 shutdown_connections 2023-08-25T04:47:37.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f191c06a0e0 0x7f191c06c5a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f193015d170 0x7f19301f6260 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19300b89f0 0x7f19301f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 --2- 172.21.15.72:0/22708537 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f19300ce090 0x7f19301f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 -- 172.21.15.72:0/22708537 >> 172.21.15.72:0/22708537 conn(0x7f1930071e10 msgr2=0x7f19300d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:37.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 -- 172.21.15.72:0/22708537 shutdown_connections 2023-08-25T04:47:37.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.289+0000 7f1935dff700 1 -- 172.21.15.72:0/22708537 wait complete. 2023-08-25T04:47:37.291 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-25T04:47:37.307 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:47:37.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.507+0000 7fe5bc3ff700 1 Processor -- start 2023-08-25T04:47:37.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.507+0000 7fe5bc3ff700 1 -- start start 2023-08-25T04:47:37.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.508+0000 7fe5bc3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:37.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.508+0000 7fe5bc3ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe5b40b86b0 0x7fe5b40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:37.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.508+0000 7fe5bc3ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b40d1780 con 0x7fe5b40b47c0 2023-08-25T04:47:37.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.508+0000 7fe5bc3ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b40d1a60 con 0x7fe5b40b86b0 2023-08-25T04:47:37.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.508+0000 7fe5bc3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40d1d40 con 0x7fe5b415d130 2023-08-25T04:47:37.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5b999a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:37.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5b999a700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.72:45944/0 (socket says 172.21.15.72:45944) 2023-08-25T04:47:37.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5b999a700 1 -- 172.21.15.72:0/1560884933 learned_addr learned my addr 172.21.15.72:0/1560884933 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5ba19b700 1 --1- 172.21.15.72:0/1560884933 >> v1:172.21.15.137:6789/0 conn(0x7fe5b40b47c0 0x7fe5b40b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.72:43126/0 (socket says 172.21.15.72:43126) 2023-08-25T04:47:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5ba99c700 1 --2- 172.21.15.72:0/1560884933 >> v2:172.21.15.137:3300/0 conn(0x7fe5b40b86b0 0x7fe5b40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5b9199700 1 -- 172.21.15.72:0/1560884933 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100103229 0 0) 0x7fe5b40d1780 con 0x7fe5b40b47c0 2023-08-25T04:47:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5b9199700 1 -- 172.21.15.72:0/1560884933 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a00035b0 con 0x7fe5b40b47c0 2023-08-25T04:47:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5b999a700 1 -- 172.21.15.72:0/1560884933 >> v2:172.21.15.137:3300/0 conn(0x7fe5b40b86b0 msgr2=0x7fe5b40b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5b999a700 1 --2- 172.21.15.72:0/1560884933 >> v2:172.21.15.137:3300/0 conn(0x7fe5b40b86b0 0x7fe5b40b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5b999a700 1 -- 172.21.15.72:0/1560884933 >> v1:172.21.15.137:6789/0 conn(0x7fe5b40b47c0 legacy=0x7fe5b40b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5b999a700 1 -- 172.21.15.72:0/1560884933 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40d2020 con 0x7fe5b415d130 2023-08-25T04:47:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.509+0000 7fe5ba99c700 1 --2- 172.21.15.72:0/1560884933 >> v2:172.21.15.137:3300/0 conn(0x7fe5b40b86b0 0x7fe5b40b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:47:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.510+0000 7fe5b999a700 1 --2- 172.21.15.72:0/1560884933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40d0e80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40098f0 tx=0x7fe5a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0196a4728be7378 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:37.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.510+0000 7fe5b9199700 1 -- 172.21.15.72:0/1560884933 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4011830 con 0x7fe5b415d130 2023-08-25T04:47:37.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.510+0000 7fe5b9199700 1 -- 172.21.15.72:0/1560884933 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a4011990 con 0x7fe5b415d130 2023-08-25T04:47:37.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.510+0000 7fe5b9199700 1 -- 172.21.15.72:0/1560884933 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4011d00 con 0x7fe5b415d130 2023-08-25T04:47:37.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.510+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/1560884933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 msgr2=0x7fe5b40d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:37.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.510+0000 7fe5bc3ff700 1 --2- 172.21.15.72:0/1560884933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40d0e80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40098f0 tx=0x7fe5a4009c00 comp rx=0 tx=0).stop 2023-08-25T04:47:37.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.510+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/1560884933 shutdown_connections 2023-08-25T04:47:37.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.510+0000 7fe5bc3ff700 1 --2- 172.21.15.72:0/1560884933 >> v2:172.21.15.137:3300/0 conn(0x7fe5b40b86b0 0x7fe5b40b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.510+0000 7fe5bc3ff700 1 --2- 172.21.15.72:0/1560884933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40d0e80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.510+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/1560884933 >> 172.21.15.72:0/1560884933 conn(0x7fe5b4072050 msgr2=0x7fe5b40d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:37.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.511+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/1560884933 shutdown_connections 2023-08-25T04:47:37.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.511+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/1560884933 wait complete. 2023-08-25T04:47:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.512+0000 7fe5bc3ff700 1 Processor -- start 2023-08-25T04:47:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.512+0000 7fe5bc3ff700 1 -- start start 2023-08-25T04:47:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.513+0000 7fe5bc3ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5b40b47c0 0x7fe5b40ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.513+0000 7fe5bc3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b40b86b0 0x7fe5b4150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.513+0000 7fe5bc3ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.513+0000 7fe5bc3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b41511d0 con 0x7fe5b40b86b0 2023-08-25T04:47:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.513+0000 7fe5bc3ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b41514b0 con 0x7fe5b40b47c0 2023-08-25T04:47:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.513+0000 7fe5bc3ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4151790 con 0x7fe5b415d130 2023-08-25T04:47:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5b999a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b40b86b0 0x7fe5b4150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5b999a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b40b86b0 0x7fe5b4150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47416/0 (socket says 172.21.15.72:47416) 2023-08-25T04:47:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5b999a700 1 -- 172.21.15.72:0/901085430 learned_addr learned my addr 172.21.15.72:0/901085430 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5ba99c700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5ba19b700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5b40b47c0 0x7fe5b40ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5b999a700 1 -- 172.21.15.72:0/901085430 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 msgr2=0x7fe5b40c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5b999a700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5b999a700 1 -- 172.21.15.72:0/901085430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5b40b47c0 msgr2=0x7fe5b40ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5b999a700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5b40b47c0 0x7fe5b40ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5b999a700 1 -- 172.21.15.72:0/901085430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac009a70 con 0x7fe5b40b86b0 2023-08-25T04:47:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5ba99c700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5b999a700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b40b86b0 0x7fe5b4150960 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009c40 tx=0x7fe5a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.514+0000 7fe5aaffd700 1 -- 172.21.15.72:0/901085430 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a40044d0 con 0x7fe5b40b86b0 2023-08-25T04:47:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.515+0000 7fe5aaffd700 1 -- 172.21.15.72:0/901085430 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a401e070 con 0x7fe5b40b86b0 2023-08-25T04:47:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.515+0000 7fe5aaffd700 1 -- 172.21.15.72:0/901085430 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a40038c0 con 0x7fe5b40b86b0 2023-08-25T04:47:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.515+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/901085430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a4009550 con 0x7fe5b40b86b0 2023-08-25T04:47:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.515+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/901085430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b4150ea0 con 0x7fe5b40b86b0 2023-08-25T04:47:37.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.516+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/901085430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b404e620 con 0x7fe5b40b86b0 2023-08-25T04:47:37.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.517+0000 7fe5aaffd700 1 -- 172.21.15.72:0/901085430 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe5a4003a20 con 0x7fe5b40b86b0 2023-08-25T04:47:37.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.517+0000 7fe5aaffd700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe59806a0e0 0x7fe59806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:37.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.517+0000 7fe5aaffd700 1 -- 172.21.15.72:0/901085430 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe5a40896b0 con 0x7fe5b40b86b0 2023-08-25T04:47:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.518+0000 7fe5ba19b700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe59806a0e0 0x7fe59806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.518+0000 7fe5ba19b700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe59806a0e0 0x7fe59806c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0000f60 tx=0x7fe5b0007ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.522+0000 7fe5aaffd700 1 -- 172.21.15.72:0/901085430 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe5a4054bc0 con 0x7fe5b40b86b0 2023-08-25T04:47:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.761+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/901085430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5b40b8190 con 0x7fe5b40b86b0 2023-08-25T04:47:37.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.761+0000 7fe5aaffd700 1 -- 172.21.15.72:0/901085430 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4881 (secure 0 0 0) 0x7fe5a40581e0 con 0x7fe5b40b86b0 2023-08-25T04:47:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:37.762 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2948105792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2948105792},{"type":"v1","addr":"172.21.15.72:6837","nonce":2948105792}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5072,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6834/3708335854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3708335854},{"type":"v1","addr":"172.21.15.137:6834","nonce":3708335854}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3308589916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3308589916},{"type":"v1","addr":"172.21.15.72:6836","nonce":3308589916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:47:26.449921+0000","modified":"2023-08-25T04:47:29.982198+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6835/2622594168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6833","nonce":2622594168},{"type":"v1","addr":"172.21.15.137:6835","nonce":2622594168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-25T04:47:37.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/901085430 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe59806a0e0 msgr2=0x7fe59806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:37.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe59806a0e0 0x7fe59806c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0000f60 tx=0x7fe5b0007ba0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/901085430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b40b86b0 msgr2=0x7fe5b4150960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:37.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b40b86b0 0x7fe5b4150960 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009c40 tx=0x7fe5a4004750 comp rx=0 tx=0).stop 2023-08-25T04:47:37.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/901085430 shutdown_connections 2023-08-25T04:47:37.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fe59806a0e0 0x7fe59806c5a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe5b415d130 0x7fe5b40c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5b40b47c0 0x7fe5b40ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 --2- 172.21.15.72:0/901085430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b40b86b0 0x7fe5b4150960 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:37.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/901085430 >> 172.21.15.72:0/901085430 conn(0x7fe5b4072050 msgr2=0x7fe5b415b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:37.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/901085430 shutdown_connections 2023-08-25T04:47:37.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:37.764+0000 7fe5bc3ff700 1 -- 172.21.15.72:0/901085430 wait complete. 2023-08-25T04:47:37.765 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 16 2023-08-25T04:47:38.184 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:47:26.449921+0000', 'modified': '2023-08-25T04:47:29.982198+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5646': {'gid': 5646, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.137:6835/2622594168', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6833', 'nonce': 2622594168}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 2622594168}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:47:38.184 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:47:38.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-25T04:47:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.382+0000 7f08315ff700 1 Processor -- start 2023-08-25T04:47:38.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.383+0000 7f08315ff700 1 -- start start 2023-08-25T04:47:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.384+0000 7f08315ff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f082c070890 0x7f082c0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.384+0000 7f08315ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c0b1870 con 0x7f082c159ff0 2023-08-25T04:47:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.384+0000 7f08315ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c0b46a0 con 0x7f082c0b0f50 2023-08-25T04:47:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.384+0000 7f08315ff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082c070de0 con 0x7f082c070890 2023-08-25T04:47:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.384+0000 7f082affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f082c159ff0 0x7f082c0b0840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51128/0 (socket says 172.21.15.72:51128) 2023-08-25T04:47:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.384+0000 7f082affd700 1 -- 172.21.15.72:0/2933147431 learned_addr learned my addr 172.21.15.72:0/2933147431 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:47:38.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.384+0000 7f0823fff700 1 --2- 172.21.15.72:0/2933147431 >> v2:172.21.15.137:3300/0 conn(0x7f082c070890 0x7f082c0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.385+0000 7f082a7fc700 1 -- 172.21.15.72:0/2933147431 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036692156 0 0) 0x7f082c0b1870 con 0x7f082c159ff0 2023-08-25T04:47:38.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.385+0000 7f082a7fc700 1 -- 172.21.15.72:0/2933147431 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08180057c0 con 0x7f082c159ff0 2023-08-25T04:47:38.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.385+0000 7f082a7fc700 1 -- 172.21.15.72:0/2933147431 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344138689 0 0) 0x7f082c0b46a0 con 0x7f082c0b0f50 2023-08-25T04:47:38.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.385+0000 7f082a7fc700 1 -- 172.21.15.72:0/2933147431 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f082c0b1870 con 0x7f082c0b0f50 2023-08-25T04:47:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.385+0000 7f0823fff700 1 -- 172.21.15.72:0/2933147431 >> v1:172.21.15.137:6789/0 conn(0x7f082c0b0f50 legacy=0x7f082c0ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.385+0000 7f0823fff700 1 -- 172.21.15.72:0/2933147431 >> v1:172.21.15.72:6789/0 conn(0x7f082c159ff0 legacy=0x7f082c0b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.385+0000 7f0823fff700 1 -- 172.21.15.72:0/2933147431 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c0710c0 con 0x7f082c070890 2023-08-25T04:47:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.385+0000 7f0823fff700 1 --2- 172.21.15.72:0/2933147431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f082c070890 0x7f082c0ca980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0814009840 tx=0x7f0814009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e79a7e208136d699 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.385+0000 7f082a7fc700 1 -- 172.21.15.72:0/2933147431 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814011830 con 0x7f082c070890 2023-08-25T04:47:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.386+0000 7f082a7fc700 1 -- 172.21.15.72:0/2933147431 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0814011990 con 0x7f082c070890 2023-08-25T04:47:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.386+0000 7f082a7fc700 1 -- 172.21.15.72:0/2933147431 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814011d20 con 0x7f082c070890 2023-08-25T04:47:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.386+0000 7f08315ff700 1 -- 172.21.15.72:0/2933147431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f082c070890 msgr2=0x7f082c0ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.386+0000 7f08315ff700 1 --2- 172.21.15.72:0/2933147431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f082c070890 0x7f082c0ca980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0814009840 tx=0x7f0814009b50 comp rx=0 tx=0).stop 2023-08-25T04:47:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.386+0000 7f08315ff700 1 -- 172.21.15.72:0/2933147431 shutdown_connections 2023-08-25T04:47:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.386+0000 7f08315ff700 1 --2- 172.21.15.72:0/2933147431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f082c070890 0x7f082c0ca980 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.386+0000 7f08315ff700 1 -- 172.21.15.72:0/2933147431 >> 172.21.15.72:0/2933147431 conn(0x7f082c0ce9a0 msgr2=0x7f082c0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.386+0000 7f08315ff700 1 -- 172.21.15.72:0/2933147431 shutdown_connections 2023-08-25T04:47:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.386+0000 7f08315ff700 1 -- 172.21.15.72:0/2933147431 wait complete. 2023-08-25T04:47:38.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.388+0000 7f08315ff700 1 Processor -- start 2023-08-25T04:47:38.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.388+0000 7f08315ff700 1 -- start start 2023-08-25T04:47:38.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.389+0000 7f08315ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f082c070890 0x7f082c1f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.389+0000 7f08315ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f082c0b0f50 0x7f082c1edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.389+0000 7f08315ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f082c159ff0 0x7f082c0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.389+0000 7f08315ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0c70e0 con 0x7f082c159ff0 2023-08-25T04:47:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.389+0000 7f08315ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c1f2a40 con 0x7f082c0b0f50 2023-08-25T04:47:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.389+0000 7f08315ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082c1ee450 con 0x7f082c070890 2023-08-25T04:47:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.389+0000 7f082b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f082c159ff0 0x7f082c0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.389+0000 7f082b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f082c159ff0 0x7f082c0cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47420/0 (socket says 172.21.15.72:47420) 2023-08-25T04:47:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.389+0000 7f082b7fe700 1 -- 172.21.15.72:0/145630490 learned_addr learned my addr 172.21.15.72:0/145630490 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f082affd700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f082c070890 0x7f082c1f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f0823fff700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f082c0b0f50 0x7f082c1edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f082b7fe700 1 -- 172.21.15.72:0/145630490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f082c070890 msgr2=0x7f082c1f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f082b7fe700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f082c070890 0x7f082c1f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f082b7fe700 1 -- 172.21.15.72:0/145630490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f082c0b0f50 msgr2=0x7f082c1edf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f082b7fe700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f082c0b0f50 0x7f082c1edf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f082b7fe700 1 -- 172.21.15.72:0/145630490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08140094a0 con 0x7f082c159ff0 2023-08-25T04:47:38.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f082affd700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f082c070890 0x7f082c1f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:38.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f0823fff700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f082c0b0f50 0x7f082c1edf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:47:38.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f082b7fe700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f082c159ff0 0x7f082c0cd680 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f082400cc20 tx=0x7f082400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:38.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f08237fe700 1 -- 172.21.15.72:0/145630490 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082400ac20 con 0x7f082c159ff0 2023-08-25T04:47:38.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f08237fe700 1 -- 172.21.15.72:0/145630490 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082400ad80 con 0x7f082c159ff0 2023-08-25T04:47:38.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f08237fe700 1 -- 172.21.15.72:0/145630490 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824003c20 con 0x7f082c159ff0 2023-08-25T04:47:38.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f08315ff700 1 -- 172.21.15.72:0/145630490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c0c96d0 con 0x7f082c159ff0 2023-08-25T04:47:38.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.390+0000 7f08315ff700 1 -- 172.21.15.72:0/145630490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c0c6d70 con 0x7f082c159ff0 2023-08-25T04:47:38.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.393+0000 7f08237fe700 1 -- 172.21.15.72:0/145630490 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f08240050d0 con 0x7f082c159ff0 2023-08-25T04:47:38.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.394+0000 7f08237fe700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f080c06a0e0 0x7f080c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.394+0000 7f08237fe700 1 -- 172.21.15.72:0/145630490 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0824088980 con 0x7f082c159ff0 2023-08-25T04:47:38.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.394+0000 7f082affd700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f080c06a0e0 0x7f080c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.395+0000 7f082affd700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f080c06a0e0 0x7f080c06c5a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f081c0011e0 tx=0x7f081c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.396+0000 7f0844eb8b80 1 Processor -- start 2023-08-25T04:47:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.396+0000 7f0844eb8b80 1 -- start start 2023-08-25T04:47:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88717ae00 0x55c88717b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c887178760 0x55c8871508d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c887150e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8870a95e0 con 0x55c88717ae00 2023-08-25T04:47:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8870a6d40 con 0x55c887178760 2023-08-25T04:47:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8870a2630 con 0x55c88718c820 2023-08-25T04:47:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f082affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88717ae00 0x55c88717b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f082affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88717ae00 0x55c88717b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47434/0 (socket says 172.21.15.72:47434) 2023-08-25T04:47:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f082affd700 1 -- 172.21.15.72:0/3511882786 learned_addr learned my addr 172.21.15.72:0/3511882786 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f082b7fe700 1 --2- 172.21.15.72:0/3511882786 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c887150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.397+0000 7f0823fff700 1 --2- 172.21.15.72:0/3511882786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c887178760 0x55c8871508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.398+0000 7f082affd700 1 -- 172.21.15.72:0/3511882786 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 msgr2=0x55c887150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.398+0000 7f082affd700 1 --2- 172.21.15.72:0/3511882786 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c887150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.398+0000 7f082affd700 1 -- 172.21.15.72:0/3511882786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c887178760 msgr2=0x55c8871508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:38.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.398+0000 7f082affd700 1 --2- 172.21.15.72:0/3511882786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c887178760 0x55c8871508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.398+0000 7f082affd700 1 -- 172.21.15.72:0/3511882786 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c886f810a0 con 0x55c88717ae00 2023-08-25T04:47:38.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.398+0000 7f0823fff700 1 --2- 172.21.15.72:0/3511882786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c887178760 0x55c8871508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:38.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.398+0000 7f082affd700 1 --2- 172.21.15.72:0/3511882786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88717ae00 0x55c88717b1e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f081c005c40 tx=0x7f081c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ee8921bb23da48 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.398+0000 7f0820ff9700 1 -- 172.21.15.72:0/3511882786 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c020450 con 0x55c88717ae00 2023-08-25T04:47:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.398+0000 7f0820ff9700 1 -- 172.21.15.72:0/3511882786 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c0205b0 con 0x55c88717ae00 2023-08-25T04:47:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.398+0000 7f0820ff9700 1 -- 172.21.15.72:0/3511882786 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c020920 con 0x55c88717ae00 2023-08-25T04:47:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.399+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3511882786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88717ae00 msgr2=0x55c88717b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.399+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/3511882786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88717ae00 0x55c88717b1e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f081c005c40 tx=0x7f081c010000 comp rx=0 tx=0).stop 2023-08-25T04:47:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.399+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3511882786 shutdown_connections 2023-08-25T04:47:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.399+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/3511882786 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c887150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.399+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/3511882786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88717ae00 0x55c88717b1e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.399+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/3511882786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c887178760 0x55c8871508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.399+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3511882786 >> 172.21.15.72:0/3511882786 conn(0x55c8870c4b90 msgr2=0x55c88714ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:38.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.399+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3511882786 shutdown_connections 2023-08-25T04:47:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.399+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3511882786 wait complete. 2023-08-25T04:47:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.400+0000 7f0844eb8b80 1 -- start start 2023-08-25T04:47:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.400+0000 7f0844eb8b80 1 Processor -- start 2023-08-25T04:47:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c887164500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c88717da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c88717df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c88705e750 con 0x55c887178760 2023-08-25T04:47:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c887044ab0 con 0x55c88717ae00 2023-08-25T04:47:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c886e95390 con 0x55c88718c820 2023-08-25T04:47:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f0844eb8b80 10 client.0 _ll_register_callbacks cb 0x55c88703e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:47:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f082affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c887164500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f082affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c887164500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47436/0 (socket says 172.21.15.72:47436) 2023-08-25T04:47:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f082affd700 1 -- 172.21.15.72:0/2156717056 learned_addr learned my addr 172.21.15.72:0/2156717056 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f0823fff700 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c88717da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.401+0000 7f082b7fe700 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c88717df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f082affd700 1 -- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 msgr2=0x55c88717df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f082affd700 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c88717df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f082affd700 1 -- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 msgr2=0x55c88717da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f082affd700 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c88717da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f082affd700 1 -- 172.21.15.72:0/2156717056 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08180057c0 con 0x55c887178760 2023-08-25T04:47:38.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f0823fff700 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c88717da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f082b7fe700 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c88717df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:47:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f082affd700 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c887164500 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f081c000f60 tx=0x7f081c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25d3eca86192e4e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f0809ffb700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-25T04:47:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f0809ffb700 1 -- 172.21.15.72:0/2156717056 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c020450 con 0x55c887178760 2023-08-25T04:47:38.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f0844eb8b80 1 -- 172.21.15.72:0/2156717056 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c886f79c00 con 0x55c887178760 2023-08-25T04:47:38.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f0809ffb700 1 -- 172.21.15.72:0/2156717056 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f081c0222d0 con 0x55c887178760 2023-08-25T04:47:38.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f0809ffb700 1 -- 172.21.15.72:0/2156717056 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f081c022490 con 0x55c887178760 2023-08-25T04:47:38.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f0844eb8b80 10 client.5862 fetch_fsmap learned FSMap version 16 2023-08-25T04:47:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.402+0000 7f0844eb8b80 1 -- 172.21.15.72:0/2156717056 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c887066b10 con 0x55c887178760 2023-08-25T04:47:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.403+0000 7f0809ffb700 1 -- 172.21.15.72:0/2156717056 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c886f79c00 con 0x55c887178760 2023-08-25T04:47:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.403+0000 7f0809ffb700 1 -- 172.21.15.72:0/2156717056 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f081c02a060 con 0x55c887178760 2023-08-25T04:47:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.403+0000 7f0844eb8b80 10 client.5862 fetch_fsmap finished waiting for FSMap version 16 2023-08-25T04:47:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.403+0000 7f0844eb8b80 10 client.5862 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-25T04:47:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.403+0000 7f0844eb8b80 20 client.5862 populate_metadata read hostname 'smithi072' 2023-08-25T04:47:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.403+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:6833/2622594168,v1:172.21.15.137:6835/2622594168] conn(0x55c887173300 0x55c88717c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.403+0000 7f0844eb8b80 4 client.5862 mds_command: new command op to 5646 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:47:38.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.403+0000 7f0844eb8b80 1 -- 172.21.15.72:0/2156717056 --> [v2:172.21.15.137:6833/2622594168,v1:172.21.15.137:6835/2622594168] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c88711f530 con 0x55c887173300 2023-08-25T04:47:38.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.403+0000 7f0823fff700 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:6833/2622594168,v1:172.21.15.137:6835/2622594168] conn(0x55c887173300 0x55c88717c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.404+0000 7f0809ffb700 10 client.5862 ms_handle_connect on v2:172.21.15.137:6833/2622594168 2023-08-25T04:47:38.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.404+0000 7f0823fff700 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:6833/2622594168,v1:172.21.15.137:6835/2622594168] conn(0x55c887173300 0x55c88717c210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41f6d076de063003 server_cookie=1147d50840c74156 in_seq=0 out_seq=0 2023-08-25T04:47:38.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0809ffb700 1 -- 172.21.15.72:0/2156717056 <== mds.0 v2:172.21.15.137:6833/2622594168 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c88711f530 con 0x55c887173300 2023-08-25T04:47:38.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0809ffb700 10 client.5862 handle_command_reply: tid=0 2023-08-25T04:47:38.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 client.5862 shutdown 2023-08-25T04:47:38.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 -- 172.21.15.72:0/2156717056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 msgr2=0x55c887164500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c887164500 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f081c000f60 tx=0x7f081c012000 comp rx=0 tx=0).stop 2023-08-25T04:47:38.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 -- 172.21.15.72:0/2156717056 shutdown_connections 2023-08-25T04:47:38.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:6833/2622594168,v1:172.21.15.137:6835/2622594168] conn(0x55c887173300 0x55c88717c210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c88717df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c887164500 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0809ffb700 0 client.5862 ms_handle_reset on v2:172.21.15.137:6833/2622594168 2023-08-25T04:47:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/2156717056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c88717da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 -- 172.21.15.72:0/2156717056 >> 172.21.15.72:0/2156717056 conn(0x55c8870c4b90 msgr2=0x55c887199190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 -- 172.21.15.72:0/2156717056 shutdown_connections 2023-08-25T04:47:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 1 -- 172.21.15.72:0/2156717056 wait complete. 2023-08-25T04:47:38.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.405+0000 7f0844eb8b80 20 client.5862 trim_cache size 0 max 16384 2023-08-25T04:47:38.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.423+0000 7f0844eb8b80 1 Processor -- start 2023-08-25T04:47:38.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.423+0000 7f0844eb8b80 1 -- start start 2023-08-25T04:47:38.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c88714eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c887150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c887162a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c88717c840 con 0x55c887178760 2023-08-25T04:47:38.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c887125ea0 con 0x55c88717ae00 2023-08-25T04:47:38.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c88717c9c0 con 0x55c88718c820 2023-08-25T04:47:38.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f082affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c88714eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f082affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c88714eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47448/0 (socket says 172.21.15.72:47448) 2023-08-25T04:47:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f082affd700 1 -- 172.21.15.72:0/1024681029 learned_addr learned my addr 172.21.15.72:0/1024681029 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f0823fff700 1 --2- 172.21.15.72:0/1024681029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c887150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.424+0000 7f082b7fe700 1 --2- 172.21.15.72:0/1024681029 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c887162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.425+0000 7f082affd700 1 -- 172.21.15.72:0/1024681029 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 msgr2=0x55c887162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:38.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.425+0000 7f082affd700 1 --2- 172.21.15.72:0/1024681029 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c887162a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.425+0000 7f082affd700 1 -- 172.21.15.72:0/1024681029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 msgr2=0x55c887150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:38.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.425+0000 7f082affd700 1 --2- 172.21.15.72:0/1024681029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c887150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.425+0000 7f082affd700 1 -- 172.21.15.72:0/1024681029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c886ef51d0 con 0x55c887178760 2023-08-25T04:47:38.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.425+0000 7f082affd700 1 --2- 172.21.15.72:0/1024681029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c88714eaf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f081c001580 tx=0x7f081c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73262ed052fff821 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:38.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.425+0000 7f08217fa700 1 -- 172.21.15.72:0/1024681029 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c022270 con 0x55c887178760 2023-08-25T04:47:38.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.425+0000 7f08217fa700 1 -- 172.21.15.72:0/1024681029 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c018040 con 0x55c887178760 2023-08-25T04:47:38.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.425+0000 7f08217fa700 1 -- 172.21.15.72:0/1024681029 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c022ca0 con 0x55c887178760 2023-08-25T04:47:38.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.426+0000 7f0844eb8b80 1 -- 172.21.15.72:0/1024681029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 msgr2=0x55c88714eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.426+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/1024681029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c88714eaf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f081c001580 tx=0x7f081c01c000 comp rx=0 tx=0).stop 2023-08-25T04:47:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.426+0000 7f0844eb8b80 1 -- 172.21.15.72:0/1024681029 shutdown_connections 2023-08-25T04:47:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.426+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/1024681029 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c88718c820 0x55c887162a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.426+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/1024681029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c887178760 0x55c88714eaf0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.426+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/1024681029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c887150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.426+0000 7f0844eb8b80 1 -- 172.21.15.72:0/1024681029 >> 172.21.15.72:0/1024681029 conn(0x55c8870c4b90 msgr2=0x55c88718ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:38.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.426+0000 7f0844eb8b80 1 -- 172.21.15.72:0/1024681029 shutdown_connections 2023-08-25T04:47:38.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.426+0000 7f0844eb8b80 1 -- 172.21.15.72:0/1024681029 wait complete. 2023-08-25T04:47:38.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.426+0000 7f0844eb8b80 1 -- start start 2023-08-25T04:47:38.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.427+0000 7f0844eb8b80 1 Processor -- start 2023-08-25T04:47:38.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.427+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c887178760 0x55c8871f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.427+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c8871708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.427+0000 7f0844eb8b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88718c820 0x55c887162a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.427+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8871f3520 con 0x55c88718c820 2023-08-25T04:47:38.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.427+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c887163510 con 0x55c88717ae00 2023-08-25T04:47:38.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f0844eb8b80 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c88718bac0 con 0x55c887178760 2023-08-25T04:47:38.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f0844eb8b80 10 client.0 _ll_register_callbacks cb 0x55c88703e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:47:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f082b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88718c820 0x55c887162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f082b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88718c820 0x55c887162a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47450/0 (socket says 172.21.15.72:47450) 2023-08-25T04:47:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f082b7fe700 1 -- 172.21.15.72:0/3115326929 learned_addr learned my addr 172.21.15.72:0/3115326929 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f082affd700 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c887178760 0x55c8871f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f0823fff700 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c8871708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f082b7fe700 1 -- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c887178760 msgr2=0x55c8871f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:38.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f082b7fe700 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c887178760 0x55c8871f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f082b7fe700 1 -- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 msgr2=0x55c8871708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f082b7fe700 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c8871708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f082b7fe700 1 -- 172.21.15.72:0/3115326929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c887066b10 con 0x55c88718c820 2023-08-25T04:47:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f082b7fe700 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88718c820 0x55c887162a60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0824086b70 tx=0x7f0824076050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3e117082e0fcfc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.428+0000 7f0809ffb700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-25T04:47:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0809ffb700 1 -- 172.21.15.72:0/3115326929 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082406d070 con 0x55c88718c820 2023-08-25T04:47:38.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0809ffb700 1 -- 172.21.15.72:0/3115326929 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0824019300 con 0x55c88718c820 2023-08-25T04:47:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3115326929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f081c0205b0 con 0x55c88718c820 2023-08-25T04:47:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0809ffb700 1 -- 172.21.15.72:0/3115326929 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08240194c0 con 0x55c88718c820 2023-08-25T04:47:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0844eb8b80 10 client.5868 fetch_fsmap learned FSMap version 16 2023-08-25T04:47:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3115326929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c886eced60 con 0x55c88718c820 2023-08-25T04:47:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0809ffb700 1 -- 172.21.15.72:0/3115326929 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c0205b0 con 0x55c88718c820 2023-08-25T04:47:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0809ffb700 1 -- 172.21.15.72:0/3115326929 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0824056fc0 con 0x55c88718c820 2023-08-25T04:47:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0844eb8b80 10 client.5868 fetch_fsmap finished waiting for FSMap version 16 2023-08-25T04:47:38.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0844eb8b80 10 client.5868 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-25T04:47:38.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0844eb8b80 20 client.5868 populate_metadata read hostname 'smithi072' 2023-08-25T04:47:38.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:6833/2622594168,v1:172.21.15.137:6835/2622594168] conn(0x55c8871ded20 0x55c8871df100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0844eb8b80 4 client.5868 mds_command: new command op to 5646 tid=0[{"prefix": "status"}] 2023-08-25T04:47:38.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.429+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3115326929 --> [v2:172.21.15.137:6833/2622594168,v1:172.21.15.137:6835/2622594168] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c88709b770 con 0x55c8871ded20 2023-08-25T04:47:38.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.430+0000 7f082affd700 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:6833/2622594168,v1:172.21.15.137:6835/2622594168] conn(0x55c8871ded20 0x55c8871df100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.430+0000 7f0809ffb700 10 client.5868 ms_handle_connect on v2:172.21.15.137:6833/2622594168 2023-08-25T04:47:38.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.430+0000 7f082affd700 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:6833/2622594168,v1:172.21.15.137:6835/2622594168] conn(0x55c8871ded20 0x55c8871df100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fdcc7aff0018dae server_cookie=df834c694c1188c1 in_seq=0 out_seq=0 2023-08-25T04:47:38.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0809ffb700 1 -- 172.21.15.72:0/3115326929 <== mds.0 v2:172.21.15.137:6833/2622594168 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c88709b770 con 0x55c8871ded20 2023-08-25T04:47:38.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0809ffb700 10 client.5868 handle_command_reply: tid=0 2023-08-25T04:47:38.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 client.5868 shutdown 2023-08-25T04:47:38.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3115326929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88718c820 msgr2=0x55c887162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88718c820 0x55c887162a60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0824086b70 tx=0x7f0824076050 comp rx=0 tx=0).stop 2023-08-25T04:47:38.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3115326929 shutdown_connections 2023-08-25T04:47:38.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:6833/2622594168,v1:172.21.15.137:6835/2622594168] conn(0x55c8871ded20 0x55c8871df100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55c88718c820 0x55c887162a60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c887178760 0x55c8871f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0809ffb700 0 client.5868 ms_handle_reset on v2:172.21.15.137:6833/2622594168 2023-08-25T04:47:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 --2- 172.21.15.72:0/3115326929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c88717ae00 0x55c8871708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3115326929 >> 172.21.15.72:0/3115326929 conn(0x55c8870c4b90 msgr2=0x55c8871510f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3115326929 shutdown_connections 2023-08-25T04:47:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 1 -- 172.21.15.72:0/3115326929 wait complete. 2023-08-25T04:47:38.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.431+0000 7f0844eb8b80 20 client.5868 trim_cache size 0 max 16384 2023-08-25T04:47:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-25T04:47:38.442 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "48882d5a-36fb-4a1e-9265-02d65750e322", 2023-08-25T04:47:38.442 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-25T04:47:38.442 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 5646, 2023-08-25T04:47:38.443 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-25T04:47:38.443 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-25T04:47:38.443 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-25T04:47:38.443 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 11.476788707000001, 2023-08-25T04:47:38.443 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 16, 2023-08-25T04:47:38.443 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 40, 2023-08-25T04:47:38.443 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 40, 2023-08-25T04:47:38.444 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 21.241718684999999 2023-08-25T04:47:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-25T04:47:38.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 -- 172.21.15.72:0/145630490 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f080c06a0e0 msgr2=0x7f080c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f080c06a0e0 0x7f080c06c5a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f081c0011e0 tx=0x7f081c009040 comp rx=0 tx=0).stop 2023-08-25T04:47:38.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 -- 172.21.15.72:0/145630490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f082c159ff0 msgr2=0x7f082c0cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f082c159ff0 0x7f082c0cd680 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f082400cc20 tx=0x7f082400a060 comp rx=0 tx=0).stop 2023-08-25T04:47:38.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 -- 172.21.15.72:0/145630490 shutdown_connections 2023-08-25T04:47:38.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f080c06a0e0 0x7f080c06c5a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f082c159ff0 0x7f082c0cd680 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f082c070890 0x7f082c1f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 --2- 172.21.15.72:0/145630490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f082c0b0f50 0x7f082c1edf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 -- 172.21.15.72:0/145630490 >> 172.21.15.72:0/145630490 conn(0x7f082c0ce9a0 msgr2=0x7f082c0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:38.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 -- 172.21.15.72:0/145630490 shutdown_connections 2023-08-25T04:47:38.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.432+0000 7f08315ff700 1 -- 172.21.15.72:0/145630490 wait complete. 2023-08-25T04:47:38.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:47:38.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.646+0000 7fd073bff700 1 Processor -- start 2023-08-25T04:47:38.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.646+0000 7fd073bff700 1 -- start start 2023-08-25T04:47:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd073bff700 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd06c15ce60 0x7fd06c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd073bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd06c0cda40 0x7fd06c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd073bff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06c0d1fe0 con 0x7fd06c0b8770 2023-08-25T04:47:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd073bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c0d2b80 con 0x7fd06c0cda40 2023-08-25T04:47:38.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd073bff700 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c0ce3f0 con 0x7fd06c15ce60 2023-08-25T04:47:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd07219c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd06c0cda40 0x7fd06c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd07219c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd06c0cda40 0x7fd06c0cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47458/0 (socket says 172.21.15.72:47458) 2023-08-25T04:47:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd07219c700 1 -- 172.21.15.72:0/3563556990 learned_addr learned my addr 172.21.15.72:0/3563556990 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:38.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd07199b700 1 --2- 172.21.15.72:0/3563556990 >> v2:172.21.15.137:3300/0 conn(0x7fd06c15ce60 0x7fd06c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd07219c700 1 -- 172.21.15.72:0/3563556990 >> v2:172.21.15.137:3300/0 conn(0x7fd06c15ce60 msgr2=0x7fd06c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:47:38.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd07219c700 1 --2- 172.21.15.72:0/3563556990 >> v2:172.21.15.137:3300/0 conn(0x7fd06c15ce60 0x7fd06c0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd07219c700 1 -- 172.21.15.72:0/3563556990 >> v1:172.21.15.137:6789/0 conn(0x7fd06c0b8770 legacy=0x7fd06c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.648+0000 7fd07219c700 1 -- 172.21.15.72:0/3563556990 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c0d13d0 con 0x7fd06c0cda40 2023-08-25T04:47:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.649+0000 7fd07219c700 1 --2- 172.21.15.72:0/3563556990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 0x7fd06c0cdeb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0d2cd0 tx=0x7fd06400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7307766411ec03a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.649+0000 7fd070999700 1 -- 172.21.15.72:0/3563556990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06400e070 con 0x7fd06c0cda40 2023-08-25T04:47:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.649+0000 7fd070999700 1 -- 172.21.15.72:0/3563556990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06400b980 con 0x7fd06c0cda40 2023-08-25T04:47:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.649+0000 7fd070999700 1 -- 172.21.15.72:0/3563556990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06400bd30 con 0x7fd06c0cda40 2023-08-25T04:47:38.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.649+0000 7fd073bff700 1 -- 172.21.15.72:0/3563556990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 msgr2=0x7fd06c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.649+0000 7fd073bff700 1 --2- 172.21.15.72:0/3563556990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 0x7fd06c0cdeb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0d2cd0 tx=0x7fd06400b330 comp rx=0 tx=0).stop 2023-08-25T04:47:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.650+0000 7fd073bff700 1 -- 172.21.15.72:0/3563556990 shutdown_connections 2023-08-25T04:47:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.650+0000 7fd073bff700 1 --2- 172.21.15.72:0/3563556990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 0x7fd06c0cdeb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.650+0000 7fd073bff700 1 --2- 172.21.15.72:0/3563556990 >> v2:172.21.15.137:3300/0 conn(0x7fd06c15ce60 0x7fd06c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.650+0000 7fd073bff700 1 -- 172.21.15.72:0/3563556990 >> 172.21.15.72:0/3563556990 conn(0x7fd06c071e10 msgr2=0x7fd06c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.650+0000 7fd073bff700 1 -- 172.21.15.72:0/3563556990 shutdown_connections 2023-08-25T04:47:38.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.650+0000 7fd073bff700 1 -- 172.21.15.72:0/3563556990 wait complete. 2023-08-25T04:47:38.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.651+0000 7fd073bff700 1 Processor -- start 2023-08-25T04:47:38.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.651+0000 7fd073bff700 1 -- start start 2023-08-25T04:47:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.652+0000 7fd073bff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c0b8770 0x7fd06c0c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.652+0000 7fd073bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 0x7fd06c0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.652+0000 7fd073bff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06c15ce60 0x7fd06c1f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.652+0000 7fd073bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0cd070 con 0x7fd06c0cda40 2023-08-25T04:47:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.652+0000 7fd073bff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0cc3f0 con 0x7fd06c15ce60 2023-08-25T04:47:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.652+0000 7fd073bff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0cc6d0 con 0x7fd06c0b8770 2023-08-25T04:47:38.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07119a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 0x7fd06c0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07119a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 0x7fd06c0ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47468/0 (socket says 172.21.15.72:47468) 2023-08-25T04:47:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07119a700 1 -- 172.21.15.72:0/3364873909 learned_addr learned my addr 172.21.15.72:0/3364873909 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:47:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07219c700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06c15ce60 0x7fd06c1f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07199b700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c0b8770 0x7fd06c0c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07119a700 1 -- 172.21.15.72:0/3364873909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c0b8770 msgr2=0x7fd06c0c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07119a700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c0b8770 0x7fd06c0c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07119a700 1 -- 172.21.15.72:0/3364873909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06c15ce60 msgr2=0x7fd06c1f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07119a700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06c15ce60 0x7fd06c1f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07119a700 1 -- 172.21.15.72:0/3364873909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd064009b30 con 0x7fd06c0cda40 2023-08-25T04:47:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.653+0000 7fd07119a700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 0x7fd06c0ca380 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00c450 tx=0x7fd05c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.654+0000 7fd0627fc700 1 -- 172.21.15.72:0/3364873909 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0052d0 con 0x7fd06c0cda40 2023-08-25T04:47:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.654+0000 7fd073bff700 1 -- 172.21.15.72:0/3364873909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06c0cc9b0 con 0x7fd06c0cda40 2023-08-25T04:47:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.654+0000 7fd0627fc700 1 -- 172.21.15.72:0/3364873909 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c005430 con 0x7fd06c0cda40 2023-08-25T04:47:38.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.654+0000 7fd0627fc700 1 -- 172.21.15.72:0/3364873909 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0038c0 con 0x7fd06c0cda40 2023-08-25T04:47:38.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.654+0000 7fd073bff700 1 -- 172.21.15.72:0/3364873909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06c14c260 con 0x7fd06c0cda40 2023-08-25T04:47:38.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.655+0000 7fd073bff700 1 -- 172.21.15.72:0/3364873909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06c04e620 con 0x7fd06c0cda40 2023-08-25T04:47:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.656+0000 7fd0627fc700 1 -- 172.21.15.72:0/3364873909 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd05c003a20 con 0x7fd06c0cda40 2023-08-25T04:47:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.657+0000 7fd0627fc700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd05006a0e0 0x7fd05006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:47:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.657+0000 7fd0627fc700 1 -- 172.21.15.72:0/3364873909 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd05c087910 con 0x7fd06c0cda40 2023-08-25T04:47:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.657+0000 7fd07199b700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd05006a0e0 0x7fd05006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:47:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.657+0000 7fd07199b700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd05006a0e0 0x7fd05006c5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd068006b20 tx=0x7fd068008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:47:38.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.661+0000 7fd0627fc700 1 -- 172.21.15.72:0/3364873909 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd05c052f50 con 0x7fd06c0cda40 2023-08-25T04:47:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.900+0000 7fd073bff700 1 -- 172.21.15.72:0/3364873909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd06c0b31a0 con 0x7fd06c0cda40 2023-08-25T04:47:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.900+0000 7fd0627fc700 1 -- 172.21.15.72:0/3364873909 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd05c00ce60 con 0x7fd06c0cda40 2023-08-25T04:47:38.901 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:47:38.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.902+0000 7fd073bff700 1 -- 172.21.15.72:0/3364873909 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd05006a0e0 msgr2=0x7fd05006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.902+0000 7fd073bff700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd05006a0e0 0x7fd05006c5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd068006b20 tx=0x7fd068008040 comp rx=0 tx=0).stop 2023-08-25T04:47:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.902+0000 7fd073bff700 1 -- 172.21.15.72:0/3364873909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 msgr2=0x7fd06c0ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:47:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.902+0000 7fd073bff700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 0x7fd06c0ca380 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00c450 tx=0x7fd05c00c760 comp rx=0 tx=0).stop 2023-08-25T04:47:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.903+0000 7fd073bff700 1 -- 172.21.15.72:0/3364873909 shutdown_connections 2023-08-25T04:47:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.903+0000 7fd073bff700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7fd05006a0e0 0x7fd05006c5a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.903+0000 7fd073bff700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06c15ce60 0x7fd06c1f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.903+0000 7fd073bff700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd06c0b8770 0x7fd06c0c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.903+0000 7fd073bff700 1 --2- 172.21.15.72:0/3364873909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c0cda40 0x7fd06c0ca380 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:47:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.903+0000 7fd073bff700 1 -- 172.21.15.72:0/3364873909 >> 172.21.15.72:0/3364873909 conn(0x7fd06c071e10 msgr2=0x7fd06c0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:47:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.903+0000 7fd073bff700 1 -- 172.21.15.72:0/3364873909 shutdown_connections 2023-08-25T04:47:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:38.903+0000 7fd073bff700 1 -- 172.21.15.72:0/3364873909 wait complete. 2023-08-25T04:47:38.920 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:47:38.921 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:47:38.922 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-25T04:47:38.922 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:47:38.922 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:47:38.923 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:47:38.923 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:47:38.923 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:47:38.924 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:47:38.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:38.925 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-25T04:47:38.973 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:47:38.974 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:47:38.974 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:47:38.974 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:47:38.975 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-25T04:47:38.975 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:47:38.975 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:47:38.975 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:47:38.975 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-25T04:47:38.976 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:47:38.976 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:47:38.976 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-25T04:47:38.976 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-25T04:47:38.976 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:47:38.976 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:47:38.976 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:47:38.976 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-25T04:47:38.977 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42109sec preferred_lft 42109sec 2023-08-25T04:47:38.977 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-25T04:47:38.977 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:47:38.977 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:47:38.977 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:91:9d:6a:a7:36 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:47:38.977 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:47:38.977 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:47:38.978 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::cc22:7ff:fe4c:6173/64 scope link 2023-08-25T04:47:38.978 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:47:38.978 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:47:38.978 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 62:26:50:09:39:ae brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:47:38.978 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::6026:50ff:fe09:39ae/64 scope link 2023-08-25T04:47:38.978 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:47:38.978 INFO:teuthology.orchestra.run.smithi072.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:47:38.979 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:91:9d:6a:a7:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:47:38.979 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3891:9dff:fe6a:a736/64 scope link 2023-08-25T04:47:38.979 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:47:38.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:38.980 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:47:39.048 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-25T04:47:39.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:39.051 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-25T04:47:39.100 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-25T04:47:39.100 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:47:39.100 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T04:47:39.101 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T04:47:39.101 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:47:39.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:39.102 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-25T04:47:39.102 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-25T04:47:39.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T04:47:39.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T04:47:39.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T04:47:39.103 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-25T04:47:39.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:39.271 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-25T04:47:39.317 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T04:47:39.318 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:47:39.319 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:47:39.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:39.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-25T04:47:39.389 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-25T04:47:39.389 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:47:39.390 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:47:39.435 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:47:39.436 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:47:39.437 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:47:39.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-08-25T04:47:39.630 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:47:39.631 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:47:39.699 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:47:39.701 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:47:39.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:39.703 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-08-25T04:47:39.748 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-25T04:47:39.749 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-08-25T04:47:39.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-08-25T04:47:39.864 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-25T04:47:39.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-25T04:47:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-25T04:47:39.937 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-25T04:47:39.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:39.939 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-08-25T04:47:39.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2023-08-25T04:47:39.960+0000 7f2948fbc5c0 -1 init, newargv = 0x564af0301030 newargc=15 2023-08-25T04:47:39.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[135612]: starting ceph client 2023-08-25T04:47:39.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[135612]: starting fuse 2023-08-25T04:47:39.989 INFO:teuthology.orchestra.run.smithi072.stdout:43 2023-08-25T04:47:39.989 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-08-25T04:47:39.990 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2023-08-25T04:47:39.990 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-08-25T04:47:39.991 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-08-25T04:47:39.991 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-08-25T04:47:39.991 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-08-25T04:47:39.992 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:47:39.992 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-08-25T04:47:39.992 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-25T04:47:39.993 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-08-25T04:47:39.993 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-25T04:47:39.993 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:47:39.993 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-08-25T04:47:39.994 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-08-25T04:47:39.994 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-08-25T04:47:39.994 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-08-25T04:47:39.995 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:47:39.995 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-08-25T04:47:39.995 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-25T04:47:39.996 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-25T04:47:39.996 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-25T04:47:39.996 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-08-25T04:47:39.997 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-08-25T04:47:39.997 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-08-25T04:47:39.997 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-25T04:47:39.998 DEBUG:teuthology.orchestra.run.smithi072:> 2023-08-25T04:47:39.998 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2023-08-25T04:47:39.998 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-08-25T04:47:40.170 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.135612.asok 2023-08-25T04:47:40.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:47:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-25T04:47:40.183 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.135612.asok 2023-08-25T04:47:40.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:40.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.135612.asok status 2023-08-25T04:47:40.405 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-25T04:47:40.406 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-08-25T04:47:40.406 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "ba6b39e4f4f77fb95c747099b53db0467d435f56", 2023-08-25T04:47:40.406 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.0.0-5703-gba6b39e4 (ba6b39e4f4f77fb95c747099b53db0467d435f56) reef (dev)", 2023-08-25T04:47:40.406 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2023-08-25T04:47:40.406 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-08-25T04:47:40.406 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-25T04:47:40.407 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "135612", 2023-08-25T04:47:40.407 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-08-25T04:47:40.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:40.407 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-08-25T04:47:40.407 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-08-25T04:47:40.407 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 5883, 2023-08-25T04:47:40.408 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-08-25T04:47:40.408 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-08-25T04:47:40.408 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-08-25T04:47:40.408 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 5883 2023-08-25T04:47:40.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-08-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-08-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-08-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 4253620130 2023-08-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:40.409 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-08-25T04:47:40.410 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-08-25T04:47:40.410 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-08-25T04:47:40.410 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 4253620130 2023-08-25T04:47:40.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-25T04:47:40.410 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.5883 192.168.0.1:0/4253620130", 2023-08-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/4253620130", 2023-08-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-08-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 16, 2023-08-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 40, 2023-08-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-08-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-08-25T04:47:40.411 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-08-25T04:47:40.412 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-25T04:47:40.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:40.420 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-08-25T04:47:40.420 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-25T04:47:40.470 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-08-25T04:47:40.470 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-25T04:47:40.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:40.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:47:40.592 DEBUG:teuthology.orchestra.run.smithi072:> mktemp -d --suffix=xfstests-dev 2023-08-25T04:47:40.643 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.isvk1JLbjhxfstests-dev 2023-08-25T04:47:40.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:40.645 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.isvk1JLbjhxfstests-dev) 2023-08-25T04:47:40.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:40.760 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.isvk1JLbjhxfstests-dev) 2023-08-25T04:47:40.816 INFO:teuthology.orchestra.run.smithi072.stderr:Cloning into '/tmp/tmp.isvk1JLbjhxfstests-dev'... 2023-08-25T04:47:41.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:41.659 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-08-25T04:47:41.717 DEBUG:teuthology.orchestra.run.smithi072:> mktemp -d --suffix=test 2023-08-25T04:47:41.763 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.HtdGzZPqJztest 2023-08-25T04:47:41.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:47:41.764 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-08-25T04:47:41.854 DEBUG:teuthology.orchestra.run.smithi072:> mktemp -d --suffix=scratch 2023-08-25T04:47:41.900 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.kLjuibYnrbscratch 2023-08-25T04:47:41.901 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-08-25T04:47:41.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-08-25T04:47:42.986 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:05:38 ago on Fri 25 Aug 2023 04:42:04 AM UTC. 2023-08-25T04:47:44.332 INFO:teuthology.orchestra.run.smithi072.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-08-25T04:47:44.333 INFO:teuthology.orchestra.run.smithi072.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-08-25T04:47:44.334 INFO:teuthology.orchestra.run.smithi072.stdout:Package automake-1.16.1-8.el8.noarch is already installed. 2023-08-25T04:47:44.335 INFO:teuthology.orchestra.run.smithi072.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-08-25T04:47:44.337 INFO:teuthology.orchestra.run.smithi072.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-08-25T04:47:44.338 INFO:teuthology.orchestra.run.smithi072.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-08-25T04:47:44.340 INFO:teuthology.orchestra.run.smithi072.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-08-25T04:47:44.341 INFO:teuthology.orchestra.run.smithi072.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-08-25T04:47:44.343 INFO:teuthology.orchestra.run.smithi072.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-08-25T04:47:44.345 INFO:teuthology.orchestra.run.smithi072.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-08-25T04:47:44.346 INFO:teuthology.orchestra.run.smithi072.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-08-25T04:47:44.347 INFO:teuthology.orchestra.run.smithi072.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-08-25T04:47:44.348 INFO:teuthology.orchestra.run.smithi072.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-08-25T04:47:44.349 INFO:teuthology.orchestra.run.smithi072.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-08-25T04:47:44.350 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.8-6.el8.x86_64 is already installed. 2023-08-25T04:47:44.351 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-08-25T04:47:44.352 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-25T04:47:44.353 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-25T04:47:44.354 INFO:teuthology.orchestra.run.smithi072.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-08-25T04:47:44.355 INFO:teuthology.orchestra.run.smithi072.stdout:Package libuuid-devel-2.32.1-42.el8.x86_64 is already installed. 2023-08-25T04:47:44.356 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2023-08-25T04:47:44.361 INFO:teuthology.orchestra.run.smithi072.stdout:Package python36-3.6.8-38.module_el8.5.0+895+a459eca8.x86_64 is already installed. 2023-08-25T04:47:44.362 INFO:teuthology.orchestra.run.smithi072.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-08-25T04:47:44.366 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-08-25T04:47:44.546 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-08-25T04:47:44.548 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-08-25T04:47:44.548 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-08-25T04:47:44.549 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-08-25T04:47:44.549 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-08-25T04:47:44.549 INFO:teuthology.orchestra.run.smithi072.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-08-25T04:47:44.549 INFO:teuthology.orchestra.run.smithi072.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-08-25T04:47:44.549 INFO:teuthology.orchestra.run.smithi072.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-08-25T04:47:44.549 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-08-25T04:47:44.549 INFO:teuthology.orchestra.run.smithi072.stdout: cpp x86_64 8.5.0-20.el8 baseos 10 M 2023-08-25T04:47:44.550 INFO:teuthology.orchestra.run.smithi072.stdout: gcc x86_64 8.5.0-20.el8 baseos 24 M 2023-08-25T04:47:44.550 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-gdb-plugin x86_64 8.5.0-20.el8 appstream 121 k 2023-08-25T04:47:44.550 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-plugin-annobin x86_64 8.5.0-20.el8 baseos 36 k 2023-08-25T04:47:44.550 INFO:teuthology.orchestra.run.smithi072.stdout: libgcc x86_64 8.5.0-20.el8 baseos 81 k 2023-08-25T04:47:44.550 INFO:teuthology.orchestra.run.smithi072.stdout: libgomp x86_64 8.5.0-20.el8 baseos 208 k 2023-08-25T04:47:44.550 INFO:teuthology.orchestra.run.smithi072.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-08-25T04:47:44.551 INFO:teuthology.orchestra.run.smithi072.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-08-25T04:47:44.551 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-08-25T04:47:44.551 INFO:teuthology.orchestra.run.smithi072.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-08-25T04:47:44.551 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-08-25T04:47:44.551 INFO:teuthology.orchestra.run.smithi072.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-08-25T04:47:44.551 INFO:teuthology.orchestra.run.smithi072.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-08-25T04:47:44.551 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:44.551 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-08-25T04:47:44.552 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-08-25T04:47:44.552 INFO:teuthology.orchestra.run.smithi072.stdout:Install 7 Packages 2023-08-25T04:47:44.552 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 8 Packages 2023-08-25T04:47:44.552 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:47:44.552 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 37 M 2023-08-25T04:47:44.553 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-08-25T04:47:45.437 INFO:teuthology.orchestra.run.smithi072.stdout:(1/15): daxctl-libs-71.1-7.el8.x86_64.rpm 119 kB/s | 42 kB 00:00 2023-08-25T04:47:45.554 INFO:teuthology.orchestra.run.smithi072.stdout:(2/15): libpmemblk-1.6.1-1.el8.x86_64.rpm 194 kB/s | 92 kB 00:00 2023-08-25T04:47:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:(3/15): dump-0.4-0.36.b46.el8.x86_64.rpm 614 kB/s | 164 kB 00:00 2023-08-25T04:47:45.815 INFO:teuthology.orchestra.run.smithi072.stdout:(4/15): rmt-1.5.3-13.el8.x86_64.rpm 474 kB/s | 51 kB 00:00 2023-08-25T04:47:45.906 INFO:teuthology.orchestra.run.smithi072.stdout:(5/15): ndctl-libs-71.1-7.el8.x86_64.rpm 228 kB/s | 80 kB 00:00 2023-08-25T04:47:46.040 INFO:teuthology.orchestra.run.smithi072.stdout:(6/15): fio-3.19-4.el8.x86_64.rpm 561 kB/s | 538 kB 00:00 2023-08-25T04:47:46.074 INFO:teuthology.orchestra.run.smithi072.stdout:(7/15): indent-2.2.13-2.el8.x86_64.rpm 718 kB/s | 187 kB 00:00 2023-08-25T04:47:46.376 INFO:teuthology.orchestra.run.smithi072.stdout:(8/15): gcc-gdb-plugin-8.5.0-20.el8.x86_64.rpm 258 kB/s | 121 kB 00:00 2023-08-25T04:47:46.643 INFO:teuthology.orchestra.run.smithi072.stdout:(9/15): gcc-plugin-annobin-8.5.0-20.el8.x86_64. 134 kB/s | 36 kB 00:00 2023-08-25T04:47:46.944 INFO:teuthology.orchestra.run.smithi072.stdout:(10/15): cpp-8.5.0-20.el8.x86_64.rpm 12 MB/s | 10 MB 00:00 2023-08-25T04:47:46.969 INFO:teuthology.orchestra.run.smithi072.stdout:(11/15): libgcc-8.5.0-20.el8.x86_64.rpm 250 kB/s | 81 kB 00:00 2023-08-25T04:47:47.062 INFO:teuthology.orchestra.run.smithi072.stdout:(12/15): libgomp-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 208 kB 00:00 2023-08-25T04:47:47.221 INFO:teuthology.orchestra.run.smithi072.stdout:(13/15): sqlite-libs-3.26.0-18.el8.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2023-08-25T04:47:47.263 INFO:teuthology.orchestra.run.smithi072.stdout:(14/15): sqlite-3.26.0-18.el8.x86_64.rpm 2.2 MB/s | 668 kB 00:00 2023-08-25T04:47:47.831 INFO:teuthology.orchestra.run.smithi072.stdout:(15/15): gcc-8.5.0-20.el8.x86_64.rpm 13 MB/s | 24 MB 00:01 2023-08-25T04:47:47.831 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-08-25T04:47:47.831 INFO:teuthology.orchestra.run.smithi072.stdout:Total 11 MB/s | 37 MB 00:03 2023-08-25T04:47:48.336 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-08-25T04:47:48.439 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-08-25T04:47:48.439 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-08-25T04:47:48.813 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-08-25T04:47:48.817 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-08-25T04:47:49.747 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-08-25T04:47:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libgcc-8.5.0-20.el8.x86_64 1/23 2023-08-25T04:47:49.999 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgcc-8.5.0-20.el8.x86_64 1/23 2023-08-25T04:47:50.197 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 2/23 2023-08-25T04:47:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 2/23 2023-08-25T04:47:50.497 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 3/23 2023-08-25T04:47:50.584 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 3/23 2023-08-25T04:47:50.772 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/23 2023-08-25T04:47:50.929 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/23 2023-08-25T04:47:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 5/23 2023-08-25T04:47:51.298 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libgomp-8.5.0-20.el8.x86_64 6/23 2023-08-25T04:47:52.634 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgomp-8.5.0-20.el8.x86_64 6/23 2023-08-25T04:47:52.863 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : cpp-8.5.0-20.el8.x86_64 7/23 2023-08-25T04:47:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cpp-8.5.0-20.el8.x86_64 7/23 2023-08-25T04:47:55.172 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : gcc-8.5.0-20.el8.x86_64 8/23 2023-08-25T04:47:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-8.5.0-20.el8.x86_64 8/23 2023-08-25T04:47:55.500 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 9/23 2023-08-25T04:47:55.696 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 10/23 2023-08-25T04:47:55.871 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : gcc-gdb-plugin-8.5.0-20.el8.x86_64 11/23 2023-08-25T04:47:55.954 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-20.el8.x86_64 11/23 2023-08-25T04:47:56.106 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : gcc-plugin-annobin-8.5.0-20.el8.x86_64 12/23 2023-08-25T04:47:56.195 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-20.el8.x86_64 12/23 2023-08-25T04:47:56.522 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 13/23 2023-08-25T04:47:56.786 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-3.19-4.el8.x86_64 14/23 2023-08-25T04:47:56.998 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : indent-2.2.13-2.el8.x86_64 15/23 2023-08-25T04:47:56.999 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : gcc-gdb-plugin-8.5.0-19.el8.x86_64 16/23 2023-08-25T04:47:57.240 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-19.el8.x86_64 16/23 2023-08-25T04:47:57.241 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : gcc-plugin-annobin-8.5.0-19.el8.x86_64 17/23 2023-08-25T04:47:57.431 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-19.el8.x86_64 17/23 2023-08-25T04:47:57.452 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-8.5.0-19.el8.x86_64 18/23 2023-08-25T04:47:57.673 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : gcc-8.5.0-19.el8.x86_64 18/23 2023-08-25T04:47:57.822 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 19/23 2023-08-25T04:47:58.039 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 20/23 2023-08-25T04:47:58.055 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cpp-8.5.0-19.el8.x86_64 21/23 2023-08-25T04:47:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : cpp-8.5.0-19.el8.x86_64 21/23 2023-08-25T04:47:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libgcc-8.5.0-19.el8.x86_64 22/23 2023-08-25T04:47:58.448 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgcc-8.5.0-19.el8.x86_64 22/23 2023-08-25T04:47:58.464 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 23/23 2023-08-25T04:47:58.464 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libgomp-8.5.0-19.el8.x86_64 23/23 2023-08-25T04:47:59.327 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 23/23 2023-08-25T04:47:59.328 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-3.19-4.el8.x86_64 1/23 2023-08-25T04:47:59.328 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/23 2023-08-25T04:47:59.328 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 3/23 2023-08-25T04:47:59.328 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 4/23 2023-08-25T04:47:59.328 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 5/23 2023-08-25T04:47:59.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 6/23 2023-08-25T04:47:59.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : indent-2.2.13-2.el8.x86_64 7/23 2023-08-25T04:47:59.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-gdb-plugin-8.5.0-20.el8.x86_64 8/23 2023-08-25T04:47:59.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-gdb-plugin-8.5.0-19.el8.x86_64 9/23 2023-08-25T04:47:59.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cpp-8.5.0-20.el8.x86_64 10/23 2023-08-25T04:47:59.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cpp-8.5.0-19.el8.x86_64 11/23 2023-08-25T04:47:59.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-8.5.0-20.el8.x86_64 12/23 2023-08-25T04:47:59.330 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-8.5.0-19.el8.x86_64 13/23 2023-08-25T04:47:59.330 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-plugin-annobin-8.5.0-20.el8.x86_64 14/23 2023-08-25T04:47:59.330 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-plugin-annobin-8.5.0-19.el8.x86_64 15/23 2023-08-25T04:47:59.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgcc-8.5.0-20.el8.x86_64 16/23 2023-08-25T04:47:59.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgcc-8.5.0-19.el8.x86_64 17/23 2023-08-25T04:47:59.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgomp-8.5.0-20.el8.x86_64 18/23 2023-08-25T04:47:59.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgomp-8.5.0-19.el8.x86_64 19/23 2023-08-25T04:47:59.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 20/23 2023-08-25T04:47:59.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 21/23 2023-08-25T04:47:59.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 22/23 2023-08-25T04:48:00.236 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 23/23 2023-08-25T04:48:00.236 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:48:00.237 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-08-25T04:48:00.237 INFO:teuthology.orchestra.run.smithi072.stdout: cpp-8.5.0-20.el8.x86_64 gcc-8.5.0-20.el8.x86_64 2023-08-25T04:48:00.237 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-gdb-plugin-8.5.0-20.el8.x86_64 gcc-plugin-annobin-8.5.0-20.el8.x86_64 2023-08-25T04:48:00.237 INFO:teuthology.orchestra.run.smithi072.stdout: libgcc-8.5.0-20.el8.x86_64 libgomp-8.5.0-20.el8.x86_64 2023-08-25T04:48:00.238 INFO:teuthology.orchestra.run.smithi072.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-08-25T04:48:00.238 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-08-25T04:48:00.238 INFO:teuthology.orchestra.run.smithi072.stdout: daxctl-libs-71.1-7.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-08-25T04:48:00.239 INFO:teuthology.orchestra.run.smithi072.stdout: fio-3.19-4.el8.x86_64 indent-2.2.13-2.el8.x86_64 2023-08-25T04:48:00.239 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemblk-1.6.1-1.el8.x86_64 ndctl-libs-71.1-7.el8.x86_64 2023-08-25T04:48:00.239 INFO:teuthology.orchestra.run.smithi072.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-08-25T04:48:00.240 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:48:00.241 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-08-25T04:48:00.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo useradd -m fsgqa 2023-08-25T04:48:00.494 INFO:teuthology.orchestra.run.smithi072.stderr:useradd: user 'fsgqa' already exists 2023-08-25T04:48:00.497 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-25T04:48:00.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo groupadd fsgqa 2023-08-25T04:48:00.566 INFO:teuthology.orchestra.run.smithi072.stderr:groupadd: group 'fsgqa' already exists 2023-08-25T04:48:00.568 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-25T04:48:00.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo useradd fsgqa2 2023-08-25T04:48:01.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo useradd 123456-fsgqa 2023-08-25T04:48:02.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:48:02.231 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:48:02.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-08-25T04:48:02.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.587+0000 7f29979ff700 1 Processor -- start 2023-08-25T04:48:02.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.587+0000 7f29979ff700 1 -- start start 2023-08-25T04:48:02.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.588+0000 7f29979ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29900cd040 0x7f299006f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:48:02.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.589+0000 7f29979ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29900cd600 con 0x7f2990160bb0 2023-08-25T04:48:02.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.589+0000 7f29979ff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299006fc90 con 0x7f299015cfd0 2023-08-25T04:48:02.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.589+0000 7f29979ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299006a420 con 0x7f29900cd040 2023-08-25T04:48:02.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.589+0000 7f2995f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2990160bb0 0x7f299006b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38560/0 (socket says 172.21.15.72:38560) 2023-08-25T04:48:02.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.589+0000 7f2995f9c700 1 -- 172.21.15.72:0/4045320042 learned_addr learned my addr 172.21.15.72:0/4045320042 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:48:02.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.589+0000 7f2994f9a700 1 --2- 172.21.15.72:0/4045320042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29900cd040 0x7f299006f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:48:02.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2987fff700 1 -- 172.21.15.72:0/4045320042 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953662507 0 0) 0x7f29900cd600 con 0x7f2990160bb0 2023-08-25T04:48:02.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2987fff700 1 -- 172.21.15.72:0/4045320042 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f297c0035b0 con 0x7f2990160bb0 2023-08-25T04:48:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2987fff700 1 -- 172.21.15.72:0/4045320042 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173460068 0 0) 0x7f299006fc90 con 0x7f299015cfd0 2023-08-25T04:48:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2987fff700 1 -- 172.21.15.72:0/4045320042 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29900cd600 con 0x7f299015cfd0 2023-08-25T04:48:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2994f9a700 1 -- 172.21.15.72:0/4045320042 >> v1:172.21.15.137:6789/0 conn(0x7f299015cfd0 legacy=0x7f29900c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2994f9a700 1 -- 172.21.15.72:0/4045320042 >> v1:172.21.15.72:6789/0 conn(0x7f2990160bb0 legacy=0x7f299006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2987fff700 1 -- 172.21.15.72:0/4045320042 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2998448247 0 0) 0x7f297c0035b0 con 0x7f2990160bb0 2023-08-25T04:48:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2994f9a700 1 -- 172.21.15.72:0/4045320042 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299006a700 con 0x7f29900cd040 2023-08-25T04:48:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2994f9a700 1 --2- 172.21.15.72:0/4045320042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29900cd040 0x7f299006f750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2980009870 tx=0x7f2980009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bedc1879cc28523b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:48:02.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2987fff700 1 -- 172.21.15.72:0/4045320042 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880019f0 con 0x7f29900cd040 2023-08-25T04:48:02.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2987fff700 1 -- 172.21.15.72:0/4045320042 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2980004030 con 0x7f29900cd040 2023-08-25T04:48:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.590+0000 7f2987fff700 1 -- 172.21.15.72:0/4045320042 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29800043a0 con 0x7f29900cd040 2023-08-25T04:48:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.591+0000 7f29979ff700 1 -- 172.21.15.72:0/4045320042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29900cd040 msgr2=0x7f299006f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.591+0000 7f29979ff700 1 --2- 172.21.15.72:0/4045320042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29900cd040 0x7f299006f750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2980009870 tx=0x7f2980009b80 comp rx=0 tx=0).stop 2023-08-25T04:48:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.591+0000 7f29979ff700 1 -- 172.21.15.72:0/4045320042 shutdown_connections 2023-08-25T04:48:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.591+0000 7f29979ff700 1 --2- 172.21.15.72:0/4045320042 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f29900cd040 0x7f299006f750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.591+0000 7f29979ff700 1 -- 172.21.15.72:0/4045320042 >> 172.21.15.72:0/4045320042 conn(0x7f299006d200 msgr2=0x7f299006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:48:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.591+0000 7f29979ff700 1 -- 172.21.15.72:0/4045320042 shutdown_connections 2023-08-25T04:48:02.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.591+0000 7f29979ff700 1 -- 172.21.15.72:0/4045320042 wait complete. 2023-08-25T04:48:02.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.593+0000 7f29979ff700 1 Processor -- start 2023-08-25T04:48:02.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.593+0000 7f29979ff700 1 -- start start 2023-08-25T04:48:02.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f29979ff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29900cd040 0x7f29901528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:48:02.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f29979ff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f299015cfd0 0x7f2990158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:48:02.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f29979ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2990160bb0 0x7f2990157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:48:02.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f29979ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2990157ae0 con 0x7f2990160bb0 2023-08-25T04:48:02.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f29979ff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2990157dc0 con 0x7f29900cd040 2023-08-25T04:48:02.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f29979ff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29901580a0 con 0x7f299015cfd0 2023-08-25T04:48:02.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f2995f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2990160bb0 0x7f2990157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:48:02.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f2995f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2990160bb0 0x7f2990157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34778/0 (socket says 172.21.15.72:34778) 2023-08-25T04:48:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f2995f9c700 1 -- 172.21.15.72:0/2066485864 learned_addr learned my addr 172.21.15.72:0/2066485864 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:48:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f299579b700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29900cd040 0x7f29901528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:48:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.594+0000 7f2994f9a700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f299015cfd0 0x7f2990158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:48:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f2995f9c700 1 -- 172.21.15.72:0/2066485864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f299015cfd0 msgr2=0x7f2990158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f2995f9c700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f299015cfd0 0x7f2990158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f2995f9c700 1 -- 172.21.15.72:0/2066485864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29900cd040 msgr2=0x7f29901528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f2995f9c700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29900cd040 0x7f29901528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f2995f9c700 1 -- 172.21.15.72:0/2066485864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29800094a0 con 0x7f2990160bb0 2023-08-25T04:48:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f2995f9c700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2990160bb0 0x7f2990157040 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2988001700 tx=0x7f298800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:48:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f2985ffb700 1 -- 172.21.15.72:0/2066485864 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800ab00 con 0x7f2990160bb0 2023-08-25T04:48:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f2985ffb700 1 -- 172.21.15.72:0/2066485864 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800ac60 con 0x7f2990160bb0 2023-08-25T04:48:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f2985ffb700 1 -- 172.21.15.72:0/2066485864 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880070d0 con 0x7f2990160bb0 2023-08-25T04:48:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f29979ff700 1 -- 172.21.15.72:0/2066485864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2990158380 con 0x7f2990160bb0 2023-08-25T04:48:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.595+0000 7f29979ff700 1 -- 172.21.15.72:0/2066485864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29900c6f70 con 0x7f2990160bb0 2023-08-25T04:48:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.596+0000 7f29979ff700 1 -- 172.21.15.72:0/2066485864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29901588a0 con 0x7f2990160bb0 2023-08-25T04:48:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.597+0000 7f2985ffb700 1 -- 172.21.15.72:0/2066485864 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2988007250 con 0x7f2990160bb0 2023-08-25T04:48:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.598+0000 7f2985ffb700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f297406a0e0 0x7f297406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:48:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.598+0000 7f2985ffb700 1 -- 172.21.15.72:0/2066485864 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2988088220 con 0x7f2990160bb0 2023-08-25T04:48:02.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.598+0000 7f299579b700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f297406a0e0 0x7f297406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:48:02.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.599+0000 7f299579b700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f297406a0e0 0x7f297406c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f298c001790 tx=0x7f298c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:48:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.603+0000 7f2985ffb700 1 -- 172.21.15.72:0/2066485864 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f29901588a0 con 0x7f2990160bb0 2023-08-25T04:48:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.878+0000 7f29979ff700 1 -- 172.21.15.72:0/2066485864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f29901588a0 con 0x7f2990160bb0 2023-08-25T04:48:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.878+0000 7f2985ffb700 1 -- 172.21.15.72:0/2066485864 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f29901588a0 con 0x7f2990160bb0 2023-08-25T04:48:02.881 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:48:02.881 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":1,"fsid":"48882d5a-36fb-4a1e-9265-02d65750e322","modified":"2023-08-25T04:44:33.116436Z","created":"2023-08-25T04:44:33.116436Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3301","nonce":0},{"type":"v1","addr":"172.21.15.137:6790","nonce":0}]},"addr":"172.21.15.137:6790/0","public_addr":"172.21.15.137:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-08-25T04:48:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 -- 172.21.15.72:0/2066485864 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f297406a0e0 msgr2=0x7f297406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f297406a0e0 0x7f297406c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f298c001790 tx=0x7f298c009040 comp rx=0 tx=0).stop 2023-08-25T04:48:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 -- 172.21.15.72:0/2066485864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2990160bb0 msgr2=0x7f2990157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2990160bb0 0x7f2990157040 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2988001700 tx=0x7f298800cf70 comp rx=0 tx=0).stop 2023-08-25T04:48:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 -- 172.21.15.72:0/2066485864 shutdown_connections 2023-08-25T04:48:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7f297406a0e0 0x7f297406c5a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2990160bb0 0x7f2990157040 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29900cd040 0x7f29901528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 --2- 172.21.15.72:0/2066485864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f299015cfd0 0x7f2990158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 -- 172.21.15.72:0/2066485864 >> 172.21.15.72:0/2066485864 conn(0x7f299006d200 msgr2=0x7f29900711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:48:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 -- 172.21.15.72:0/2066485864 shutdown_connections 2023-08-25T04:48:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:02.881+0000 7f29979ff700 1 -- 172.21.15.72:0/2066485864 wait complete. 2023-08-25T04:48:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:dumped monmap epoch 1 2023-08-25T04:48:02.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-08-25T04:48:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.097+0000 7ff7acfff700 1 Processor -- start 2023-08-25T04:48:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.097+0000 7ff7acfff700 1 -- start start 2023-08-25T04:48:03.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.099+0000 7ff7acfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7a815d470 0x7ff7a80b1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:48:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.099+0000 7ff7acfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80cd7e0 con 0x7ff7a80ca830 2023-08-25T04:48:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.099+0000 7ff7acfff700 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80b24e0 con 0x7ff7a806a2f0 2023-08-25T04:48:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.099+0000 7ff7acfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a80b1c40 con 0x7ff7a815d470 2023-08-25T04:48:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.099+0000 7ff7a6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff7a80ca830 0x7ff7a8166da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33580/0 (socket says 172.21.15.72:33580) 2023-08-25T04:48:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.099+0000 7ff7a6d9d700 1 -- 172.21.15.72:0/3225022103 learned_addr learned my addr 172.21.15.72:0/3225022103 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-25T04:48:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.099+0000 7ff79ffff700 1 --2- 172.21.15.72:0/3225022103 >> v2:172.21.15.72:3300/0 conn(0x7ff7a815d470 0x7ff7a80b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:48:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.099+0000 7ff79ffff700 1 -- 172.21.15.72:0/3225022103 >> v1:172.21.15.137:6789/0 conn(0x7ff7a806a2f0 legacy=0x7ff7a806a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.099+0000 7ff79ffff700 1 -- 172.21.15.72:0/3225022103 >> v1:172.21.15.72:6789/0 conn(0x7ff7a80ca830 legacy=0x7ff7a8166da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.099+0000 7ff79ffff700 1 -- 172.21.15.72:0/3225022103 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80b1f20 con 0x7ff7a815d470 2023-08-25T04:48:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.100+0000 7ff79ffff700 1 --2- 172.21.15.72:0/3225022103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 0x7ff7a80b1560 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff790009840 tx=0x7ff790009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3260c256139ca5b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:48:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.100+0000 7ff7a5d9b700 1 -- 172.21.15.72:0/3225022103 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790011830 con 0x7ff7a815d470 2023-08-25T04:48:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.100+0000 7ff7a5d9b700 1 -- 172.21.15.72:0/3225022103 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790011990 con 0x7ff7a815d470 2023-08-25T04:48:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.100+0000 7ff7a5d9b700 1 -- 172.21.15.72:0/3225022103 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790011d20 con 0x7ff7a815d470 2023-08-25T04:48:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.100+0000 7ff7acfff700 1 -- 172.21.15.72:0/3225022103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 msgr2=0x7ff7a80b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.100+0000 7ff7acfff700 1 --2- 172.21.15.72:0/3225022103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 0x7ff7a80b1560 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff790009840 tx=0x7ff790009b50 comp rx=0 tx=0).stop 2023-08-25T04:48:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.101+0000 7ff7acfff700 1 -- 172.21.15.72:0/3225022103 shutdown_connections 2023-08-25T04:48:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.101+0000 7ff7acfff700 1 --2- 172.21.15.72:0/3225022103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 0x7ff7a80b1560 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.101+0000 7ff7acfff700 1 -- 172.21.15.72:0/3225022103 >> 172.21.15.72:0/3225022103 conn(0x7ff7a806db30 msgr2=0x7ff7a806df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:48:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.101+0000 7ff7acfff700 1 -- 172.21.15.72:0/3225022103 shutdown_connections 2023-08-25T04:48:03.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.101+0000 7ff7acfff700 1 -- 172.21.15.72:0/3225022103 wait complete. 2023-08-25T04:48:03.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.102+0000 7ff7acfff700 1 Processor -- start 2023-08-25T04:48:03.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.102+0000 7ff7acfff700 1 -- start start 2023-08-25T04:48:03.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.103+0000 7ff7acfff700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7a806a2f0 0x7ff7a81560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:48:03.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.103+0000 7ff7acfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 0x7ff7a80c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:48:03.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.103+0000 7ff7acfff700 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff7a80c9670 0x7ff7a80b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:48:03.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.103+0000 7ff7acfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80c8a20 con 0x7ff7a815d470 2023-08-25T04:48:03.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.103+0000 7ff7acfff700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8156620 con 0x7ff7a806a2f0 2023-08-25T04:48:03.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.103+0000 7ff7acfff700 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80c7e10 con 0x7ff7a80c9670 2023-08-25T04:48:03.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 0x7ff7a80c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:48:03.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 0x7ff7a80c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59338/0 (socket says 172.21.15.72:59338) 2023-08-25T04:48:03.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79ffff700 1 -- 172.21.15.72:0/3676938666 learned_addr learned my addr 172.21.15.72:0/3676938666 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-25T04:48:03.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79ffff700 1 -- 172.21.15.72:0/3676938666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff7a80c9670 msgr2=0x7ff7a80b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:03.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79ffff700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff7a80c9670 0x7ff7a80b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:03.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79ffff700 1 -- 172.21.15.72:0/3676938666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7a806a2f0 msgr2=0x7ff7a81560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:03.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79ffff700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7a806a2f0 0x7ff7a81560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:03.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79ffff700 1 -- 172.21.15.72:0/3676938666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7900094a0 con 0x7ff7a815d470 2023-08-25T04:48:03.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79ffff700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 0x7ff7a80c75c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff7900090b0 tx=0x7ff790004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:48:03.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79effd700 1 -- 172.21.15.72:0/3676938666 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7900045f0 con 0x7ff7a815d470 2023-08-25T04:48:03.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79effd700 1 -- 172.21.15.72:0/3676938666 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79001e070 con 0x7ff7a815d470 2023-08-25T04:48:03.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff7acfff700 1 -- 172.21.15.72:0/3676938666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a80c80f0 con 0x7ff7a815d470 2023-08-25T04:48:03.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.104+0000 7ff79effd700 1 -- 172.21.15.72:0/3676938666 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790003b00 con 0x7ff7a815d470 2023-08-25T04:48:03.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.105+0000 7ff7acfff700 1 -- 172.21.15.72:0/3676938666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a80c86b0 con 0x7ff7a815d470 2023-08-25T04:48:03.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.106+0000 7ff7acfff700 1 -- 172.21.15.72:0/3676938666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a8066cb0 con 0x7ff7a815d470 2023-08-25T04:48:03.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.106+0000 7ff79effd700 1 -- 172.21.15.72:0/3676938666 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff790003c60 con 0x7ff7a815d470 2023-08-25T04:48:03.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.107+0000 7ff79effd700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff78806a0e0 0x7ff78806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:48:03.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.107+0000 7ff79effd700 1 -- 172.21.15.72:0/3676938666 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff790089840 con 0x7ff7a815d470 2023-08-25T04:48:03.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.108+0000 7ff7a659c700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff78806a0e0 0x7ff78806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:48:03.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.108+0000 7ff7a659c700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff78806a0e0 0x7ff78806c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff798000f60 tx=0x7ff798007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:48:03.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.112+0000 7ff79effd700 1 -- 172.21.15.72:0/3676938666 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff790054de0 con 0x7ff7a815d470 2023-08-25T04:48:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.386+0000 7ff7acfff700 1 -- 172.21.15.72:0/3676938666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7ff7a80b21d0 con 0x7ff7a815d470 2023-08-25T04:48:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.387+0000 7ff79effd700 1 -- 172.21.15.72:0/3676938666 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) v1 ==== 82+0+151 (secure 0 0 0) 0x7ff790058400 con 0x7ff7a815d470 2023-08-25T04:48:03.388 INFO:teuthology.orchestra.run.smithi072.stdout:[client.admin] 2023-08-25T04:48:03.389 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCxMehkki/bGhAA7AACokUqOL3tz75ZHgWgtA== 2023-08-25T04:48:03.389 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow *" 2023-08-25T04:48:03.389 INFO:teuthology.orchestra.run.smithi072.stdout: caps mgr = "allow *" 2023-08-25T04:48:03.389 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow *" 2023-08-25T04:48:03.389 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow *" 2023-08-25T04:48:03.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 -- 172.21.15.72:0/3676938666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff78806a0e0 msgr2=0x7ff78806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:03.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff78806a0e0 0x7ff78806c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff798000f60 tx=0x7ff798007a40 comp rx=0 tx=0).stop 2023-08-25T04:48:03.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 -- 172.21.15.72:0/3676938666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 msgr2=0x7ff7a80c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:48:03.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 0x7ff7a80c75c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff7900090b0 tx=0x7ff790004750 comp rx=0 tx=0).stop 2023-08-25T04:48:03.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 -- 172.21.15.72:0/3676938666 shutdown_connections 2023-08-25T04:48:03.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.72:6832/1377484023,v1:172.21.15.72:6833/1377484023] conn(0x7ff78806a0e0 0x7ff78806c5a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff7a80c9670 0x7ff7a80b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7a806a2f0 0x7ff7a81560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 --2- 172.21.15.72:0/3676938666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a815d470 0x7ff7a80c75c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:48:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 -- 172.21.15.72:0/3676938666 >> 172.21.15.72:0/3676938666 conn(0x7ff7a806db30 msgr2=0x7ff7a80d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:48:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 -- 172.21.15.72:0/3676938666 shutdown_connections 2023-08-25T04:48:03.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-25T04:48:03.389+0000 7ff7acfff700 1 -- 172.21.15.72:0/3676938666 wait complete. 2023-08-25T04:48:03.408 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-08-25T04:48:03.454 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.Ahmnoyoc80 2023-08-25T04:48:03.454 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:48:03.455 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/tmp/tmp.Ahmnoyoc80 2023-08-25T04:48:03.541 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:48:03.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/tmp/tmp.isvk1JLbjhxfstests-dev/local.config 2023-08-25T04:48:03.649 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.HtdGzZPqJztest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.kLjuibYnrbscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.72:6789 -k /tmp/tmp.Ahmnoyoc80 --client_mountpoint /test" 2023-08-25T04:48:03.650 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-25T04:48:03.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/tmp/tmp.isvk1JLbjhxfstests-dev/ceph.exclude 2023-08-25T04:48:03.759 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo make) 2023-08-25T04:48:03.890 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize -cfi 2023-08-25T04:48:04.446 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: putting auxiliary files in '.'. 2023-08-25T04:48:04.446 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './config.guess' 2023-08-25T04:48:04.456 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './config.sub' 2023-08-25T04:48:04.466 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './install-sh' 2023-08-25T04:48:04.477 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './ltmain.sh' 2023-08-25T04:48:04.539 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-08-25T04:48:04.539 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-08-25T04:48:04.552 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-08-25T04:48:04.564 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-08-25T04:48:04.577 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-08-25T04:48:04.590 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-08-25T04:48:04.606 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-08-25T04:48:04.609 INFO:teuthology.orchestra.run.smithi072.stdout:cp include/install-sh . 2023-08-25T04:48:04.612 INFO:teuthology.orchestra.run.smithi072.stdout:aclocal -I m4 2023-08-25T04:48:05.866 INFO:teuthology.orchestra.run.smithi072.stdout:autoheader 2023-08-25T04:48:06.231 INFO:teuthology.orchestra.run.smithi072.stdout:autoconf 2023-08-25T04:48:06.440 INFO:teuthology.orchestra.run.smithi072.stdout:./configure \ 2023-08-25T04:48:06.440 INFO:teuthology.orchestra.run.smithi072.stdout: --libexecdir=/usr/lib \ 2023-08-25T04:48:06.440 INFO:teuthology.orchestra.run.smithi072.stdout: --exec_prefix=/var/lib 2023-08-25T04:48:06.891 INFO:teuthology.orchestra.run.smithi072.stdout:checking build system type... x86_64-pc-linux-gnu 2023-08-25T04:48:06.891 INFO:teuthology.orchestra.run.smithi072.stdout:checking host system type... x86_64-pc-linux-gnu 2023-08-25T04:48:06.895 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to print strings... printf 2023-08-25T04:48:06.895 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc... gcc 2023-08-25T04:48:07.042 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether the C compiler works... yes 2023-08-25T04:48:07.042 INFO:teuthology.orchestra.run.smithi072.stdout:checking for C compiler default output file name... a.out 2023-08-25T04:48:07.092 INFO:teuthology.orchestra.run.smithi072.stdout:checking for suffix of executables... 2023-08-25T04:48:07.157 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether we are cross compiling... no 2023-08-25T04:48:07.195 INFO:teuthology.orchestra.run.smithi072.stdout:checking for suffix of object files... o 2023-08-25T04:48:07.229 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether we are using the GNU C compiler... yes 2023-08-25T04:48:07.263 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether gcc accepts -g... yes 2023-08-25T04:48:07.310 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc option to accept ISO C89... none needed 2023-08-25T04:48:07.318 INFO:teuthology.orchestra.run.smithi072.stdout:checking for a sed that does not truncate output... /bin/sed 2023-08-25T04:48:07.323 INFO:teuthology.orchestra.run.smithi072.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-08-25T04:48:07.326 INFO:teuthology.orchestra.run.smithi072.stdout:checking for egrep... /bin/grep -E 2023-08-25T04:48:07.329 INFO:teuthology.orchestra.run.smithi072.stdout:checking for fgrep... /bin/grep -F 2023-08-25T04:48:07.337 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ld used by gcc... /bin/ld 2023-08-25T04:48:07.341 INFO:teuthology.orchestra.run.smithi072.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-08-25T04:48:07.357 INFO:teuthology.orchestra.run.smithi072.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-08-25T04:48:07.396 INFO:teuthology.orchestra.run.smithi072.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-08-25T04:48:07.396 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether ln -s works... yes 2023-08-25T04:48:07.414 INFO:teuthology.orchestra.run.smithi072.stdout:checking the maximum length of command line arguments... 1572864 2023-08-25T04:48:07.420 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-08-25T04:48:07.421 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-08-25T04:48:07.421 INFO:teuthology.orchestra.run.smithi072.stdout:checking for /bin/ld option to reload object files... -r 2023-08-25T04:48:07.421 INFO:teuthology.orchestra.run.smithi072.stdout:checking for objdump... objdump 2023-08-25T04:48:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to recognize dependent libraries... pass_all 2023-08-25T04:48:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dlltool... no 2023-08-25T04:48:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-08-25T04:48:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ar... ar 2023-08-25T04:48:07.477 INFO:teuthology.orchestra.run.smithi072.stdout:checking for archiver @FILE support... @ 2023-08-25T04:48:07.477 INFO:teuthology.orchestra.run.smithi072.stdout:checking for strip... strip 2023-08-25T04:48:07.478 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ranlib... ranlib 2023-08-25T04:48:07.478 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gawk... gawk 2023-08-25T04:48:07.588 INFO:teuthology.orchestra.run.smithi072.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-08-25T04:48:07.591 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sysroot... no 2023-08-25T04:48:07.598 INFO:teuthology.orchestra.run.smithi072.stdout:checking for a working dd... /bin/dd 2023-08-25T04:48:07.606 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-08-25T04:48:07.635 INFO:teuthology.orchestra.run.smithi072.stdout:checking for mt... no 2023-08-25T04:48:07.640 INFO:teuthology.orchestra.run.smithi072.stdout:checking if : is a manifest tool... no 2023-08-25T04:48:07.708 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to run the C preprocessor... gcc -E 2023-08-25T04:48:07.944 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ANSI C header files... yes 2023-08-25T04:48:07.984 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/types.h... yes 2023-08-25T04:48:08.044 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/stat.h... yes 2023-08-25T04:48:08.096 INFO:teuthology.orchestra.run.smithi072.stdout:checking for stdlib.h... yes 2023-08-25T04:48:08.149 INFO:teuthology.orchestra.run.smithi072.stdout:checking for string.h... yes 2023-08-25T04:48:08.202 INFO:teuthology.orchestra.run.smithi072.stdout:checking for memory.h... yes 2023-08-25T04:48:08.255 INFO:teuthology.orchestra.run.smithi072.stdout:checking for strings.h... yes 2023-08-25T04:48:08.309 INFO:teuthology.orchestra.run.smithi072.stdout:checking for inttypes.h... yes 2023-08-25T04:48:08.364 INFO:teuthology.orchestra.run.smithi072.stdout:checking for stdint.h... yes 2023-08-25T04:48:08.421 INFO:teuthology.orchestra.run.smithi072.stdout:checking for unistd.h... yes 2023-08-25T04:48:08.479 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dlfcn.h... yes 2023-08-25T04:48:08.488 INFO:teuthology.orchestra.run.smithi072.stdout:checking for objdir... .libs 2023-08-25T04:48:08.623 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-08-25T04:48:08.623 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-08-25T04:48:08.664 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-08-25T04:48:08.701 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc static flag -static works... no 2023-08-25T04:48:08.754 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc supports -c -o file.o... yes 2023-08-25T04:48:08.755 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-08-25T04:48:08.770 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-08-25T04:48:08.818 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether -lc should be explicitly linked in... no 2023-08-25T04:48:08.921 INFO:teuthology.orchestra.run.smithi072.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-08-25T04:48:08.921 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to hardcode library paths into programs... immediate 2023-08-25T04:48:08.935 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether stripping libraries is possible... yes 2023-08-25T04:48:08.935 INFO:teuthology.orchestra.run.smithi072.stdout:checking if libtool supports shared libraries... yes 2023-08-25T04:48:08.936 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether to build shared libraries... yes 2023-08-25T04:48:08.936 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether to build static libraries... yes 2023-08-25T04:48:08.947 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc... (cached) gcc 2023-08-25T04:48:08.986 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-08-25T04:48:08.986 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether gcc accepts -g... (cached) yes 2023-08-25T04:48:08.986 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-08-25T04:48:08.987 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gmake... /usr/bin/gmake 2023-08-25T04:48:08.987 INFO:teuthology.orchestra.run.smithi072.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-08-25T04:48:08.988 INFO:teuthology.orchestra.run.smithi072.stdout:checking for tar... /bin/tar 2023-08-25T04:48:08.988 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gzip... /bin/gzip 2023-08-25T04:48:09.003 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether gcc -MM is supported... yes 2023-08-25T04:48:09.004 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sort... /bin/sort 2023-08-25T04:48:09.005 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether ln -s works... yes 2023-08-25T04:48:09.005 INFO:teuthology.orchestra.run.smithi072.stdout:checking for rpm... /bin/rpm 2023-08-25T04:48:09.013 INFO:teuthology.orchestra.run.smithi072.stdout:checking for rpmbuild... no 2023-08-25T04:48:09.070 INFO:teuthology.orchestra.run.smithi072.stdout:checking assert.h usability... yes 2023-08-25T04:48:09.086 INFO:teuthology.orchestra.run.smithi072.stdout:checking assert.h presence... yes 2023-08-25T04:48:09.087 INFO:teuthology.orchestra.run.smithi072.stdout:checking for assert.h... yes 2023-08-25T04:48:09.143 INFO:teuthology.orchestra.run.smithi072.stdout:checking bstring.h usability... no 2023-08-25T04:48:09.167 INFO:teuthology.orchestra.run.smithi072.stdout:checking bstring.h presence... no 2023-08-25T04:48:09.167 INFO:teuthology.orchestra.run.smithi072.stdout:checking for bstring.h... no 2023-08-25T04:48:09.223 INFO:teuthology.orchestra.run.smithi072.stdout:checking libgen.h usability... yes 2023-08-25T04:48:09.239 INFO:teuthology.orchestra.run.smithi072.stdout:checking libgen.h presence... yes 2023-08-25T04:48:09.240 INFO:teuthology.orchestra.run.smithi072.stdout:checking for libgen.h... yes 2023-08-25T04:48:09.304 INFO:teuthology.orchestra.run.smithi072.stdout:checking dirent.h usability... yes 2023-08-25T04:48:09.321 INFO:teuthology.orchestra.run.smithi072.stdout:checking dirent.h presence... yes 2023-08-25T04:48:09.322 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dirent.h... yes 2023-08-25T04:48:09.399 INFO:teuthology.orchestra.run.smithi072.stdout:checking errno.h usability... yes 2023-08-25T04:48:09.415 INFO:teuthology.orchestra.run.smithi072.stdout:checking errno.h presence... yes 2023-08-25T04:48:09.416 INFO:teuthology.orchestra.run.smithi072.stdout:checking for errno.h... yes 2023-08-25T04:48:09.480 INFO:teuthology.orchestra.run.smithi072.stdout:checking malloc.h usability... yes 2023-08-25T04:48:09.498 INFO:teuthology.orchestra.run.smithi072.stdout:checking malloc.h presence... yes 2023-08-25T04:48:09.498 INFO:teuthology.orchestra.run.smithi072.stdout:checking for malloc.h... yes 2023-08-25T04:48:09.555 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid.h usability... no 2023-08-25T04:48:09.579 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid.h presence... no 2023-08-25T04:48:09.579 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid.h... no 2023-08-25T04:48:09.639 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid/uuid.h usability... yes 2023-08-25T04:48:09.658 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid/uuid.h presence... yes 2023-08-25T04:48:09.659 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid/uuid.h... yes 2023-08-25T04:48:09.716 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/uuid.h usability... no 2023-08-25T04:48:09.740 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/uuid.h presence... no 2023-08-25T04:48:09.740 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/uuid.h... no 2023-08-25T04:48:09.792 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/file.h usability... yes 2023-08-25T04:48:09.809 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/file.h presence... yes 2023-08-25T04:48:09.810 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/file.h... yes 2023-08-25T04:48:09.867 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fcntl.h usability... yes 2023-08-25T04:48:09.884 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fcntl.h presence... yes 2023-08-25T04:48:09.884 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/fcntl.h... yes 2023-08-25T04:48:09.942 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/syssgi.h usability... no 2023-08-25T04:48:09.967 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/syssgi.h presence... no 2023-08-25T04:48:09.967 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/syssgi.h... no 2023-08-25T04:48:10.047 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/param.h usability... yes 2023-08-25T04:48:10.068 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/param.h presence... yes 2023-08-25T04:48:10.069 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/param.h... yes 2023-08-25T04:48:10.083 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/stat.h... (cached) yes 2023-08-25T04:48:10.147 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/statvfs.h usability... yes 2023-08-25T04:48:10.164 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/statvfs.h presence... yes 2023-08-25T04:48:10.164 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/statvfs.h... yes 2023-08-25T04:48:10.221 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/time.h usability... yes 2023-08-25T04:48:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/time.h presence... yes 2023-08-25T04:48:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/time.h... yes 2023-08-25T04:48:10.298 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/ioctl.h usability... yes 2023-08-25T04:48:10.315 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/ioctl.h presence... yes 2023-08-25T04:48:10.316 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/ioctl.h... yes 2023-08-25T04:48:10.376 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/wait.h usability... yes 2023-08-25T04:48:10.396 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/wait.h presence... yes 2023-08-25T04:48:10.396 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/wait.h... yes 2023-08-25T04:48:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/types.h... (cached) yes 2023-08-25T04:48:10.424 INFO:teuthology.orchestra.run.smithi072.stdout:checking for strings.h... (cached) yes 2023-08-25T04:48:10.481 INFO:teuthology.orchestra.run.smithi072.stdout:checking err.h usability... yes 2023-08-25T04:48:10.497 INFO:teuthology.orchestra.run.smithi072.stdout:checking err.h presence... yes 2023-08-25T04:48:10.497 INFO:teuthology.orchestra.run.smithi072.stdout:checking for err.h... yes 2023-08-25T04:48:10.557 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/falloc.h usability... yes 2023-08-25T04:48:10.573 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/falloc.h presence... yes 2023-08-25T04:48:10.573 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/falloc.h... yes 2023-08-25T04:48:10.631 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-08-25T04:48:10.655 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-08-25T04:48:10.655 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/fs/xfs_fsops.h... no 2023-08-25T04:48:10.704 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_itable.h usability... no 2023-08-25T04:48:10.728 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_itable.h presence... no 2023-08-25T04:48:10.728 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/fs/xfs_itable.h... no 2023-08-25T04:48:10.776 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/platform_defs.h usability... no 2023-08-25T04:48:10.800 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/platform_defs.h presence... no 2023-08-25T04:48:10.800 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/platform_defs.h... no 2023-08-25T04:48:10.849 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfs/ioctl.h usability... no 2023-08-25T04:48:10.873 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfs/ioctl.h presence... no 2023-08-25T04:48:10.874 INFO:teuthology.orchestra.run.smithi072.stdout:checking for btrfs/ioctl.h... no 2023-08-25T04:48:10.922 INFO:teuthology.orchestra.run.smithi072.stdout:checking cifs/ioctl.h usability... no 2023-08-25T04:48:10.947 INFO:teuthology.orchestra.run.smithi072.stdout:checking cifs/ioctl.h presence... no 2023-08-25T04:48:10.947 INFO:teuthology.orchestra.run.smithi072.stdout:checking for cifs/ioctl.h... no 2023-08-25T04:48:10.997 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/mman.h usability... yes 2023-08-25T04:48:11.014 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/mman.h presence... yes 2023-08-25T04:48:11.014 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/mman.h... yes 2023-08-25T04:48:11.052 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/xfs_log_format.h... no 2023-08-25T04:48:11.119 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid_compare... no 2023-08-25T04:48:11.175 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid_compare in -luuid... yes 2023-08-25T04:48:11.279 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/xfs.h... yes 2023-08-25T04:48:11.311 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/libxfs.h... no 2023-08-25T04:48:11.349 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether xlog_assign_lsn is declared... no 2023-08-25T04:48:11.401 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/xqm.h... yes 2023-08-25T04:48:11.480 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfsctl from xfs/xfs.h... ok 2023-08-25T04:48:11.526 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/handle.h usability... yes 2023-08-25T04:48:11.541 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/handle.h presence... yes 2023-08-25T04:48:11.541 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/handle.h... yes 2023-08-25T04:48:11.601 INFO:teuthology.orchestra.run.smithi072.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-08-25T04:48:11.651 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/acl.h usability... yes 2023-08-25T04:48:11.669 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/acl.h presence... yes 2023-08-25T04:48:11.669 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/acl.h... yes 2023-08-25T04:48:11.732 INFO:teuthology.orchestra.run.smithi072.stdout:checking acl/libacl.h usability... yes 2023-08-25T04:48:11.750 INFO:teuthology.orchestra.run.smithi072.stdout:checking acl/libacl.h presence... yes 2023-08-25T04:48:11.750 INFO:teuthology.orchestra.run.smithi072.stdout:checking for acl/libacl.h... yes 2023-08-25T04:48:11.810 INFO:teuthology.orchestra.run.smithi072.stdout:checking for acl_init in -lacl... yes 2023-08-25T04:48:11.856 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm-ndbm.h usability... no 2023-08-25T04:48:11.880 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm-ndbm.h presence... no 2023-08-25T04:48:11.881 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gdbm-ndbm.h... no 2023-08-25T04:48:11.923 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm/ndbm.h usability... no 2023-08-25T04:48:11.947 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm/ndbm.h presence... no 2023-08-25T04:48:11.948 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gdbm/ndbm.h... no 2023-08-25T04:48:11.990 INFO:teuthology.orchestra.run.smithi072.stdout:checking ndbm.h usability... no 2023-08-25T04:48:12.015 INFO:teuthology.orchestra.run.smithi072.stdout:checking ndbm.h presence... no 2023-08-25T04:48:12.015 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ndbm.h... no 2023-08-25T04:48:12.062 INFO:teuthology.orchestra.run.smithi072.stdout:checking libaio.h usability... yes 2023-08-25T04:48:12.084 INFO:teuthology.orchestra.run.smithi072.stdout:checking libaio.h presence... yes 2023-08-25T04:48:12.084 INFO:teuthology.orchestra.run.smithi072.stdout:checking for libaio.h... yes 2023-08-25T04:48:12.129 INFO:teuthology.orchestra.run.smithi072.stdout:checking liburing.h usability... no 2023-08-25T04:48:12.153 INFO:teuthology.orchestra.run.smithi072.stdout:checking liburing.h presence... no 2023-08-25T04:48:12.153 INFO:teuthology.orchestra.run.smithi072.stdout:checking for liburing.h... no 2023-08-25T04:48:12.196 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/capability.h usability... no 2023-08-25T04:48:12.220 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/capability.h presence... no 2023-08-25T04:48:12.220 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/capability.h... no 2023-08-25T04:48:12.263 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fiemap.h usability... yes 2023-08-25T04:48:12.280 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fiemap.h presence... yes 2023-08-25T04:48:12.281 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/fiemap.h... yes 2023-08-25T04:48:12.341 INFO:teuthology.orchestra.run.smithi072.stdout:checking for fallocate... yes 2023-08-25T04:48:12.401 INFO:teuthology.orchestra.run.smithi072.stdout:checking for open_by_handle_at... yes 2023-08-25T04:48:12.447 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/prctl.h usability... yes 2023-08-25T04:48:12.464 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/prctl.h presence... yes 2023-08-25T04:48:12.465 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/prctl.h... yes 2023-08-25T04:48:12.512 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fs.h usability... yes 2023-08-25T04:48:12.528 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fs.h presence... yes 2023-08-25T04:48:12.529 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/fs.h... yes 2023-08-25T04:48:12.572 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfsutil.h usability... no 2023-08-25T04:48:12.596 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfsutil.h presence... no 2023-08-25T04:48:12.596 INFO:teuthology.orchestra.run.smithi072.stdout:checking for btrfsutil.h... no 2023-08-25T04:48:12.658 INFO:teuthology.orchestra.run.smithi072.stdout:checking for copy_file_range... yes 2023-08-25T04:48:12.722 INFO:teuthology.orchestra.run.smithi072.stdout:checking for SEEK_DATA... yes 2023-08-25T04:48:12.803 INFO:teuthology.orchestra.run.smithi072.stdout:checking for BMV_OF_SHARED... yes 2023-08-25T04:48:12.867 INFO:teuthology.orchestra.run.smithi072.stdout:checking for nftw... yes 2023-08-25T04:48:12.928 INFO:teuthology.orchestra.run.smithi072.stdout:checking for RLIMIT_NOFILE... yes 2023-08-25T04:48:12.967 INFO:teuthology.orchestra.run.smithi072.stdout:checking for FIEXCHANGE_RANGE... no 2023-08-25T04:48:13.028 INFO:teuthology.orchestra.run.smithi072.stdout:checking for renameat2... yes 2023-08-25T04:48:13.090 INFO:teuthology.orchestra.run.smithi072.stdout:checking for reallocarray... yes 2023-08-25T04:48:13.122 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct mount_attr... no 2023-08-25T04:48:13.197 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_qgroup_limit... yes 2023-08-25T04:48:13.271 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-08-25T04:48:13.344 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-08-25T04:48:13.417 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-08-25T04:48:13.490 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-08-25T04:48:13.564 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-08-25T04:48:13.638 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-08-25T04:48:13.872 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs.h usability... yes 2023-08-25T04:48:13.890 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs.h presence... yes 2023-08-25T04:48:13.890 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/btrfs.h... yes 2023-08-25T04:48:13.951 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs_tree.h usability... yes 2023-08-25T04:48:13.969 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs_tree.h presence... yes 2023-08-25T04:48:13.969 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/btrfs_tree.h... yes 2023-08-25T04:48:14.042 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-08-25T04:48:14.072 INFO:teuthology.orchestra.run.smithi072.stdout:configure: creating ./config.status 2023-08-25T04:48:14.985 INFO:teuthology.orchestra.run.smithi072.stdout:config.status: creating include/builddefs 2023-08-25T04:48:15.015 INFO:teuthology.orchestra.run.smithi072.stdout:config.status: creating include/config.h 2023-08-25T04:48:15.036 INFO:teuthology.orchestra.run.smithi072.stdout:config.status: executing libtool commands 2023-08-25T04:48:15.116 INFO:teuthology.orchestra.run.smithi072.stdout:Building include 2023-08-25T04:48:15.123 INFO:teuthology.orchestra.run.smithi072.stdout:Building lib 2023-08-25T04:48:15.130 INFO:teuthology.orchestra.run.smithi072.stdout: [LTDEP] 2023-08-25T04:48:15.338 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dataascii.lo 2023-08-25T04:48:15.541 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] databin.lo 2023-08-25T04:48:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] datapid.lo 2023-08-25T04:48:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] file_lock.lo 2023-08-25T04:48:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] forker.lo 2023-08-25T04:48:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] pattern.lo 2023-08-25T04:48:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] open_flags.lo 2023-08-25T04:48:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] random_range.lo 2023-08-25T04:48:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] string_to_tokens.lo 2023-08-25T04:48:17.348 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] str_to_bytes.lo 2023-08-25T04:48:17.565 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] tlibio.lo 2023-08-25T04:48:17.886 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] write_log.lo 2023-08-25T04:48:18.213 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] random.lo 2023-08-25T04:48:18.409 INFO:teuthology.orchestra.run.smithi072.stdout: [LD] 2023-08-25T04:48:18.543 INFO:teuthology.orchestra.run.smithi072.stdout:Building ltp 2023-08-25T04:48:18.550 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2023-08-25T04:48:18.768 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] doio 2023-08-25T04:48:19.507 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsstress 2023-08-25T04:48:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsx 2023-08-25T04:48:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] growfiles 2023-08-25T04:48:22.429 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] iogen 2023-08-25T04:48:22.884 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-stress 2023-08-25T04:48:23.397 INFO:teuthology.orchestra.run.smithi072.stdout:Building src 2023-08-25T04:48:23.407 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2023-08-25T04:48:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2023-08-25T04:48:25.917 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2023-08-25T04:48:25.934 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2023-08-25T04:48:26.275 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2023-08-25T04:48:26.315 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dirstress 2023-08-25T04:48:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fill 2023-08-25T04:48:26.908 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fill2 2023-08-25T04:48:27.241 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] getpagesize 2023-08-25T04:48:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] holes 2023-08-25T04:48:27.775 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] lstat64 2023-08-25T04:48:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] nametest 2023-08-25T04:48:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] permname 2023-08-25T04:48:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] randholes 2023-08-25T04:48:29.049 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] runas 2023-08-25T04:48:29.328 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] truncfile 2023-08-25T04:48:29.612 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] usemem 2023-08-25T04:48:29.864 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mmapcat 2023-08-25T04:48:30.116 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] append_reader 2023-08-25T04:48:30.367 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] append_writer 2023-08-25T04:48:30.621 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dirperf 2023-08-25T04:48:30.943 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] metaperf 2023-08-25T04:48:31.296 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] devzero 2023-08-25T04:48:31.574 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] feature 2023-08-25T04:48:31.895 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] alloc 2023-08-25T04:48:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fault 2023-08-25T04:48:32.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:48:32.344 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:48:32.481 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fstest 2023-08-25T04:48:32.821 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_access_root 2023-08-25T04:48:33.074 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] godown 2023-08-25T04:48:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] resvtest 2023-08-25T04:48:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] writemod 2023-08-25T04:48:33.879 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] writev_on_pagefault 2023-08-25T04:48:34.138 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] makeextents 2023-08-25T04:48:34.420 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] itrash 2023-08-25T04:48:34.675 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] rename 2023-08-25T04:48:34.914 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] multi_open_unlink 2023-08-25T04:48:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] unwritten_sync 2023-08-25T04:48:35.463 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] genhashnames 2023-08-25T04:48:35.748 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_holes 2023-08-25T04:48:35.995 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_writev 2023-08-25T04:48:36.244 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_truncate_cmtime 2023-08-25T04:48:36.504 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dirhash_collide 2023-08-25T04:48:36.788 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_rename_overwrite 2023-08-25T04:48:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] holetest 2023-08-25T04:48:37.347 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_truncate_self 2023-08-25T04:48:37.587 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] af_unix 2023-08-25T04:48:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_stale_pmd 2023-08-25T04:48:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_cow_race 2023-08-25T04:48:38.362 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_fallocate 2023-08-25T04:48:38.615 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsync-err 2023-08-25T04:48:38.901 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_write_ro 2023-08-25T04:48:39.157 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_ext4_dax_journal_corruption 2023-08-25T04:48:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_ext4_dax_inline_corruption 2023-08-25T04:48:39.672 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_ofd_locks 2023-08-25T04:48:39.976 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_collision 2023-08-25T04:48:40.273 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mmap-write-concurrent 2023-08-25T04:48:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_get_file_time 2023-08-25T04:48:40.791 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_create_short_dirs 2023-08-25T04:48:41.059 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_create_long_dirs 2023-08-25T04:48:41.323 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_enospc 2023-08-25T04:48:41.610 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_writev_overlap 2023-08-25T04:48:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] checkpoint_journal 2023-08-25T04:48:42.137 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mmap-rw-fault 2023-08-25T04:48:42.422 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] allocstale 2023-08-25T04:48:42.694 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_cow_memory_failure 2023-08-25T04:48:42.966 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fake-dump-rootino 2023-08-25T04:48:43.217 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dio-buf-fault 2023-08-25T04:48:43.473 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] xfsctl 2023-08-25T04:48:43.765 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bstat 2023-08-25T04:48:44.073 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mtab 2023-08-25T04:48:44.360 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] getdevicesize 2023-08-25T04:48:44.601 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] preallo_rw_pattern_reader 2023-08-25T04:48:44.864 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] preallo_rw_pattern_writer 2023-08-25T04:48:45.127 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] ftrunc 2023-08-25T04:48:45.377 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] trunc 2023-08-25T04:48:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fs_perms 2023-08-25T04:48:45.907 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] testx 2023-08-25T04:48:46.140 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] looptest 2023-08-25T04:48:46.431 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] locktest 2023-08-25T04:48:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] unwritten_mmap 2023-08-25T04:48:47.105 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bulkstat_unlink_test 2023-08-25T04:48:47.408 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] deduperace 2023-08-25T04:48:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bulkstat_unlink_test_modified 2023-08-25T04:48:48.006 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_dir_offset 2023-08-25T04:48:48.256 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_futimens 2023-08-25T04:48:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_immutable 2023-08-25T04:48:49.191 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] stale_handle 2023-08-25T04:48:49.466 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] pwrite_mmap_blocked 2023-08-25T04:48:49.720 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_dir_offset2 2023-08-25T04:48:50.015 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] seek_sanity_test 2023-08-25T04:48:50.523 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] seek_copy_test 2023-08-25T04:48:50.801 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_readdir_1 2023-08-25T04:48:51.052 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_readdir_2 2023-08-25T04:48:51.304 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsync-tester 2023-08-25T04:48:51.652 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] nsexec 2023-08-25T04:48:51.928 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] cloner 2023-08-25T04:48:52.207 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] renameat2 2023-08-25T04:48:52.479 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_getcwd 2023-08-25T04:48:52.740 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] e4compact 2023-08-25T04:48:53.041 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] test-nextquota 2023-08-25T04:48:53.318 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] punch-alternating 2023-08-25T04:48:53.594 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] attr-list-by-handle-cursor-test 2023-08-25T04:48:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] listxattr 2023-08-25T04:48:54.114 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dio-interleaved 2023-08-25T04:48:54.375 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_dir_type 2023-08-25T04:48:54.633 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dio-invalidate-cache 2023-08-25T04:48:54.935 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] stat_test 2023-08-25T04:48:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_encrypted_d_revalidate 2023-08-25T04:48:55.600 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] attr_replace_test 2023-08-25T04:48:55.866 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] swapon 2023-08-25T04:48:56.133 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mkswap 2023-08-25T04:48:56.387 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_attr_corruption 2023-08-25T04:48:56.638 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_open_tmpfiles 2023-08-25T04:48:56.920 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fscrypt-crypt-util 2023-08-25T04:48:57.641 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bulkstat_null_ocount 2023-08-25T04:48:57.905 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] splice-test 2023-08-25T04:48:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] chprojid_fail 2023-08-25T04:48:58.453 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] detached_mounts_propagation 2023-08-25T04:48:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] ext4_resize 2023-08-25T04:48:58.995 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_readdir_3 2023-08-25T04:48:59.291 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] splice2pipe 2023-08-25T04:48:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] uuid_ioctl 2023-08-25T04:48:59.811 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fiemap-tester 2023-08-25T04:49:00.177 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_stripealign 2023-08-25T04:49:00.431 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] open_by_handle 2023-08-25T04:49:00.786 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_dio 2023-08-25T04:49:01.052 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] xfsfind 2023-08-25T04:49:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fssum 2023-08-25T04:49:01.877 INFO:teuthology.orchestra.run.smithi072.stdout:Building log-writes 2023-08-25T04:49:01.887 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] replay-log 2023-08-25T04:49:02.301 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2023-08-25T04:49:02.309 INFO:teuthology.orchestra.run.smithi072.stdout:Building aio-dio-regress 2023-08-25T04:49:02.320 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-append-write-fallocate-race 2023-08-25T04:49:02.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:49:02.456 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:49:02.605 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-fcntl-race 2023-08-25T04:49:02.875 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-subblock-eof-read 2023-08-25T04:49:03.128 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-append-write-read-race 2023-08-25T04:49:03.409 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-invalidate-readahead 2023-08-25T04:49:03.681 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-hole-filling-race 2023-08-25T04:49:03.937 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-08-25T04:49:04.177 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-last-ref-held-by-io 2023-08-25T04:49:04.456 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-cycle-write 2023-08-25T04:49:04.746 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-extend-stat 2023-08-25T04:49:05.020 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-08-25T04:49:05.257 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-invalidate-failure 2023-08-25T04:49:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aiodio_sparse2 2023-08-25T04:49:05.841 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aiocp 2023-08-25T04:49:06.168 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-cow-race 2023-08-25T04:49:06.428 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-write-verify 2023-08-25T04:49:06.725 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-eof-race 2023-08-25T04:49:07.012 INFO:teuthology.orchestra.run.smithi072.stdout:Building vfs 2023-08-25T04:49:07.023 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] vfstest 2023-08-25T04:49:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mount-idmapped 2023-08-25T04:49:09.544 INFO:teuthology.orchestra.run.smithi072.stdout:Building m4 2023-08-25T04:49:09.551 INFO:teuthology.orchestra.run.smithi072.stdout:Building common 2023-08-25T04:49:09.559 INFO:teuthology.orchestra.run.smithi072.stdout:Building tests 2023-08-25T04:49:09.569 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2023-08-25T04:49:09.579 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/perf/group.list 2023-08-25T04:49:09.608 INFO:teuthology.orchestra.run.smithi072.stdout:Building ext4 2023-08-25T04:49:09.618 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/ext4/group.list 2023-08-25T04:49:09.714 INFO:teuthology.orchestra.run.smithi072.stdout:Building ocfs2 2023-08-25T04:49:09.724 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/ocfs2/group.list 2023-08-25T04:49:09.758 INFO:teuthology.orchestra.run.smithi072.stdout:Building overlay 2023-08-25T04:49:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/overlay/group.list 2023-08-25T04:49:09.868 INFO:teuthology.orchestra.run.smithi072.stdout:Building cifs 2023-08-25T04:49:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/cifs/group.list 2023-08-25T04:49:09.910 INFO:teuthology.orchestra.run.smithi072.stdout:Building generic 2023-08-25T04:49:09.922 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/generic/group.list 2023-08-25T04:49:10.170 INFO:teuthology.orchestra.run.smithi072.stdout:Building shared 2023-08-25T04:49:10.180 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/shared/group.list 2023-08-25T04:49:10.224 INFO:teuthology.orchestra.run.smithi072.stdout:Building nfs 2023-08-25T04:49:10.234 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/nfs/group.list 2023-08-25T04:49:10.271 INFO:teuthology.orchestra.run.smithi072.stdout:Building f2fs 2023-08-25T04:49:10.280 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/f2fs/group.list 2023-08-25T04:49:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:Building udf 2023-08-25T04:49:10.334 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/udf/group.list 2023-08-25T04:49:10.363 INFO:teuthology.orchestra.run.smithi072.stdout:Building ceph 2023-08-25T04:49:10.373 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/ceph/group.list 2023-08-25T04:49:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:Building xfs 2023-08-25T04:49:10.422 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/xfs/group.list 2023-08-25T04:49:10.672 INFO:teuthology.orchestra.run.smithi072.stdout:Building btrfs 2023-08-25T04:49:10.683 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/btrfs/group.list 2023-08-25T04:49:10.833 INFO:teuthology.orchestra.run.smithi072.stdout:Building tmpfs 2023-08-25T04:49:10.843 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/tmpfs/group.list 2023-08-25T04:49:10.877 INFO:teuthology.orchestra.run.smithi072.stdout:Building selftest 2023-08-25T04:49:10.887 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/selftest/group.list 2023-08-25T04:49:10.922 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo make install) 2023-08-25T04:49:11.017 INFO:teuthology.orchestra.run.smithi072.stdout:Building include 2023-08-25T04:49:11.024 INFO:teuthology.orchestra.run.smithi072.stdout:Building lib 2023-08-25T04:49:11.032 INFO:teuthology.orchestra.run.smithi072.stdout:Building ltp 2023-08-25T04:49:11.040 INFO:teuthology.orchestra.run.smithi072.stdout:Building src 2023-08-25T04:49:11.102 INFO:teuthology.orchestra.run.smithi072.stdout:Building log-writes 2023-08-25T04:49:11.110 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2023-08-25T04:49:11.117 INFO:teuthology.orchestra.run.smithi072.stdout:Building aio-dio-regress 2023-08-25T04:49:11.125 INFO:teuthology.orchestra.run.smithi072.stdout:Building vfs 2023-08-25T04:49:11.133 INFO:teuthology.orchestra.run.smithi072.stdout:Building m4 2023-08-25T04:49:11.140 INFO:teuthology.orchestra.run.smithi072.stdout:Building common 2023-08-25T04:49:11.147 INFO:teuthology.orchestra.run.smithi072.stdout:Building tests 2023-08-25T04:49:11.157 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2023-08-25T04:49:11.167 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/perf/group.list 2023-08-25T04:49:11.197 INFO:teuthology.orchestra.run.smithi072.stdout:Building ext4 2023-08-25T04:49:11.207 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/ext4/group.list 2023-08-25T04:49:11.302 INFO:teuthology.orchestra.run.smithi072.stdout:Building ocfs2 2023-08-25T04:49:11.311 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/ocfs2/group.list 2023-08-25T04:49:11.346 INFO:teuthology.orchestra.run.smithi072.stdout:Building overlay 2023-08-25T04:49:11.356 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/overlay/group.list 2023-08-25T04:49:11.455 INFO:teuthology.orchestra.run.smithi072.stdout:Building cifs 2023-08-25T04:49:11.465 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/cifs/group.list 2023-08-25T04:49:11.497 INFO:teuthology.orchestra.run.smithi072.stdout:Building generic 2023-08-25T04:49:11.509 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/generic/group.list 2023-08-25T04:49:11.748 INFO:teuthology.orchestra.run.smithi072.stdout:Building shared 2023-08-25T04:49:11.758 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/shared/group.list 2023-08-25T04:49:11.802 INFO:teuthology.orchestra.run.smithi072.stdout:Building nfs 2023-08-25T04:49:11.812 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/nfs/group.list 2023-08-25T04:49:11.848 INFO:teuthology.orchestra.run.smithi072.stdout:Building f2fs 2023-08-25T04:49:11.858 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/f2fs/group.list 2023-08-25T04:49:11.902 INFO:teuthology.orchestra.run.smithi072.stdout:Building udf 2023-08-25T04:49:11.912 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/udf/group.list 2023-08-25T04:49:11.941 INFO:teuthology.orchestra.run.smithi072.stdout:Building ceph 2023-08-25T04:49:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/ceph/group.list 2023-08-25T04:49:11.988 INFO:teuthology.orchestra.run.smithi072.stdout:Building xfs 2023-08-25T04:49:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/xfs/group.list 2023-08-25T04:49:12.242 INFO:teuthology.orchestra.run.smithi072.stdout:Building btrfs 2023-08-25T04:49:12.254 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/btrfs/group.list 2023-08-25T04:49:12.400 INFO:teuthology.orchestra.run.smithi072.stdout:Building tmpfs 2023-08-25T04:49:12.410 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/tmpfs/group.list 2023-08-25T04:49:12.444 INFO:teuthology.orchestra.run.smithi072.stdout:Building selftest 2023-08-25T04:49:12.454 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.isvk1JLbjhxfstests-dev/tests/selftest/group.list 2023-08-25T04:49:12.485 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-08-25T04:49:12.488 INFO:teuthology.orchestra.run.smithi072.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-25T04:49:12.488 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-08-25T04:49:12.491 INFO:teuthology.orchestra.run.smithi072.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-25T04:49:12.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-08-25T04:49:12.495 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-08-25T04:49:12.518 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-08-25T04:49:12.693 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-08-25T04:49:12.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-08-25T04:49:12.747 INFO:teuthology.orchestra.run.smithi072.stdout:Building log-writes 2023-08-25T04:49:12.754 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2023-08-25T04:49:12.761 INFO:teuthology.orchestra.run.smithi072.stdout:Building aio-dio-regress 2023-08-25T04:49:12.769 INFO:teuthology.orchestra.run.smithi072.stdout:Building vfs 2023-08-25T04:49:12.775 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C log-writes install 2023-08-25T04:49:12.778 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-08-25T04:49:12.801 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-08-25T04:49:12.825 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C perf install 2023-08-25T04:49:12.883 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-08-25T04:49:12.883 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-08-25T04:49:12.911 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-08-25T04:49:12.914 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-08-25T04:49:12.937 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-08-25T04:49:13.079 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C vfs install 2023-08-25T04:49:13.081 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-08-25T04:49:13.104 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-08-25T04:49:13.136 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-08-25T04:49:13.160 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-08-25T04:49:16.158 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-08-25T04:49:16.378 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-08-25T04:49:16.434 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-08-25T04:49:16.437 INFO:teuthology.orchestra.run.smithi072.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-25T04:49:16.437 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-08-25T04:49:16.440 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-08-25T04:49:16.463 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-08-25T04:49:16.819 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-08-25T04:49:16.821 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/btrfs/ install 2023-08-25T04:49:16.825 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-08-25T04:49:16.849 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 299 /var/lib/xfstests/tests/btrfs 2023-08-25T04:49:19.037 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-08-25T04:49:19.061 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 240.out 180.out 069.out 282.out 092.out 015.out 280.out 140.out 056.out 206.out 008.out 004.out 233.out 194.out 234.out 248.out 109.out 033.out 252.out 270.out 148.out 040.out 176.out 296.out 137.out 125.out 078.out 152.out 142.out 264.out 243.out 192.out 075.out 077.out 178.out 284.out 052.out 256.out 207.out 228.out 143.out 028.out 183.out 225.out 290.out 094.out 046.out 273.out 135.out 086.out 089.out 020.out 215.out 115.out 197.out 205.out 250.out 266.out 051.out 219.out 119.out 244.out 128.out 232.out 187.out 024.out 220.out 202.out 102.out 002.out 171.out 261.out 251.out 156.out 292.out 255.out 072.out 068.out 006.out 048.out 062.out 073.out 084.out 129.out 029.out 229.out 103.out 111.out 011.out 155.out 134.out 170.out 260.out 095.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 214.out 276.out 295.out 138.out 154.out 106.out 038.out 145.out 160.out 091.out 081.out 071.out 061.out 085.out 265.out 200.out 100.out 165.out 258.out 286.out 269.out 039.out 196.out 098.out 080.out 070.out 060.out 208.out 009.out 167.out 217.out 120.out 191.out 117.out 017.out 246.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 293.out 065.out 204.out 104.out 041.out 177.out 254.out 279.out 281.out 241.out 235.out 253.out 025.out 124.out 035.out 172.out 278.out 063.out 058.out 262.out 169.out 042.out 153.out 097.out 283.out 199.out 236.out 186.out 209.out 053.out 133.out 164.out 239.out 189.out 037.out 139.out 267.out 141.out 114.out 074.out 036.out 016.out 175.out 193.out 223.out 150.out 132.out 179.out 144.out 032.out 277.out 136.out 005.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 257.out 291.out 185.out 067.out 088.out 285.out 123.out 044.out 201.out 019.out 001.out 287.out 237.out 151.out 231.out 163.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 227.out 010.out 263.out 127.out 230.out 130.out 023.out 099.out 082.out 030.out 203.out 003.out 055.out 166.out 245.out 014.out 222.out 159.out 249.out 122.out 076.out 022.out 289.out 174.out 045.out 299.out 224.out 181.out 271.out 149.out 064.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 049.out 226.out 126.out 026.out 021.out 275.out 090.out 221.out 087.out 294.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 288.out 242.out /var/lib/xfstests/tests/btrfs 2023-08-25T04:49:21.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/ceph/ install 2023-08-25T04:49:21.254 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-08-25T04:49:21.277 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-08-25T04:49:21.330 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-08-25T04:49:21.353 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-08-25T04:49:21.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/cifs/ install 2023-08-25T04:49:21.408 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-08-25T04:49:21.432 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-08-25T04:49:21.455 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-08-25T04:49:21.478 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-08-25T04:49:21.502 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/ext4/ install 2023-08-25T04:49:21.505 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-08-25T04:49:21.528 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-08-25T04:49:22.039 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-08-25T04:49:22.062 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-08-25T04:49:22.599 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/f2fs/ install 2023-08-25T04:49:22.602 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-08-25T04:49:22.625 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-08-25T04:49:22.656 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-08-25T04:49:22.679 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-08-25T04:49:22.711 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/generic/ install 2023-08-25T04:49:22.716 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-08-25T04:49:22.740 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-08-25T04:49:28.094 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-08-25T04:49:28.117 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 310.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 243.out 592.out 282.out 272.out 728.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 120.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 655.out 591.out 064.out 471.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 295.out 390.out 497.out 160.out 691.out 274.out 061.out 239.out 457.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 309.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 012.out 634.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 566.out 433.out 704.out 108.out 504.out 404.out 304.out 104.out 175.out 297.out 393.out 333.out 599.out 476.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 352.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 480.out 436.out 544.out 169.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 376.out 724.out 206.out 663.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 142.out 715.out 279.out 222.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 682.out 472.out 684.out 674.out 550.out 052.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 487.out 688.out 643.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 030.out 244.out 128.out 385.out 005.out 336.out 579.out 236.out 405.out 667.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 505.out 305.out 105.out 263.out 144.out 291.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 548.out 560.out 166.out 707.out 461.out 381.out 445.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 150.out 613.out 326.out 082.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 485.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 173.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 729.out 378.out 004.out 458.out 062.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 280.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 301.out 431.out 635.out 288.out 722.out 331.out 377.out 713.out 535.out 513.out 554.out 622.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 534.out 427.out 210.out 449.out 327.out 330.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 532.out 245.out 522.out 422.out 624.out 322.out 394.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 565.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 167.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 111.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 110.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 095.out 581.out 697.out 145.out 641.out 464.out 491.out 081.out 075.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 259.out 090.out 080.out 708.out 608.out 508.out 409.out 307.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 531.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out 452.out 096.out /var/lib/xfstests/tests/generic 2023-08-25T04:49:32.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:49:32.653 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:49:33.511 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/nfs/ install 2023-08-25T04:49:33.514 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-08-25T04:49:33.537 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-08-25T04:49:33.561 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-08-25T04:49:33.584 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-08-25T04:49:33.608 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/ocfs2/ install 2023-08-25T04:49:33.611 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-08-25T04:49:33.634 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-08-25T04:49:33.657 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-08-25T04:49:33.681 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-08-25T04:49:33.705 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/overlay/ install 2023-08-25T04:49:33.708 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-08-25T04:49:33.731 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-08-25T04:49:34.466 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-08-25T04:49:34.490 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 073.out 078.out 037.out 030.out 058.out 103.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 023.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 007.out 028.out 079.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 080.out 107.out 025.out 056.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 057.out 009.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out 110.out /var/lib/xfstests/tests/overlay 2023-08-25T04:49:35.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/perf/ install 2023-08-25T04:49:35.231 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-08-25T04:49:35.255 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-08-25T04:49:35.278 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-08-25T04:49:35.301 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-08-25T04:49:35.325 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/selftest/ install 2023-08-25T04:49:35.328 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-08-25T04:49:35.351 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-08-25T04:49:35.410 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-08-25T04:49:35.434 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-08-25T04:49:35.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/shared/ install 2023-08-25T04:49:35.496 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-08-25T04:49:35.520 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-08-25T04:49:35.558 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-08-25T04:49:35.581 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-08-25T04:49:35.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/tmpfs/ install 2023-08-25T04:49:35.622 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-08-25T04:49:35.645 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-08-25T04:49:35.668 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-08-25T04:49:35.692 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-08-25T04:49:35.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/udf/ install 2023-08-25T04:49:35.718 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-08-25T04:49:35.742 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-08-25T04:49:35.765 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-08-25T04:49:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-08-25T04:49:35.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.isvk1JLbjhxfstests-dev/tests/xfs/ install 2023-08-25T04:49:35.818 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-08-25T04:49:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-08-25T04:49:40.971 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-08-25T04:49:40.995 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 473.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 264.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 017.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 590.out 363.out 131.out 183.out 547.out 738.out 260.out 034.out 757.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 042.out 497.out 193.out 097.out 392.out 271.out 283.out 541.out 770.out 709.out 755.out 441.out 157.out 740.out 356.out 474.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 788.out 280.out 434.out 140.out 766.out 185.out 408.out 308.out 254.out 335.out 207.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 751.out 433.out 036.out 134.out 393.out 333.out 599.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 481.out 267.out 390.out 399.out 781.out 357.out 169.out 175.out 593.out 565.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 466.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 415.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 583.out 290.out 094.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 395.out 515.out 451.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 475.out 536.out 228.out 518.out 101.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 405.out 305.out 580.out 136.out 598.out 176.out 198.out 723.out 008.out 790.out 505.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 419.out 219.out 527.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 597.out 350.out 132.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 307.out 493.out 786.out 007.out 448.out 251.out 380.out 562.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 748.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 446.out 148.out 129.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 368.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 366.out 085.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 725.out 731.out 782.out 374.out 285.out 127.out 256.out 501.out 301.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 230.out 083.out 299.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 243.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 234.out 022.out 174.out 779.out 490.out 090.out 423.out 154.out 718.out 149.out 318.out 465.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 329.out 196.out 520.out 026.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 759.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 496.out 376.out 714.out 559.out 710.out 410.out 310.out 401.out 010.out 001.out 141.out 495.out 048.out 276.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 464.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 309.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out 383.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 093.out /var/lib/xfstests/tests/xfs 2023-08-25T04:49:46.163 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-08-25T04:49:46.186 INFO:teuthology.orchestra.run.smithi072.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-08-25T04:49:46.209 INFO:teuthology.orchestra.run.smithi072.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-08-25T04:49:46.233 INFO:teuthology.orchestra.run.smithi072.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-08-25T04:49:46.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:49:46.260 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec ls tests/generic) 2023-08-25T04:49:46.309 INFO:teuthology.orchestra.run.smithi072.stdout:001 2023-08-25T04:49:46.309 INFO:teuthology.orchestra.run.smithi072.stdout:001.out 2023-08-25T04:49:46.309 INFO:teuthology.orchestra.run.smithi072.stdout:002 2023-08-25T04:49:46.309 INFO:teuthology.orchestra.run.smithi072.stdout:002.out 2023-08-25T04:49:46.309 INFO:teuthology.orchestra.run.smithi072.stdout:003 2023-08-25T04:49:46.310 INFO:teuthology.orchestra.run.smithi072.stdout:003.out 2023-08-25T04:49:46.310 INFO:teuthology.orchestra.run.smithi072.stdout:004 2023-08-25T04:49:46.310 INFO:teuthology.orchestra.run.smithi072.stdout:004.out 2023-08-25T04:49:46.310 INFO:teuthology.orchestra.run.smithi072.stdout:005 2023-08-25T04:49:46.310 INFO:teuthology.orchestra.run.smithi072.stdout:005.out 2023-08-25T04:49:46.310 INFO:teuthology.orchestra.run.smithi072.stdout:006 2023-08-25T04:49:46.310 INFO:teuthology.orchestra.run.smithi072.stdout:006.out 2023-08-25T04:49:46.311 INFO:teuthology.orchestra.run.smithi072.stdout:007 2023-08-25T04:49:46.311 INFO:teuthology.orchestra.run.smithi072.stdout:007.out 2023-08-25T04:49:46.311 INFO:teuthology.orchestra.run.smithi072.stdout:008 2023-08-25T04:49:46.311 INFO:teuthology.orchestra.run.smithi072.stdout:008.out 2023-08-25T04:49:46.311 INFO:teuthology.orchestra.run.smithi072.stdout:009 2023-08-25T04:49:46.311 INFO:teuthology.orchestra.run.smithi072.stdout:009.out 2023-08-25T04:49:46.311 INFO:teuthology.orchestra.run.smithi072.stdout:010 2023-08-25T04:49:46.311 INFO:teuthology.orchestra.run.smithi072.stdout:010.out 2023-08-25T04:49:46.312 INFO:teuthology.orchestra.run.smithi072.stdout:011 2023-08-25T04:49:46.312 INFO:teuthology.orchestra.run.smithi072.stdout:011.out 2023-08-25T04:49:46.312 INFO:teuthology.orchestra.run.smithi072.stdout:012 2023-08-25T04:49:46.312 INFO:teuthology.orchestra.run.smithi072.stdout:012.out 2023-08-25T04:49:46.312 INFO:teuthology.orchestra.run.smithi072.stdout:013 2023-08-25T04:49:46.312 INFO:teuthology.orchestra.run.smithi072.stdout:013.out 2023-08-25T04:49:46.313 INFO:teuthology.orchestra.run.smithi072.stdout:014 2023-08-25T04:49:46.313 INFO:teuthology.orchestra.run.smithi072.stdout:014.out 2023-08-25T04:49:46.313 INFO:teuthology.orchestra.run.smithi072.stdout:015 2023-08-25T04:49:46.313 INFO:teuthology.orchestra.run.smithi072.stdout:015.out 2023-08-25T04:49:46.313 INFO:teuthology.orchestra.run.smithi072.stdout:016 2023-08-25T04:49:46.313 INFO:teuthology.orchestra.run.smithi072.stdout:016.out 2023-08-25T04:49:46.313 INFO:teuthology.orchestra.run.smithi072.stdout:017 2023-08-25T04:49:46.313 INFO:teuthology.orchestra.run.smithi072.stdout:017.out 2023-08-25T04:49:46.314 INFO:teuthology.orchestra.run.smithi072.stdout:018 2023-08-25T04:49:46.314 INFO:teuthology.orchestra.run.smithi072.stdout:018.out 2023-08-25T04:49:46.314 INFO:teuthology.orchestra.run.smithi072.stdout:019 2023-08-25T04:49:46.314 INFO:teuthology.orchestra.run.smithi072.stdout:019.out 2023-08-25T04:49:46.314 INFO:teuthology.orchestra.run.smithi072.stdout:020 2023-08-25T04:49:46.314 INFO:teuthology.orchestra.run.smithi072.stdout:020.out 2023-08-25T04:49:46.314 INFO:teuthology.orchestra.run.smithi072.stdout:021 2023-08-25T04:49:46.314 INFO:teuthology.orchestra.run.smithi072.stdout:021.out 2023-08-25T04:49:46.315 INFO:teuthology.orchestra.run.smithi072.stdout:022 2023-08-25T04:49:46.315 INFO:teuthology.orchestra.run.smithi072.stdout:022.out 2023-08-25T04:49:46.315 INFO:teuthology.orchestra.run.smithi072.stdout:023 2023-08-25T04:49:46.315 INFO:teuthology.orchestra.run.smithi072.stdout:023.out 2023-08-25T04:49:46.315 INFO:teuthology.orchestra.run.smithi072.stdout:024 2023-08-25T04:49:46.315 INFO:teuthology.orchestra.run.smithi072.stdout:024.out 2023-08-25T04:49:46.315 INFO:teuthology.orchestra.run.smithi072.stdout:025 2023-08-25T04:49:46.316 INFO:teuthology.orchestra.run.smithi072.stdout:025.out 2023-08-25T04:49:46.316 INFO:teuthology.orchestra.run.smithi072.stdout:026 2023-08-25T04:49:46.316 INFO:teuthology.orchestra.run.smithi072.stdout:026.out 2023-08-25T04:49:46.316 INFO:teuthology.orchestra.run.smithi072.stdout:027 2023-08-25T04:49:46.316 INFO:teuthology.orchestra.run.smithi072.stdout:027.out 2023-08-25T04:49:46.316 INFO:teuthology.orchestra.run.smithi072.stdout:028 2023-08-25T04:49:46.316 INFO:teuthology.orchestra.run.smithi072.stdout:028.out 2023-08-25T04:49:46.317 INFO:teuthology.orchestra.run.smithi072.stdout:029 2023-08-25T04:49:46.317 INFO:teuthology.orchestra.run.smithi072.stdout:029.out 2023-08-25T04:49:46.317 INFO:teuthology.orchestra.run.smithi072.stdout:030 2023-08-25T04:49:46.317 INFO:teuthology.orchestra.run.smithi072.stdout:030.out 2023-08-25T04:49:46.317 INFO:teuthology.orchestra.run.smithi072.stdout:031 2023-08-25T04:49:46.317 INFO:teuthology.orchestra.run.smithi072.stdout:031.out 2023-08-25T04:49:46.317 INFO:teuthology.orchestra.run.smithi072.stdout:032 2023-08-25T04:49:46.317 INFO:teuthology.orchestra.run.smithi072.stdout:032.out 2023-08-25T04:49:46.318 INFO:teuthology.orchestra.run.smithi072.stdout:033 2023-08-25T04:49:46.318 INFO:teuthology.orchestra.run.smithi072.stdout:033.out 2023-08-25T04:49:46.318 INFO:teuthology.orchestra.run.smithi072.stdout:034 2023-08-25T04:49:46.318 INFO:teuthology.orchestra.run.smithi072.stdout:034.out 2023-08-25T04:49:46.318 INFO:teuthology.orchestra.run.smithi072.stdout:035 2023-08-25T04:49:46.318 INFO:teuthology.orchestra.run.smithi072.stdout:035.cfg 2023-08-25T04:49:46.318 INFO:teuthology.orchestra.run.smithi072.stdout:035.out.default 2023-08-25T04:49:46.318 INFO:teuthology.orchestra.run.smithi072.stdout:035.out.nfs 2023-08-25T04:49:46.319 INFO:teuthology.orchestra.run.smithi072.stdout:036 2023-08-25T04:49:46.319 INFO:teuthology.orchestra.run.smithi072.stdout:036.out 2023-08-25T04:49:46.319 INFO:teuthology.orchestra.run.smithi072.stdout:037 2023-08-25T04:49:46.319 INFO:teuthology.orchestra.run.smithi072.stdout:037.out 2023-08-25T04:49:46.319 INFO:teuthology.orchestra.run.smithi072.stdout:038 2023-08-25T04:49:46.319 INFO:teuthology.orchestra.run.smithi072.stdout:038.out 2023-08-25T04:49:46.319 INFO:teuthology.orchestra.run.smithi072.stdout:039 2023-08-25T04:49:46.319 INFO:teuthology.orchestra.run.smithi072.stdout:039.out 2023-08-25T04:49:46.320 INFO:teuthology.orchestra.run.smithi072.stdout:040 2023-08-25T04:49:46.320 INFO:teuthology.orchestra.run.smithi072.stdout:040.out 2023-08-25T04:49:46.320 INFO:teuthology.orchestra.run.smithi072.stdout:041 2023-08-25T04:49:46.320 INFO:teuthology.orchestra.run.smithi072.stdout:041.out 2023-08-25T04:49:46.320 INFO:teuthology.orchestra.run.smithi072.stdout:042 2023-08-25T04:49:46.320 INFO:teuthology.orchestra.run.smithi072.stdout:042.out 2023-08-25T04:49:46.320 INFO:teuthology.orchestra.run.smithi072.stdout:043 2023-08-25T04:49:46.321 INFO:teuthology.orchestra.run.smithi072.stdout:043.out 2023-08-25T04:49:46.321 INFO:teuthology.orchestra.run.smithi072.stdout:044 2023-08-25T04:49:46.321 INFO:teuthology.orchestra.run.smithi072.stdout:044.out 2023-08-25T04:49:46.321 INFO:teuthology.orchestra.run.smithi072.stdout:045 2023-08-25T04:49:46.321 INFO:teuthology.orchestra.run.smithi072.stdout:045.out 2023-08-25T04:49:46.321 INFO:teuthology.orchestra.run.smithi072.stdout:046 2023-08-25T04:49:46.321 INFO:teuthology.orchestra.run.smithi072.stdout:046.out 2023-08-25T04:49:46.321 INFO:teuthology.orchestra.run.smithi072.stdout:047 2023-08-25T04:49:46.322 INFO:teuthology.orchestra.run.smithi072.stdout:047.out 2023-08-25T04:49:46.322 INFO:teuthology.orchestra.run.smithi072.stdout:048 2023-08-25T04:49:46.322 INFO:teuthology.orchestra.run.smithi072.stdout:048.out 2023-08-25T04:49:46.322 INFO:teuthology.orchestra.run.smithi072.stdout:049 2023-08-25T04:49:46.322 INFO:teuthology.orchestra.run.smithi072.stdout:049.out 2023-08-25T04:49:46.322 INFO:teuthology.orchestra.run.smithi072.stdout:050 2023-08-25T04:49:46.322 INFO:teuthology.orchestra.run.smithi072.stdout:050.cfg 2023-08-25T04:49:46.323 INFO:teuthology.orchestra.run.smithi072.stdout:050.out.default 2023-08-25T04:49:46.323 INFO:teuthology.orchestra.run.smithi072.stdout:050.out.nojournal 2023-08-25T04:49:46.323 INFO:teuthology.orchestra.run.smithi072.stdout:050.out.xfsquota 2023-08-25T04:49:46.323 INFO:teuthology.orchestra.run.smithi072.stdout:051 2023-08-25T04:49:46.323 INFO:teuthology.orchestra.run.smithi072.stdout:051.out 2023-08-25T04:49:46.323 INFO:teuthology.orchestra.run.smithi072.stdout:052 2023-08-25T04:49:46.323 INFO:teuthology.orchestra.run.smithi072.stdout:052.out 2023-08-25T04:49:46.324 INFO:teuthology.orchestra.run.smithi072.stdout:053 2023-08-25T04:49:46.324 INFO:teuthology.orchestra.run.smithi072.stdout:053.out 2023-08-25T04:49:46.324 INFO:teuthology.orchestra.run.smithi072.stdout:054 2023-08-25T04:49:46.324 INFO:teuthology.orchestra.run.smithi072.stdout:054.out 2023-08-25T04:49:46.324 INFO:teuthology.orchestra.run.smithi072.stdout:055 2023-08-25T04:49:46.324 INFO:teuthology.orchestra.run.smithi072.stdout:055.out 2023-08-25T04:49:46.324 INFO:teuthology.orchestra.run.smithi072.stdout:056 2023-08-25T04:49:46.324 INFO:teuthology.orchestra.run.smithi072.stdout:056.out 2023-08-25T04:49:46.325 INFO:teuthology.orchestra.run.smithi072.stdout:057 2023-08-25T04:49:46.325 INFO:teuthology.orchestra.run.smithi072.stdout:057.out 2023-08-25T04:49:46.325 INFO:teuthology.orchestra.run.smithi072.stdout:058 2023-08-25T04:49:46.325 INFO:teuthology.orchestra.run.smithi072.stdout:058.out 2023-08-25T04:49:46.325 INFO:teuthology.orchestra.run.smithi072.stdout:059 2023-08-25T04:49:46.325 INFO:teuthology.orchestra.run.smithi072.stdout:059.out 2023-08-25T04:49:46.325 INFO:teuthology.orchestra.run.smithi072.stdout:060 2023-08-25T04:49:46.325 INFO:teuthology.orchestra.run.smithi072.stdout:060.out 2023-08-25T04:49:46.326 INFO:teuthology.orchestra.run.smithi072.stdout:061 2023-08-25T04:49:46.326 INFO:teuthology.orchestra.run.smithi072.stdout:061.out 2023-08-25T04:49:46.326 INFO:teuthology.orchestra.run.smithi072.stdout:062 2023-08-25T04:49:46.326 INFO:teuthology.orchestra.run.smithi072.stdout:062.out 2023-08-25T04:49:46.326 INFO:teuthology.orchestra.run.smithi072.stdout:063 2023-08-25T04:49:46.326 INFO:teuthology.orchestra.run.smithi072.stdout:063.out 2023-08-25T04:49:46.326 INFO:teuthology.orchestra.run.smithi072.stdout:064 2023-08-25T04:49:46.327 INFO:teuthology.orchestra.run.smithi072.stdout:064.out 2023-08-25T04:49:46.327 INFO:teuthology.orchestra.run.smithi072.stdout:065 2023-08-25T04:49:46.327 INFO:teuthology.orchestra.run.smithi072.stdout:065.out 2023-08-25T04:49:46.327 INFO:teuthology.orchestra.run.smithi072.stdout:066 2023-08-25T04:49:46.327 INFO:teuthology.orchestra.run.smithi072.stdout:066.out 2023-08-25T04:49:46.327 INFO:teuthology.orchestra.run.smithi072.stdout:067 2023-08-25T04:49:46.327 INFO:teuthology.orchestra.run.smithi072.stdout:067.out 2023-08-25T04:49:46.327 INFO:teuthology.orchestra.run.smithi072.stdout:068 2023-08-25T04:49:46.328 INFO:teuthology.orchestra.run.smithi072.stdout:068.out 2023-08-25T04:49:46.328 INFO:teuthology.orchestra.run.smithi072.stdout:069 2023-08-25T04:49:46.328 INFO:teuthology.orchestra.run.smithi072.stdout:069.out 2023-08-25T04:49:46.328 INFO:teuthology.orchestra.run.smithi072.stdout:070 2023-08-25T04:49:46.328 INFO:teuthology.orchestra.run.smithi072.stdout:070.out 2023-08-25T04:49:46.328 INFO:teuthology.orchestra.run.smithi072.stdout:071 2023-08-25T04:49:46.328 INFO:teuthology.orchestra.run.smithi072.stdout:071.out 2023-08-25T04:49:46.328 INFO:teuthology.orchestra.run.smithi072.stdout:072 2023-08-25T04:49:46.329 INFO:teuthology.orchestra.run.smithi072.stdout:072.out 2023-08-25T04:49:46.329 INFO:teuthology.orchestra.run.smithi072.stdout:073 2023-08-25T04:49:46.329 INFO:teuthology.orchestra.run.smithi072.stdout:073.out 2023-08-25T04:49:46.329 INFO:teuthology.orchestra.run.smithi072.stdout:074 2023-08-25T04:49:46.329 INFO:teuthology.orchestra.run.smithi072.stdout:074.out 2023-08-25T04:49:46.329 INFO:teuthology.orchestra.run.smithi072.stdout:075 2023-08-25T04:49:46.329 INFO:teuthology.orchestra.run.smithi072.stdout:075.out 2023-08-25T04:49:46.329 INFO:teuthology.orchestra.run.smithi072.stdout:076 2023-08-25T04:49:46.330 INFO:teuthology.orchestra.run.smithi072.stdout:076.out 2023-08-25T04:49:46.330 INFO:teuthology.orchestra.run.smithi072.stdout:077 2023-08-25T04:49:46.330 INFO:teuthology.orchestra.run.smithi072.stdout:077.out 2023-08-25T04:49:46.330 INFO:teuthology.orchestra.run.smithi072.stdout:078 2023-08-25T04:49:46.330 INFO:teuthology.orchestra.run.smithi072.stdout:078.out 2023-08-25T04:49:46.330 INFO:teuthology.orchestra.run.smithi072.stdout:079 2023-08-25T04:49:46.330 INFO:teuthology.orchestra.run.smithi072.stdout:079.out 2023-08-25T04:49:46.331 INFO:teuthology.orchestra.run.smithi072.stdout:080 2023-08-25T04:49:46.331 INFO:teuthology.orchestra.run.smithi072.stdout:080.out 2023-08-25T04:49:46.331 INFO:teuthology.orchestra.run.smithi072.stdout:081 2023-08-25T04:49:46.331 INFO:teuthology.orchestra.run.smithi072.stdout:081.out 2023-08-25T04:49:46.331 INFO:teuthology.orchestra.run.smithi072.stdout:082 2023-08-25T04:49:46.331 INFO:teuthology.orchestra.run.smithi072.stdout:082.out 2023-08-25T04:49:46.331 INFO:teuthology.orchestra.run.smithi072.stdout:083 2023-08-25T04:49:46.331 INFO:teuthology.orchestra.run.smithi072.stdout:083.out 2023-08-25T04:49:46.332 INFO:teuthology.orchestra.run.smithi072.stdout:084 2023-08-25T04:49:46.332 INFO:teuthology.orchestra.run.smithi072.stdout:084.out 2023-08-25T04:49:46.332 INFO:teuthology.orchestra.run.smithi072.stdout:085 2023-08-25T04:49:46.332 INFO:teuthology.orchestra.run.smithi072.stdout:085.out 2023-08-25T04:49:46.332 INFO:teuthology.orchestra.run.smithi072.stdout:086 2023-08-25T04:49:46.332 INFO:teuthology.orchestra.run.smithi072.stdout:086.out 2023-08-25T04:49:46.332 INFO:teuthology.orchestra.run.smithi072.stdout:087 2023-08-25T04:49:46.332 INFO:teuthology.orchestra.run.smithi072.stdout:087.out 2023-08-25T04:49:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:088 2023-08-25T04:49:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:088.out 2023-08-25T04:49:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:089 2023-08-25T04:49:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:089.out 2023-08-25T04:49:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:090 2023-08-25T04:49:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:090.out 2023-08-25T04:49:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:091 2023-08-25T04:49:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:091.out 2023-08-25T04:49:46.334 INFO:teuthology.orchestra.run.smithi072.stdout:092 2023-08-25T04:49:46.334 INFO:teuthology.orchestra.run.smithi072.stdout:092.out 2023-08-25T04:49:46.334 INFO:teuthology.orchestra.run.smithi072.stdout:093 2023-08-25T04:49:46.334 INFO:teuthology.orchestra.run.smithi072.stdout:093.out 2023-08-25T04:49:46.334 INFO:teuthology.orchestra.run.smithi072.stdout:094 2023-08-25T04:49:46.334 INFO:teuthology.orchestra.run.smithi072.stdout:094.out 2023-08-25T04:49:46.334 INFO:teuthology.orchestra.run.smithi072.stdout:095 2023-08-25T04:49:46.334 INFO:teuthology.orchestra.run.smithi072.stdout:095.out 2023-08-25T04:49:46.335 INFO:teuthology.orchestra.run.smithi072.stdout:096 2023-08-25T04:49:46.335 INFO:teuthology.orchestra.run.smithi072.stdout:096.out 2023-08-25T04:49:46.335 INFO:teuthology.orchestra.run.smithi072.stdout:097 2023-08-25T04:49:46.335 INFO:teuthology.orchestra.run.smithi072.stdout:097.out 2023-08-25T04:49:46.335 INFO:teuthology.orchestra.run.smithi072.stdout:098 2023-08-25T04:49:46.335 INFO:teuthology.orchestra.run.smithi072.stdout:098.out 2023-08-25T04:49:46.335 INFO:teuthology.orchestra.run.smithi072.stdout:099 2023-08-25T04:49:46.335 INFO:teuthology.orchestra.run.smithi072.stdout:099.out 2023-08-25T04:49:46.336 INFO:teuthology.orchestra.run.smithi072.stdout:100 2023-08-25T04:49:46.336 INFO:teuthology.orchestra.run.smithi072.stdout:100.out 2023-08-25T04:49:46.336 INFO:teuthology.orchestra.run.smithi072.stdout:101 2023-08-25T04:49:46.336 INFO:teuthology.orchestra.run.smithi072.stdout:101.out 2023-08-25T04:49:46.336 INFO:teuthology.orchestra.run.smithi072.stdout:102 2023-08-25T04:49:46.336 INFO:teuthology.orchestra.run.smithi072.stdout:102.out 2023-08-25T04:49:46.336 INFO:teuthology.orchestra.run.smithi072.stdout:103 2023-08-25T04:49:46.336 INFO:teuthology.orchestra.run.smithi072.stdout:103.out 2023-08-25T04:49:46.337 INFO:teuthology.orchestra.run.smithi072.stdout:104 2023-08-25T04:49:46.337 INFO:teuthology.orchestra.run.smithi072.stdout:104.out 2023-08-25T04:49:46.337 INFO:teuthology.orchestra.run.smithi072.stdout:105 2023-08-25T04:49:46.337 INFO:teuthology.orchestra.run.smithi072.stdout:105.out 2023-08-25T04:49:46.337 INFO:teuthology.orchestra.run.smithi072.stdout:106 2023-08-25T04:49:46.337 INFO:teuthology.orchestra.run.smithi072.stdout:106.out 2023-08-25T04:49:46.337 INFO:teuthology.orchestra.run.smithi072.stdout:107 2023-08-25T04:49:46.338 INFO:teuthology.orchestra.run.smithi072.stdout:107.out 2023-08-25T04:49:46.338 INFO:teuthology.orchestra.run.smithi072.stdout:108 2023-08-25T04:49:46.338 INFO:teuthology.orchestra.run.smithi072.stdout:108.out 2023-08-25T04:49:46.338 INFO:teuthology.orchestra.run.smithi072.stdout:109 2023-08-25T04:49:46.338 INFO:teuthology.orchestra.run.smithi072.stdout:109.out 2023-08-25T04:49:46.338 INFO:teuthology.orchestra.run.smithi072.stdout:110 2023-08-25T04:49:46.338 INFO:teuthology.orchestra.run.smithi072.stdout:110.out 2023-08-25T04:49:46.339 INFO:teuthology.orchestra.run.smithi072.stdout:111 2023-08-25T04:49:46.339 INFO:teuthology.orchestra.run.smithi072.stdout:111.out 2023-08-25T04:49:46.339 INFO:teuthology.orchestra.run.smithi072.stdout:112 2023-08-25T04:49:46.339 INFO:teuthology.orchestra.run.smithi072.stdout:112.out 2023-08-25T04:49:46.339 INFO:teuthology.orchestra.run.smithi072.stdout:113 2023-08-25T04:49:46.339 INFO:teuthology.orchestra.run.smithi072.stdout:113.out 2023-08-25T04:49:46.340 INFO:teuthology.orchestra.run.smithi072.stdout:114 2023-08-25T04:49:46.340 INFO:teuthology.orchestra.run.smithi072.stdout:114.out 2023-08-25T04:49:46.340 INFO:teuthology.orchestra.run.smithi072.stdout:115 2023-08-25T04:49:46.340 INFO:teuthology.orchestra.run.smithi072.stdout:115.out 2023-08-25T04:49:46.340 INFO:teuthology.orchestra.run.smithi072.stdout:116 2023-08-25T04:49:46.340 INFO:teuthology.orchestra.run.smithi072.stdout:116.out 2023-08-25T04:49:46.340 INFO:teuthology.orchestra.run.smithi072.stdout:117 2023-08-25T04:49:46.341 INFO:teuthology.orchestra.run.smithi072.stdout:117.out 2023-08-25T04:49:46.341 INFO:teuthology.orchestra.run.smithi072.stdout:118 2023-08-25T04:49:46.341 INFO:teuthology.orchestra.run.smithi072.stdout:118.out 2023-08-25T04:49:46.341 INFO:teuthology.orchestra.run.smithi072.stdout:119 2023-08-25T04:49:46.341 INFO:teuthology.orchestra.run.smithi072.stdout:119.out 2023-08-25T04:49:46.341 INFO:teuthology.orchestra.run.smithi072.stdout:120 2023-08-25T04:49:46.341 INFO:teuthology.orchestra.run.smithi072.stdout:120.out 2023-08-25T04:49:46.342 INFO:teuthology.orchestra.run.smithi072.stdout:121 2023-08-25T04:49:46.342 INFO:teuthology.orchestra.run.smithi072.stdout:121.out 2023-08-25T04:49:46.342 INFO:teuthology.orchestra.run.smithi072.stdout:122 2023-08-25T04:49:46.342 INFO:teuthology.orchestra.run.smithi072.stdout:122.out 2023-08-25T04:49:46.342 INFO:teuthology.orchestra.run.smithi072.stdout:123 2023-08-25T04:49:46.343 INFO:teuthology.orchestra.run.smithi072.stdout:123.out 2023-08-25T04:49:46.343 INFO:teuthology.orchestra.run.smithi072.stdout:124 2023-08-25T04:49:46.343 INFO:teuthology.orchestra.run.smithi072.stdout:124.out 2023-08-25T04:49:46.343 INFO:teuthology.orchestra.run.smithi072.stdout:125 2023-08-25T04:49:46.343 INFO:teuthology.orchestra.run.smithi072.stdout:125.out 2023-08-25T04:49:46.343 INFO:teuthology.orchestra.run.smithi072.stdout:126 2023-08-25T04:49:46.343 INFO:teuthology.orchestra.run.smithi072.stdout:126.out 2023-08-25T04:49:46.343 INFO:teuthology.orchestra.run.smithi072.stdout:127 2023-08-25T04:49:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:127.out 2023-08-25T04:49:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:128 2023-08-25T04:49:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:128.out 2023-08-25T04:49:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:129 2023-08-25T04:49:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:129.out 2023-08-25T04:49:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:130 2023-08-25T04:49:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:130.out 2023-08-25T04:49:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:131 2023-08-25T04:49:46.345 INFO:teuthology.orchestra.run.smithi072.stdout:131.out 2023-08-25T04:49:46.345 INFO:teuthology.orchestra.run.smithi072.stdout:132 2023-08-25T04:49:46.345 INFO:teuthology.orchestra.run.smithi072.stdout:132.out 2023-08-25T04:49:46.345 INFO:teuthology.orchestra.run.smithi072.stdout:133 2023-08-25T04:49:46.345 INFO:teuthology.orchestra.run.smithi072.stdout:133.out 2023-08-25T04:49:46.346 INFO:teuthology.orchestra.run.smithi072.stdout:134 2023-08-25T04:49:46.346 INFO:teuthology.orchestra.run.smithi072.stdout:134.out 2023-08-25T04:49:46.346 INFO:teuthology.orchestra.run.smithi072.stdout:135 2023-08-25T04:49:46.346 INFO:teuthology.orchestra.run.smithi072.stdout:135.out 2023-08-25T04:49:46.346 INFO:teuthology.orchestra.run.smithi072.stdout:136 2023-08-25T04:49:46.346 INFO:teuthology.orchestra.run.smithi072.stdout:136.out 2023-08-25T04:49:46.347 INFO:teuthology.orchestra.run.smithi072.stdout:137 2023-08-25T04:49:46.347 INFO:teuthology.orchestra.run.smithi072.stdout:137.out 2023-08-25T04:49:46.347 INFO:teuthology.orchestra.run.smithi072.stdout:138 2023-08-25T04:49:46.347 INFO:teuthology.orchestra.run.smithi072.stdout:138.out 2023-08-25T04:49:46.347 INFO:teuthology.orchestra.run.smithi072.stdout:139 2023-08-25T04:49:46.347 INFO:teuthology.orchestra.run.smithi072.stdout:139.out 2023-08-25T04:49:46.347 INFO:teuthology.orchestra.run.smithi072.stdout:140 2023-08-25T04:49:46.347 INFO:teuthology.orchestra.run.smithi072.stdout:140.out 2023-08-25T04:49:46.348 INFO:teuthology.orchestra.run.smithi072.stdout:141 2023-08-25T04:49:46.348 INFO:teuthology.orchestra.run.smithi072.stdout:141.out 2023-08-25T04:49:46.348 INFO:teuthology.orchestra.run.smithi072.stdout:142 2023-08-25T04:49:46.348 INFO:teuthology.orchestra.run.smithi072.stdout:142.out 2023-08-25T04:49:46.348 INFO:teuthology.orchestra.run.smithi072.stdout:143 2023-08-25T04:49:46.348 INFO:teuthology.orchestra.run.smithi072.stdout:143.out 2023-08-25T04:49:46.348 INFO:teuthology.orchestra.run.smithi072.stdout:144 2023-08-25T04:49:46.348 INFO:teuthology.orchestra.run.smithi072.stdout:144.out 2023-08-25T04:49:46.349 INFO:teuthology.orchestra.run.smithi072.stdout:145 2023-08-25T04:49:46.349 INFO:teuthology.orchestra.run.smithi072.stdout:145.out 2023-08-25T04:49:46.349 INFO:teuthology.orchestra.run.smithi072.stdout:146 2023-08-25T04:49:46.349 INFO:teuthology.orchestra.run.smithi072.stdout:146.out 2023-08-25T04:49:46.349 INFO:teuthology.orchestra.run.smithi072.stdout:147 2023-08-25T04:49:46.349 INFO:teuthology.orchestra.run.smithi072.stdout:147.out 2023-08-25T04:49:46.349 INFO:teuthology.orchestra.run.smithi072.stdout:148 2023-08-25T04:49:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:148.out 2023-08-25T04:49:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:149 2023-08-25T04:49:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:149.out 2023-08-25T04:49:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:150 2023-08-25T04:49:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:150.out 2023-08-25T04:49:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:151 2023-08-25T04:49:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:151.out 2023-08-25T04:49:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:152 2023-08-25T04:49:46.351 INFO:teuthology.orchestra.run.smithi072.stdout:152.out 2023-08-25T04:49:46.351 INFO:teuthology.orchestra.run.smithi072.stdout:153 2023-08-25T04:49:46.351 INFO:teuthology.orchestra.run.smithi072.stdout:153.out 2023-08-25T04:49:46.351 INFO:teuthology.orchestra.run.smithi072.stdout:154 2023-08-25T04:49:46.351 INFO:teuthology.orchestra.run.smithi072.stdout:154.out 2023-08-25T04:49:46.351 INFO:teuthology.orchestra.run.smithi072.stdout:155 2023-08-25T04:49:46.351 INFO:teuthology.orchestra.run.smithi072.stdout:155.out 2023-08-25T04:49:46.351 INFO:teuthology.orchestra.run.smithi072.stdout:156 2023-08-25T04:49:46.352 INFO:teuthology.orchestra.run.smithi072.stdout:156.out 2023-08-25T04:49:46.352 INFO:teuthology.orchestra.run.smithi072.stdout:157 2023-08-25T04:49:46.352 INFO:teuthology.orchestra.run.smithi072.stdout:157.out 2023-08-25T04:49:46.352 INFO:teuthology.orchestra.run.smithi072.stdout:158 2023-08-25T04:49:46.352 INFO:teuthology.orchestra.run.smithi072.stdout:158.out 2023-08-25T04:49:46.352 INFO:teuthology.orchestra.run.smithi072.stdout:159 2023-08-25T04:49:46.352 INFO:teuthology.orchestra.run.smithi072.stdout:159.out 2023-08-25T04:49:46.352 INFO:teuthology.orchestra.run.smithi072.stdout:160 2023-08-25T04:49:46.353 INFO:teuthology.orchestra.run.smithi072.stdout:160.out 2023-08-25T04:49:46.353 INFO:teuthology.orchestra.run.smithi072.stdout:161 2023-08-25T04:49:46.353 INFO:teuthology.orchestra.run.smithi072.stdout:161.out 2023-08-25T04:49:46.353 INFO:teuthology.orchestra.run.smithi072.stdout:162 2023-08-25T04:49:46.353 INFO:teuthology.orchestra.run.smithi072.stdout:162.out 2023-08-25T04:49:46.353 INFO:teuthology.orchestra.run.smithi072.stdout:163 2023-08-25T04:49:46.353 INFO:teuthology.orchestra.run.smithi072.stdout:163.out 2023-08-25T04:49:46.354 INFO:teuthology.orchestra.run.smithi072.stdout:164 2023-08-25T04:49:46.354 INFO:teuthology.orchestra.run.smithi072.stdout:164.out 2023-08-25T04:49:46.354 INFO:teuthology.orchestra.run.smithi072.stdout:165 2023-08-25T04:49:46.354 INFO:teuthology.orchestra.run.smithi072.stdout:165.out 2023-08-25T04:49:46.354 INFO:teuthology.orchestra.run.smithi072.stdout:166 2023-08-25T04:49:46.354 INFO:teuthology.orchestra.run.smithi072.stdout:166.out 2023-08-25T04:49:46.354 INFO:teuthology.orchestra.run.smithi072.stdout:167 2023-08-25T04:49:46.354 INFO:teuthology.orchestra.run.smithi072.stdout:167.out 2023-08-25T04:49:46.355 INFO:teuthology.orchestra.run.smithi072.stdout:168 2023-08-25T04:49:46.355 INFO:teuthology.orchestra.run.smithi072.stdout:168.out 2023-08-25T04:49:46.355 INFO:teuthology.orchestra.run.smithi072.stdout:169 2023-08-25T04:49:46.355 INFO:teuthology.orchestra.run.smithi072.stdout:169.out 2023-08-25T04:49:46.355 INFO:teuthology.orchestra.run.smithi072.stdout:170 2023-08-25T04:49:46.355 INFO:teuthology.orchestra.run.smithi072.stdout:170.out 2023-08-25T04:49:46.355 INFO:teuthology.orchestra.run.smithi072.stdout:171 2023-08-25T04:49:46.355 INFO:teuthology.orchestra.run.smithi072.stdout:171.out 2023-08-25T04:49:46.356 INFO:teuthology.orchestra.run.smithi072.stdout:172 2023-08-25T04:49:46.356 INFO:teuthology.orchestra.run.smithi072.stdout:172.out 2023-08-25T04:49:46.356 INFO:teuthology.orchestra.run.smithi072.stdout:173 2023-08-25T04:49:46.356 INFO:teuthology.orchestra.run.smithi072.stdout:173.out 2023-08-25T04:49:46.356 INFO:teuthology.orchestra.run.smithi072.stdout:174 2023-08-25T04:49:46.356 INFO:teuthology.orchestra.run.smithi072.stdout:174.out 2023-08-25T04:49:46.356 INFO:teuthology.orchestra.run.smithi072.stdout:175 2023-08-25T04:49:46.357 INFO:teuthology.orchestra.run.smithi072.stdout:175.out 2023-08-25T04:49:46.357 INFO:teuthology.orchestra.run.smithi072.stdout:176 2023-08-25T04:49:46.357 INFO:teuthology.orchestra.run.smithi072.stdout:176.out 2023-08-25T04:49:46.357 INFO:teuthology.orchestra.run.smithi072.stdout:177 2023-08-25T04:49:46.357 INFO:teuthology.orchestra.run.smithi072.stdout:177.out 2023-08-25T04:49:46.357 INFO:teuthology.orchestra.run.smithi072.stdout:178 2023-08-25T04:49:46.357 INFO:teuthology.orchestra.run.smithi072.stdout:178.out 2023-08-25T04:49:46.357 INFO:teuthology.orchestra.run.smithi072.stdout:179 2023-08-25T04:49:46.358 INFO:teuthology.orchestra.run.smithi072.stdout:179.out 2023-08-25T04:49:46.358 INFO:teuthology.orchestra.run.smithi072.stdout:180 2023-08-25T04:49:46.358 INFO:teuthology.orchestra.run.smithi072.stdout:180.out 2023-08-25T04:49:46.358 INFO:teuthology.orchestra.run.smithi072.stdout:181 2023-08-25T04:49:46.358 INFO:teuthology.orchestra.run.smithi072.stdout:181.out 2023-08-25T04:49:46.358 INFO:teuthology.orchestra.run.smithi072.stdout:182 2023-08-25T04:49:46.358 INFO:teuthology.orchestra.run.smithi072.stdout:182.out 2023-08-25T04:49:46.358 INFO:teuthology.orchestra.run.smithi072.stdout:183 2023-08-25T04:49:46.359 INFO:teuthology.orchestra.run.smithi072.stdout:183.out 2023-08-25T04:49:46.359 INFO:teuthology.orchestra.run.smithi072.stdout:184 2023-08-25T04:49:46.359 INFO:teuthology.orchestra.run.smithi072.stdout:184.out 2023-08-25T04:49:46.359 INFO:teuthology.orchestra.run.smithi072.stdout:185 2023-08-25T04:49:46.359 INFO:teuthology.orchestra.run.smithi072.stdout:185.out 2023-08-25T04:49:46.359 INFO:teuthology.orchestra.run.smithi072.stdout:186 2023-08-25T04:49:46.359 INFO:teuthology.orchestra.run.smithi072.stdout:186.out 2023-08-25T04:49:46.359 INFO:teuthology.orchestra.run.smithi072.stdout:187 2023-08-25T04:49:46.360 INFO:teuthology.orchestra.run.smithi072.stdout:187.out 2023-08-25T04:49:46.360 INFO:teuthology.orchestra.run.smithi072.stdout:188 2023-08-25T04:49:46.360 INFO:teuthology.orchestra.run.smithi072.stdout:188.out 2023-08-25T04:49:46.360 INFO:teuthology.orchestra.run.smithi072.stdout:189 2023-08-25T04:49:46.360 INFO:teuthology.orchestra.run.smithi072.stdout:189.out 2023-08-25T04:49:46.360 INFO:teuthology.orchestra.run.smithi072.stdout:190 2023-08-25T04:49:46.360 INFO:teuthology.orchestra.run.smithi072.stdout:190.out 2023-08-25T04:49:46.360 INFO:teuthology.orchestra.run.smithi072.stdout:191 2023-08-25T04:49:46.361 INFO:teuthology.orchestra.run.smithi072.stdout:191.out 2023-08-25T04:49:46.361 INFO:teuthology.orchestra.run.smithi072.stdout:192 2023-08-25T04:49:46.361 INFO:teuthology.orchestra.run.smithi072.stdout:192.out 2023-08-25T04:49:46.361 INFO:teuthology.orchestra.run.smithi072.stdout:193 2023-08-25T04:49:46.361 INFO:teuthology.orchestra.run.smithi072.stdout:193.out 2023-08-25T04:49:46.361 INFO:teuthology.orchestra.run.smithi072.stdout:194 2023-08-25T04:49:46.361 INFO:teuthology.orchestra.run.smithi072.stdout:194.out 2023-08-25T04:49:46.361 INFO:teuthology.orchestra.run.smithi072.stdout:195 2023-08-25T04:49:46.362 INFO:teuthology.orchestra.run.smithi072.stdout:195.out 2023-08-25T04:49:46.362 INFO:teuthology.orchestra.run.smithi072.stdout:196 2023-08-25T04:49:46.362 INFO:teuthology.orchestra.run.smithi072.stdout:196.out 2023-08-25T04:49:46.362 INFO:teuthology.orchestra.run.smithi072.stdout:197 2023-08-25T04:49:46.362 INFO:teuthology.orchestra.run.smithi072.stdout:197.out 2023-08-25T04:49:46.362 INFO:teuthology.orchestra.run.smithi072.stdout:198 2023-08-25T04:49:46.362 INFO:teuthology.orchestra.run.smithi072.stdout:198.out 2023-08-25T04:49:46.362 INFO:teuthology.orchestra.run.smithi072.stdout:199 2023-08-25T04:49:46.363 INFO:teuthology.orchestra.run.smithi072.stdout:199.out 2023-08-25T04:49:46.363 INFO:teuthology.orchestra.run.smithi072.stdout:200 2023-08-25T04:49:46.363 INFO:teuthology.orchestra.run.smithi072.stdout:200.out 2023-08-25T04:49:46.363 INFO:teuthology.orchestra.run.smithi072.stdout:201 2023-08-25T04:49:46.363 INFO:teuthology.orchestra.run.smithi072.stdout:201.out 2023-08-25T04:49:46.363 INFO:teuthology.orchestra.run.smithi072.stdout:202 2023-08-25T04:49:46.363 INFO:teuthology.orchestra.run.smithi072.stdout:202.out 2023-08-25T04:49:46.363 INFO:teuthology.orchestra.run.smithi072.stdout:203 2023-08-25T04:49:46.364 INFO:teuthology.orchestra.run.smithi072.stdout:203.out 2023-08-25T04:49:46.364 INFO:teuthology.orchestra.run.smithi072.stdout:204 2023-08-25T04:49:46.364 INFO:teuthology.orchestra.run.smithi072.stdout:204.out 2023-08-25T04:49:46.364 INFO:teuthology.orchestra.run.smithi072.stdout:205 2023-08-25T04:49:46.364 INFO:teuthology.orchestra.run.smithi072.stdout:205.out 2023-08-25T04:49:46.364 INFO:teuthology.orchestra.run.smithi072.stdout:206 2023-08-25T04:49:46.364 INFO:teuthology.orchestra.run.smithi072.stdout:206.out 2023-08-25T04:49:46.364 INFO:teuthology.orchestra.run.smithi072.stdout:207 2023-08-25T04:49:46.365 INFO:teuthology.orchestra.run.smithi072.stdout:207.out 2023-08-25T04:49:46.365 INFO:teuthology.orchestra.run.smithi072.stdout:208 2023-08-25T04:49:46.365 INFO:teuthology.orchestra.run.smithi072.stdout:208.out 2023-08-25T04:49:46.365 INFO:teuthology.orchestra.run.smithi072.stdout:209 2023-08-25T04:49:46.365 INFO:teuthology.orchestra.run.smithi072.stdout:209.out 2023-08-25T04:49:46.365 INFO:teuthology.orchestra.run.smithi072.stdout:210 2023-08-25T04:49:46.365 INFO:teuthology.orchestra.run.smithi072.stdout:210.out 2023-08-25T04:49:46.365 INFO:teuthology.orchestra.run.smithi072.stdout:211 2023-08-25T04:49:46.366 INFO:teuthology.orchestra.run.smithi072.stdout:211.out 2023-08-25T04:49:46.366 INFO:teuthology.orchestra.run.smithi072.stdout:212 2023-08-25T04:49:46.366 INFO:teuthology.orchestra.run.smithi072.stdout:212.out 2023-08-25T04:49:46.366 INFO:teuthology.orchestra.run.smithi072.stdout:213 2023-08-25T04:49:46.366 INFO:teuthology.orchestra.run.smithi072.stdout:213.out 2023-08-25T04:49:46.366 INFO:teuthology.orchestra.run.smithi072.stdout:214 2023-08-25T04:49:46.366 INFO:teuthology.orchestra.run.smithi072.stdout:214.out 2023-08-25T04:49:46.366 INFO:teuthology.orchestra.run.smithi072.stdout:215 2023-08-25T04:49:46.367 INFO:teuthology.orchestra.run.smithi072.stdout:215.out 2023-08-25T04:49:46.367 INFO:teuthology.orchestra.run.smithi072.stdout:216 2023-08-25T04:49:46.367 INFO:teuthology.orchestra.run.smithi072.stdout:216.out 2023-08-25T04:49:46.367 INFO:teuthology.orchestra.run.smithi072.stdout:217 2023-08-25T04:49:46.367 INFO:teuthology.orchestra.run.smithi072.stdout:217.out 2023-08-25T04:49:46.367 INFO:teuthology.orchestra.run.smithi072.stdout:218 2023-08-25T04:49:46.367 INFO:teuthology.orchestra.run.smithi072.stdout:218.out 2023-08-25T04:49:46.367 INFO:teuthology.orchestra.run.smithi072.stdout:219 2023-08-25T04:49:46.368 INFO:teuthology.orchestra.run.smithi072.stdout:219.out 2023-08-25T04:49:46.368 INFO:teuthology.orchestra.run.smithi072.stdout:220 2023-08-25T04:49:46.368 INFO:teuthology.orchestra.run.smithi072.stdout:220.out 2023-08-25T04:49:46.368 INFO:teuthology.orchestra.run.smithi072.stdout:221 2023-08-25T04:49:46.368 INFO:teuthology.orchestra.run.smithi072.stdout:221.out 2023-08-25T04:49:46.368 INFO:teuthology.orchestra.run.smithi072.stdout:222 2023-08-25T04:49:46.368 INFO:teuthology.orchestra.run.smithi072.stdout:222.out 2023-08-25T04:49:46.368 INFO:teuthology.orchestra.run.smithi072.stdout:223 2023-08-25T04:49:46.369 INFO:teuthology.orchestra.run.smithi072.stdout:223.out 2023-08-25T04:49:46.369 INFO:teuthology.orchestra.run.smithi072.stdout:224 2023-08-25T04:49:46.369 INFO:teuthology.orchestra.run.smithi072.stdout:224.out 2023-08-25T04:49:46.369 INFO:teuthology.orchestra.run.smithi072.stdout:225 2023-08-25T04:49:46.369 INFO:teuthology.orchestra.run.smithi072.stdout:225.out 2023-08-25T04:49:46.369 INFO:teuthology.orchestra.run.smithi072.stdout:226 2023-08-25T04:49:46.369 INFO:teuthology.orchestra.run.smithi072.stdout:226.out 2023-08-25T04:49:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:227 2023-08-25T04:49:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:227.out 2023-08-25T04:49:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:228 2023-08-25T04:49:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:228.out 2023-08-25T04:49:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:229 2023-08-25T04:49:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:229.out 2023-08-25T04:49:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:230 2023-08-25T04:49:46.371 INFO:teuthology.orchestra.run.smithi072.stdout:230.out 2023-08-25T04:49:46.371 INFO:teuthology.orchestra.run.smithi072.stdout:231 2023-08-25T04:49:46.371 INFO:teuthology.orchestra.run.smithi072.stdout:231.out 2023-08-25T04:49:46.371 INFO:teuthology.orchestra.run.smithi072.stdout:232 2023-08-25T04:49:46.371 INFO:teuthology.orchestra.run.smithi072.stdout:232.out 2023-08-25T04:49:46.371 INFO:teuthology.orchestra.run.smithi072.stdout:233 2023-08-25T04:49:46.371 INFO:teuthology.orchestra.run.smithi072.stdout:233.out 2023-08-25T04:49:46.371 INFO:teuthology.orchestra.run.smithi072.stdout:234 2023-08-25T04:49:46.372 INFO:teuthology.orchestra.run.smithi072.stdout:234.out 2023-08-25T04:49:46.372 INFO:teuthology.orchestra.run.smithi072.stdout:235 2023-08-25T04:49:46.372 INFO:teuthology.orchestra.run.smithi072.stdout:235.out 2023-08-25T04:49:46.372 INFO:teuthology.orchestra.run.smithi072.stdout:236 2023-08-25T04:49:46.372 INFO:teuthology.orchestra.run.smithi072.stdout:236.out 2023-08-25T04:49:46.372 INFO:teuthology.orchestra.run.smithi072.stdout:237 2023-08-25T04:49:46.372 INFO:teuthology.orchestra.run.smithi072.stdout:237.out 2023-08-25T04:49:46.372 INFO:teuthology.orchestra.run.smithi072.stdout:238 2023-08-25T04:49:46.373 INFO:teuthology.orchestra.run.smithi072.stdout:238.out 2023-08-25T04:49:46.373 INFO:teuthology.orchestra.run.smithi072.stdout:239 2023-08-25T04:49:46.373 INFO:teuthology.orchestra.run.smithi072.stdout:239.out 2023-08-25T04:49:46.373 INFO:teuthology.orchestra.run.smithi072.stdout:240 2023-08-25T04:49:46.373 INFO:teuthology.orchestra.run.smithi072.stdout:240.out 2023-08-25T04:49:46.373 INFO:teuthology.orchestra.run.smithi072.stdout:241 2023-08-25T04:49:46.373 INFO:teuthology.orchestra.run.smithi072.stdout:241.out 2023-08-25T04:49:46.373 INFO:teuthology.orchestra.run.smithi072.stdout:242 2023-08-25T04:49:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:242.out 2023-08-25T04:49:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:243 2023-08-25T04:49:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:243.out 2023-08-25T04:49:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:244 2023-08-25T04:49:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:244.out 2023-08-25T04:49:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:245 2023-08-25T04:49:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:245.out 2023-08-25T04:49:46.375 INFO:teuthology.orchestra.run.smithi072.stdout:246 2023-08-25T04:49:46.375 INFO:teuthology.orchestra.run.smithi072.stdout:246.out 2023-08-25T04:49:46.375 INFO:teuthology.orchestra.run.smithi072.stdout:247 2023-08-25T04:49:46.375 INFO:teuthology.orchestra.run.smithi072.stdout:247.out 2023-08-25T04:49:46.375 INFO:teuthology.orchestra.run.smithi072.stdout:248 2023-08-25T04:49:46.375 INFO:teuthology.orchestra.run.smithi072.stdout:248.out 2023-08-25T04:49:46.375 INFO:teuthology.orchestra.run.smithi072.stdout:249 2023-08-25T04:49:46.375 INFO:teuthology.orchestra.run.smithi072.stdout:249.out 2023-08-25T04:49:46.376 INFO:teuthology.orchestra.run.smithi072.stdout:250 2023-08-25T04:49:46.376 INFO:teuthology.orchestra.run.smithi072.stdout:250.out 2023-08-25T04:49:46.376 INFO:teuthology.orchestra.run.smithi072.stdout:251 2023-08-25T04:49:46.376 INFO:teuthology.orchestra.run.smithi072.stdout:251.out 2023-08-25T04:49:46.376 INFO:teuthology.orchestra.run.smithi072.stdout:252 2023-08-25T04:49:46.376 INFO:teuthology.orchestra.run.smithi072.stdout:252.out 2023-08-25T04:49:46.376 INFO:teuthology.orchestra.run.smithi072.stdout:253 2023-08-25T04:49:46.376 INFO:teuthology.orchestra.run.smithi072.stdout:253.out 2023-08-25T04:49:46.377 INFO:teuthology.orchestra.run.smithi072.stdout:254 2023-08-25T04:49:46.377 INFO:teuthology.orchestra.run.smithi072.stdout:254.out 2023-08-25T04:49:46.377 INFO:teuthology.orchestra.run.smithi072.stdout:255 2023-08-25T04:49:46.377 INFO:teuthology.orchestra.run.smithi072.stdout:255.out 2023-08-25T04:49:46.377 INFO:teuthology.orchestra.run.smithi072.stdout:256 2023-08-25T04:49:46.377 INFO:teuthology.orchestra.run.smithi072.stdout:256.out 2023-08-25T04:49:46.377 INFO:teuthology.orchestra.run.smithi072.stdout:257 2023-08-25T04:49:46.377 INFO:teuthology.orchestra.run.smithi072.stdout:257.out 2023-08-25T04:49:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:258 2023-08-25T04:49:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:258.out 2023-08-25T04:49:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:259 2023-08-25T04:49:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:259.out 2023-08-25T04:49:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:260 2023-08-25T04:49:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:260.out 2023-08-25T04:49:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:261 2023-08-25T04:49:46.379 INFO:teuthology.orchestra.run.smithi072.stdout:261.out 2023-08-25T04:49:46.379 INFO:teuthology.orchestra.run.smithi072.stdout:262 2023-08-25T04:49:46.379 INFO:teuthology.orchestra.run.smithi072.stdout:262.out 2023-08-25T04:49:46.379 INFO:teuthology.orchestra.run.smithi072.stdout:263 2023-08-25T04:49:46.379 INFO:teuthology.orchestra.run.smithi072.stdout:263.out 2023-08-25T04:49:46.379 INFO:teuthology.orchestra.run.smithi072.stdout:264 2023-08-25T04:49:46.379 INFO:teuthology.orchestra.run.smithi072.stdout:264.out 2023-08-25T04:49:46.379 INFO:teuthology.orchestra.run.smithi072.stdout:265 2023-08-25T04:49:46.380 INFO:teuthology.orchestra.run.smithi072.stdout:265.out 2023-08-25T04:49:46.380 INFO:teuthology.orchestra.run.smithi072.stdout:266 2023-08-25T04:49:46.380 INFO:teuthology.orchestra.run.smithi072.stdout:266.out 2023-08-25T04:49:46.380 INFO:teuthology.orchestra.run.smithi072.stdout:267 2023-08-25T04:49:46.380 INFO:teuthology.orchestra.run.smithi072.stdout:267.out 2023-08-25T04:49:46.380 INFO:teuthology.orchestra.run.smithi072.stdout:268 2023-08-25T04:49:46.380 INFO:teuthology.orchestra.run.smithi072.stdout:268.out 2023-08-25T04:49:46.380 INFO:teuthology.orchestra.run.smithi072.stdout:269 2023-08-25T04:49:46.381 INFO:teuthology.orchestra.run.smithi072.stdout:269.out 2023-08-25T04:49:46.381 INFO:teuthology.orchestra.run.smithi072.stdout:270 2023-08-25T04:49:46.381 INFO:teuthology.orchestra.run.smithi072.stdout:270.out 2023-08-25T04:49:46.381 INFO:teuthology.orchestra.run.smithi072.stdout:271 2023-08-25T04:49:46.381 INFO:teuthology.orchestra.run.smithi072.stdout:271.out 2023-08-25T04:49:46.381 INFO:teuthology.orchestra.run.smithi072.stdout:272 2023-08-25T04:49:46.381 INFO:teuthology.orchestra.run.smithi072.stdout:272.out 2023-08-25T04:49:46.382 INFO:teuthology.orchestra.run.smithi072.stdout:273 2023-08-25T04:49:46.382 INFO:teuthology.orchestra.run.smithi072.stdout:273.out 2023-08-25T04:49:46.382 INFO:teuthology.orchestra.run.smithi072.stdout:274 2023-08-25T04:49:46.382 INFO:teuthology.orchestra.run.smithi072.stdout:274.out 2023-08-25T04:49:46.382 INFO:teuthology.orchestra.run.smithi072.stdout:275 2023-08-25T04:49:46.382 INFO:teuthology.orchestra.run.smithi072.stdout:275.out 2023-08-25T04:49:46.382 INFO:teuthology.orchestra.run.smithi072.stdout:276 2023-08-25T04:49:46.382 INFO:teuthology.orchestra.run.smithi072.stdout:276.out 2023-08-25T04:49:46.383 INFO:teuthology.orchestra.run.smithi072.stdout:277 2023-08-25T04:49:46.383 INFO:teuthology.orchestra.run.smithi072.stdout:277.out 2023-08-25T04:49:46.383 INFO:teuthology.orchestra.run.smithi072.stdout:278 2023-08-25T04:49:46.383 INFO:teuthology.orchestra.run.smithi072.stdout:278.out 2023-08-25T04:49:46.383 INFO:teuthology.orchestra.run.smithi072.stdout:279 2023-08-25T04:49:46.383 INFO:teuthology.orchestra.run.smithi072.stdout:279.out 2023-08-25T04:49:46.383 INFO:teuthology.orchestra.run.smithi072.stdout:280 2023-08-25T04:49:46.383 INFO:teuthology.orchestra.run.smithi072.stdout:280.out 2023-08-25T04:49:46.384 INFO:teuthology.orchestra.run.smithi072.stdout:281 2023-08-25T04:49:46.384 INFO:teuthology.orchestra.run.smithi072.stdout:281.out 2023-08-25T04:49:46.384 INFO:teuthology.orchestra.run.smithi072.stdout:282 2023-08-25T04:49:46.384 INFO:teuthology.orchestra.run.smithi072.stdout:282.out 2023-08-25T04:49:46.384 INFO:teuthology.orchestra.run.smithi072.stdout:283 2023-08-25T04:49:46.384 INFO:teuthology.orchestra.run.smithi072.stdout:283.out 2023-08-25T04:49:46.384 INFO:teuthology.orchestra.run.smithi072.stdout:284 2023-08-25T04:49:46.385 INFO:teuthology.orchestra.run.smithi072.stdout:284.out 2023-08-25T04:49:46.385 INFO:teuthology.orchestra.run.smithi072.stdout:285 2023-08-25T04:49:46.385 INFO:teuthology.orchestra.run.smithi072.stdout:285.out 2023-08-25T04:49:46.385 INFO:teuthology.orchestra.run.smithi072.stdout:286 2023-08-25T04:49:46.385 INFO:teuthology.orchestra.run.smithi072.stdout:286.out 2023-08-25T04:49:46.385 INFO:teuthology.orchestra.run.smithi072.stdout:287 2023-08-25T04:49:46.385 INFO:teuthology.orchestra.run.smithi072.stdout:287.out 2023-08-25T04:49:46.385 INFO:teuthology.orchestra.run.smithi072.stdout:288 2023-08-25T04:49:46.386 INFO:teuthology.orchestra.run.smithi072.stdout:288.out 2023-08-25T04:49:46.386 INFO:teuthology.orchestra.run.smithi072.stdout:289 2023-08-25T04:49:46.386 INFO:teuthology.orchestra.run.smithi072.stdout:289.out 2023-08-25T04:49:46.386 INFO:teuthology.orchestra.run.smithi072.stdout:290 2023-08-25T04:49:46.386 INFO:teuthology.orchestra.run.smithi072.stdout:290.out 2023-08-25T04:49:46.386 INFO:teuthology.orchestra.run.smithi072.stdout:291 2023-08-25T04:49:46.386 INFO:teuthology.orchestra.run.smithi072.stdout:291.out 2023-08-25T04:49:46.386 INFO:teuthology.orchestra.run.smithi072.stdout:292 2023-08-25T04:49:46.387 INFO:teuthology.orchestra.run.smithi072.stdout:292.out 2023-08-25T04:49:46.387 INFO:teuthology.orchestra.run.smithi072.stdout:293 2023-08-25T04:49:46.387 INFO:teuthology.orchestra.run.smithi072.stdout:293.out 2023-08-25T04:49:46.387 INFO:teuthology.orchestra.run.smithi072.stdout:294 2023-08-25T04:49:46.387 INFO:teuthology.orchestra.run.smithi072.stdout:294.out 2023-08-25T04:49:46.387 INFO:teuthology.orchestra.run.smithi072.stdout:295 2023-08-25T04:49:46.388 INFO:teuthology.orchestra.run.smithi072.stdout:295.out 2023-08-25T04:49:46.388 INFO:teuthology.orchestra.run.smithi072.stdout:296 2023-08-25T04:49:46.388 INFO:teuthology.orchestra.run.smithi072.stdout:296.out 2023-08-25T04:49:46.388 INFO:teuthology.orchestra.run.smithi072.stdout:297 2023-08-25T04:49:46.389 INFO:teuthology.orchestra.run.smithi072.stdout:297.out 2023-08-25T04:49:46.389 INFO:teuthology.orchestra.run.smithi072.stdout:298 2023-08-25T04:49:46.389 INFO:teuthology.orchestra.run.smithi072.stdout:298.out 2023-08-25T04:49:46.389 INFO:teuthology.orchestra.run.smithi072.stdout:299 2023-08-25T04:49:46.390 INFO:teuthology.orchestra.run.smithi072.stdout:299.out 2023-08-25T04:49:46.390 INFO:teuthology.orchestra.run.smithi072.stdout:300 2023-08-25T04:49:46.390 INFO:teuthology.orchestra.run.smithi072.stdout:300.out 2023-08-25T04:49:46.390 INFO:teuthology.orchestra.run.smithi072.stdout:301 2023-08-25T04:49:46.391 INFO:teuthology.orchestra.run.smithi072.stdout:301.out 2023-08-25T04:49:46.391 INFO:teuthology.orchestra.run.smithi072.stdout:302 2023-08-25T04:49:46.391 INFO:teuthology.orchestra.run.smithi072.stdout:302.out 2023-08-25T04:49:46.391 INFO:teuthology.orchestra.run.smithi072.stdout:303 2023-08-25T04:49:46.392 INFO:teuthology.orchestra.run.smithi072.stdout:303.out 2023-08-25T04:49:46.392 INFO:teuthology.orchestra.run.smithi072.stdout:304 2023-08-25T04:49:46.392 INFO:teuthology.orchestra.run.smithi072.stdout:304.out 2023-08-25T04:49:46.392 INFO:teuthology.orchestra.run.smithi072.stdout:305 2023-08-25T04:49:46.392 INFO:teuthology.orchestra.run.smithi072.stdout:305.out 2023-08-25T04:49:46.392 INFO:teuthology.orchestra.run.smithi072.stdout:306 2023-08-25T04:49:46.392 INFO:teuthology.orchestra.run.smithi072.stdout:306.out 2023-08-25T04:49:46.393 INFO:teuthology.orchestra.run.smithi072.stdout:307 2023-08-25T04:49:46.393 INFO:teuthology.orchestra.run.smithi072.stdout:307.out 2023-08-25T04:49:46.393 INFO:teuthology.orchestra.run.smithi072.stdout:308 2023-08-25T04:49:46.393 INFO:teuthology.orchestra.run.smithi072.stdout:308.out 2023-08-25T04:49:46.393 INFO:teuthology.orchestra.run.smithi072.stdout:309 2023-08-25T04:49:46.393 INFO:teuthology.orchestra.run.smithi072.stdout:309.out 2023-08-25T04:49:46.393 INFO:teuthology.orchestra.run.smithi072.stdout:310 2023-08-25T04:49:46.393 INFO:teuthology.orchestra.run.smithi072.stdout:310.out 2023-08-25T04:49:46.394 INFO:teuthology.orchestra.run.smithi072.stdout:311 2023-08-25T04:49:46.394 INFO:teuthology.orchestra.run.smithi072.stdout:311.out 2023-08-25T04:49:46.394 INFO:teuthology.orchestra.run.smithi072.stdout:312 2023-08-25T04:49:46.394 INFO:teuthology.orchestra.run.smithi072.stdout:312.out 2023-08-25T04:49:46.394 INFO:teuthology.orchestra.run.smithi072.stdout:313 2023-08-25T04:49:46.394 INFO:teuthology.orchestra.run.smithi072.stdout:313.out 2023-08-25T04:49:46.394 INFO:teuthology.orchestra.run.smithi072.stdout:314 2023-08-25T04:49:46.395 INFO:teuthology.orchestra.run.smithi072.stdout:314.out 2023-08-25T04:49:46.395 INFO:teuthology.orchestra.run.smithi072.stdout:315 2023-08-25T04:49:46.395 INFO:teuthology.orchestra.run.smithi072.stdout:315.out 2023-08-25T04:49:46.395 INFO:teuthology.orchestra.run.smithi072.stdout:316 2023-08-25T04:49:46.396 INFO:teuthology.orchestra.run.smithi072.stdout:316.out 2023-08-25T04:49:46.396 INFO:teuthology.orchestra.run.smithi072.stdout:317 2023-08-25T04:49:46.396 INFO:teuthology.orchestra.run.smithi072.stdout:317.out 2023-08-25T04:49:46.396 INFO:teuthology.orchestra.run.smithi072.stdout:318 2023-08-25T04:49:46.396 INFO:teuthology.orchestra.run.smithi072.stdout:318.out 2023-08-25T04:49:46.396 INFO:teuthology.orchestra.run.smithi072.stdout:319 2023-08-25T04:49:46.396 INFO:teuthology.orchestra.run.smithi072.stdout:319.out 2023-08-25T04:49:46.396 INFO:teuthology.orchestra.run.smithi072.stdout:320 2023-08-25T04:49:46.397 INFO:teuthology.orchestra.run.smithi072.stdout:320.out 2023-08-25T04:49:46.397 INFO:teuthology.orchestra.run.smithi072.stdout:321 2023-08-25T04:49:46.397 INFO:teuthology.orchestra.run.smithi072.stdout:321.out 2023-08-25T04:49:46.397 INFO:teuthology.orchestra.run.smithi072.stdout:322 2023-08-25T04:49:46.397 INFO:teuthology.orchestra.run.smithi072.stdout:322.out 2023-08-25T04:49:46.397 INFO:teuthology.orchestra.run.smithi072.stdout:323 2023-08-25T04:49:46.397 INFO:teuthology.orchestra.run.smithi072.stdout:323.out 2023-08-25T04:49:46.397 INFO:teuthology.orchestra.run.smithi072.stdout:324 2023-08-25T04:49:46.398 INFO:teuthology.orchestra.run.smithi072.stdout:324.out 2023-08-25T04:49:46.398 INFO:teuthology.orchestra.run.smithi072.stdout:325 2023-08-25T04:49:46.398 INFO:teuthology.orchestra.run.smithi072.stdout:325.out 2023-08-25T04:49:46.398 INFO:teuthology.orchestra.run.smithi072.stdout:326 2023-08-25T04:49:46.398 INFO:teuthology.orchestra.run.smithi072.stdout:326.out 2023-08-25T04:49:46.398 INFO:teuthology.orchestra.run.smithi072.stdout:327 2023-08-25T04:49:46.398 INFO:teuthology.orchestra.run.smithi072.stdout:327.out 2023-08-25T04:49:46.398 INFO:teuthology.orchestra.run.smithi072.stdout:328 2023-08-25T04:49:46.399 INFO:teuthology.orchestra.run.smithi072.stdout:328.out 2023-08-25T04:49:46.399 INFO:teuthology.orchestra.run.smithi072.stdout:329 2023-08-25T04:49:46.399 INFO:teuthology.orchestra.run.smithi072.stdout:329.out 2023-08-25T04:49:46.399 INFO:teuthology.orchestra.run.smithi072.stdout:330 2023-08-25T04:49:46.399 INFO:teuthology.orchestra.run.smithi072.stdout:330.out 2023-08-25T04:49:46.399 INFO:teuthology.orchestra.run.smithi072.stdout:331 2023-08-25T04:49:46.399 INFO:teuthology.orchestra.run.smithi072.stdout:331.out 2023-08-25T04:49:46.399 INFO:teuthology.orchestra.run.smithi072.stdout:332 2023-08-25T04:49:46.400 INFO:teuthology.orchestra.run.smithi072.stdout:332.out 2023-08-25T04:49:46.400 INFO:teuthology.orchestra.run.smithi072.stdout:333 2023-08-25T04:49:46.400 INFO:teuthology.orchestra.run.smithi072.stdout:333.out 2023-08-25T04:49:46.400 INFO:teuthology.orchestra.run.smithi072.stdout:334 2023-08-25T04:49:46.400 INFO:teuthology.orchestra.run.smithi072.stdout:334.out 2023-08-25T04:49:46.400 INFO:teuthology.orchestra.run.smithi072.stdout:335 2023-08-25T04:49:46.400 INFO:teuthology.orchestra.run.smithi072.stdout:335.out 2023-08-25T04:49:46.401 INFO:teuthology.orchestra.run.smithi072.stdout:336 2023-08-25T04:49:46.401 INFO:teuthology.orchestra.run.smithi072.stdout:336.out 2023-08-25T04:49:46.401 INFO:teuthology.orchestra.run.smithi072.stdout:337 2023-08-25T04:49:46.401 INFO:teuthology.orchestra.run.smithi072.stdout:337.out 2023-08-25T04:49:46.401 INFO:teuthology.orchestra.run.smithi072.stdout:338 2023-08-25T04:49:46.401 INFO:teuthology.orchestra.run.smithi072.stdout:338.out 2023-08-25T04:49:46.401 INFO:teuthology.orchestra.run.smithi072.stdout:339 2023-08-25T04:49:46.401 INFO:teuthology.orchestra.run.smithi072.stdout:339.out 2023-08-25T04:49:46.402 INFO:teuthology.orchestra.run.smithi072.stdout:340 2023-08-25T04:49:46.402 INFO:teuthology.orchestra.run.smithi072.stdout:340.out 2023-08-25T04:49:46.402 INFO:teuthology.orchestra.run.smithi072.stdout:341 2023-08-25T04:49:46.402 INFO:teuthology.orchestra.run.smithi072.stdout:341.out 2023-08-25T04:49:46.402 INFO:teuthology.orchestra.run.smithi072.stdout:342 2023-08-25T04:49:46.402 INFO:teuthology.orchestra.run.smithi072.stdout:342.out 2023-08-25T04:49:46.402 INFO:teuthology.orchestra.run.smithi072.stdout:343 2023-08-25T04:49:46.402 INFO:teuthology.orchestra.run.smithi072.stdout:343.out 2023-08-25T04:49:46.403 INFO:teuthology.orchestra.run.smithi072.stdout:344 2023-08-25T04:49:46.403 INFO:teuthology.orchestra.run.smithi072.stdout:344.out 2023-08-25T04:49:46.403 INFO:teuthology.orchestra.run.smithi072.stdout:345 2023-08-25T04:49:46.403 INFO:teuthology.orchestra.run.smithi072.stdout:345.out 2023-08-25T04:49:46.403 INFO:teuthology.orchestra.run.smithi072.stdout:346 2023-08-25T04:49:46.403 INFO:teuthology.orchestra.run.smithi072.stdout:346.out 2023-08-25T04:49:46.403 INFO:teuthology.orchestra.run.smithi072.stdout:347 2023-08-25T04:49:46.403 INFO:teuthology.orchestra.run.smithi072.stdout:347.out 2023-08-25T04:49:46.404 INFO:teuthology.orchestra.run.smithi072.stdout:348 2023-08-25T04:49:46.404 INFO:teuthology.orchestra.run.smithi072.stdout:348.out 2023-08-25T04:49:46.404 INFO:teuthology.orchestra.run.smithi072.stdout:349 2023-08-25T04:49:46.404 INFO:teuthology.orchestra.run.smithi072.stdout:349.out 2023-08-25T04:49:46.404 INFO:teuthology.orchestra.run.smithi072.stdout:350 2023-08-25T04:49:46.404 INFO:teuthology.orchestra.run.smithi072.stdout:350.out 2023-08-25T04:49:46.404 INFO:teuthology.orchestra.run.smithi072.stdout:351 2023-08-25T04:49:46.405 INFO:teuthology.orchestra.run.smithi072.stdout:351.out 2023-08-25T04:49:46.405 INFO:teuthology.orchestra.run.smithi072.stdout:352 2023-08-25T04:49:46.405 INFO:teuthology.orchestra.run.smithi072.stdout:352.out 2023-08-25T04:49:46.405 INFO:teuthology.orchestra.run.smithi072.stdout:353 2023-08-25T04:49:46.405 INFO:teuthology.orchestra.run.smithi072.stdout:353.out 2023-08-25T04:49:46.405 INFO:teuthology.orchestra.run.smithi072.stdout:354 2023-08-25T04:49:46.405 INFO:teuthology.orchestra.run.smithi072.stdout:354.out 2023-08-25T04:49:46.405 INFO:teuthology.orchestra.run.smithi072.stdout:355 2023-08-25T04:49:46.406 INFO:teuthology.orchestra.run.smithi072.stdout:355.out 2023-08-25T04:49:46.406 INFO:teuthology.orchestra.run.smithi072.stdout:356 2023-08-25T04:49:46.406 INFO:teuthology.orchestra.run.smithi072.stdout:356.out 2023-08-25T04:49:46.406 INFO:teuthology.orchestra.run.smithi072.stdout:357 2023-08-25T04:49:46.406 INFO:teuthology.orchestra.run.smithi072.stdout:357.out 2023-08-25T04:49:46.406 INFO:teuthology.orchestra.run.smithi072.stdout:358 2023-08-25T04:49:46.406 INFO:teuthology.orchestra.run.smithi072.stdout:358.out 2023-08-25T04:49:46.406 INFO:teuthology.orchestra.run.smithi072.stdout:359 2023-08-25T04:49:46.407 INFO:teuthology.orchestra.run.smithi072.stdout:359.out 2023-08-25T04:49:46.407 INFO:teuthology.orchestra.run.smithi072.stdout:360 2023-08-25T04:49:46.407 INFO:teuthology.orchestra.run.smithi072.stdout:360.out 2023-08-25T04:49:46.407 INFO:teuthology.orchestra.run.smithi072.stdout:361 2023-08-25T04:49:46.407 INFO:teuthology.orchestra.run.smithi072.stdout:361.out 2023-08-25T04:49:46.407 INFO:teuthology.orchestra.run.smithi072.stdout:362 2023-08-25T04:49:46.407 INFO:teuthology.orchestra.run.smithi072.stdout:362.out 2023-08-25T04:49:46.407 INFO:teuthology.orchestra.run.smithi072.stdout:363 2023-08-25T04:49:46.408 INFO:teuthology.orchestra.run.smithi072.stdout:363.out 2023-08-25T04:49:46.408 INFO:teuthology.orchestra.run.smithi072.stdout:364 2023-08-25T04:49:46.408 INFO:teuthology.orchestra.run.smithi072.stdout:364.out 2023-08-25T04:49:46.408 INFO:teuthology.orchestra.run.smithi072.stdout:365 2023-08-25T04:49:46.408 INFO:teuthology.orchestra.run.smithi072.stdout:365.out 2023-08-25T04:49:46.408 INFO:teuthology.orchestra.run.smithi072.stdout:366 2023-08-25T04:49:46.408 INFO:teuthology.orchestra.run.smithi072.stdout:366.out 2023-08-25T04:49:46.408 INFO:teuthology.orchestra.run.smithi072.stdout:367 2023-08-25T04:49:46.409 INFO:teuthology.orchestra.run.smithi072.stdout:367.out 2023-08-25T04:49:46.409 INFO:teuthology.orchestra.run.smithi072.stdout:368 2023-08-25T04:49:46.409 INFO:teuthology.orchestra.run.smithi072.stdout:368.out 2023-08-25T04:49:46.409 INFO:teuthology.orchestra.run.smithi072.stdout:369 2023-08-25T04:49:46.409 INFO:teuthology.orchestra.run.smithi072.stdout:369.out 2023-08-25T04:49:46.409 INFO:teuthology.orchestra.run.smithi072.stdout:370 2023-08-25T04:49:46.409 INFO:teuthology.orchestra.run.smithi072.stdout:370.out 2023-08-25T04:49:46.409 INFO:teuthology.orchestra.run.smithi072.stdout:371 2023-08-25T04:49:46.410 INFO:teuthology.orchestra.run.smithi072.stdout:371.out 2023-08-25T04:49:46.410 INFO:teuthology.orchestra.run.smithi072.stdout:372 2023-08-25T04:49:46.410 INFO:teuthology.orchestra.run.smithi072.stdout:372.out 2023-08-25T04:49:46.410 INFO:teuthology.orchestra.run.smithi072.stdout:373 2023-08-25T04:49:46.410 INFO:teuthology.orchestra.run.smithi072.stdout:373.out 2023-08-25T04:49:46.410 INFO:teuthology.orchestra.run.smithi072.stdout:374 2023-08-25T04:49:46.410 INFO:teuthology.orchestra.run.smithi072.stdout:374.out 2023-08-25T04:49:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:375 2023-08-25T04:49:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:375.out 2023-08-25T04:49:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:376 2023-08-25T04:49:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:376.out 2023-08-25T04:49:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:377 2023-08-25T04:49:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:377.out 2023-08-25T04:49:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:378 2023-08-25T04:49:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:378.out 2023-08-25T04:49:46.412 INFO:teuthology.orchestra.run.smithi072.stdout:379 2023-08-25T04:49:46.412 INFO:teuthology.orchestra.run.smithi072.stdout:379.out 2023-08-25T04:49:46.412 INFO:teuthology.orchestra.run.smithi072.stdout:380 2023-08-25T04:49:46.412 INFO:teuthology.orchestra.run.smithi072.stdout:380.out 2023-08-25T04:49:46.412 INFO:teuthology.orchestra.run.smithi072.stdout:381 2023-08-25T04:49:46.412 INFO:teuthology.orchestra.run.smithi072.stdout:381.out 2023-08-25T04:49:46.412 INFO:teuthology.orchestra.run.smithi072.stdout:382 2023-08-25T04:49:46.413 INFO:teuthology.orchestra.run.smithi072.stdout:382.out 2023-08-25T04:49:46.413 INFO:teuthology.orchestra.run.smithi072.stdout:383 2023-08-25T04:49:46.413 INFO:teuthology.orchestra.run.smithi072.stdout:383.out 2023-08-25T04:49:46.413 INFO:teuthology.orchestra.run.smithi072.stdout:384 2023-08-25T04:49:46.413 INFO:teuthology.orchestra.run.smithi072.stdout:384.out 2023-08-25T04:49:46.413 INFO:teuthology.orchestra.run.smithi072.stdout:385 2023-08-25T04:49:46.413 INFO:teuthology.orchestra.run.smithi072.stdout:385.out 2023-08-25T04:49:46.413 INFO:teuthology.orchestra.run.smithi072.stdout:386 2023-08-25T04:49:46.414 INFO:teuthology.orchestra.run.smithi072.stdout:386.out 2023-08-25T04:49:46.414 INFO:teuthology.orchestra.run.smithi072.stdout:387 2023-08-25T04:49:46.414 INFO:teuthology.orchestra.run.smithi072.stdout:387.out 2023-08-25T04:49:46.414 INFO:teuthology.orchestra.run.smithi072.stdout:388 2023-08-25T04:49:46.414 INFO:teuthology.orchestra.run.smithi072.stdout:388.out 2023-08-25T04:49:46.414 INFO:teuthology.orchestra.run.smithi072.stdout:389 2023-08-25T04:49:46.414 INFO:teuthology.orchestra.run.smithi072.stdout:389.out 2023-08-25T04:49:46.414 INFO:teuthology.orchestra.run.smithi072.stdout:390 2023-08-25T04:49:46.415 INFO:teuthology.orchestra.run.smithi072.stdout:390.out 2023-08-25T04:49:46.415 INFO:teuthology.orchestra.run.smithi072.stdout:391 2023-08-25T04:49:46.415 INFO:teuthology.orchestra.run.smithi072.stdout:391.out 2023-08-25T04:49:46.415 INFO:teuthology.orchestra.run.smithi072.stdout:392 2023-08-25T04:49:46.415 INFO:teuthology.orchestra.run.smithi072.stdout:392.out 2023-08-25T04:49:46.415 INFO:teuthology.orchestra.run.smithi072.stdout:393 2023-08-25T04:49:46.415 INFO:teuthology.orchestra.run.smithi072.stdout:393.out 2023-08-25T04:49:46.415 INFO:teuthology.orchestra.run.smithi072.stdout:394 2023-08-25T04:49:46.416 INFO:teuthology.orchestra.run.smithi072.stdout:394.out 2023-08-25T04:49:46.416 INFO:teuthology.orchestra.run.smithi072.stdout:395 2023-08-25T04:49:46.416 INFO:teuthology.orchestra.run.smithi072.stdout:395.out 2023-08-25T04:49:46.416 INFO:teuthology.orchestra.run.smithi072.stdout:396 2023-08-25T04:49:46.416 INFO:teuthology.orchestra.run.smithi072.stdout:396.out 2023-08-25T04:49:46.416 INFO:teuthology.orchestra.run.smithi072.stdout:397 2023-08-25T04:49:46.416 INFO:teuthology.orchestra.run.smithi072.stdout:397.out 2023-08-25T04:49:46.416 INFO:teuthology.orchestra.run.smithi072.stdout:398 2023-08-25T04:49:46.417 INFO:teuthology.orchestra.run.smithi072.stdout:398.out 2023-08-25T04:49:46.417 INFO:teuthology.orchestra.run.smithi072.stdout:399 2023-08-25T04:49:46.417 INFO:teuthology.orchestra.run.smithi072.stdout:399.out 2023-08-25T04:49:46.417 INFO:teuthology.orchestra.run.smithi072.stdout:400 2023-08-25T04:49:46.417 INFO:teuthology.orchestra.run.smithi072.stdout:400.out 2023-08-25T04:49:46.417 INFO:teuthology.orchestra.run.smithi072.stdout:401 2023-08-25T04:49:46.417 INFO:teuthology.orchestra.run.smithi072.stdout:401.out 2023-08-25T04:49:46.417 INFO:teuthology.orchestra.run.smithi072.stdout:402 2023-08-25T04:49:46.418 INFO:teuthology.orchestra.run.smithi072.stdout:402.out 2023-08-25T04:49:46.418 INFO:teuthology.orchestra.run.smithi072.stdout:403 2023-08-25T04:49:46.418 INFO:teuthology.orchestra.run.smithi072.stdout:403.out 2023-08-25T04:49:46.418 INFO:teuthology.orchestra.run.smithi072.stdout:404 2023-08-25T04:49:46.418 INFO:teuthology.orchestra.run.smithi072.stdout:404.out 2023-08-25T04:49:46.418 INFO:teuthology.orchestra.run.smithi072.stdout:405 2023-08-25T04:49:46.418 INFO:teuthology.orchestra.run.smithi072.stdout:405.out 2023-08-25T04:49:46.418 INFO:teuthology.orchestra.run.smithi072.stdout:406 2023-08-25T04:49:46.419 INFO:teuthology.orchestra.run.smithi072.stdout:406.out 2023-08-25T04:49:46.419 INFO:teuthology.orchestra.run.smithi072.stdout:407 2023-08-25T04:49:46.419 INFO:teuthology.orchestra.run.smithi072.stdout:407.out 2023-08-25T04:49:46.419 INFO:teuthology.orchestra.run.smithi072.stdout:408 2023-08-25T04:49:46.419 INFO:teuthology.orchestra.run.smithi072.stdout:408.out 2023-08-25T04:49:46.419 INFO:teuthology.orchestra.run.smithi072.stdout:409 2023-08-25T04:49:46.419 INFO:teuthology.orchestra.run.smithi072.stdout:409.out 2023-08-25T04:49:46.419 INFO:teuthology.orchestra.run.smithi072.stdout:410 2023-08-25T04:49:46.420 INFO:teuthology.orchestra.run.smithi072.stdout:410.out 2023-08-25T04:49:46.420 INFO:teuthology.orchestra.run.smithi072.stdout:411 2023-08-25T04:49:46.420 INFO:teuthology.orchestra.run.smithi072.stdout:411.out 2023-08-25T04:49:46.420 INFO:teuthology.orchestra.run.smithi072.stdout:412 2023-08-25T04:49:46.420 INFO:teuthology.orchestra.run.smithi072.stdout:412.out 2023-08-25T04:49:46.420 INFO:teuthology.orchestra.run.smithi072.stdout:413 2023-08-25T04:49:46.420 INFO:teuthology.orchestra.run.smithi072.stdout:413.out 2023-08-25T04:49:46.420 INFO:teuthology.orchestra.run.smithi072.stdout:414 2023-08-25T04:49:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:414.out 2023-08-25T04:49:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:415 2023-08-25T04:49:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:415.out 2023-08-25T04:49:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:416 2023-08-25T04:49:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:416.out 2023-08-25T04:49:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:417 2023-08-25T04:49:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:417.out 2023-08-25T04:49:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:418 2023-08-25T04:49:46.422 INFO:teuthology.orchestra.run.smithi072.stdout:418.out 2023-08-25T04:49:46.422 INFO:teuthology.orchestra.run.smithi072.stdout:419 2023-08-25T04:49:46.422 INFO:teuthology.orchestra.run.smithi072.stdout:419.out 2023-08-25T04:49:46.422 INFO:teuthology.orchestra.run.smithi072.stdout:420 2023-08-25T04:49:46.422 INFO:teuthology.orchestra.run.smithi072.stdout:420.out 2023-08-25T04:49:46.422 INFO:teuthology.orchestra.run.smithi072.stdout:421 2023-08-25T04:49:46.422 INFO:teuthology.orchestra.run.smithi072.stdout:421.out 2023-08-25T04:49:46.422 INFO:teuthology.orchestra.run.smithi072.stdout:422 2023-08-25T04:49:46.423 INFO:teuthology.orchestra.run.smithi072.stdout:422.out 2023-08-25T04:49:46.423 INFO:teuthology.orchestra.run.smithi072.stdout:423 2023-08-25T04:49:46.423 INFO:teuthology.orchestra.run.smithi072.stdout:423.out 2023-08-25T04:49:46.423 INFO:teuthology.orchestra.run.smithi072.stdout:424 2023-08-25T04:49:46.423 INFO:teuthology.orchestra.run.smithi072.stdout:424.out 2023-08-25T04:49:46.423 INFO:teuthology.orchestra.run.smithi072.stdout:425 2023-08-25T04:49:46.424 INFO:teuthology.orchestra.run.smithi072.stdout:425.out 2023-08-25T04:49:46.424 INFO:teuthology.orchestra.run.smithi072.stdout:426 2023-08-25T04:49:46.424 INFO:teuthology.orchestra.run.smithi072.stdout:426.out 2023-08-25T04:49:46.424 INFO:teuthology.orchestra.run.smithi072.stdout:427 2023-08-25T04:49:46.424 INFO:teuthology.orchestra.run.smithi072.stdout:427.out 2023-08-25T04:49:46.424 INFO:teuthology.orchestra.run.smithi072.stdout:428 2023-08-25T04:49:46.424 INFO:teuthology.orchestra.run.smithi072.stdout:428.out 2023-08-25T04:49:46.424 INFO:teuthology.orchestra.run.smithi072.stdout:429 2023-08-25T04:49:46.425 INFO:teuthology.orchestra.run.smithi072.stdout:429.out 2023-08-25T04:49:46.425 INFO:teuthology.orchestra.run.smithi072.stdout:430 2023-08-25T04:49:46.425 INFO:teuthology.orchestra.run.smithi072.stdout:430.out 2023-08-25T04:49:46.425 INFO:teuthology.orchestra.run.smithi072.stdout:431 2023-08-25T04:49:46.425 INFO:teuthology.orchestra.run.smithi072.stdout:431.out 2023-08-25T04:49:46.425 INFO:teuthology.orchestra.run.smithi072.stdout:432 2023-08-25T04:49:46.425 INFO:teuthology.orchestra.run.smithi072.stdout:432.out 2023-08-25T04:49:46.425 INFO:teuthology.orchestra.run.smithi072.stdout:433 2023-08-25T04:49:46.426 INFO:teuthology.orchestra.run.smithi072.stdout:433.out 2023-08-25T04:49:46.426 INFO:teuthology.orchestra.run.smithi072.stdout:434 2023-08-25T04:49:46.426 INFO:teuthology.orchestra.run.smithi072.stdout:434.out 2023-08-25T04:49:46.426 INFO:teuthology.orchestra.run.smithi072.stdout:435 2023-08-25T04:49:46.426 INFO:teuthology.orchestra.run.smithi072.stdout:435.out 2023-08-25T04:49:46.426 INFO:teuthology.orchestra.run.smithi072.stdout:436 2023-08-25T04:49:46.426 INFO:teuthology.orchestra.run.smithi072.stdout:436.out 2023-08-25T04:49:46.426 INFO:teuthology.orchestra.run.smithi072.stdout:437 2023-08-25T04:49:46.427 INFO:teuthology.orchestra.run.smithi072.stdout:437.out 2023-08-25T04:49:46.427 INFO:teuthology.orchestra.run.smithi072.stdout:438 2023-08-25T04:49:46.427 INFO:teuthology.orchestra.run.smithi072.stdout:438.out 2023-08-25T04:49:46.427 INFO:teuthology.orchestra.run.smithi072.stdout:439 2023-08-25T04:49:46.427 INFO:teuthology.orchestra.run.smithi072.stdout:439.out 2023-08-25T04:49:46.427 INFO:teuthology.orchestra.run.smithi072.stdout:440 2023-08-25T04:49:46.427 INFO:teuthology.orchestra.run.smithi072.stdout:440.out 2023-08-25T04:49:46.427 INFO:teuthology.orchestra.run.smithi072.stdout:441 2023-08-25T04:49:46.428 INFO:teuthology.orchestra.run.smithi072.stdout:441.out 2023-08-25T04:49:46.428 INFO:teuthology.orchestra.run.smithi072.stdout:442 2023-08-25T04:49:46.428 INFO:teuthology.orchestra.run.smithi072.stdout:442.out 2023-08-25T04:49:46.428 INFO:teuthology.orchestra.run.smithi072.stdout:443 2023-08-25T04:49:46.428 INFO:teuthology.orchestra.run.smithi072.stdout:443.out 2023-08-25T04:49:46.428 INFO:teuthology.orchestra.run.smithi072.stdout:444 2023-08-25T04:49:46.428 INFO:teuthology.orchestra.run.smithi072.stdout:444.out 2023-08-25T04:49:46.429 INFO:teuthology.orchestra.run.smithi072.stdout:445 2023-08-25T04:49:46.429 INFO:teuthology.orchestra.run.smithi072.stdout:445.out 2023-08-25T04:49:46.429 INFO:teuthology.orchestra.run.smithi072.stdout:446 2023-08-25T04:49:46.429 INFO:teuthology.orchestra.run.smithi072.stdout:446.out 2023-08-25T04:49:46.429 INFO:teuthology.orchestra.run.smithi072.stdout:447 2023-08-25T04:49:46.429 INFO:teuthology.orchestra.run.smithi072.stdout:447.out 2023-08-25T04:49:46.429 INFO:teuthology.orchestra.run.smithi072.stdout:448 2023-08-25T04:49:46.429 INFO:teuthology.orchestra.run.smithi072.stdout:448.out 2023-08-25T04:49:46.430 INFO:teuthology.orchestra.run.smithi072.stdout:449 2023-08-25T04:49:46.430 INFO:teuthology.orchestra.run.smithi072.stdout:449.out 2023-08-25T04:49:46.430 INFO:teuthology.orchestra.run.smithi072.stdout:450 2023-08-25T04:49:46.430 INFO:teuthology.orchestra.run.smithi072.stdout:450.out 2023-08-25T04:49:46.430 INFO:teuthology.orchestra.run.smithi072.stdout:451 2023-08-25T04:49:46.430 INFO:teuthology.orchestra.run.smithi072.stdout:451.out 2023-08-25T04:49:46.430 INFO:teuthology.orchestra.run.smithi072.stdout:452 2023-08-25T04:49:46.430 INFO:teuthology.orchestra.run.smithi072.stdout:452.out 2023-08-25T04:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout:453 2023-08-25T04:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout:453.out 2023-08-25T04:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout:454 2023-08-25T04:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout:454.out 2023-08-25T04:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout:455 2023-08-25T04:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout:455.out 2023-08-25T04:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout:456 2023-08-25T04:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout:456.out 2023-08-25T04:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout:457 2023-08-25T04:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout:457.out 2023-08-25T04:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout:458 2023-08-25T04:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout:458.out 2023-08-25T04:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout:459 2023-08-25T04:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout:459.out 2023-08-25T04:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout:460 2023-08-25T04:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout:460.out 2023-08-25T04:49:46.433 INFO:teuthology.orchestra.run.smithi072.stdout:461 2023-08-25T04:49:46.433 INFO:teuthology.orchestra.run.smithi072.stdout:461.out 2023-08-25T04:49:46.433 INFO:teuthology.orchestra.run.smithi072.stdout:462 2023-08-25T04:49:46.433 INFO:teuthology.orchestra.run.smithi072.stdout:462.out 2023-08-25T04:49:46.433 INFO:teuthology.orchestra.run.smithi072.stdout:463 2023-08-25T04:49:46.433 INFO:teuthology.orchestra.run.smithi072.stdout:463.out 2023-08-25T04:49:46.434 INFO:teuthology.orchestra.run.smithi072.stdout:464 2023-08-25T04:49:46.434 INFO:teuthology.orchestra.run.smithi072.stdout:464.out 2023-08-25T04:49:46.434 INFO:teuthology.orchestra.run.smithi072.stdout:465 2023-08-25T04:49:46.434 INFO:teuthology.orchestra.run.smithi072.stdout:465.out 2023-08-25T04:49:46.434 INFO:teuthology.orchestra.run.smithi072.stdout:466 2023-08-25T04:49:46.434 INFO:teuthology.orchestra.run.smithi072.stdout:466.out 2023-08-25T04:49:46.435 INFO:teuthology.orchestra.run.smithi072.stdout:467 2023-08-25T04:49:46.435 INFO:teuthology.orchestra.run.smithi072.stdout:467.out 2023-08-25T04:49:46.435 INFO:teuthology.orchestra.run.smithi072.stdout:468 2023-08-25T04:49:46.435 INFO:teuthology.orchestra.run.smithi072.stdout:468.out 2023-08-25T04:49:46.436 INFO:teuthology.orchestra.run.smithi072.stdout:469 2023-08-25T04:49:46.436 INFO:teuthology.orchestra.run.smithi072.stdout:469.out 2023-08-25T04:49:46.436 INFO:teuthology.orchestra.run.smithi072.stdout:470 2023-08-25T04:49:46.436 INFO:teuthology.orchestra.run.smithi072.stdout:470.out 2023-08-25T04:49:46.437 INFO:teuthology.orchestra.run.smithi072.stdout:471 2023-08-25T04:49:46.437 INFO:teuthology.orchestra.run.smithi072.stdout:471.out 2023-08-25T04:49:46.437 INFO:teuthology.orchestra.run.smithi072.stdout:472 2023-08-25T04:49:46.437 INFO:teuthology.orchestra.run.smithi072.stdout:472.out 2023-08-25T04:49:46.438 INFO:teuthology.orchestra.run.smithi072.stdout:473 2023-08-25T04:49:46.438 INFO:teuthology.orchestra.run.smithi072.stdout:473.out 2023-08-25T04:49:46.438 INFO:teuthology.orchestra.run.smithi072.stdout:474 2023-08-25T04:49:46.438 INFO:teuthology.orchestra.run.smithi072.stdout:474.out 2023-08-25T04:49:46.438 INFO:teuthology.orchestra.run.smithi072.stdout:475 2023-08-25T04:49:46.439 INFO:teuthology.orchestra.run.smithi072.stdout:475.out 2023-08-25T04:49:46.439 INFO:teuthology.orchestra.run.smithi072.stdout:476 2023-08-25T04:49:46.439 INFO:teuthology.orchestra.run.smithi072.stdout:476.out 2023-08-25T04:49:46.439 INFO:teuthology.orchestra.run.smithi072.stdout:477 2023-08-25T04:49:46.439 INFO:teuthology.orchestra.run.smithi072.stdout:477.out 2023-08-25T04:49:46.439 INFO:teuthology.orchestra.run.smithi072.stdout:478 2023-08-25T04:49:46.439 INFO:teuthology.orchestra.run.smithi072.stdout:478.out 2023-08-25T04:49:46.440 INFO:teuthology.orchestra.run.smithi072.stdout:479 2023-08-25T04:49:46.440 INFO:teuthology.orchestra.run.smithi072.stdout:479.out 2023-08-25T04:49:46.440 INFO:teuthology.orchestra.run.smithi072.stdout:480 2023-08-25T04:49:46.440 INFO:teuthology.orchestra.run.smithi072.stdout:480.out 2023-08-25T04:49:46.440 INFO:teuthology.orchestra.run.smithi072.stdout:481 2023-08-25T04:49:46.440 INFO:teuthology.orchestra.run.smithi072.stdout:481.out 2023-08-25T04:49:46.441 INFO:teuthology.orchestra.run.smithi072.stdout:482 2023-08-25T04:49:46.441 INFO:teuthology.orchestra.run.smithi072.stdout:482.out 2023-08-25T04:49:46.441 INFO:teuthology.orchestra.run.smithi072.stdout:483 2023-08-25T04:49:46.441 INFO:teuthology.orchestra.run.smithi072.stdout:483.out 2023-08-25T04:49:46.441 INFO:teuthology.orchestra.run.smithi072.stdout:484 2023-08-25T04:49:46.441 INFO:teuthology.orchestra.run.smithi072.stdout:484.out 2023-08-25T04:49:46.441 INFO:teuthology.orchestra.run.smithi072.stdout:485 2023-08-25T04:49:46.441 INFO:teuthology.orchestra.run.smithi072.stdout:485.out 2023-08-25T04:49:46.442 INFO:teuthology.orchestra.run.smithi072.stdout:486 2023-08-25T04:49:46.442 INFO:teuthology.orchestra.run.smithi072.stdout:486.out 2023-08-25T04:49:46.442 INFO:teuthology.orchestra.run.smithi072.stdout:487 2023-08-25T04:49:46.442 INFO:teuthology.orchestra.run.smithi072.stdout:487.out 2023-08-25T04:49:46.442 INFO:teuthology.orchestra.run.smithi072.stdout:488 2023-08-25T04:49:46.442 INFO:teuthology.orchestra.run.smithi072.stdout:488.out 2023-08-25T04:49:46.442 INFO:teuthology.orchestra.run.smithi072.stdout:489 2023-08-25T04:49:46.442 INFO:teuthology.orchestra.run.smithi072.stdout:489.out 2023-08-25T04:49:46.443 INFO:teuthology.orchestra.run.smithi072.stdout:490 2023-08-25T04:49:46.443 INFO:teuthology.orchestra.run.smithi072.stdout:490.out 2023-08-25T04:49:46.443 INFO:teuthology.orchestra.run.smithi072.stdout:491 2023-08-25T04:49:46.443 INFO:teuthology.orchestra.run.smithi072.stdout:491.out 2023-08-25T04:49:46.443 INFO:teuthology.orchestra.run.smithi072.stdout:492 2023-08-25T04:49:46.443 INFO:teuthology.orchestra.run.smithi072.stdout:492.out 2023-08-25T04:49:46.443 INFO:teuthology.orchestra.run.smithi072.stdout:493 2023-08-25T04:49:46.443 INFO:teuthology.orchestra.run.smithi072.stdout:493.out 2023-08-25T04:49:46.444 INFO:teuthology.orchestra.run.smithi072.stdout:494 2023-08-25T04:49:46.444 INFO:teuthology.orchestra.run.smithi072.stdout:494.out 2023-08-25T04:49:46.444 INFO:teuthology.orchestra.run.smithi072.stdout:495 2023-08-25T04:49:46.444 INFO:teuthology.orchestra.run.smithi072.stdout:495.out 2023-08-25T04:49:46.444 INFO:teuthology.orchestra.run.smithi072.stdout:496 2023-08-25T04:49:46.444 INFO:teuthology.orchestra.run.smithi072.stdout:496.out 2023-08-25T04:49:46.444 INFO:teuthology.orchestra.run.smithi072.stdout:497 2023-08-25T04:49:46.445 INFO:teuthology.orchestra.run.smithi072.stdout:497.out 2023-08-25T04:49:46.445 INFO:teuthology.orchestra.run.smithi072.stdout:498 2023-08-25T04:49:46.445 INFO:teuthology.orchestra.run.smithi072.stdout:498.out 2023-08-25T04:49:46.445 INFO:teuthology.orchestra.run.smithi072.stdout:499 2023-08-25T04:49:46.445 INFO:teuthology.orchestra.run.smithi072.stdout:499.out 2023-08-25T04:49:46.445 INFO:teuthology.orchestra.run.smithi072.stdout:500 2023-08-25T04:49:46.445 INFO:teuthology.orchestra.run.smithi072.stdout:500.out 2023-08-25T04:49:46.445 INFO:teuthology.orchestra.run.smithi072.stdout:501 2023-08-25T04:49:46.446 INFO:teuthology.orchestra.run.smithi072.stdout:501.out 2023-08-25T04:49:46.446 INFO:teuthology.orchestra.run.smithi072.stdout:502 2023-08-25T04:49:46.446 INFO:teuthology.orchestra.run.smithi072.stdout:502.out 2023-08-25T04:49:46.446 INFO:teuthology.orchestra.run.smithi072.stdout:503 2023-08-25T04:49:46.446 INFO:teuthology.orchestra.run.smithi072.stdout:503.out 2023-08-25T04:49:46.446 INFO:teuthology.orchestra.run.smithi072.stdout:504 2023-08-25T04:49:46.446 INFO:teuthology.orchestra.run.smithi072.stdout:504.out 2023-08-25T04:49:46.446 INFO:teuthology.orchestra.run.smithi072.stdout:505 2023-08-25T04:49:46.447 INFO:teuthology.orchestra.run.smithi072.stdout:505.out 2023-08-25T04:49:46.447 INFO:teuthology.orchestra.run.smithi072.stdout:506 2023-08-25T04:49:46.447 INFO:teuthology.orchestra.run.smithi072.stdout:506.out 2023-08-25T04:49:46.447 INFO:teuthology.orchestra.run.smithi072.stdout:507 2023-08-25T04:49:46.447 INFO:teuthology.orchestra.run.smithi072.stdout:507.out 2023-08-25T04:49:46.447 INFO:teuthology.orchestra.run.smithi072.stdout:508 2023-08-25T04:49:46.447 INFO:teuthology.orchestra.run.smithi072.stdout:508.out 2023-08-25T04:49:46.447 INFO:teuthology.orchestra.run.smithi072.stdout:509 2023-08-25T04:49:46.448 INFO:teuthology.orchestra.run.smithi072.stdout:509.out 2023-08-25T04:49:46.448 INFO:teuthology.orchestra.run.smithi072.stdout:510 2023-08-25T04:49:46.448 INFO:teuthology.orchestra.run.smithi072.stdout:510.out 2023-08-25T04:49:46.448 INFO:teuthology.orchestra.run.smithi072.stdout:511 2023-08-25T04:49:46.448 INFO:teuthology.orchestra.run.smithi072.stdout:511.out 2023-08-25T04:49:46.448 INFO:teuthology.orchestra.run.smithi072.stdout:512 2023-08-25T04:49:46.448 INFO:teuthology.orchestra.run.smithi072.stdout:512.out 2023-08-25T04:49:46.448 INFO:teuthology.orchestra.run.smithi072.stdout:513 2023-08-25T04:49:46.449 INFO:teuthology.orchestra.run.smithi072.stdout:513.out 2023-08-25T04:49:46.449 INFO:teuthology.orchestra.run.smithi072.stdout:514 2023-08-25T04:49:46.449 INFO:teuthology.orchestra.run.smithi072.stdout:514.out 2023-08-25T04:49:46.449 INFO:teuthology.orchestra.run.smithi072.stdout:515 2023-08-25T04:49:46.449 INFO:teuthology.orchestra.run.smithi072.stdout:515.out 2023-08-25T04:49:46.449 INFO:teuthology.orchestra.run.smithi072.stdout:516 2023-08-25T04:49:46.449 INFO:teuthology.orchestra.run.smithi072.stdout:516.out 2023-08-25T04:49:46.450 INFO:teuthology.orchestra.run.smithi072.stdout:517 2023-08-25T04:49:46.450 INFO:teuthology.orchestra.run.smithi072.stdout:517.out 2023-08-25T04:49:46.450 INFO:teuthology.orchestra.run.smithi072.stdout:518 2023-08-25T04:49:46.450 INFO:teuthology.orchestra.run.smithi072.stdout:518.out 2023-08-25T04:49:46.450 INFO:teuthology.orchestra.run.smithi072.stdout:519 2023-08-25T04:49:46.450 INFO:teuthology.orchestra.run.smithi072.stdout:519.out 2023-08-25T04:49:46.450 INFO:teuthology.orchestra.run.smithi072.stdout:520 2023-08-25T04:49:46.450 INFO:teuthology.orchestra.run.smithi072.stdout:520.out 2023-08-25T04:49:46.451 INFO:teuthology.orchestra.run.smithi072.stdout:521 2023-08-25T04:49:46.451 INFO:teuthology.orchestra.run.smithi072.stdout:521.out 2023-08-25T04:49:46.451 INFO:teuthology.orchestra.run.smithi072.stdout:522 2023-08-25T04:49:46.451 INFO:teuthology.orchestra.run.smithi072.stdout:522.out 2023-08-25T04:49:46.451 INFO:teuthology.orchestra.run.smithi072.stdout:523 2023-08-25T04:49:46.451 INFO:teuthology.orchestra.run.smithi072.stdout:523.out 2023-08-25T04:49:46.451 INFO:teuthology.orchestra.run.smithi072.stdout:524 2023-08-25T04:49:46.451 INFO:teuthology.orchestra.run.smithi072.stdout:524.out 2023-08-25T04:49:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:525 2023-08-25T04:49:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:525.out 2023-08-25T04:49:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:526 2023-08-25T04:49:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:526.out 2023-08-25T04:49:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:527 2023-08-25T04:49:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:527.out 2023-08-25T04:49:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:528 2023-08-25T04:49:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:528.out 2023-08-25T04:49:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:529 2023-08-25T04:49:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:529.out 2023-08-25T04:49:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:530 2023-08-25T04:49:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:530.out 2023-08-25T04:49:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:531 2023-08-25T04:49:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:531.out 2023-08-25T04:49:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:532 2023-08-25T04:49:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:532.out 2023-08-25T04:49:46.454 INFO:teuthology.orchestra.run.smithi072.stdout:533 2023-08-25T04:49:46.454 INFO:teuthology.orchestra.run.smithi072.stdout:533.out 2023-08-25T04:49:46.454 INFO:teuthology.orchestra.run.smithi072.stdout:534 2023-08-25T04:49:46.454 INFO:teuthology.orchestra.run.smithi072.stdout:534.out 2023-08-25T04:49:46.454 INFO:teuthology.orchestra.run.smithi072.stdout:535 2023-08-25T04:49:46.454 INFO:teuthology.orchestra.run.smithi072.stdout:535.out 2023-08-25T04:49:46.455 INFO:teuthology.orchestra.run.smithi072.stdout:536 2023-08-25T04:49:46.455 INFO:teuthology.orchestra.run.smithi072.stdout:536.out 2023-08-25T04:49:46.455 INFO:teuthology.orchestra.run.smithi072.stdout:537 2023-08-25T04:49:46.455 INFO:teuthology.orchestra.run.smithi072.stdout:537.out 2023-08-25T04:49:46.455 INFO:teuthology.orchestra.run.smithi072.stdout:538 2023-08-25T04:49:46.455 INFO:teuthology.orchestra.run.smithi072.stdout:538.out 2023-08-25T04:49:46.455 INFO:teuthology.orchestra.run.smithi072.stdout:539 2023-08-25T04:49:46.455 INFO:teuthology.orchestra.run.smithi072.stdout:539.out 2023-08-25T04:49:46.456 INFO:teuthology.orchestra.run.smithi072.stdout:540 2023-08-25T04:49:46.456 INFO:teuthology.orchestra.run.smithi072.stdout:540.out 2023-08-25T04:49:46.456 INFO:teuthology.orchestra.run.smithi072.stdout:541 2023-08-25T04:49:46.456 INFO:teuthology.orchestra.run.smithi072.stdout:541.out 2023-08-25T04:49:46.456 INFO:teuthology.orchestra.run.smithi072.stdout:542 2023-08-25T04:49:46.456 INFO:teuthology.orchestra.run.smithi072.stdout:542.out 2023-08-25T04:49:46.456 INFO:teuthology.orchestra.run.smithi072.stdout:543 2023-08-25T04:49:46.456 INFO:teuthology.orchestra.run.smithi072.stdout:543.out 2023-08-25T04:49:46.457 INFO:teuthology.orchestra.run.smithi072.stdout:544 2023-08-25T04:49:46.457 INFO:teuthology.orchestra.run.smithi072.stdout:544.out 2023-08-25T04:49:46.457 INFO:teuthology.orchestra.run.smithi072.stdout:545 2023-08-25T04:49:46.457 INFO:teuthology.orchestra.run.smithi072.stdout:545.out 2023-08-25T04:49:46.457 INFO:teuthology.orchestra.run.smithi072.stdout:546 2023-08-25T04:49:46.457 INFO:teuthology.orchestra.run.smithi072.stdout:546.out 2023-08-25T04:49:46.457 INFO:teuthology.orchestra.run.smithi072.stdout:547 2023-08-25T04:49:46.457 INFO:teuthology.orchestra.run.smithi072.stdout:547.out 2023-08-25T04:49:46.458 INFO:teuthology.orchestra.run.smithi072.stdout:548 2023-08-25T04:49:46.458 INFO:teuthology.orchestra.run.smithi072.stdout:548.out 2023-08-25T04:49:46.458 INFO:teuthology.orchestra.run.smithi072.stdout:549 2023-08-25T04:49:46.458 INFO:teuthology.orchestra.run.smithi072.stdout:549.out 2023-08-25T04:49:46.458 INFO:teuthology.orchestra.run.smithi072.stdout:550 2023-08-25T04:49:46.458 INFO:teuthology.orchestra.run.smithi072.stdout:550.out 2023-08-25T04:49:46.458 INFO:teuthology.orchestra.run.smithi072.stdout:551 2023-08-25T04:49:46.458 INFO:teuthology.orchestra.run.smithi072.stdout:551.out 2023-08-25T04:49:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:552 2023-08-25T04:49:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:552.out 2023-08-25T04:49:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:553 2023-08-25T04:49:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:553.out 2023-08-25T04:49:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:554 2023-08-25T04:49:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:554.out 2023-08-25T04:49:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:555 2023-08-25T04:49:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:555.out 2023-08-25T04:49:46.460 INFO:teuthology.orchestra.run.smithi072.stdout:556 2023-08-25T04:49:46.460 INFO:teuthology.orchestra.run.smithi072.stdout:556.out 2023-08-25T04:49:46.460 INFO:teuthology.orchestra.run.smithi072.stdout:557 2023-08-25T04:49:46.460 INFO:teuthology.orchestra.run.smithi072.stdout:557.out 2023-08-25T04:49:46.460 INFO:teuthology.orchestra.run.smithi072.stdout:558 2023-08-25T04:49:46.460 INFO:teuthology.orchestra.run.smithi072.stdout:558.out 2023-08-25T04:49:46.460 INFO:teuthology.orchestra.run.smithi072.stdout:559 2023-08-25T04:49:46.460 INFO:teuthology.orchestra.run.smithi072.stdout:559.out 2023-08-25T04:49:46.461 INFO:teuthology.orchestra.run.smithi072.stdout:560 2023-08-25T04:49:46.461 INFO:teuthology.orchestra.run.smithi072.stdout:560.out 2023-08-25T04:49:46.461 INFO:teuthology.orchestra.run.smithi072.stdout:561 2023-08-25T04:49:46.461 INFO:teuthology.orchestra.run.smithi072.stdout:561.out 2023-08-25T04:49:46.461 INFO:teuthology.orchestra.run.smithi072.stdout:562 2023-08-25T04:49:46.461 INFO:teuthology.orchestra.run.smithi072.stdout:562.out 2023-08-25T04:49:46.461 INFO:teuthology.orchestra.run.smithi072.stdout:563 2023-08-25T04:49:46.462 INFO:teuthology.orchestra.run.smithi072.stdout:563.out 2023-08-25T04:49:46.462 INFO:teuthology.orchestra.run.smithi072.stdout:564 2023-08-25T04:49:46.462 INFO:teuthology.orchestra.run.smithi072.stdout:564.out 2023-08-25T04:49:46.462 INFO:teuthology.orchestra.run.smithi072.stdout:565 2023-08-25T04:49:46.462 INFO:teuthology.orchestra.run.smithi072.stdout:565.out 2023-08-25T04:49:46.462 INFO:teuthology.orchestra.run.smithi072.stdout:566 2023-08-25T04:49:46.462 INFO:teuthology.orchestra.run.smithi072.stdout:566.out 2023-08-25T04:49:46.462 INFO:teuthology.orchestra.run.smithi072.stdout:567 2023-08-25T04:49:46.463 INFO:teuthology.orchestra.run.smithi072.stdout:567.out 2023-08-25T04:49:46.463 INFO:teuthology.orchestra.run.smithi072.stdout:568 2023-08-25T04:49:46.463 INFO:teuthology.orchestra.run.smithi072.stdout:568.out 2023-08-25T04:49:46.463 INFO:teuthology.orchestra.run.smithi072.stdout:569 2023-08-25T04:49:46.463 INFO:teuthology.orchestra.run.smithi072.stdout:569.out 2023-08-25T04:49:46.463 INFO:teuthology.orchestra.run.smithi072.stdout:570 2023-08-25T04:49:46.463 INFO:teuthology.orchestra.run.smithi072.stdout:570.out 2023-08-25T04:49:46.463 INFO:teuthology.orchestra.run.smithi072.stdout:571 2023-08-25T04:49:46.464 INFO:teuthology.orchestra.run.smithi072.stdout:571.out 2023-08-25T04:49:46.464 INFO:teuthology.orchestra.run.smithi072.stdout:572 2023-08-25T04:49:46.464 INFO:teuthology.orchestra.run.smithi072.stdout:572.out 2023-08-25T04:49:46.464 INFO:teuthology.orchestra.run.smithi072.stdout:573 2023-08-25T04:49:46.464 INFO:teuthology.orchestra.run.smithi072.stdout:573.out 2023-08-25T04:49:46.464 INFO:teuthology.orchestra.run.smithi072.stdout:574 2023-08-25T04:49:46.464 INFO:teuthology.orchestra.run.smithi072.stdout:574.out 2023-08-25T04:49:46.464 INFO:teuthology.orchestra.run.smithi072.stdout:575 2023-08-25T04:49:46.465 INFO:teuthology.orchestra.run.smithi072.stdout:575.out 2023-08-25T04:49:46.465 INFO:teuthology.orchestra.run.smithi072.stdout:576 2023-08-25T04:49:46.465 INFO:teuthology.orchestra.run.smithi072.stdout:576.out 2023-08-25T04:49:46.465 INFO:teuthology.orchestra.run.smithi072.stdout:577 2023-08-25T04:49:46.465 INFO:teuthology.orchestra.run.smithi072.stdout:577.out 2023-08-25T04:49:46.465 INFO:teuthology.orchestra.run.smithi072.stdout:578 2023-08-25T04:49:46.465 INFO:teuthology.orchestra.run.smithi072.stdout:578.out 2023-08-25T04:49:46.465 INFO:teuthology.orchestra.run.smithi072.stdout:579 2023-08-25T04:49:46.466 INFO:teuthology.orchestra.run.smithi072.stdout:579.out 2023-08-25T04:49:46.466 INFO:teuthology.orchestra.run.smithi072.stdout:580 2023-08-25T04:49:46.466 INFO:teuthology.orchestra.run.smithi072.stdout:580.out 2023-08-25T04:49:46.466 INFO:teuthology.orchestra.run.smithi072.stdout:581 2023-08-25T04:49:46.466 INFO:teuthology.orchestra.run.smithi072.stdout:581.out 2023-08-25T04:49:46.466 INFO:teuthology.orchestra.run.smithi072.stdout:582 2023-08-25T04:49:46.466 INFO:teuthology.orchestra.run.smithi072.stdout:582.out 2023-08-25T04:49:46.466 INFO:teuthology.orchestra.run.smithi072.stdout:583 2023-08-25T04:49:46.467 INFO:teuthology.orchestra.run.smithi072.stdout:583.out 2023-08-25T04:49:46.467 INFO:teuthology.orchestra.run.smithi072.stdout:584 2023-08-25T04:49:46.467 INFO:teuthology.orchestra.run.smithi072.stdout:584.out 2023-08-25T04:49:46.467 INFO:teuthology.orchestra.run.smithi072.stdout:585 2023-08-25T04:49:46.467 INFO:teuthology.orchestra.run.smithi072.stdout:585.out 2023-08-25T04:49:46.467 INFO:teuthology.orchestra.run.smithi072.stdout:586 2023-08-25T04:49:46.467 INFO:teuthology.orchestra.run.smithi072.stdout:586.out 2023-08-25T04:49:46.467 INFO:teuthology.orchestra.run.smithi072.stdout:587 2023-08-25T04:49:46.468 INFO:teuthology.orchestra.run.smithi072.stdout:587.out 2023-08-25T04:49:46.468 INFO:teuthology.orchestra.run.smithi072.stdout:588 2023-08-25T04:49:46.468 INFO:teuthology.orchestra.run.smithi072.stdout:588.out 2023-08-25T04:49:46.468 INFO:teuthology.orchestra.run.smithi072.stdout:589 2023-08-25T04:49:46.468 INFO:teuthology.orchestra.run.smithi072.stdout:589.out 2023-08-25T04:49:46.468 INFO:teuthology.orchestra.run.smithi072.stdout:590 2023-08-25T04:49:46.468 INFO:teuthology.orchestra.run.smithi072.stdout:590.out 2023-08-25T04:49:46.468 INFO:teuthology.orchestra.run.smithi072.stdout:591 2023-08-25T04:49:46.469 INFO:teuthology.orchestra.run.smithi072.stdout:591.out 2023-08-25T04:49:46.469 INFO:teuthology.orchestra.run.smithi072.stdout:592 2023-08-25T04:49:46.469 INFO:teuthology.orchestra.run.smithi072.stdout:592.out 2023-08-25T04:49:46.469 INFO:teuthology.orchestra.run.smithi072.stdout:593 2023-08-25T04:49:46.469 INFO:teuthology.orchestra.run.smithi072.stdout:593.out 2023-08-25T04:49:46.469 INFO:teuthology.orchestra.run.smithi072.stdout:594 2023-08-25T04:49:46.469 INFO:teuthology.orchestra.run.smithi072.stdout:594.out 2023-08-25T04:49:46.469 INFO:teuthology.orchestra.run.smithi072.stdout:595 2023-08-25T04:49:46.470 INFO:teuthology.orchestra.run.smithi072.stdout:595.out 2023-08-25T04:49:46.470 INFO:teuthology.orchestra.run.smithi072.stdout:596 2023-08-25T04:49:46.470 INFO:teuthology.orchestra.run.smithi072.stdout:596.out 2023-08-25T04:49:46.470 INFO:teuthology.orchestra.run.smithi072.stdout:597 2023-08-25T04:49:46.470 INFO:teuthology.orchestra.run.smithi072.stdout:597.out 2023-08-25T04:49:46.470 INFO:teuthology.orchestra.run.smithi072.stdout:598 2023-08-25T04:49:46.470 INFO:teuthology.orchestra.run.smithi072.stdout:598.out 2023-08-25T04:49:46.471 INFO:teuthology.orchestra.run.smithi072.stdout:599 2023-08-25T04:49:46.471 INFO:teuthology.orchestra.run.smithi072.stdout:599.out 2023-08-25T04:49:46.471 INFO:teuthology.orchestra.run.smithi072.stdout:600 2023-08-25T04:49:46.471 INFO:teuthology.orchestra.run.smithi072.stdout:600.out 2023-08-25T04:49:46.471 INFO:teuthology.orchestra.run.smithi072.stdout:601 2023-08-25T04:49:46.471 INFO:teuthology.orchestra.run.smithi072.stdout:601.out 2023-08-25T04:49:46.471 INFO:teuthology.orchestra.run.smithi072.stdout:602 2023-08-25T04:49:46.472 INFO:teuthology.orchestra.run.smithi072.stdout:602.out 2023-08-25T04:49:46.472 INFO:teuthology.orchestra.run.smithi072.stdout:603 2023-08-25T04:49:46.472 INFO:teuthology.orchestra.run.smithi072.stdout:603.out 2023-08-25T04:49:46.472 INFO:teuthology.orchestra.run.smithi072.stdout:604 2023-08-25T04:49:46.472 INFO:teuthology.orchestra.run.smithi072.stdout:604.out 2023-08-25T04:49:46.473 INFO:teuthology.orchestra.run.smithi072.stdout:605 2023-08-25T04:49:46.473 INFO:teuthology.orchestra.run.smithi072.stdout:605.out 2023-08-25T04:49:46.473 INFO:teuthology.orchestra.run.smithi072.stdout:606 2023-08-25T04:49:46.473 INFO:teuthology.orchestra.run.smithi072.stdout:606.out 2023-08-25T04:49:46.474 INFO:teuthology.orchestra.run.smithi072.stdout:607 2023-08-25T04:49:46.474 INFO:teuthology.orchestra.run.smithi072.stdout:607.out 2023-08-25T04:49:46.474 INFO:teuthology.orchestra.run.smithi072.stdout:608 2023-08-25T04:49:46.474 INFO:teuthology.orchestra.run.smithi072.stdout:608.out 2023-08-25T04:49:46.475 INFO:teuthology.orchestra.run.smithi072.stdout:609 2023-08-25T04:49:46.475 INFO:teuthology.orchestra.run.smithi072.stdout:609.out 2023-08-25T04:49:46.475 INFO:teuthology.orchestra.run.smithi072.stdout:610 2023-08-25T04:49:46.475 INFO:teuthology.orchestra.run.smithi072.stdout:610.out 2023-08-25T04:49:46.476 INFO:teuthology.orchestra.run.smithi072.stdout:611 2023-08-25T04:49:46.476 INFO:teuthology.orchestra.run.smithi072.stdout:611.out 2023-08-25T04:49:46.476 INFO:teuthology.orchestra.run.smithi072.stdout:612 2023-08-25T04:49:46.477 INFO:teuthology.orchestra.run.smithi072.stdout:612.out 2023-08-25T04:49:46.477 INFO:teuthology.orchestra.run.smithi072.stdout:613 2023-08-25T04:49:46.477 INFO:teuthology.orchestra.run.smithi072.stdout:613.out 2023-08-25T04:49:46.477 INFO:teuthology.orchestra.run.smithi072.stdout:614 2023-08-25T04:49:46.478 INFO:teuthology.orchestra.run.smithi072.stdout:614.out 2023-08-25T04:49:46.478 INFO:teuthology.orchestra.run.smithi072.stdout:615 2023-08-25T04:49:46.478 INFO:teuthology.orchestra.run.smithi072.stdout:615.out 2023-08-25T04:49:46.478 INFO:teuthology.orchestra.run.smithi072.stdout:616 2023-08-25T04:49:46.479 INFO:teuthology.orchestra.run.smithi072.stdout:616.out 2023-08-25T04:49:46.479 INFO:teuthology.orchestra.run.smithi072.stdout:617 2023-08-25T04:49:46.479 INFO:teuthology.orchestra.run.smithi072.stdout:617.out 2023-08-25T04:49:46.479 INFO:teuthology.orchestra.run.smithi072.stdout:618 2023-08-25T04:49:46.480 INFO:teuthology.orchestra.run.smithi072.stdout:618.out 2023-08-25T04:49:46.480 INFO:teuthology.orchestra.run.smithi072.stdout:619 2023-08-25T04:49:46.480 INFO:teuthology.orchestra.run.smithi072.stdout:619.out 2023-08-25T04:49:46.480 INFO:teuthology.orchestra.run.smithi072.stdout:620 2023-08-25T04:49:46.481 INFO:teuthology.orchestra.run.smithi072.stdout:620.out 2023-08-25T04:49:46.481 INFO:teuthology.orchestra.run.smithi072.stdout:621 2023-08-25T04:49:46.481 INFO:teuthology.orchestra.run.smithi072.stdout:621.out 2023-08-25T04:49:46.481 INFO:teuthology.orchestra.run.smithi072.stdout:622 2023-08-25T04:49:46.482 INFO:teuthology.orchestra.run.smithi072.stdout:622.out 2023-08-25T04:49:46.482 INFO:teuthology.orchestra.run.smithi072.stdout:623 2023-08-25T04:49:46.482 INFO:teuthology.orchestra.run.smithi072.stdout:623.out 2023-08-25T04:49:46.482 INFO:teuthology.orchestra.run.smithi072.stdout:624 2023-08-25T04:49:46.483 INFO:teuthology.orchestra.run.smithi072.stdout:624.out 2023-08-25T04:49:46.483 INFO:teuthology.orchestra.run.smithi072.stdout:625 2023-08-25T04:49:46.483 INFO:teuthology.orchestra.run.smithi072.stdout:625.out 2023-08-25T04:49:46.483 INFO:teuthology.orchestra.run.smithi072.stdout:626 2023-08-25T04:49:46.484 INFO:teuthology.orchestra.run.smithi072.stdout:626.out 2023-08-25T04:49:46.484 INFO:teuthology.orchestra.run.smithi072.stdout:627 2023-08-25T04:49:46.484 INFO:teuthology.orchestra.run.smithi072.stdout:627.out 2023-08-25T04:49:46.484 INFO:teuthology.orchestra.run.smithi072.stdout:628 2023-08-25T04:49:46.485 INFO:teuthology.orchestra.run.smithi072.stdout:628.out 2023-08-25T04:49:46.485 INFO:teuthology.orchestra.run.smithi072.stdout:629 2023-08-25T04:49:46.485 INFO:teuthology.orchestra.run.smithi072.stdout:629.out 2023-08-25T04:49:46.485 INFO:teuthology.orchestra.run.smithi072.stdout:630 2023-08-25T04:49:46.486 INFO:teuthology.orchestra.run.smithi072.stdout:630.out 2023-08-25T04:49:46.486 INFO:teuthology.orchestra.run.smithi072.stdout:631 2023-08-25T04:49:46.486 INFO:teuthology.orchestra.run.smithi072.stdout:631.out 2023-08-25T04:49:46.486 INFO:teuthology.orchestra.run.smithi072.stdout:632 2023-08-25T04:49:46.487 INFO:teuthology.orchestra.run.smithi072.stdout:632.out 2023-08-25T04:49:46.487 INFO:teuthology.orchestra.run.smithi072.stdout:633 2023-08-25T04:49:46.487 INFO:teuthology.orchestra.run.smithi072.stdout:633.out 2023-08-25T04:49:46.487 INFO:teuthology.orchestra.run.smithi072.stdout:634 2023-08-25T04:49:46.488 INFO:teuthology.orchestra.run.smithi072.stdout:634.out 2023-08-25T04:49:46.488 INFO:teuthology.orchestra.run.smithi072.stdout:635 2023-08-25T04:49:46.488 INFO:teuthology.orchestra.run.smithi072.stdout:635.out 2023-08-25T04:49:46.489 INFO:teuthology.orchestra.run.smithi072.stdout:636 2023-08-25T04:49:46.489 INFO:teuthology.orchestra.run.smithi072.stdout:636.out 2023-08-25T04:49:46.489 INFO:teuthology.orchestra.run.smithi072.stdout:637 2023-08-25T04:49:46.489 INFO:teuthology.orchestra.run.smithi072.stdout:637.out 2023-08-25T04:49:46.490 INFO:teuthology.orchestra.run.smithi072.stdout:638 2023-08-25T04:49:46.490 INFO:teuthology.orchestra.run.smithi072.stdout:638.out 2023-08-25T04:49:46.490 INFO:teuthology.orchestra.run.smithi072.stdout:639 2023-08-25T04:49:46.490 INFO:teuthology.orchestra.run.smithi072.stdout:639.out 2023-08-25T04:49:46.491 INFO:teuthology.orchestra.run.smithi072.stdout:640 2023-08-25T04:49:46.491 INFO:teuthology.orchestra.run.smithi072.stdout:640.out 2023-08-25T04:49:46.491 INFO:teuthology.orchestra.run.smithi072.stdout:641 2023-08-25T04:49:46.491 INFO:teuthology.orchestra.run.smithi072.stdout:641.out 2023-08-25T04:49:46.491 INFO:teuthology.orchestra.run.smithi072.stdout:642 2023-08-25T04:49:46.492 INFO:teuthology.orchestra.run.smithi072.stdout:642.out 2023-08-25T04:49:46.492 INFO:teuthology.orchestra.run.smithi072.stdout:643 2023-08-25T04:49:46.492 INFO:teuthology.orchestra.run.smithi072.stdout:643.out 2023-08-25T04:49:46.492 INFO:teuthology.orchestra.run.smithi072.stdout:644 2023-08-25T04:49:46.493 INFO:teuthology.orchestra.run.smithi072.stdout:644.out 2023-08-25T04:49:46.493 INFO:teuthology.orchestra.run.smithi072.stdout:645 2023-08-25T04:49:46.493 INFO:teuthology.orchestra.run.smithi072.stdout:645.out 2023-08-25T04:49:46.493 INFO:teuthology.orchestra.run.smithi072.stdout:646 2023-08-25T04:49:46.493 INFO:teuthology.orchestra.run.smithi072.stdout:646.out 2023-08-25T04:49:46.493 INFO:teuthology.orchestra.run.smithi072.stdout:647 2023-08-25T04:49:46.493 INFO:teuthology.orchestra.run.smithi072.stdout:647.out 2023-08-25T04:49:46.494 INFO:teuthology.orchestra.run.smithi072.stdout:648 2023-08-25T04:49:46.494 INFO:teuthology.orchestra.run.smithi072.stdout:648.out 2023-08-25T04:49:46.494 INFO:teuthology.orchestra.run.smithi072.stdout:649 2023-08-25T04:49:46.494 INFO:teuthology.orchestra.run.smithi072.stdout:649.out 2023-08-25T04:49:46.494 INFO:teuthology.orchestra.run.smithi072.stdout:650 2023-08-25T04:49:46.494 INFO:teuthology.orchestra.run.smithi072.stdout:650.out 2023-08-25T04:49:46.494 INFO:teuthology.orchestra.run.smithi072.stdout:651 2023-08-25T04:49:46.494 INFO:teuthology.orchestra.run.smithi072.stdout:651.out 2023-08-25T04:49:46.495 INFO:teuthology.orchestra.run.smithi072.stdout:652 2023-08-25T04:49:46.495 INFO:teuthology.orchestra.run.smithi072.stdout:652.out 2023-08-25T04:49:46.495 INFO:teuthology.orchestra.run.smithi072.stdout:653 2023-08-25T04:49:46.495 INFO:teuthology.orchestra.run.smithi072.stdout:653.out 2023-08-25T04:49:46.495 INFO:teuthology.orchestra.run.smithi072.stdout:654 2023-08-25T04:49:46.495 INFO:teuthology.orchestra.run.smithi072.stdout:654.out 2023-08-25T04:49:46.495 INFO:teuthology.orchestra.run.smithi072.stdout:655 2023-08-25T04:49:46.495 INFO:teuthology.orchestra.run.smithi072.stdout:655.out 2023-08-25T04:49:46.496 INFO:teuthology.orchestra.run.smithi072.stdout:656 2023-08-25T04:49:46.496 INFO:teuthology.orchestra.run.smithi072.stdout:656.out 2023-08-25T04:49:46.496 INFO:teuthology.orchestra.run.smithi072.stdout:657 2023-08-25T04:49:46.496 INFO:teuthology.orchestra.run.smithi072.stdout:657.out 2023-08-25T04:49:46.496 INFO:teuthology.orchestra.run.smithi072.stdout:658 2023-08-25T04:49:46.496 INFO:teuthology.orchestra.run.smithi072.stdout:658.out 2023-08-25T04:49:46.496 INFO:teuthology.orchestra.run.smithi072.stdout:659 2023-08-25T04:49:46.496 INFO:teuthology.orchestra.run.smithi072.stdout:659.out 2023-08-25T04:49:46.497 INFO:teuthology.orchestra.run.smithi072.stdout:660 2023-08-25T04:49:46.497 INFO:teuthology.orchestra.run.smithi072.stdout:660.out 2023-08-25T04:49:46.497 INFO:teuthology.orchestra.run.smithi072.stdout:661 2023-08-25T04:49:46.497 INFO:teuthology.orchestra.run.smithi072.stdout:661.out 2023-08-25T04:49:46.497 INFO:teuthology.orchestra.run.smithi072.stdout:662 2023-08-25T04:49:46.497 INFO:teuthology.orchestra.run.smithi072.stdout:662.out 2023-08-25T04:49:46.497 INFO:teuthology.orchestra.run.smithi072.stdout:663 2023-08-25T04:49:46.497 INFO:teuthology.orchestra.run.smithi072.stdout:663.out 2023-08-25T04:49:46.498 INFO:teuthology.orchestra.run.smithi072.stdout:664 2023-08-25T04:49:46.498 INFO:teuthology.orchestra.run.smithi072.stdout:664.out 2023-08-25T04:49:46.498 INFO:teuthology.orchestra.run.smithi072.stdout:665 2023-08-25T04:49:46.498 INFO:teuthology.orchestra.run.smithi072.stdout:665.out 2023-08-25T04:49:46.498 INFO:teuthology.orchestra.run.smithi072.stdout:666 2023-08-25T04:49:46.498 INFO:teuthology.orchestra.run.smithi072.stdout:666.out 2023-08-25T04:49:46.498 INFO:teuthology.orchestra.run.smithi072.stdout:667 2023-08-25T04:49:46.498 INFO:teuthology.orchestra.run.smithi072.stdout:667.out 2023-08-25T04:49:46.499 INFO:teuthology.orchestra.run.smithi072.stdout:668 2023-08-25T04:49:46.499 INFO:teuthology.orchestra.run.smithi072.stdout:668.out 2023-08-25T04:49:46.499 INFO:teuthology.orchestra.run.smithi072.stdout:669 2023-08-25T04:49:46.499 INFO:teuthology.orchestra.run.smithi072.stdout:669.out 2023-08-25T04:49:46.499 INFO:teuthology.orchestra.run.smithi072.stdout:670 2023-08-25T04:49:46.499 INFO:teuthology.orchestra.run.smithi072.stdout:670.out 2023-08-25T04:49:46.499 INFO:teuthology.orchestra.run.smithi072.stdout:671 2023-08-25T04:49:46.499 INFO:teuthology.orchestra.run.smithi072.stdout:671.out 2023-08-25T04:49:46.500 INFO:teuthology.orchestra.run.smithi072.stdout:672 2023-08-25T04:49:46.500 INFO:teuthology.orchestra.run.smithi072.stdout:672.out 2023-08-25T04:49:46.500 INFO:teuthology.orchestra.run.smithi072.stdout:673 2023-08-25T04:49:46.500 INFO:teuthology.orchestra.run.smithi072.stdout:673.out 2023-08-25T04:49:46.500 INFO:teuthology.orchestra.run.smithi072.stdout:674 2023-08-25T04:49:46.500 INFO:teuthology.orchestra.run.smithi072.stdout:674.out 2023-08-25T04:49:46.500 INFO:teuthology.orchestra.run.smithi072.stdout:675 2023-08-25T04:49:46.500 INFO:teuthology.orchestra.run.smithi072.stdout:675.out 2023-08-25T04:49:46.501 INFO:teuthology.orchestra.run.smithi072.stdout:676 2023-08-25T04:49:46.501 INFO:teuthology.orchestra.run.smithi072.stdout:676.out 2023-08-25T04:49:46.501 INFO:teuthology.orchestra.run.smithi072.stdout:677 2023-08-25T04:49:46.501 INFO:teuthology.orchestra.run.smithi072.stdout:677.out 2023-08-25T04:49:46.501 INFO:teuthology.orchestra.run.smithi072.stdout:678 2023-08-25T04:49:46.501 INFO:teuthology.orchestra.run.smithi072.stdout:678.out 2023-08-25T04:49:46.501 INFO:teuthology.orchestra.run.smithi072.stdout:679 2023-08-25T04:49:46.501 INFO:teuthology.orchestra.run.smithi072.stdout:679.out 2023-08-25T04:49:46.502 INFO:teuthology.orchestra.run.smithi072.stdout:680 2023-08-25T04:49:46.502 INFO:teuthology.orchestra.run.smithi072.stdout:680.out 2023-08-25T04:49:46.502 INFO:teuthology.orchestra.run.smithi072.stdout:681 2023-08-25T04:49:46.502 INFO:teuthology.orchestra.run.smithi072.stdout:681.out 2023-08-25T04:49:46.502 INFO:teuthology.orchestra.run.smithi072.stdout:682 2023-08-25T04:49:46.502 INFO:teuthology.orchestra.run.smithi072.stdout:682.out 2023-08-25T04:49:46.502 INFO:teuthology.orchestra.run.smithi072.stdout:683 2023-08-25T04:49:46.502 INFO:teuthology.orchestra.run.smithi072.stdout:683.out 2023-08-25T04:49:46.503 INFO:teuthology.orchestra.run.smithi072.stdout:684 2023-08-25T04:49:46.503 INFO:teuthology.orchestra.run.smithi072.stdout:684.out 2023-08-25T04:49:46.503 INFO:teuthology.orchestra.run.smithi072.stdout:685 2023-08-25T04:49:46.503 INFO:teuthology.orchestra.run.smithi072.stdout:685.out 2023-08-25T04:49:46.503 INFO:teuthology.orchestra.run.smithi072.stdout:686 2023-08-25T04:49:46.503 INFO:teuthology.orchestra.run.smithi072.stdout:686.out 2023-08-25T04:49:46.503 INFO:teuthology.orchestra.run.smithi072.stdout:687 2023-08-25T04:49:46.503 INFO:teuthology.orchestra.run.smithi072.stdout:687.out 2023-08-25T04:49:46.504 INFO:teuthology.orchestra.run.smithi072.stdout:688 2023-08-25T04:49:46.504 INFO:teuthology.orchestra.run.smithi072.stdout:688.out 2023-08-25T04:49:46.504 INFO:teuthology.orchestra.run.smithi072.stdout:689 2023-08-25T04:49:46.504 INFO:teuthology.orchestra.run.smithi072.stdout:689.out 2023-08-25T04:49:46.504 INFO:teuthology.orchestra.run.smithi072.stdout:690 2023-08-25T04:49:46.504 INFO:teuthology.orchestra.run.smithi072.stdout:690.out 2023-08-25T04:49:46.504 INFO:teuthology.orchestra.run.smithi072.stdout:691 2023-08-25T04:49:46.505 INFO:teuthology.orchestra.run.smithi072.stdout:691.out 2023-08-25T04:49:46.505 INFO:teuthology.orchestra.run.smithi072.stdout:692 2023-08-25T04:49:46.505 INFO:teuthology.orchestra.run.smithi072.stdout:692.out 2023-08-25T04:49:46.505 INFO:teuthology.orchestra.run.smithi072.stdout:693 2023-08-25T04:49:46.505 INFO:teuthology.orchestra.run.smithi072.stdout:693.out 2023-08-25T04:49:46.505 INFO:teuthology.orchestra.run.smithi072.stdout:694 2023-08-25T04:49:46.505 INFO:teuthology.orchestra.run.smithi072.stdout:694.out 2023-08-25T04:49:46.505 INFO:teuthology.orchestra.run.smithi072.stdout:695 2023-08-25T04:49:46.505 INFO:teuthology.orchestra.run.smithi072.stdout:695.out 2023-08-25T04:49:46.506 INFO:teuthology.orchestra.run.smithi072.stdout:696 2023-08-25T04:49:46.506 INFO:teuthology.orchestra.run.smithi072.stdout:696.out 2023-08-25T04:49:46.506 INFO:teuthology.orchestra.run.smithi072.stdout:697 2023-08-25T04:49:46.506 INFO:teuthology.orchestra.run.smithi072.stdout:697.out 2023-08-25T04:49:46.506 INFO:teuthology.orchestra.run.smithi072.stdout:698 2023-08-25T04:49:46.506 INFO:teuthology.orchestra.run.smithi072.stdout:698.out 2023-08-25T04:49:46.506 INFO:teuthology.orchestra.run.smithi072.stdout:699 2023-08-25T04:49:46.506 INFO:teuthology.orchestra.run.smithi072.stdout:699.out 2023-08-25T04:49:46.507 INFO:teuthology.orchestra.run.smithi072.stdout:700 2023-08-25T04:49:46.507 INFO:teuthology.orchestra.run.smithi072.stdout:700.out 2023-08-25T04:49:46.507 INFO:teuthology.orchestra.run.smithi072.stdout:701 2023-08-25T04:49:46.507 INFO:teuthology.orchestra.run.smithi072.stdout:701.out 2023-08-25T04:49:46.507 INFO:teuthology.orchestra.run.smithi072.stdout:702 2023-08-25T04:49:46.507 INFO:teuthology.orchestra.run.smithi072.stdout:702.out 2023-08-25T04:49:46.507 INFO:teuthology.orchestra.run.smithi072.stdout:703 2023-08-25T04:49:46.507 INFO:teuthology.orchestra.run.smithi072.stdout:703.out 2023-08-25T04:49:46.508 INFO:teuthology.orchestra.run.smithi072.stdout:704 2023-08-25T04:49:46.508 INFO:teuthology.orchestra.run.smithi072.stdout:704.out 2023-08-25T04:49:46.508 INFO:teuthology.orchestra.run.smithi072.stdout:705 2023-08-25T04:49:46.508 INFO:teuthology.orchestra.run.smithi072.stdout:705.out 2023-08-25T04:49:46.508 INFO:teuthology.orchestra.run.smithi072.stdout:706 2023-08-25T04:49:46.508 INFO:teuthology.orchestra.run.smithi072.stdout:706.out 2023-08-25T04:49:46.508 INFO:teuthology.orchestra.run.smithi072.stdout:707 2023-08-25T04:49:46.508 INFO:teuthology.orchestra.run.smithi072.stdout:707.out 2023-08-25T04:49:46.509 INFO:teuthology.orchestra.run.smithi072.stdout:708 2023-08-25T04:49:46.509 INFO:teuthology.orchestra.run.smithi072.stdout:708.out 2023-08-25T04:49:46.509 INFO:teuthology.orchestra.run.smithi072.stdout:709 2023-08-25T04:49:46.509 INFO:teuthology.orchestra.run.smithi072.stdout:709.out 2023-08-25T04:49:46.509 INFO:teuthology.orchestra.run.smithi072.stdout:710 2023-08-25T04:49:46.509 INFO:teuthology.orchestra.run.smithi072.stdout:710.out 2023-08-25T04:49:46.509 INFO:teuthology.orchestra.run.smithi072.stdout:711 2023-08-25T04:49:46.509 INFO:teuthology.orchestra.run.smithi072.stdout:711.out 2023-08-25T04:49:46.510 INFO:teuthology.orchestra.run.smithi072.stdout:712 2023-08-25T04:49:46.510 INFO:teuthology.orchestra.run.smithi072.stdout:712.out 2023-08-25T04:49:46.510 INFO:teuthology.orchestra.run.smithi072.stdout:713 2023-08-25T04:49:46.510 INFO:teuthology.orchestra.run.smithi072.stdout:713.out 2023-08-25T04:49:46.510 INFO:teuthology.orchestra.run.smithi072.stdout:714 2023-08-25T04:49:46.510 INFO:teuthology.orchestra.run.smithi072.stdout:714.out 2023-08-25T04:49:46.510 INFO:teuthology.orchestra.run.smithi072.stdout:715 2023-08-25T04:49:46.511 INFO:teuthology.orchestra.run.smithi072.stdout:715.out 2023-08-25T04:49:46.511 INFO:teuthology.orchestra.run.smithi072.stdout:716 2023-08-25T04:49:46.511 INFO:teuthology.orchestra.run.smithi072.stdout:716.out 2023-08-25T04:49:46.511 INFO:teuthology.orchestra.run.smithi072.stdout:717 2023-08-25T04:49:46.511 INFO:teuthology.orchestra.run.smithi072.stdout:717.out 2023-08-25T04:49:46.511 INFO:teuthology.orchestra.run.smithi072.stdout:718 2023-08-25T04:49:46.511 INFO:teuthology.orchestra.run.smithi072.stdout:718.out 2023-08-25T04:49:46.511 INFO:teuthology.orchestra.run.smithi072.stdout:719 2023-08-25T04:49:46.512 INFO:teuthology.orchestra.run.smithi072.stdout:719.out 2023-08-25T04:49:46.512 INFO:teuthology.orchestra.run.smithi072.stdout:720 2023-08-25T04:49:46.512 INFO:teuthology.orchestra.run.smithi072.stdout:720.out 2023-08-25T04:49:46.512 INFO:teuthology.orchestra.run.smithi072.stdout:721 2023-08-25T04:49:46.512 INFO:teuthology.orchestra.run.smithi072.stdout:721.out 2023-08-25T04:49:46.512 INFO:teuthology.orchestra.run.smithi072.stdout:722 2023-08-25T04:49:46.512 INFO:teuthology.orchestra.run.smithi072.stdout:722.out 2023-08-25T04:49:46.512 INFO:teuthology.orchestra.run.smithi072.stdout:723 2023-08-25T04:49:46.513 INFO:teuthology.orchestra.run.smithi072.stdout:723.out 2023-08-25T04:49:46.513 INFO:teuthology.orchestra.run.smithi072.stdout:724 2023-08-25T04:49:46.513 INFO:teuthology.orchestra.run.smithi072.stdout:724.out 2023-08-25T04:49:46.513 INFO:teuthology.orchestra.run.smithi072.stdout:725 2023-08-25T04:49:46.513 INFO:teuthology.orchestra.run.smithi072.stdout:725.out 2023-08-25T04:49:46.513 INFO:teuthology.orchestra.run.smithi072.stdout:726 2023-08-25T04:49:46.513 INFO:teuthology.orchestra.run.smithi072.stdout:726.out 2023-08-25T04:49:46.513 INFO:teuthology.orchestra.run.smithi072.stdout:727 2023-08-25T04:49:46.514 INFO:teuthology.orchestra.run.smithi072.stdout:727.out 2023-08-25T04:49:46.514 INFO:teuthology.orchestra.run.smithi072.stdout:728 2023-08-25T04:49:46.514 INFO:teuthology.orchestra.run.smithi072.stdout:728.out 2023-08-25T04:49:46.514 INFO:teuthology.orchestra.run.smithi072.stdout:729 2023-08-25T04:49:46.514 INFO:teuthology.orchestra.run.smithi072.stdout:729.out 2023-08-25T04:49:46.514 INFO:teuthology.orchestra.run.smithi072.stdout:group.list 2023-08-25T04:49:46.514 INFO:teuthology.orchestra.run.smithi072.stdout:Makefile 2023-08-25T04:49:46.515 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-08-25T04:49:46.911 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:49:46.924 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:49:46.924 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:49:52.533 INFO:teuthology.orchestra.run.smithi072.stdout:generic/001 6s 2023-08-25T04:49:52.546 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/001 2023-08-25T04:49:52.546 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:49:52.552 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:49:52.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[135612]: fuse finished with error 0 and tester_r 0 2023-08-25T04:49:52.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:49:52.575 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-08-25T04:49:52.998 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:49:53.011 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:49:53.012 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:49:53.928 INFO:teuthology.orchestra.run.smithi072.stdout:generic/002 0s 2023-08-25T04:49:53.940 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/002 2023-08-25T04:49:53.941 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:49:53.946 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:49:53.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:49:53.969 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-08-25T04:49:54.421 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:49:54.434 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:49:54.435 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:49:54.719 INFO:teuthology.orchestra.run.smithi072.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T04:49:54.729 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/003 2023-08-25T04:49:54.729 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/003 2023-08-25T04:49:54.729 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:49:54.734 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:49:54.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:49:54.756 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-08-25T04:49:55.179 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:49:55.191 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:49:55.192 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:49:55.497 INFO:teuthology.orchestra.run.smithi072.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-08-25T04:49:55.506 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/004 2023-08-25T04:49:55.507 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/004 2023-08-25T04:49:55.507 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:49:55.512 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:49:55.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:49:55.534 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-08-25T04:49:55.953 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:49:55.965 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:49:55.966 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:49:57.088 INFO:teuthology.orchestra.run.smithi072.stdout:generic/005 2s 2023-08-25T04:49:57.100 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/005 2023-08-25T04:49:57.100 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:49:57.106 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:49:57.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:49:57.129 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-08-25T04:49:57.585 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:49:57.598 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:49:57.598 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:50:02.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:50:02.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:50:32.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:50:32.979 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:50:39.912 INFO:teuthology.orchestra.run.smithi072.stdout:generic/006 42s 2023-08-25T04:50:39.925 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/006 2023-08-25T04:50:39.925 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:50:39.931 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:50:39.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:50:39.977 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-08-25T04:50:40.414 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:50:40.427 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:50:40.427 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:51:05.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:51:05.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:51:35.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:51:35.932 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:52:06.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:52:06.077 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:52:15.963 INFO:teuthology.orchestra.run.smithi072.stdout:generic/007 95s 2023-08-25T04:52:15.975 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/007 2023-08-25T04:52:15.976 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:52:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:52:16.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:52:16.019 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-08-25T04:52:16.458 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:52:16.470 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:52:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:52:18.090 INFO:teuthology.orchestra.run.smithi072.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-25T04:52:18.099 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/008 2023-08-25T04:52:18.099 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/008 2023-08-25T04:52:18.100 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:52:18.105 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:52:18.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:52:18.128 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-08-25T04:52:18.545 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:52:18.559 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:52:18.559 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:52:20.104 INFO:teuthology.orchestra.run.smithi072.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-25T04:52:20.114 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/009 2023-08-25T04:52:20.114 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/009 2023-08-25T04:52:20.115 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:52:20.119 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:52:20.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:52:20.141 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-08-25T04:52:20.567 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:52:20.579 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:52:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:52:20.872 INFO:teuthology.orchestra.run.smithi072.stdout:generic/010 [not run] /tmp/tmp.isvk1JLbjhxfstests-dev/src/dbtest not built 2023-08-25T04:52:20.881 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/010 2023-08-25T04:52:20.881 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/010 2023-08-25T04:52:20.882 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:52:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:52:20.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:52:20.910 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-08-25T04:52:21.340 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:52:21.353 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:52:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:52:36.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:52:36.192 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:53:04.997 INFO:teuthology.orchestra.run.smithi072.stdout:generic/011 43s 2023-08-25T04:53:05.010 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/011 2023-08-25T04:53:05.010 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:53:05.015 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:53:05.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:53:05.040 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-08-25T04:53:05.587 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:53:05.600 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:53:05.600 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:53:06.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:53:06.547 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:53:07.226 INFO:teuthology.orchestra.run.smithi072.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-25T04:53:07.235 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/012 2023-08-25T04:53:07.235 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/012 2023-08-25T04:53:07.235 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:53:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:53:07.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:53:07.273 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-08-25T04:53:07.717 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:53:07.730 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:53:07.731 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:53:36.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:53:36.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:54:08.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:54:08.226 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:54:39.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:54:39.499 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:55:09.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:55:09.720 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:55:12.300 INFO:teuthology.orchestra.run.smithi072.stdout:generic/013 125s 2023-08-25T04:55:15.568 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/013 2023-08-25T04:55:15.568 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T04:55:15.581 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:55:15.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T04:55:15.616 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-08-25T04:55:16.283 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T04:55:16.304 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T04:55:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T04:55:39.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:55:39.913 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:55:40.716 INFO:tasks.ceph.mds.d.smithi137.stderr:2023-08-25T04:55:40.715+0000 7f4753ff9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 123412) UID: 0 2023-08-25T04:55:40.716 INFO:tasks.ceph.mds.b.smithi137.stderr:2023-08-25T04:55:40.717+0000 7ff5f87f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 123412) UID: 0 2023-08-25T04:58:52.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:58:52.381 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:59:22.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:59:22.564 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:59:54.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:59:54.386 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:00:15.962 INFO:teuthology.orchestra.run.smithi072.stdout:generic/014 299s 2023-08-25T05:00:15.981 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/014 2023-08-25T05:00:15.981 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:00:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:16.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:00:16.030 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-08-25T05:00:16.683 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:00:16.708 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:00:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:17.133 INFO:teuthology.orchestra.run.smithi072.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:00:17.147 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/015 2023-08-25T05:00:17.148 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/015 2023-08-25T05:00:17.148 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:00:17.161 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:17.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:00:17.189 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-08-25T05:00:17.832 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:00:17.853 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:00:17.853 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:20.528 INFO:teuthology.orchestra.run.smithi072.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-25T05:00:20.543 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/016 2023-08-25T05:00:20.543 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/016 2023-08-25T05:00:20.543 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:00:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:20.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:00:20.589 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-08-25T05:00:21.460 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:00:21.480 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:00:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:21.904 INFO:teuthology.orchestra.run.smithi072.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:00:21.919 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/017 2023-08-25T05:00:21.919 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/017 2023-08-25T05:00:21.920 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:00:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:21.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:00:21.963 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-08-25T05:00:22.630 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:00:22.650 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:00:22.650 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:23.098 INFO:teuthology.orchestra.run.smithi072.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:00:23.113 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/018 2023-08-25T05:00:23.114 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/018 2023-08-25T05:00:23.114 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:00:23.122 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:23.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:00:23.155 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-08-25T05:00:23.817 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:00:23.833 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:00:23.834 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:24.285 INFO:teuthology.orchestra.run.smithi072.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:00:24.300 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/019 2023-08-25T05:00:24.301 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/019 2023-08-25T05:00:24.301 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:00:24.310 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:24.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:00:24.340 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-08-25T05:00:24.981 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:00:25.004 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:00:25.005 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:26.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:00:26.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:00:43.691 INFO:teuthology.orchestra.run.smithi072.stdout:generic/020 - output mismatch (see /tmp/tmp.isvk1JLbjhxfstests-dev/results//generic/020.out.bad) 2023-08-25T05:00:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: --- tests/generic/020.out 2023-08-25 04:47:41.431995940 +0000 2023-08-25T05:00:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: +++ /tmp/tmp.isvk1JLbjhxfstests-dev/results//generic/020.out.bad 2023-08-25 05:00:43.686203734 +0000 2023-08-25T05:00:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: @@ -47,9 +47,13 @@ 2023-08-25T05:00:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: user.snrub="fish2\012" 2023-08-25T05:00:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: *** really long value 2023-08-25T05:00:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: -0000000 00 2023-08-25T05:00:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: -* 2023-08-25T05:00:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: -ATTRSIZE 2023-08-25T05:00:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: +attr_set: No space left on device 2023-08-25T05:00:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: +Could not set "long_attr" for 2023-08-25T05:00:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: +attr_get: No data available 2023-08-25T05:00:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: +Could not get "long_attr" for 2023-08-25T05:00:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: +0000000 2023-08-25T05:00:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: +attr_remove: No data available 2023-08-25T05:00:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: +Could not remove "long_attr" for 2023-08-25T05:00:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: *** set/get/remove really long names (expect failure) 2023-08-25T05:00:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: attr_set: Invalid argument 2023-08-25T05:00:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-08-25T05:00:43.709 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/020 2023-08-25T05:00:43.709 INFO:teuthology.orchestra.run.smithi072.stdout:Failures: generic/020 2023-08-25T05:00:43.709 INFO:teuthology.orchestra.run.smithi072.stdout:Failed 1 of 1 tests 2023-08-25T05:00:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:43.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T05:00:43.796 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-25T05:00:43.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-25T05:00:43.800 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-08-25T05:00:44.622 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:00:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:00:44.644 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:47.559 INFO:teuthology.orchestra.run.smithi072.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-25T05:00:47.571 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/021 2023-08-25T05:00:47.571 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/021 2023-08-25T05:00:47.572 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:00:47.578 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:47.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:00:47.622 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-08-25T05:00:48.531 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:00:48.550 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:00:48.550 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:51.162 INFO:teuthology.orchestra.run.smithi072.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-25T05:00:51.182 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/022 2023-08-25T05:00:51.182 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/022 2023-08-25T05:00:51.182 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:00:51.197 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:51.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:00:51.245 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-08-25T05:00:52.097 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:00:52.117 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:00:52.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:00:57.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:00:57.029 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:01:27.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:01:27.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:01:57.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:01:57.405 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:02:07.621 INFO:teuthology.orchestra.run.smithi072.stdout:generic/023 75s 2023-08-25T05:02:07.636 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/023 2023-08-25T05:02:07.637 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:07.640 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:07.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:07.669 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-08-25T05:02:08.353 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:08.367 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:08.367 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:08.688 INFO:teuthology.orchestra.run.smithi072.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-08-25T05:02:08.697 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/024 2023-08-25T05:02:08.697 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/024 2023-08-25T05:02:08.697 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:08.703 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:08.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:08.753 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-08-25T05:02:09.410 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:09.422 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:09.423 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:09.751 INFO:teuthology.orchestra.run.smithi072.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-08-25T05:02:09.760 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/025 2023-08-25T05:02:09.760 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/025 2023-08-25T05:02:09.760 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:09.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:09.793 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-08-25T05:02:10.480 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:10.492 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:10.493 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:10.848 INFO:teuthology.orchestra.run.smithi072.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-08-25T05:02:10.857 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/026 2023-08-25T05:02:10.857 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/026 2023-08-25T05:02:10.858 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:10.863 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:10.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:10.884 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-08-25T05:02:11.304 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:11.316 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:11.317 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:11.606 INFO:teuthology.orchestra.run.smithi072.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:11.615 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/027 2023-08-25T05:02:11.616 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/027 2023-08-25T05:02:11.616 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:11.622 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:11.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:11.644 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-08-25T05:02:12.076 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:12.089 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:17.412 INFO:teuthology.orchestra.run.smithi072.stdout:generic/028 5s 2023-08-25T05:02:17.425 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/028 2023-08-25T05:02:17.425 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:17.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:17.454 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-08-25T05:02:17.880 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:17.892 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:17.893 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:18.186 INFO:teuthology.orchestra.run.smithi072.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:18.195 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/029 2023-08-25T05:02:18.195 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/029 2023-08-25T05:02:18.195 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:18.201 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:18.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:18.222 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-08-25T05:02:18.646 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:18.659 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:18.660 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:18.942 INFO:teuthology.orchestra.run.smithi072.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/030 2023-08-25T05:02:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/030 2023-08-25T05:02:18.952 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:18.958 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:18.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:18.979 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-08-25T05:02:19.402 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:19.415 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:19.415 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:19.710 INFO:teuthology.orchestra.run.smithi072.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:19.719 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/031 2023-08-25T05:02:19.719 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/031 2023-08-25T05:02:19.720 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:19.725 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:19.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:19.746 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-08-25T05:02:20.165 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:20.178 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:20.179 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:20.462 INFO:teuthology.orchestra.run.smithi072.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:20.471 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/032 2023-08-25T05:02:20.472 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/032 2023-08-25T05:02:20.472 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:20.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:20.499 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-08-25T05:02:20.913 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:20.926 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:20.926 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:21.207 INFO:teuthology.orchestra.run.smithi072.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:21.216 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/033 2023-08-25T05:02:21.217 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/033 2023-08-25T05:02:21.217 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:21.222 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:21.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:21.243 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-08-25T05:02:21.672 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:21.684 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:22.001 INFO:teuthology.orchestra.run.smithi072.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:22.010 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/034 2023-08-25T05:02:22.010 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/034 2023-08-25T05:02:22.010 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:22.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:22.039 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-08-25T05:02:22.461 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:22.474 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:22.474 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:22.872 INFO:teuthology.orchestra.run.smithi072.stdout:generic/035 0s 2023-08-25T05:02:22.885 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/035 2023-08-25T05:02:22.885 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:22.891 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:22.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:22.978 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-08-25T05:02:23.630 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:23.643 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:23.644 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:27.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:02:27.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:02:34.070 INFO:teuthology.orchestra.run.smithi072.stdout:generic/036 11s 2023-08-25T05:02:34.083 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/036 2023-08-25T05:02:34.083 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:34.088 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:34.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:34.157 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-08-25T05:02:34.802 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:34.815 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:34.815 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:35.105 INFO:teuthology.orchestra.run.smithi072.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:35.114 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/037 2023-08-25T05:02:35.114 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/037 2023-08-25T05:02:35.114 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:35.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:35.141 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-08-25T05:02:35.572 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:35.586 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:35.586 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:35.874 INFO:teuthology.orchestra.run.smithi072.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:35.883 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/038 2023-08-25T05:02:35.884 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/038 2023-08-25T05:02:35.884 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:35.889 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:35.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:35.911 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-08-25T05:02:36.333 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:36.346 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:36.346 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:36.658 INFO:teuthology.orchestra.run.smithi072.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:36.667 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/039 2023-08-25T05:02:36.667 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/039 2023-08-25T05:02:36.668 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:36.675 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:36.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:36.695 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-08-25T05:02:37.114 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:37.129 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:37.445 INFO:teuthology.orchestra.run.smithi072.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/040 2023-08-25T05:02:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/040 2023-08-25T05:02:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:37.460 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:37.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:37.481 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-08-25T05:02:37.897 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:37.910 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:38.228 INFO:teuthology.orchestra.run.smithi072.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:38.238 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/041 2023-08-25T05:02:38.238 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/041 2023-08-25T05:02:38.238 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:38.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:38.265 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-08-25T05:02:38.683 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:38.695 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:38.696 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:38.989 INFO:teuthology.orchestra.run.smithi072.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:38.998 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/042 2023-08-25T05:02:38.999 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/042 2023-08-25T05:02:38.999 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:39.004 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:39.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:39.025 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-08-25T05:02:39.444 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:39.458 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:39.750 INFO:teuthology.orchestra.run.smithi072.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:39.758 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/043 2023-08-25T05:02:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/043 2023-08-25T05:02:39.759 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:39.764 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:39.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:39.785 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-08-25T05:02:40.204 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:40.216 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:40.216 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:40.503 INFO:teuthology.orchestra.run.smithi072.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:40.513 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/044 2023-08-25T05:02:40.513 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/044 2023-08-25T05:02:40.514 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:40.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:40.540 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-08-25T05:02:40.958 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:40.970 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:40.971 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:41.258 INFO:teuthology.orchestra.run.smithi072.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:41.267 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/045 2023-08-25T05:02:41.268 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/045 2023-08-25T05:02:41.269 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:41.274 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:41.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:41.296 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-08-25T05:02:41.712 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:41.725 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:41.725 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:42.008 INFO:teuthology.orchestra.run.smithi072.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:42.018 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/046 2023-08-25T05:02:42.018 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/046 2023-08-25T05:02:42.018 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:42.024 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:42.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:42.045 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-08-25T05:02:42.463 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:42.476 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:42.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:42.762 INFO:teuthology.orchestra.run.smithi072.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:42.770 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/047 2023-08-25T05:02:42.770 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/047 2023-08-25T05:02:42.770 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:42.776 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:42.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:42.797 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-08-25T05:02:43.234 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:43.247 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:43.247 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:43.534 INFO:teuthology.orchestra.run.smithi072.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:43.544 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/048 2023-08-25T05:02:43.544 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/048 2023-08-25T05:02:43.544 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:43.549 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:43.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:43.570 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-08-25T05:02:43.991 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:44.004 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:44.004 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:44.287 INFO:teuthology.orchestra.run.smithi072.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:44.296 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/049 2023-08-25T05:02:44.297 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/049 2023-08-25T05:02:44.297 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:44.302 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:44.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:44.324 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-08-25T05:02:44.747 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:44.760 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:44.760 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:45.049 INFO:teuthology.orchestra.run.smithi072.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:45.058 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/050 2023-08-25T05:02:45.058 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/050 2023-08-25T05:02:45.058 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:45.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:45.084 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-08-25T05:02:45.503 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:45.516 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:45.517 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:45.804 INFO:teuthology.orchestra.run.smithi072.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:45.813 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/051 2023-08-25T05:02:45.814 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/051 2023-08-25T05:02:45.814 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:45.820 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:45.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:45.843 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-08-25T05:02:46.260 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:46.272 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:46.273 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:46.574 INFO:teuthology.orchestra.run.smithi072.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:46.583 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/052 2023-08-25T05:02:46.584 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/052 2023-08-25T05:02:46.584 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:46.590 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:46.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:46.611 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-08-25T05:02:47.029 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:47.042 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:47.042 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:47.330 INFO:teuthology.orchestra.run.smithi072.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:47.339 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/053 2023-08-25T05:02:47.339 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/053 2023-08-25T05:02:47.339 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:47.345 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:47.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:47.366 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-08-25T05:02:47.783 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:47.796 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:47.796 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:48.092 INFO:teuthology.orchestra.run.smithi072.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:48.101 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/054 2023-08-25T05:02:48.101 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/054 2023-08-25T05:02:48.101 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:48.107 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:48.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:48.128 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-08-25T05:02:48.547 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:48.559 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:48.560 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:48.861 INFO:teuthology.orchestra.run.smithi072.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:48.870 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/055 2023-08-25T05:02:48.870 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/055 2023-08-25T05:02:48.871 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:48.876 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:48.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:48.898 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-08-25T05:02:49.317 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:49.330 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:49.330 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:49.643 INFO:teuthology.orchestra.run.smithi072.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:49.652 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/056 2023-08-25T05:02:49.653 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/056 2023-08-25T05:02:49.653 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:49.658 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:49.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:49.680 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-08-25T05:02:50.103 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:50.116 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:50.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:50.427 INFO:teuthology.orchestra.run.smithi072.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:50.436 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/057 2023-08-25T05:02:50.436 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/057 2023-08-25T05:02:50.437 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:50.441 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:50.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:50.462 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-08-25T05:02:50.877 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:50.891 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:52.493 INFO:teuthology.orchestra.run.smithi072.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-25T05:02:52.503 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/058 2023-08-25T05:02:52.503 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/058 2023-08-25T05:02:52.504 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:52.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:52.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:52.552 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-08-25T05:02:53.219 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:53.231 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:53.232 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:53.545 INFO:teuthology.orchestra.run.smithi072.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:53.555 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/059 2023-08-25T05:02:53.555 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/059 2023-08-25T05:02:53.555 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:53.561 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:53.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:53.581 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-08-25T05:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:55.648 INFO:teuthology.orchestra.run.smithi072.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-25T05:02:55.657 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/060 2023-08-25T05:02:55.658 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/060 2023-08-25T05:02:55.658 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:55.663 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:55.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:55.702 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-08-25T05:02:56.395 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:56.408 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:56.408 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:57.972 INFO:teuthology.orchestra.run.smithi072.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-25T05:02:57.981 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/061 2023-08-25T05:02:57.981 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/061 2023-08-25T05:02:57.981 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:57.987 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:58.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:02:58.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:58.022 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-08-25T05:02:58.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:02:58.717 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:58.730 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:58.731 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:02:59.036 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/062 2023-08-25T05:02:59.036 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/062 2023-08-25T05:02:59.036 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:02:59.042 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:02:59.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:02:59.063 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-08-25T05:02:59.480 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:01.053 INFO:teuthology.orchestra.run.smithi072.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-25T05:03:01.063 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/063 2023-08-25T05:03:01.063 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/063 2023-08-25T05:03:01.063 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:03:01.067 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:01.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:03:01.106 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-08-25T05:03:01.794 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:03:01.806 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:03:01.807 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:02.093 INFO:teuthology.orchestra.run.smithi072.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:03:02.102 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/064 2023-08-25T05:03:02.103 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/064 2023-08-25T05:03:02.103 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:03:02.108 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:02.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:03:02.130 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-08-25T05:03:02.550 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:03:02.563 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:03:02.563 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:02.878 INFO:teuthology.orchestra.run.smithi072.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:03:02.887 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/065 2023-08-25T05:03:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/065 2023-08-25T05:03:02.888 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:03:02.894 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:02.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:03:02.915 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-08-25T05:03:03.331 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:03:03.344 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:03:03.344 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:03.662 INFO:teuthology.orchestra.run.smithi072.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:03:03.672 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/066 2023-08-25T05:03:03.673 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/066 2023-08-25T05:03:03.673 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:03:03.678 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:03.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:03:03.699 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-08-25T05:03:04.121 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:03:04.134 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:03:04.134 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:04.462 INFO:teuthology.orchestra.run.smithi072.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:03:04.471 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/067 2023-08-25T05:03:04.471 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/067 2023-08-25T05:03:04.472 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:03:04.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:04.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:03:04.499 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-08-25T05:03:04.913 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:03:04.926 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:03:04.926 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:05.222 INFO:teuthology.orchestra.run.smithi072.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:03:05.230 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/068 2023-08-25T05:03:05.231 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/068 2023-08-25T05:03:05.231 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:03:05.236 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:05.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:03:05.258 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-08-25T05:03:05.677 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:03:05.690 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:03:05.691 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:05.980 INFO:teuthology.orchestra.run.smithi072.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:03:05.989 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/069 2023-08-25T05:03:05.989 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/069 2023-08-25T05:03:05.989 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:03:05.995 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:06.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:03:06.016 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-08-25T05:03:06.433 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:03:06.446 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:03:06.446 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:03:28.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:03:28.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:03:58.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:03:58.459 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:04:28.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:04:28.600 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:04:34.092 INFO:teuthology.orchestra.run.smithi072.stdout:generic/070 88s 2023-08-25T05:04:34.105 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/070 2023-08-25T05:04:34.105 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:04:34.111 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:04:34.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:04:34.182 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-08-25T05:04:34.866 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:04:34.878 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:04:34.879 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:04:35.205 INFO:teuthology.orchestra.run.smithi072.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:04:35.229 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/071 2023-08-25T05:04:35.229 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/071 2023-08-25T05:04:35.229 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:04:35.238 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:04:35.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:04:35.273 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-08-25T05:04:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:04:35.913 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:04:35.913 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:04:38.503 INFO:teuthology.orchestra.run.smithi072.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-08-25T05:04:38.517 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/072 2023-08-25T05:04:38.518 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/072 2023-08-25T05:04:38.518 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:04:38.527 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:04:38.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:04:38.565 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-08-25T05:04:39.224 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:04:39.243 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:04:39.244 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:04:39.721 INFO:teuthology.orchestra.run.smithi072.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:04:39.735 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/073 2023-08-25T05:04:39.736 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/073 2023-08-25T05:04:39.736 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:04:39.745 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:04:39.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:04:39.777 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-08-25T05:04:40.429 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:04:40.448 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:04:40.448 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:04:58.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:04:58.711 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:05:35.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:05:35.048 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:06:14.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:06:14.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:06:52.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:06:52.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:07:22.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:07:22.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:07:55.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:07:55.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:08:25.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:08:25.882 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:08:57.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:08:57.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:09:32.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:09:32.127 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:10:02.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:10:02.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:10:34.084 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:10:34.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:11:04.269 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:11:04.285 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:11:06.940 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-25T05:11:06.939+0000 7f34c35f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212514) UID: 0 2023-08-25T05:11:06.942 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-25T05:11:06.940+0000 7f51667f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212514) UID: 0 2023-08-25T05:11:06.943 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-25T05:11:06.941+0000 7f9da3df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212514) UID: 0 2023-08-25T05:11:06.944 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-25T05:11:06.940+0000 7f5718bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212514) UID: 0 2023-08-25T05:19:46.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:19:46.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:19:46.534 INFO:tasks.ceph.osd.6.smithi137.stderr:2023-08-25T05:19:46.533+0000 7feab39f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125165) UID: 0 2023-08-25T05:19:46.535 INFO:tasks.ceph.osd.4.smithi137.stderr:2023-08-25T05:19:46.533+0000 7fe1dbdf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125165) UID: 0 2023-08-25T05:19:46.538 INFO:tasks.ceph.osd.7.smithi137.stderr:2023-08-25T05:19:46.533+0000 7fac3f7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125165) UID: 0 2023-08-25T05:19:46.541 INFO:tasks.ceph.osd.5.smithi137.stderr:2023-08-25T05:19:46.540+0000 7f8d7cbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125165) UID: 0 2023-08-25T05:19:46.545 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-25T05:19:46.544+0000 7f51667f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212667) UID: 0 2023-08-25T05:19:46.545 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-25T05:19:46.544+0000 7f5718bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212667) UID: 0 2023-08-25T05:19:46.546 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-25T05:19:46.544+0000 7f34c35f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212667) UID: 0 2023-08-25T05:19:46.546 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-25T05:19:46.544+0000 7f9da3df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212667) UID: 0 2023-08-25T05:28:01.435 INFO:tasks.ceph.osd.5.smithi137.stderr:2023-08-25T05:28:01.434+0000 7f8d7cbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125341) UID: 0 2023-08-25T05:28:01.436 INFO:tasks.ceph.osd.4.smithi137.stderr:2023-08-25T05:28:01.433+0000 7fe1dbdf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125341) UID: 0 2023-08-25T05:28:01.437 INFO:tasks.ceph.osd.7.smithi137.stderr:2023-08-25T05:28:01.434+0000 7fac3f7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125341) UID: 0 2023-08-25T05:28:01.443 INFO:tasks.ceph.osd.6.smithi137.stderr:2023-08-25T05:28:01.433+0000 7feab39f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125341) UID: 0 2023-08-25T05:29:47.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:29:47.825 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:29:53.563 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-25T05:29:53.561+0000 7f34c35f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 213209) UID: 0 2023-08-25T05:29:53.788 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-25T05:29:53.564+0000 7f5718bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 213209) UID: 0 2023-08-25T05:29:53.788 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-25T05:29:53.561+0000 7f51667f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 213209) UID: 0 2023-08-25T05:29:53.789 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-25T05:29:53.564+0000 7f9da3df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 213209) UID: 0 2023-08-25T05:33:49.762 INFO:teuthology.orchestra.run.smithi072.stdout:generic/074 1749s 2023-08-25T05:33:52.133 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/074 2023-08-25T05:33:52.133 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:33:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:33:54.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:33:54.206 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-08-25T05:34:02.370 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:34:02.382 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:34:02.383 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:34:50.189 INFO:teuthology.orchestra.run.smithi072.stdout:generic/075 48s 2023-08-25T05:34:50.270 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/075 2023-08-25T05:34:50.270 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:34:50.275 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:34:50.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:34:50.306 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-08-25T05:34:51.058 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:34:51.070 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:34:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:34:51.358 INFO:teuthology.orchestra.run.smithi072.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:34:51.367 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/076 2023-08-25T05:34:51.368 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/076 2023-08-25T05:34:51.368 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:34:51.373 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:34:51.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:34:51.398 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-08-25T05:34:51.819 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:34:51.831 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:34:51.832 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:16.012 INFO:teuthology.orchestra.run.smithi072.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:35:16.021 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/077 2023-08-25T05:35:16.021 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/077 2023-08-25T05:35:16.022 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:35:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:16.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:35:16.051 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-08-25T05:35:16.478 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:35:16.492 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:35:16.492 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:18.048 INFO:teuthology.orchestra.run.smithi072.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-08-25T05:35:18.057 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/078 2023-08-25T05:35:18.057 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/078 2023-08-25T05:35:18.058 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:35:18.063 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:18.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:35:18.095 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-08-25T05:35:18.859 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:35:18.872 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:35:18.872 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:20.376 INFO:teuthology.orchestra.run.smithi072.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-08-25T05:35:20.386 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/079 2023-08-25T05:35:20.386 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/079 2023-08-25T05:35:20.387 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:35:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:20.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:35:20.418 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-08-25T05:35:20.845 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:35:20.857 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:35:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:23.238 INFO:teuthology.orchestra.run.smithi072.stdout:generic/080 3s 2023-08-25T05:35:24.404 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/080 2023-08-25T05:35:24.405 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:35:24.410 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:24.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:35:24.433 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-08-25T05:35:25.073 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:35:25.087 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:35:25.088 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:25.391 INFO:teuthology.orchestra.run.smithi072.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:35:25.401 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/081 2023-08-25T05:35:25.401 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/081 2023-08-25T05:35:25.401 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:35:25.408 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:25.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:35:25.430 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-08-25T05:35:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:35:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:35:25.950 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:26.249 INFO:teuthology.orchestra.run.smithi072.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:35:26.258 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/082 2023-08-25T05:35:26.258 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/082 2023-08-25T05:35:26.258 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:35:26.264 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:26.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:35:26.286 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-08-25T05:35:26.707 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:35:26.720 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:35:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:27.030 INFO:teuthology.orchestra.run.smithi072.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:35:27.039 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/083 2023-08-25T05:35:27.040 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/083 2023-08-25T05:35:27.040 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:35:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:27.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:35:27.068 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-08-25T05:35:27.491 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:35:27.512 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:35:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:27.807 INFO:teuthology.orchestra.run.smithi072.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:35:27.817 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/084 2023-08-25T05:35:27.818 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/084 2023-08-25T05:35:27.818 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:35:27.824 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:27.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:35:27.849 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-08-25T05:35:28.273 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:35:28.287 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:35:28.287 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:32.163 INFO:teuthology.orchestra.run.smithi072.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-08-25T05:35:32.172 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/085 2023-08-25T05:35:32.172 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/085 2023-08-25T05:35:32.172 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:35:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:35:32.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:35:32.203 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-08-25T05:35:32.619 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:35:32.631 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:35:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:37:38.141 INFO:teuthology.orchestra.run.smithi072.stdout:generic/086 124s 2023-08-25T05:37:38.613 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/086 2023-08-25T05:37:38.613 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:37:38.619 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:37:39.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:37:39.359 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-08-25T05:38:06.184 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:38:06.197 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:38:06.197 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:38:09.393 INFO:teuthology.orchestra.run.smithi072.stdout:generic/087 3s 2023-08-25T05:38:09.406 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/087 2023-08-25T05:38:09.406 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:38:09.412 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:38:09.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:38:09.475 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-08-25T05:38:10.215 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:38:10.227 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:38:10.227 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:38:13.543 INFO:teuthology.orchestra.run.smithi072.stdout:generic/088 3s 2023-08-25T05:38:13.555 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/088 2023-08-25T05:38:13.556 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2023-08-25T05:38:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:38:13.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-25T05:38:13.630 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.isvk1JLbjhxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-08-25T05:38:14.342 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph-fuse 2023-08-25T05:38:14.355 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 6.5.0-rc7-ga6a696707610 #1 SMP PREEMPT_DYNAMIC Thu Aug 24 10:21:56 UTC 2023 2023-08-25T05:38:14.355 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-25T05:42:42.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:42:42.657 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:43:12.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:43:12.806 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:43:42.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:43:42.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:44:13.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:44:13.042 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:44:43.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:44:43.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:45:13.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:45:13.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:45:43.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:45:43.681 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:46:13.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:46:13.945 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:46:44.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:46:44.058 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:47:14.192 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:47:14.197 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:47:44.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:47:44.345 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:48:14.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:48:14.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:48:44.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:48:44.706 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:49:14.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:49:14.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:49:45.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:49:45.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:50:15.309 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:50:15.314 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:50:45.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:50:45.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:51:15.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:51:15.574 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:51:45.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:51:45.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:52:15.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:52:15.805 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:52:46.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:52:46.033 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:53:16.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:53:16.178 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:53:46.336 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:53:46.342 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:54:16.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:54:16.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:54:46.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:54:46.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:55:16.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:55:16.882 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:55:47.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:55:47.155 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:56:17.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:56:17.276 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:56:47.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:56:47.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:57:17.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:57:17.880 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:57:47.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:57:48.002 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:58:18.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:58:18.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:58:48.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:58:48.305 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:59:18.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:59:18.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:59:48.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:59:48.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:00:18.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:00:18.953 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:00:49.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:00:49.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:01:19.284 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:01:19.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:01:49.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:01:49.402 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:02:19.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:02:19.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:02:49.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:02:49.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:03:19.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:03:19.986 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:03:50.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:03:50.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:04:20.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:04:20.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:04:50.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:04:50.527 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:05:20.632 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:05:20.637 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:05:50.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:05:50.822 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:06:20.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:06:20.984 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:06:51.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:06:51.122 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:07:21.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:07:21.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:07:51.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:07:51.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:08:21.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:08:21.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:08:51.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:08:51.868 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:09:22.109 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:09:22.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:09:52.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:09:52.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:10:22.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:10:22.509 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:10:52.666 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:10:52.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:11:22.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:11:22.776 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:11:53.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:11:53.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:12:23.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:12:23.240 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:12:53.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:12:53.377 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:13:23.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:13:23.498 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:13:53.616 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:13:53.621 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:14:23.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:14:23.798 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:14:53.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:14:53.956 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:15:24.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:15:24.220 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:15:54.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:15:54.508 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:16:24.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:16:24.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:16:54.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:16:54.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:17:25.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:17:25.009 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:17:55.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:17:55.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:18:25.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:18:25.243 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:18:55.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:18:55.375 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:19:25.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:19:25.497 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:19:55.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:19:55.603 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:20:25.727 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:20:25.732 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:20:55.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:20:55.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:21:25.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:21:26.000 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:21:56.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:21:56.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:22:26.289 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:22:26.294 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:22:56.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:22:56.408 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:23:26.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:23:26.526 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:23:56.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:23:56.626 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:24:26.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:24:26.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:24:56.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:24:56.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:25:27.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:25:27.243 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:25:57.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:25:57.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:26:27.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:26:27.561 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:26:57.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:26:57.692 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:27:27.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:27:27.799 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:27:58.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:27:58.012 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:28:28.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:28:28.159 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:28:58.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:28:58.286 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:29:28.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:29:28.413 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:29:58.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:29:58.536 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:30:28.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:30:28.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:30:59.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:30:59.104 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:31:29.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:31:29.259 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:31:59.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:31:59.371 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:32:29.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:32:29.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:32:59.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:32:59.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:33:29.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:33:29.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:34:00.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:34:00.114 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:34:30.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:34:30.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:35:00.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:35:00.361 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:35:30.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:35:30.479 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:36:00.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:36:00.613 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:36:30.721 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:36:30.726 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:37:00.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:37:00.865 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:37:30.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:37:30.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:38:01.111 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:38:01.117 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:38:31.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:38:31.230 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:39:01.346 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:39:01.351 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:39:31.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:39:31.455 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:40:01.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:40:01.571 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:40:31.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:40:31.702 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:41:02.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:41:02.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:41:32.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:41:32.386 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:42:02.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:42:02.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:42:32.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:42:32.654 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:43:02.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:43:02.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:43:33.010 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:43:33.015 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:44:03.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:44:03.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:44:33.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:44:33.251 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:45:03.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:45:03.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:45:33.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:45:33.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:46:03.911 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:46:03.920 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:46:34.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:46:34.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:47:04.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:47:04.277 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:47:34.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:47:34.390 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:48:04.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:48:04.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:48:34.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:48:34.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:49:04.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:49:04.839 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:49:34.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:49:34.960 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:50:05.086 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:50:05.095 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:50:35.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:50:35.223 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:51:05.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:51:05.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:51:35.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:51:35.610 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:52:05.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:52:05.805 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:52:36.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:52:36.028 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:53:06.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:53:06.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:53:36.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:53:36.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:54:06.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:54:06.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:54:36.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:54:36.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:55:06.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:55:06.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:55:37.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:55:37.017 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:56:07.174 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:56:07.179 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:56:37.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:56:37.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:57:07.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:57:07.460 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:57:37.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:57:37.651 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:58:07.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:58:07.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:58:38.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:58:38.101 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:59:08.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:59:08.218 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:59:38.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T06:59:38.420 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:00:08.536 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:00:08.541 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:00:38.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:00:38.656 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:01:08.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:01:08.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:01:39.060 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:01:39.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:02:09.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:02:09.193 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:02:39.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:02:39.379 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:03:09.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:03:09.509 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:03:39.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:03:39.626 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:04:09.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:04:09.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:04:40.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:04:40.022 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:05:10.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:05:10.160 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:05:40.359 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:05:40.365 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:06:10.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:06:10.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:06:40.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:06:40.786 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:07:10.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:07:10.946 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:07:41.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:07:41.069 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:08:11.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:08:11.251 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:08:41.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:08:41.437 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:09:11.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:09:11.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:09:41.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:09:41.829 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:10:11.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:10:11.951 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:10:42.152 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:10:42.157 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:11:12.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:11:12.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:11:42.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:11:42.474 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:12:12.600 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:12:12.607 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:12:42.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:12:42.743 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:13:12.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:13:12.880 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:13:43.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:13:43.036 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:14:13.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:14:13.249 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:14:43.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:14:43.386 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:15:13.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:15:13.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:15:43.717 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:15:43.722 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:16:13.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:16:13.868 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:16:44.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:16:44.048 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:17:14.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:17:14.161 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:17:44.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:17:44.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:18:14.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:18:14.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:18:44.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:18:44.668 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:19:14.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:19:14.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:19:45.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:19:45.020 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:20:15.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:20:15.208 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:20:45.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:20:45.380 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:21:15.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:21:15.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:21:45.717 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:21:45.722 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:22:15.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:22:15.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:22:45.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:22:45.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:23:16.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:23:16.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:23:46.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:23:46.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:24:16.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:24:16.415 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:24:46.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:24:46.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:25:16.719 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:25:16.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:25:46.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:25:46.837 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:26:17.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:26:17.126 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:26:47.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:26:47.248 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:27:17.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:27:17.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:27:47.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:27:47.640 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:28:17.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:28:17.862 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:28:48.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:28:48.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:29:18.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:29:18.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:29:48.330 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:29:48.335 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:30:18.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:30:18.490 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:30:48.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:30:48.614 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:31:18.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:31:18.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:31:48.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:31:48.939 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:32:19.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:32:19.135 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:32:49.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:32:49.308 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:33:19.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:33:19.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:33:49.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:33:49.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:34:19.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:34:19.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:34:49.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:34:49.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:35:20.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:35:20.076 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:35:50.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:35:50.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:36:20.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:36:20.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:36:50.561 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:36:50.567 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:37:20.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:37:20.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:37:50.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:37:50.943 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:38:21.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:38:21.082 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:38:51.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:38:51.262 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:39:21.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:39:21.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:39:51.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:39:51.489 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:40:21.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:40:21.628 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:40:51.819 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:40:51.824 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:41:21.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:41:21.954 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:41:52.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:41:52.075 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:42:22.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:42:22.247 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:42:52.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:42:52.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:43:22.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:43:22.574 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:43:52.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:43:52.687 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:44:22.819 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:44:22.826 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:44:52.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:44:52.956 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:45:23.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:45:23.144 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:45:53.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:45:53.332 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:46:23.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:46:23.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:46:53.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:46:53.684 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:47:23.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:47:23.865 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:47:54.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:47:54.069 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:48:24.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:48:24.249 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:48:54.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:48:54.363 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:49:24.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:49:24.535 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:49:54.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:49:54.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:50:24.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:50:24.869 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:50:55.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:50:55.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:51:25.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:51:25.173 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:51:55.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:51:55.302 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:52:25.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:52:25.491 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:52:55.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:52:55.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:53:25.838 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:53:25.843 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:53:55.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:53:55.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:54:26.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:54:26.162 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:54:56.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:54:56.284 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:55:26.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:55:26.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:55:56.611 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:55:56.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:56:26.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:56:26.808 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:56:56.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:56:56.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:57:27.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:57:27.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:57:57.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:57:57.305 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:58:27.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:58:27.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:58:57.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:58:57.615 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:59:27.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:59:27.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:59:57.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T07:59:57.992 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:00:28.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:00:28.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:00:58.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:00:58.260 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:01:28.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:01:28.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:01:58.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:01:58.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:02:28.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:02:28.766 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:02:58.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:02:58.935 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:03:29.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:03:29.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:03:59.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:03:59.258 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:04:29.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:04:29.421 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:04:59.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:04:59.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:05:29.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:05:29.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:05:59.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:05:59.927 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:06:30.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:06:30.114 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:07:00.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:07:00.237 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:07:30.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:07:30.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:08:00.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:08:00.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:08:30.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:08:30.742 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:09:00.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:09:00.948 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:09:31.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:09:31.070 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:10:01.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:10:01.291 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:10:31.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:10:31.506 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:11:01.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:11:01.710 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:11:31.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:11:31.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:12:02.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:12:02.030 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:12:32.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:12:32.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:13:02.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:13:02.407 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:13:32.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:13:32.514 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:14:02.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:14:02.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:14:32.809 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:14:32.828 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:15:02.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:15:02.944 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:15:33.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:15:33.059 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:16:03.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:16:03.188 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:16:33.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:16:33.357 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:17:03.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:17:03.504 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:17:33.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:17:33.618 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:18:03.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:18:03.806 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:18:34.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:18:34.010 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:19:04.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:19:04.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:19:34.307 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:19:34.313 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:20:04.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:20:04.510 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:20:34.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:20:34.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:21:04.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:21:04.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:21:34.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:21:34.948 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:22:05.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:22:05.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:22:35.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:22:35.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:23:05.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:23:05.451 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:23:35.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:23:35.647 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:24:05.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:24:05.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:24:35.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:24:35.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:25:06.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:25:06.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:25:36.353 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:25:36.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:26:06.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:26:06.546 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:26:36.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:26:36.720 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:27:06.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:27:06.875 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:27:37.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:27:37.063 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:28:07.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:28:07.175 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:28:37.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:28:37.355 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:29:07.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:29:07.552 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:29:37.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:29:37.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:30:07.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:30:07.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:30:38.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:30:38.017 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:31:08.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:31:08.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:31:38.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:31:38.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:32:08.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:32:08.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:32:38.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:32:38.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:33:08.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:33:08.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:33:38.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:33:38.968 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:34:09.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:34:09.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:34:39.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:34:39.491 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:35:09.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:35:09.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:35:39.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:35:39.826 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:36:10.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:36:10.031 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:36:40.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:36:40.195 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:37:10.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:37:10.349 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:37:40.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:37:40.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:38:10.755 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:38:10.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:38:40.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:38:40.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:39:11.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:39:11.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:39:41.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:39:41.192 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:40:11.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:40:11.363 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:40:41.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:40:41.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:41:11.751 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:41:11.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:41:41.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:41:41.912 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:42:12.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:42:12.076 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:42:42.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:42:42.264 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:43:12.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:43:12.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:43:42.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:43:42.583 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:44:12.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:44:12.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:44:42.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:44:42.976 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:45:13.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:45:13.148 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:45:43.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:45:43.329 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:46:13.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:46:13.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:46:43.644 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:46:43.650 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:47:13.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:47:13.772 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:47:43.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:47:43.948 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:48:14.132 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:48:14.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:48:44.330 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:48:44.336 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:49:14.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:49:14.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:49:44.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:49:44.628 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:50:14.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:50:14.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:50:44.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:50:44.944 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:51:15.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:51:15.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:51:45.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:51:45.248 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:52:15.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:52:15.445 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:52:45.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:52:45.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:53:15.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:53:15.829 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:53:45.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:53:45.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:54:16.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:54:16.148 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:54:46.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:54:46.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:55:16.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:55:16.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:55:46.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:55:46.563 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:56:16.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:56:16.676 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:56:46.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:56:46.882 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:57:17.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:57:17.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:57:47.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:57:47.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:58:17.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:58:17.405 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:58:47.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:58:47.568 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:59:17.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:59:17.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:59:47.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T08:59:47.832 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:00:17.955 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:00:17.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:00:48.075 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:00:48.083 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:01:18.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:01:18.203 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:01:48.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:01:48.391 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:02:18.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:02:18.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:02:48.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:02:48.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:03:18.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:03:18.914 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:03:49.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:03:49.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:04:19.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:04:19.300 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:04:49.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:04:49.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:05:19.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:05:19.618 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:05:49.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:05:49.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:06:19.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:06:19.936 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:06:50.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:06:50.101 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:07:20.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:07:20.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:07:50.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:07:50.335 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:08:20.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:08:20.498 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:08:50.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:08:50.681 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:09:20.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:09:20.791 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:09:50.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:09:50.981 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:10:21.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:10:21.101 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:10:51.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:10:51.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:11:21.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:11:21.414 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:11:51.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:11:51.527 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:12:21.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:12:21.733 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:12:51.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:12:51.928 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:13:22.111 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:13:22.116 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:13:52.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:13:52.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:14:22.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:14:22.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:14:52.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:14:52.547 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:15:22.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:15:22.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:15:52.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:15:52.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:16:23.007 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:16:23.012 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:16:53.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:16:53.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:17:23.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:17:23.414 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:17:53.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:17:53.527 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:18:23.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:18:23.652 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:18:53.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:18:53.771 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:19:23.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:19:23.879 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:19:54.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:19:54.082 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:20:24.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:20:24.246 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:20:54.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:20:54.568 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:21:24.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:21:24.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:21:54.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:21:54.903 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:22:25.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:22:25.082 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:22:55.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:22:55.196 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:23:25.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:23:25.375 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:23:55.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:23:55.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:24:25.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:24:25.701 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:24:55.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:24:55.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:25:26.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:25:26.062 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:25:56.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:25:56.251 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:26:26.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:26:26.448 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:26:56.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:26:56.561 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:27:26.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:27:26.674 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:27:56.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:27:56.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:28:26.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:28:26.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:28:57.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:28:57.023 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:29:27.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:29:27.151 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:29:57.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:29:57.274 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:30:27.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:30:27.401 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:30:57.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:30:57.516 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:31:27.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:31:27.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:31:57.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:31:57.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:32:27.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:32:27.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:32:57.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:32:57.974 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:33:28.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:33:28.084 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:33:58.194 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:33:58.200 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:34:28.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:34:28.328 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:34:58.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:34:58.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:35:28.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:35:28.553 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:35:58.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:35:58.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:36:28.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:36:28.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:36:58.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:36:58.903 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:37:29.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:37:29.033 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:37:59.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:37:59.148 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:38:29.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:38:29.277 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:38:59.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:38:59.381 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:39:29.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:39:29.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:39:59.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:39:59.598 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:40:29.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:40:29.714 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:40:59.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:40:59.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:41:29.935 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:41:29.946 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:42:00.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:42:00.054 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:42:30.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:42:30.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:43:00.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:43:00.279 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:43:30.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:43:30.395 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:44:00.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:44:00.508 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:44:30.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:44:30.622 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:45:00.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:45:00.730 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:45:30.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:45:30.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:46:00.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:46:00.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:46:31.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:46:31.076 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:47:01.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:47:01.192 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:47:31.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:47:31.310 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:48:01.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:48:01.423 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:48:31.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:48:31.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:49:01.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:49:01.659 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:49:31.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:49:31.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:50:01.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:50:01.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:50:32.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:50:32.014 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:02.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:02.196 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:32.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:51:32.600 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:52:02.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:52:02.787 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:52:32.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:52:32.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:53:03.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:53:03.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:53:33.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:53:33.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:54:03.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:54:03.366 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:54:33.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:54:33.547 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:55:03.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:55:03.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:55:33.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:55:33.849 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:56:04.007 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:56:04.012 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:56:34.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:56:34.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:57:04.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:57:04.246 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:57:34.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:57:34.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:58:04.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:58:04.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:58:34.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:58:34.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:59:04.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:59:04.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:59:35.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T09:59:35.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:00:05.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:00:05.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:00:35.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:00:35.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:01:05.638 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:01:05.643 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:01:35.743 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:01:35.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:02:05.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:02:05.874 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:02:35.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:02:35.977 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:03:06.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:03:06.097 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:03:36.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:03:36.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:04:06.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:04:06.429 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:04:36.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:04:36.537 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:05:06.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:05:06.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:05:36.867 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:05:36.873 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:06:07.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:06:07.035 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:06:37.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:06:37.207 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:07:07.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:07:07.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:07:37.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:07:37.516 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:08:07.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:08:07.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:08:37.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:08:37.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:09:07.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:09:07.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:09:38.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:09:38.169 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:10:08.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:10:08.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:10:38.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:10:38.422 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:11:08.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:11:08.602 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:11:38.785 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:11:38.790 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:12:08.958 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:12:08.963 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:12:39.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:12:39.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:13:09.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:13:09.281 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:13:39.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:13:39.402 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:14:09.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:14:09.583 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:14:39.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:14:39.704 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:15:09.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:15:09.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:15:40.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:15:40.040 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:16:10.147 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:16:10.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:16:40.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:16:40.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:17:10.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:17:10.379 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:17:40.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:17:40.487 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:18:10.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:18:10.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:18:40.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:18:40.719 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:19:10.858 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:19:10.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:19:40.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:19:40.971 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:20:11.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:20:11.082 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:20:41.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:20:41.197 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:21:11.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:21:11.328 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:21:41.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:21:41.440 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:22:11.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:22:11.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:22:41.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:22:41.662 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:23:11.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:23:11.946 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:23:42.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:23:42.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:24:12.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:24:12.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:24:42.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:24:42.285 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:25:12.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:25:12.480 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:25:42.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:25:42.647 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:26:12.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:26:12.786 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:26:42.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:26:42.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:27:13.022 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:27:13.027 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:27:43.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:27:43.207 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:28:13.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:28:13.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:28:43.536 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:28:43.541 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:29:13.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:29:13.654 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:29:43.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:29:43.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:30:13.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:30:13.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:30:44.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:30:44.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:31:14.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:31:14.342 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:31:44.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:31:44.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:32:14.664 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:32:14.669 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:32:44.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:32:44.808 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:33:14.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:33:14.980 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:33:45.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:33:45.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:34:15.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:34:15.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:34:45.407 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:34:45.412 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:35:15.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:35:15.603 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:35:45.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:35:45.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:36:15.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:36:15.920 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:36:46.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:36:46.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:37:16.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:37:16.249 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:37:46.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:37:46.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:38:16.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:38:16.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:38:46.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:38:46.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:39:17.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:39:17.095 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:39:47.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:39:47.266 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:40:17.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:40:17.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:40:47.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:40:47.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:41:17.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:41:17.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:41:47.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:41:47.977 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:42:18.085 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:42:18.090 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:42:48.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:42:48.220 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:43:18.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:43:18.418 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:43:48.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:43:48.615 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:44:18.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:44:18.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:44:48.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:44:48.950 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:45:19.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:45:19.130 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:45:49.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:45:49.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:46:19.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:46:19.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:46:49.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:46:49.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:47:19.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:47:19.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:47:49.918 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:47:49.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:48:20.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:48:20.042 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:48:50.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:48:50.165 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:49:20.271 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:49:20.276 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:49:50.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:49:50.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:50:20.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:50:20.506 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:50:50.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:50:50.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:51:20.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:51:20.735 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:51:50.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:51:50.874 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:52:20.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:52:20.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:52:51.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:52:51.107 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:53:21.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:53:21.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:53:51.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:53:51.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:54:21.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:54:21.590 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:54:51.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:54:51.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:55:21.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:55:21.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:55:52.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:55:52.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:56:22.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:56:22.285 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:56:52.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:56:52.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:57:22.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:57:22.604 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:57:52.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:57:52.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:58:23.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:58:23.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:58:53.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:58:53.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:59:23.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:59:23.390 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:59:53.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T10:59:53.545 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:00:23.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:00:23.700 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:00:53.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:00:53.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:01:24.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:01:24.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:01:54.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:01:54.266 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:02:24.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:02:24.392 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:02:54.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:02:54.511 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:03:24.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:03:24.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:03:54.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:03:54.879 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:04:25.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:04:25.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:04:55.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:04:55.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:05:25.380 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:05:25.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:05:55.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:05:55.498 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:06:25.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:06:25.686 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:06:55.819 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:06:55.825 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:07:25.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:07:26.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:07:56.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:07:56.169 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:08:26.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:08:26.357 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:08:56.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:08:56.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:09:26.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:09:26.692 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:09:56.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:09:56.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:10:26.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:10:26.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:10:57.060 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:10:57.065 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:11:27.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:11:27.177 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:11:57.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:11:57.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:12:27.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:12:27.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:12:57.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:12:57.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:13:27.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:13:27.611 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:13:57.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:13:57.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:14:27.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:14:27.850 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:14:57.956 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:14:57.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:15:28.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:15:28.070 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:15:58.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:15:58.190 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:16:28.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:16:28.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:16:58.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:16:58.408 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:17:28.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:17:28.522 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:17:58.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:17:58.631 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:18:28.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:18:28.741 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:18:58.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:18:58.856 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:19:28.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:19:28.984 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:19:59.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:19:59.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:20:29.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:20:29.220 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:20:59.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:20:59.335 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:21:29.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:21:29.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:21:59.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:21:59.556 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:22:29.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:22:29.682 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:22:59.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:22:59.805 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:23:29.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:23:29.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:24:00.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:24:00.023 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:24:30.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:24:30.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:25:00.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:25:00.237 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:25:30.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:25:30.362 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:26:00.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:26:00.495 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:26:30.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:26:30.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:27:00.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:27:00.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:27:30.946 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:27:30.951 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:28:01.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:28:01.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:28:31.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:28:31.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:29:01.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:29:01.365 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:29:31.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:29:31.479 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:30:01.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:30:01.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:30:31.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:30:31.876 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:31:01.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:31:02.005 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:31:32.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:31:32.117 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:32:02.309 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:32:02.314 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:32:32.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:32:32.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:33:02.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:33:02.607 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:33:32.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:33:32.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:34:02.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:34:02.992 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:34:33.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:34:33.097 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:35:03.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:35:03.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:35:33.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:35:33.324 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:36:03.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:36:03.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:36:33.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:36:33.550 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:37:03.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:37:03.662 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:37:33.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:37:33.771 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:38:03.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:38:03.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:38:34.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:38:34.014 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:39:04.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:39:04.127 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:39:34.236 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:39:34.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:40:04.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:40:04.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:40:34.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:40:34.473 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:41:04.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:41:04.607 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:41:34.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:41:34.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:42:04.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:42:04.858 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:42:34.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:42:34.980 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:43:05.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:43:05.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:43:35.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:43:35.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:44:05.330 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:44:05.335 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:44:35.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:44:35.467 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:45:05.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:45:05.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:45:35.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:45:35.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:46:05.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:46:05.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:46:35.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:46:35.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:47:06.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:47:06.010 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:47:36.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:47:36.131 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:48:06.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:48:06.263 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:48:36.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:48:36.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:49:06.478 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:49:06.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:49:36.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:49:36.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:50:06.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:50:06.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:50:36.842 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:50:36.847 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:51:06.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:51:06.952 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:51:37.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:51:37.067 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:52:07.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:52:07.178 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:52:37.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:52:37.301 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:53:07.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:53:07.413 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:53:37.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:53:37.519 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:54:07.626 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:54:07.631 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:54:37.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:54:37.753 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:55:07.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:55:07.862 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:55:37.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:55:37.971 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:56:08.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:56:08.076 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:56:38.192 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:56:38.197 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:57:08.315 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:57:08.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:57:38.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:57:38.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:58:08.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:58:08.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:58:38.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:58:38.650 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:59:08.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:59:08.758 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:59:38.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T11:59:38.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:00:08.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:00:09.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:00:39.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:00:39.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:01:09.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:01:09.237 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:01:39.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:01:39.349 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:02:09.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:02:09.456 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:02:39.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:02:39.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:03:09.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:03:09.698 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:03:39.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:03:39.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:04:09.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:04:09.932 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:04:40.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:04:40.047 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:05:10.152 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:05:10.158 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:05:40.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:05:40.266 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:06:10.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:06:10.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:06:40.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:06:40.594 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:07:10.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:07:10.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:07:40.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:07:40.830 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:08:11.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:08:11.020 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:08:41.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:08:41.124 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:09:11.298 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:09:11.303 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:09:41.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:09:41.477 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:10:11.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:10:11.590 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:10:41.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:10:41.727 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:11:11.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:11:11.834 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:11:41.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:11:41.948 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:12:12.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:12:12.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:12:42.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:12:42.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:13:12.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:13:12.299 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:13:42.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:13:42.427 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:14:12.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:14:12.532 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:14:42.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:14:42.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:15:12.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:15:12.759 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:15:42.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:15:42.889 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:16:13.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:16:13.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:16:43.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:16:43.128 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:17:13.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:17:13.237 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:17:43.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:17:43.346 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:18:13.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:18:13.539 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:18:43.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:18:43.712 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:19:13.911 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:19:13.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:19:44.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:19:44.029 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:20:14.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:20:14.235 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:20:44.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:20:44.433 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:21:14.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:21:14.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:21:44.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:21:44.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:22:14.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:22:14.847 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:22:45.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:22:45.026 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:23:15.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:23:15.133 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:23:45.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:23:45.269 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:24:15.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:24:15.449 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:24:45.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:24:45.563 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:25:15.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:25:15.752 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:25:45.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:25:45.881 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:26:16.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:26:16.095 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:26:46.269 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:26:46.274 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:27:16.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:27:16.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:27:46.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:27:46.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:28:16.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:28:16.682 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:28:46.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:28:46.795 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:29:16.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:29:16.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:29:47.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:29:47.032 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:30:17.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:30:17.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:30:47.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:30:47.266 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:31:17.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:31:17.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:31:47.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:31:47.493 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:32:17.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:32:17.607 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:32:47.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:32:47.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:33:17.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:33:17.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:33:47.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:33:47.976 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:34:18.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:34:18.125 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:34:48.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:34:48.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:35:18.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:35:18.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:35:48.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:35:48.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:36:18.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:36:18.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:36:48.731 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:36:48.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:37:18.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:37:18.865 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:37:48.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:37:48.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:38:19.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:38:19.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:38:49.375 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:38:49.380 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:39:19.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:39:19.494 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:39:49.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:39:49.665 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:40:19.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:40:19.803 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:40:50.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:40:50.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:41:20.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:41:20.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:41:50.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:41:50.231 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:42:20.334 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:42:20.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:42:50.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:42:50.470 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:43:20.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:43:20.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:43:50.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:43:50.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:44:20.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:44:20.810 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:44:50.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:44:50.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:45:21.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:45:21.029 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:45:51.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:45:51.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:46:21.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:46:21.355 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:46:51.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:46:51.469 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:47:21.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:47:21.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:47:51.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:47:51.813 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:48:21.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:48:21.921 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:48:52.110 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:48:52.116 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:49:22.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:49:22.246 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:49:52.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:49:52.366 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:50:22.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:50:22.539 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:50:52.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:50:52.661 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:51:22.852 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:51:22.858 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:51:53.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:51:53.055 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:52:23.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:52:23.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:52:53.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:52:53.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:53:23.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:53:23.553 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:53:53.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:53:53.658 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:54:23.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:54:23.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:54:53.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:54:53.969 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:55:24.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:55:24.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:55:54.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:55:54.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:56:24.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:56:24.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:56:54.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:56:54.606 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:57:24.714 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:57:24.720 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:57:54.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:57:54.926 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:58:25.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:58:25.106 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:58:55.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:58:55.219 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:59:25.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:59:25.341 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:59:55.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T12:59:55.530 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:00:25.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:00:25.651 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:00:55.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:00:55.774 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:01:25.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:01:25.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:01:55.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:01:55.992 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:02:26.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:02:26.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:02:56.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:02:56.310 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:03:26.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:03:26.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:03:56.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:03:56.646 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:04:26.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:04:26.792 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:04:56.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:04:56.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:05:27.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:05:27.018 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:05:57.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:05:57.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:06:27.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:06:27.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:06:57.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:06:57.349 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:07:27.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:07:27.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:07:57.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:07:57.594 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:08:27.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:08:27.806 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:08:57.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:08:57.969 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:09:28.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:09:28.158 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:09:58.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:09:58.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:10:28.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:10:28.427 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:10:58.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:10:58.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:11:28.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:11:28.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:11:58.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:11:59.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:12:29.109 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:12:29.114 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:12:59.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:12:59.277 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:13:29.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:13:29.433 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:13:59.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:13:59.561 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:14:29.747 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:14:29.752 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:14:59.894 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:14:59.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:15:30.007 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:15:30.013 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:16:00.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:16:00.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:16:30.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:16:30.366 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:17:00.531 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:17:00.536 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:17:30.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:17:30.734 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:18:00.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:18:00.922 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:18:31.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:18:31.059 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:19:01.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:19:01.217 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:19:31.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:19:31.404 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:20:01.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:20:01.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:20:31.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:20:31.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:21:01.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:21:01.838 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:21:31.946 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:21:31.951 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:22:02.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:22:02.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:22:32.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:22:32.278 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:23:02.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:23:02.467 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:23:32.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:23:32.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:24:02.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:24:02.768 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:24:32.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:24:32.881 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:25:02.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:25:02.989 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:25:33.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:25:33.098 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:26:03.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:26:03.203 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:26:33.328 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:26:33.334 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:27:03.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:27:03.455 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:27:33.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:27:33.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:28:03.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:28:03.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:28:33.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:28:33.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:29:03.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:29:03.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:29:34.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:29:34.027 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:30:04.147 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:30:04.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:30:34.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:30:34.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:31:04.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:31:04.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:31:34.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:31:34.518 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:32:04.626 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:32:04.631 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:32:34.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:32:34.771 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:33:04.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:33:04.951 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:33:35.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:33:35.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:34:05.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:34:05.238 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:34:35.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:34:35.357 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:35:05.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:35:05.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:35:35.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:35:35.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:36:05.809 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:36:05.815 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:36:36.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:36:36.021 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:37:06.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:37:06.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:37:36.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:37:36.372 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:38:06.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:38:06.564 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:38:36.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:38:36.758 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:39:06.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:39:06.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:39:37.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:39:37.058 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:40:07.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:40:07.199 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:40:37.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:40:37.321 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:41:07.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:41:07.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:41:37.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:41:37.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:42:07.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:42:07.743 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:42:37.850 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:42:37.865 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:43:07.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:43:07.989 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:43:38.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:43:38.111 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:44:08.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:44:08.246 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:44:38.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:44:38.363 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:45:08.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:45:08.489 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:45:38.664 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:45:38.669 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:46:08.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:46:08.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:46:38.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:46:38.892 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:47:09.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:47:09.018 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:47:39.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:47:39.207 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:48:09.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:48:09.387 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:48:39.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:48:39.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:49:09.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:49:09.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:49:39.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:49:39.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:50:09.835 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:50:09.841 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:50:39.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:50:39.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:51:10.075 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:51:10.082 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:51:40.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:51:40.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:52:10.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:52:10.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:52:40.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:52:40.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:53:10.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:53:10.596 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:53:40.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:53:40.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:54:10.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:54:10.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:54:41.181 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:54:41.186 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:55:11.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:55:11.383 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:55:41.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:55:41.563 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:56:11.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:56:11.693 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:56:41.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:56:41.811 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:57:11.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:57:11.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:57:42.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:57:42.029 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:58:12.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:58:12.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:58:42.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:58:42.263 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:59:12.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:59:12.372 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:59:42.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T13:59:42.503 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:00:12.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:00:12.615 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:00:42.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:00:42.742 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:01:12.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:01:12.852 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:01:42.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:01:42.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:02:13.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:02:13.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:02:43.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:02:43.211 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:03:13.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:03:13.328 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:03:43.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:03:43.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:04:13.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:04:13.590 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:04:43.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:04:43.697 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:05:13.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:05:13.807 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:05:43.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:05:43.933 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:06:14.039 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:06:14.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:06:44.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:06:44.173 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:07:14.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:07:14.390 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:07:44.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:07:44.578 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:08:14.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:08:14.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:08:44.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:08:44.873 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:09:15.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:09:15.052 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:09:45.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:09:45.173 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:10:15.331 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:10:15.337 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:10:45.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:10:45.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:11:15.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:11:15.647 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:11:45.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:11:45.845 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:12:16.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:12:16.033 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:12:46.133 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:12:46.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:13:16.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:13:16.267 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:13:46.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:13:46.456 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:14:16.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:14:16.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:14:46.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:14:46.774 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:15:16.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:15:16.946 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:15:47.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:15:47.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:16:17.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:16:17.248 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:16:47.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:16:47.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:17:17.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:17:17.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:17:47.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:17:47.739 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:18:17.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:18:17.927 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:18:48.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:18:48.032 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:19:18.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:19:18.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:19:48.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:19:48.344 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:20:18.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:20:18.473 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:20:48.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:20:48.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:21:18.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:21:18.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:21:48.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:21:48.815 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:22:18.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:22:18.941 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:22:49.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:22:49.059 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:23:19.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:23:19.172 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:23:49.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:23:49.286 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:24:19.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:24:19.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:24:49.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:24:49.512 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:25:19.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:25:19.650 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:25:49.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:25:49.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:26:20.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:26:20.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:26:50.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:26:50.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:27:20.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:27:20.429 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:27:50.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:27:50.550 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:28:20.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:28:20.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:28:50.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:28:50.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:29:21.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:29:21.050 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:29:51.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:29:51.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:30:21.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:30:21.402 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:30:51.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:30:51.523 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:31:21.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:31:21.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:31:51.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:31:51.743 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:32:21.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:32:21.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:32:51.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:32:51.979 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:33:22.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:33:22.084 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:33:52.192 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:33:52.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:34:22.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:34:22.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:34:52.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:34:52.431 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:35:22.531 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:35:22.537 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:35:52.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:35:52.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:36:22.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:36:22.759 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:36:52.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:36:52.881 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:37:23.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:37:23.009 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:37:53.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:37:53.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:38:23.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:38:23.255 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:38:53.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:38:53.377 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:39:23.494 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:39:23.503 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:39:53.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:39:53.622 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:40:23.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:40:23.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:40:53.867 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:40:53.873 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:41:23.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:41:24.005 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:41:54.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:41:54.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:42:24.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:42:24.259 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:42:54.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:42:54.378 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:43:24.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:43:24.555 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:43:54.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:43:54.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:44:24.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:44:24.801 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:44:54.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:44:54.980 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:45:25.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:45:25.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:45:55.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:45:55.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:46:25.380 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:46:25.386 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:46:55.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:46:55.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:47:25.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:47:25.673 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:47:55.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:47:55.835 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:48:26.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:48:26.013 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:48:56.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:48:56.193 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:49:26.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:49:26.315 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:49:56.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:49:56.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:50:26.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:50:26.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:50:56.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:50:56.680 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:51:26.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:51:26.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:51:56.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:51:56.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:52:27.082 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:52:27.088 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:52:57.289 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:52:57.294 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:53:27.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:53:27.516 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:53:57.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:53:57.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:54:28.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:54:28.009 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:54:58.192 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:54:58.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:55:28.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:55:28.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:55:58.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:55:58.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:56:28.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:56:28.662 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:56:58.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:56:58.844 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:57:29.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:57:29.049 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:57:59.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:57:59.220 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:58:29.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:58:29.392 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:58:59.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:58:59.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:59:29.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:59:29.639 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:59:59.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T14:59:59.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:00:29.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:00:29.970 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:01:00.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:01:00.175 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:01:30.343 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:01:30.349 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:02:00.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:02:00.544 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:02:30.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:02:30.702 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:03:00.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:03:00.898 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:03:31.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:03:31.062 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:04:01.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:04:01.176 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:04:31.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:04:31.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:05:01.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:05:01.578 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:05:31.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:05:31.741 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:06:01.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:06:01.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:06:32.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:06:32.145 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:07:02.250 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:07:02.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:07:32.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:07:32.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:08:02.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:08:02.733 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:08:32.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:08:32.854 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:09:02.962 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:09:02.967 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:09:33.076 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:09:33.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:10:03.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:10:03.186 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:10:33.307 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:10:33.312 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:11:03.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:11:03.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:11:33.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:11:33.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:12:03.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:12:03.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:12:33.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:12:33.997 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:13:04.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:13:04.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:13:34.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:13:34.415 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:14:04.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:14:04.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:14:34.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:14:34.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:15:04.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:15:04.943 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:15:35.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:15:35.086 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:16:05.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:16:05.215 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:16:35.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:16:35.378 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:17:05.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:17:05.583 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:17:35.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:17:35.704 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:18:05.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:18:05.876 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:18:36.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:18:36.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:19:06.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:19:06.111 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:19:36.311 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:19:36.316 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:20:06.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:20:06.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:20:36.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:20:36.628 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:21:06.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:21:06.759 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:21:36.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:21:36.946 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:22:07.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:22:07.126 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:22:37.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:22:37.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:23:07.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:23:07.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:23:37.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:23:37.642 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:24:07.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:24:07.763 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:24:37.946 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:24:37.952 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:25:08.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:25:08.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:25:38.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:25:38.328 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:26:08.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:26:08.516 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:26:38.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:26:38.670 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:27:08.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:27:08.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:27:39.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:27:39.023 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:28:09.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:28:09.220 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:28:39.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:28:39.416 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:29:09.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:29:09.596 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:29:39.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:29:39.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:30:09.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:30:09.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:30:40.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:30:40.110 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:31:10.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:31:10.232 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:31:40.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:31:40.388 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:32:10.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:32:10.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:32:40.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:32:40.764 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:33:10.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:33:10.978 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:33:41.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:33:41.167 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:34:11.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:34:11.305 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:34:41.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:34:41.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:35:11.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:35:11.664 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:35:41.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:35:41.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:36:11.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:36:11.974 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:36:42.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:36:42.095 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:37:12.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:37:12.227 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:37:42.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:37:42.416 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:38:12.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:38:12.620 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:38:42.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:38:42.742 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:39:12.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:39:12.939 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:39:43.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:39:43.144 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:40:13.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:40:13.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:40:43.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:40:43.529 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:41:13.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:41:13.649 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:41:43.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:41:43.939 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:42:14.114 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:42:14.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:42:44.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:42:44.291 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:43:14.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:43:14.479 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:43:44.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:43:44.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:44:14.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:44:14.839 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:44:44.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:44:45.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:45:15.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:45:15.217 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:45:45.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:45:45.332 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:46:15.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:46:15.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:46:45.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:46:45.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:47:15.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:47:15.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:47:46.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:47:46.068 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:48:16.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:48:16.248 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:48:46.372 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:48:46.377 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:49:16.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:49:16.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:49:46.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:49:46.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:50:16.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:50:16.942 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:50:47.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:50:47.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:51:17.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:51:17.344 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:51:47.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:51:47.457 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:52:17.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:52:17.613 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:52:47.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:52:47.767 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:53:17.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:53:17.939 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:53:48.114 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:53:48.119 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:54:18.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:54:18.308 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:54:48.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:54:48.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:55:18.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:55:18.610 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:55:48.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:55:48.739 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:56:18.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:56:18.844 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:56:48.944 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:56:48.949 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:57:19.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:57:19.062 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:57:49.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:57:49.176 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:58:19.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:58:19.356 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:58:49.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:58:49.470 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:59:19.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:59:19.642 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:59:49.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T15:59:49.748 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:00:20.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:00:20.104 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:00:50.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:00:50.216 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:01:20.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:01:20.329 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:01:50.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:01:50.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:02:20.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:02:20.553 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:02:50.664 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:02:50.669 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:03:20.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:03:20.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:03:50.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:03:50.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:04:21.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:04:21.019 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:04:51.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:04:51.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:05:21.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:05:21.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:05:51.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:05:51.469 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:06:21.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:06:21.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:06:51.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:06:51.812 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:07:21.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:07:21.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:07:52.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:07:52.171 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:08:22.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:08:22.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:08:52.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:08:52.473 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:09:22.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:09:22.795 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:09:52.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:09:52.983 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:10:23.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:10:23.188 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:10:53.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:10:53.342 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:11:23.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:11:23.532 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:11:53.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:11:53.704 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:12:23.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:12:23.875 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:12:53.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:12:54.005 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:13:24.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:13:24.186 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:13:54.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:13:54.313 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:14:24.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:14:24.512 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:14:54.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:14:54.693 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:15:24.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:15:24.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:15:54.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:15:54.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:16:25.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:16:25.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:16:55.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:16:55.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:17:25.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:17:25.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:17:55.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:17:55.558 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:18:25.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:18:25.754 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:18:55.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:18:55.927 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:19:26.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:19:26.098 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:19:56.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:19:56.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:20:26.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:20:26.408 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:20:56.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:20:56.607 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:21:26.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:21:26.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:21:56.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:21:56.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:22:27.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:22:27.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:22:57.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:22:57.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:23:27.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:23:27.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:23:57.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:23:57.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:24:27.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:24:27.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:24:57.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:24:57.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:25:28.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:25:28.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T16:25:37.308 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-08-25T16:25:37.337 DEBUG:teuthology.task.console_log:Killing console logger for smithi072 2023-08-25T16:25:37.338 DEBUG:teuthology.task.console_log:Killing console logger for smithi137 2023-08-25T16:25:37.338 DEBUG:teuthology.exit:Finished running handlers